> ## Documentation Index
> Fetch the complete documentation index at: https://docs.insight.nobly.dk/llms.txt
> Use this file to discover all available pages before exploring further.

# AI search index administration

> Inspect indexed documents, run bounded discovery and indexing jobs, and distinguish content refresh from metadata synchronization.

## Prerequisites

The AI search feature must be available. Under **Admin settings → AI Search Index**, `ai.searchindex.view` permits statistics and progress inspection; `ai.searchindex.manage` permits indexing changes and bulk indexing jobs.

The AI search index supports retrieval. Removing an entry from it is not the same as deleting the source document, and changing the source document does not prove a particular indexing job has completed.

## Inspect a known document first

Use **Index Statistics** to inspect indexed counts and a known document's metadata and content details. Check its last synchronization time and whether it has content chunks or only metadata. A metadata-only entry cannot provide text retrieval from content it has never indexed.

When diagnosing a missing result, check document access and security metadata as well as indexing status. Increasing ranking weights will not repair absent content or incorrect metadata.

<Frame caption="Inspect the index totals and a known document before planning a bulk indexing operation.">
  <img src="https://mintcdn.com/nobly/vtIE7VxmxD31SQoh/images/guides/index-stats.png?fit=max&auto=format&n=vtIE7VxmxD31SQoh&q=85&s=98c6bea344db263ab3a9e27d8eea4d1e" alt="Inspect the index totals and a known document before planning a bulk indexing operation." width="1200" height="650" data-path="images/guides/index-stats.png" />
</Frame>

## Plan a bounded bulk run

The **Data migration** screen performs bulk indexing. Select document types, date range, file extensions, maximum documents, and size limits appropriate to the task. Start with a small representative scope.

Choose **Dry Run** to discover the matching population without fetching content, calling AI, or writing index entries. Review the discovered and already-indexed counts before starting an actual run.

| Option                         | Effect                                                                              |
| ------------------------------ | ----------------------------------------------------------------------------------- |
| **Include Content**            | Extracts text, performs OCR where needed, and creates content chunks and embeddings |
| **Include Metadata**           | Refreshes document details and searchable/security keywords                         |
| **Force Reindex**              | Processes already-indexed documents instead of skipping them                        |
| **Force OCR**                  | Sends PDFs through OCR even when a text layer exists; images already require OCR    |
| Include unsupported file types | Allows metadata-only indexing for file types without supported content extraction   |

A metadata-only pass leaves existing indexed content intact. Refreshing existing metadata requires **Force Reindex**, otherwise already-indexed documents are skipped.

<Warning>
  Security keywords are part of indexing metadata and affect search filtering. Leave **Include Metadata** enabled for newly indexed documents. Only omit it for a deliberate content refresh where the required security metadata is already present and verified.
</Warning>

<Frame caption="Bulk migration exposes limits, dry-run selection, content options, and document filters. Set a bounded scope before starting.">
  <img src="https://mintcdn.com/nobly/vtIE7VxmxD31SQoh/images/guides/index-migration.png?fit=max&auto=format&n=vtIE7VxmxD31SQoh&q=85&s=295e291e5297fe597114c80d2cf9f8d8" alt="Bulk migration exposes limits, dry-run selection, content options, and document filters. Set a bounded scope before starting." width="1440" height="1000" data-path="images/guides/index-migration.png" />
</Frame>

## Monitor and recover

Inspect discovered, skipped, processed, successful, and failed counts, along with the latest failures and processing times. A run can have partial success; review its failures before declaring the population indexed.

**Pause**, **Resume**, and **Stop** control an active run. Stopping is not a rollback of entries already written. A run shown from persisted history is not necessarily active in the current service process; interrupted runs are not automatically resumed. Start a new bounded run after investigating, normally keeping the skip-already-indexed behavior unless existing entries need refreshing.

Use a representative indexed document to verify content, metadata, and access after completion. Retain the job information and failing document IDs for support without copying full confidential documents into a ticket.

## Where to read next

<Card title="AI document classification" icon="wand-magic-sparkles" href="/document-classification/introduction" horizontal>
  Let AI classify an uploaded document and fill its keywords in one step, with a confidence score and the reasoning behind every suggestion.
</Card>

<Card title="Caseflow" icon="table-columns" href="/caseflow/introduction" horizontal>
  Configure the business objects and forms that connect related work in Insight.
</Card>
