Product DocsMenu

Limiting the Crawling Depth

The term crawling depth refers to the number of levels and sublevels of a repository indexed by the Coveo Platform. By default, CES indexes the starting address of a source and all its subfolders or subsites. However, it is possible to index only main folders or sites. Furthermore, it is possible to limit the depth or crawling by level.

Example: Restricting the depth of crawling to 2 levels indexes only the main address (\\CoveoServer\Help\AdminTool\) and addresses directly related to it (\\CoveoServer\Help\AdminTool\Sources\), other subfolders or subsites (\\CoveoServer\Help\AdminTool\Sources\Local\) are not indexed.

Indexing only the main folders or sites

  1. On the Coveo server, access the Administration Tool (see Opening the Administration Tool).

  2. In the Administration Tool, select Index > Sources and Collections.

  3. In the Sources and Collections page, in the Sources section, expand the drop-down list of the source that you want to modify, and then select Edit General Properties.

     

  4. In the General page:

    1. In the Options section, clear the Recursive check box.

    2. Click Apply Changes.

Limiting the crawling depth by level

  1. On the Coveo server, access the Administration Tool (see Opening the Administration Tool).

  2. In the Administration Tool, select Index > Sources and Collections.

  3. In the Sources and Collections page, in the Sources section, expand the drop-down list of the source that you want to modify, and then select Edit Advanced.

     

  4. In the Advanced page:

    1. In the Crawling section, select the Restrict crawling to X levels check box, and enter the appropriate number of levels.

    2. Click Apply Changes.

People who viewed this topic also viewed