Scheduling Source Refresh Actions
A best practice is to create and assign one or more tailored custom schedules for each source with optimized incremental/full refresh intervals (see What Should Be the Frequency of Source Refresh Schedules?). This also allows you to distribute the refreshing of your various sources over time and to enable/disable a schedule for a source without affecting other sources.
When incremental refresh is available for a source type, you will typically assign two schedules to a source:
-
Incremental Refresh scheduled at short intervals based on content change rate (see Scheduling a Source Incremental Refresh).
-
Full Refresh scheduled at longer intervals such as weekly.
Notes:
-
You do not have to worry about overlapping Full Refresh and Incremental Refresh schedules:
-
A scheduled Full Refresh/Rebuild automatically stops a running Incremental Refresh before starting.
-
A scheduled Incremental Refresh is ignored while a Full Refresh/Rebuild is running.
-
-
CES 7.0.6942– (August 2014) You cannot add or delete a schedule while a source is being indexed.
To schedule a source refresh action
-
On the Coveo server, access the Administration Tool (see Opening the Administration Tool).
-
Access the Sources and Collections page (Index > Sources and Collections).
-
In the Collections section, select the collection that contains the source to which you want to assign a refresh schedule.
-
In the Sources section, select the source to which you want to assign a schedule.
-
In the navigation panel on the left, select Schedules
-
In the Schedules page:
-
Click an existing schedule to modify its configuration.
OR
Click Add to assign a new schedule to this source.
-
In the page that appears:
-
CES 7.0.6424+ (February 2014) In the Action drop-down list, select the desired action:
-
Start to start either an Incremental Refresh, a Full Refresh or a Rebuild.
-
Pause, Resume, or Stop to act on an ongoing source refresh (Incremental Refresh, Full Refresh or Rebuild).
Example: A full refresh of your CRM source starts every weekday at midnight. On Wednesdays, between 1:00 and 4:00 AM, your CRM is scheduled for maintenance, so you want to ensure that the source is not indexed during this period by scheduling a refresh Pause and a Resume at corresponding time.
Notes:
-
If you pause, and then resume an ongoing source refresh, once the refresh is completed, you should perform a full refresh to ensure the integrity of the source.
-
When no Incremental Refresh, Full Refresh, or Rebuild is ongoing, a Resume does nothing.
-
-
In the Type section, select the type of refresh to start:
-
Incremental Refresh to index only modified documents since the last incremental refresh (see Incremental Refresh).
Note: When the Incremental Refresh option is not present, the source type does not support incremental refresh.
-
Full Refresh to index only modified documents (see Full Refresh).
-
Rebuild to completely re-index all documents of a source (see Rebuild).
Important: It is not recommended to schedule to regularly Rebuild a source, particularly for large sources, because each rebuild temporarily increases the size of the index and the load on the index compaction process (see About the Index Self-Optimization Process).
-
-
In the Schedule drop-down list, select the schedule to use for this action.
Note: You can modify an existing schedule or create a new one by clicking Manage Schedules.
-
-
Click Apply Changes.
-
-
Repeat the previous step when you want to assign another schedule to the source.
Note: You can enable/disable a source refresh schedule for example when repositories are offline to prevent unnecessary connection attempts (see Creating or Modifying a Source Schedule).