Our crawler runs once a week, but often we have mid-week releases where we want to update the index. We use a static-site generator and have solely relied on the crawler to update the index. Our options appear to be:
- Develop an integration with our build process to push updates to the index (large effort).
- Rerun the crawler manually after a mid-week release (seems excessive for minor updates).
- ??? Is there a way to point the crawler at individual URLs to update the index? (ideal)