Previously I had requested Docsearch to be enabled on my documentation site. It was done and has been working well so far. However, for some reasons, I need to make the site private, and it won’t be accessible publicly in future.
Therefore, I installed Docsearch locally, created a new app in my Algolia account, used the same .json file that was being used to scrape my public site (downloaded it from the public github repo), updated the start_urls to point to
http://localhost:<port>/doc URL instead of
However, the scraper only indexes the page listed under start_urls. It doesn’t follow the links in the starting page like it does on the public site. If I change back the URL to point to the public site and run the local docsearch again, it is able to follow the links in the page
So, there’s something about running the docsearch locally that it’s not able to follow the links on the localhost server. The content of the page is exactly the same when running locally or on the public site.
I’m using Jekyll to build my site.
Is there a limitation or a bug, or am I missing some configuration?
Any help would be appreciated.