Is there a way to crawl bigger pages (maybe in chunks)

I have a problem with crawl, I have a web page, that renders 87K JSON
file as HTML. But Algolia throw error that the file is too big. This is
/reference page that holds all the doc strings from my programming language
functions and macros. Is there a way to index this file somehow?