Using contextual search from docusaurus site with tags facetFilter

I have two sites that I am using the docsearch crawler with. The first is a docusaurus site and my config works perfectly for it. The second is a site generated by jazzy docs that I do not control and cannot add meta tags to.

I use the docusaurus config setting of contextual search because I have multiple versions and this works perfectly except it excludes the results from the jazzy site.

I have added a tag to the crawler config for the jazzy site hoping that by adding that to facetFilters it would allow the jazzy site results to pop up but this did not work.

Is there a way for me to do this?