Netlify deploy not triggering algolia plugin

Netlify Integration
#1

I followed the great getting started guide on the Algolia netlify plugin github and everything looked good to go. However when deploying my site it doesn’t seem to trigger the plugin. There’s nothing in the build logs, the summary in Netlify doesn’t mention Alogolia and my first crawl doesn’t seem to be starting on the algolia site anywhere.

When I try and manually start a crawl on crawler.algolia.com it tells me I don’t have permission to crawl on my app, which I also find odd but might be unrelated.

I’m using jekyll with a custom domain (www.progression.fyi) not hosted on Netlify. My netlify.toml is:

[[plugins]]
package = "@algolia/netlify-plugin-crawler"
  [plugins.inputs]
  customDomain = "www.progression.fyi"
  renderJavaScript = true

Thanks in advance for any help!

#2

Hello @jonnyburch,

Are you triggering a build via the Netlify UI or via the CLI?

To access your crawler you need to specifically go to crawler.algolia.com/admin/netlify (the normal login will not give you access to our UI).
To help you can you also share a public deploy log, you can send the link to support@algolia.com if you don’t want to share it publicly

Looking forward your answer

#3

Hey @samuel.bodin, thanks for the reply!

Yeah on that site I see progression.fyi and I’ve added the UI bundle into the app too. I can also see in Netlify that the plugin is installed.

I’ve triggered builds from the Netlify UI and the cli (through a GH push) - neither seem to work.

Netlify deply log below - no mention of Algolia in it.

12:11:25 AM: Build ready to start
12:11:27 AM: build-image version: 8e315e54bc4032a32e73290be556cde4f8348c12
12:11:27 AM: build-image tag: v2.8.2
12:11:27 AM: buildbot version: 7aa30f4805782ff59fecad56e0bfa4b63404839b
12:11:27 AM: Fetching cached dependencies
12:11:27 AM: Starting to download cache of 206.6MB
12:11:28 AM: Finished downloading cache in 1.084015025s
12:11:28 AM: Starting to extract cache
12:11:35 AM: Finished extracting cache in 7.043952362s
12:11:35 AM: Finished fetching cache in 8.182519779s
12:11:35 AM: Starting to prepare the repo for build
12:11:36 AM: Preparing Git Reference refs/heads/master
12:11:36 AM: Found netlify.toml. Overriding site configuration
12:11:36 AM: Starting build script
12:11:36 AM: Installing dependencies
12:11:36 AM: Python version set to 3.6
12:11:37 AM: Started restoring cached node version
12:11:40 AM: Finished restoring cached node version
12:11:41 AM: v8.17.0 is already installed.
12:11:42 AM: Now using node v8.17.0 (npm v6.13.4)
12:11:42 AM: Attempting ruby version 2.3.6, read from environment
12:11:44 AM: Using ruby version 2.3.6
12:11:44 AM: Using PHP version 5.6
12:11:44 AM: Started restoring cached ruby gems
12:11:44 AM: Finished restoring cached ruby gems
12:11:44 AM: Installing pip dependencies
12:11:44 AM: Started restoring cached pip cache
12:11:44 AM: Finished restoring cached pip cache
12:11:45 AM: Collecting airtable-python-wrapper==0.11.3.post.1 (from -r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/30/12/d2f4ec7b349351106760d210e9c7c972a035243e10ee01208db58109dd83/airtable_python_wrapper-0.11.3.post1-py2.py3-none-any.whl
12:11:45 AM: Collecting requests>=2.18.3 (from airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/29/c1/24814557f1d22c56d50280771a17307e6bf87b70727d975fd6b2ce6b014a/requests-2.25.1-py2.py3-none-any.whl
12:11:45 AM: Collecting six>=1.10.0 (from airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/ee/ff/48bde5c0f013094d729fe4b0316ba2a24774b3ff1c52d924a8a4cb04078a/six-1.15.0-py2.py3-none-any.whl
12:11:45 AM: Collecting idna<3,>=2.5 (from requests>=2.18.3->airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl
12:11:45 AM: Collecting urllib3<1.27,>=1.21.1 (from requests>=2.18.3->airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/f5/71/45d36a8df68f3ebb098d6861b2c017f3d094538c0fb98fa61d4dc43e69b9/urllib3-1.26.2-py2.py3-none-any.whl
12:11:45 AM: Collecting chardet<5,>=3.0.2 (from requests>=2.18.3->airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/19/c7/fa589626997dd07bd87d9269342ccb74b1720384a4d739a1872bd84fbe68/chardet-4.0.0-py2.py3-none-any.whl
12:11:45 AM: Collecting certifi>=2017.4.17 (from requests>=2.18.3->airtable-python-wrapper==0.11.3.post.1->-r requirements.txt (line 1))
12:11:45 AM:   Using cached https://files.pythonhosted.org/packages/5e/a0/5f06e1e1d463903cf0c0eebeb751791119ed7a4b3737fdc9a77f1cdfb51f/certifi-2020.12.5-py2.py3-none-any.whl
12:11:45 AM: Installing collected packages: idna, urllib3, chardet, certifi, requests, six, airtable-python-wrapper
12:11:46 AM: Successfully installed airtable-python-wrapper-0.11.3.post1 certifi-2020.12.5 chardet-4.0.0 idna-2.10 requests-2.25.1 six-1.15.0 urllib3-1.26.2
12:11:46 AM: You are using pip version 19.0.3, however version 20.3.3 is available.
12:11:46 AM: You should consider upgrading via the 'pip install --upgrade pip' command.
12:11:46 AM: Pip dependencies installed
12:11:46 AM: Started restoring cached go cache
12:11:48 AM: Finished restoring cached go cache
12:11:48 AM: Installing Go version 1.10
12:11:48 AM: unset GOOS;
12:11:48 AM: unset GOARCH;
12:11:48 AM: export GOROOT='/opt/buildhome/.gimme_cache/versions/go1.10.linux.amd64';
12:11:48 AM: export PATH="/opt/buildhome/.gimme_cache/versions/go1.10.linux.amd64/bin:${PATH}";
12:11:48 AM: go version >&2;
12:11:48 AM: export GIMME_ENV='/opt/buildhome/.gimme_cache/env/go1.10.linux.amd64.env';
12:11:48 AM: go version go1.10 linux/amd64
12:11:48 AM: Installing missing commands
12:11:48 AM: Verify run directory
12:11:48 AM: Executing user command: make build
12:11:48 AM: Pulling data from airtable...
12:11:51 AM: frameworks.json
12:11:51 AM: Saved Frameworks table using Live on site view
12:11:51 AM: components.json
12:11:51 AM: Saved Components table using Grid view view
12:11:51 AM: licenses.json
12:11:51 AM: Saved Licenses table using Grid view view
12:11:51 AM: authors.json
12:11:51 AM: Saved Authors table using Grid view view
12:11:51 AM: links.json
12:11:51 AM: Saved Further Reading table using Grid view view
12:11:51 AM: Progression Data downloaded!
12:11:51 AM: --------------------------------------------------------
12:11:51 AM: [other build output]
12:12:02 AM: --------------------------------------------------------
12:12:02 AM: Progression.fyi is ready to roll
12:12:02 AM: --------------------------------------------------------
12:12:02 AM: Building for production
12:12:02 AM: JEKYLL_ENV=production bundle exec jekyll build
12:12:03 AM: Configuration file: /opt/build/repo/_config.yml
12:12:03 AM:             Source: /opt/build/repo
12:12:03 AM:        Destination: /opt/build/repo/_site
12:12:03 AM:  Incremental build: disabled. Enable with --incremental
12:12:03 AM:       Generating...
12:12:03 AM:        Jekyll Feed: Generating feed for f
12:12:03 AM:        Jekyll Feed: Generating feed for posts
12:12:05 AM:                     done in 2.009 seconds.
12:12:05 AM:  Auto-regeneration: disabled. Use --watch to enable.
12:12:05 AM: Skipping functions preparation step: no functions directory set
12:12:05 AM: Caching artifacts
12:12:05 AM: Started saving ruby gems
12:12:05 AM: Finished saving ruby gems
12:12:05 AM: Started saving pip cache
12:12:05 AM: Finished saving pip cache
12:12:05 AM: Started saving emacs cask dependencies
12:12:05 AM: Finished saving emacs cask dependencies
12:12:05 AM: Started saving maven dependencies
12:12:06 AM: Finished saving maven dependencies
12:12:06 AM: Started saving boot dependencies
12:12:06 AM: Finished saving boot dependencies
12:12:06 AM: Started saving go dependencies
12:12:07 AM: Finished saving go dependencies
12:12:07 AM: Build script success
12:12:07 AM: Starting to deploy site from '_site/'
12:12:07 AM: Creating deploy tree 
12:12:07 AM: Creating deploy upload records
12:12:08 AM: 2 new files to upload
12:12:08 AM: 0 new functions to upload
12:12:08 AM: Starting post processing
12:12:08 AM: Post processing - HTML
12:12:08 AM: Post processing - header rules
12:12:08 AM: Post processing - redirect rules
12:12:08 AM: Post processing done
12:12:09 AM: Site is live ✨
12:12:47 AM: Finished processing build request in 1m20.066933064s
#4

Thanks for sharing, the logs seems fine.
However:

  • you might be using an old version of the build-image (latest is 3.6.0).
  • you might be using an old Ubuntu, build plugin require at least Ubuntu16.04

Can you double check that?

#5

Ah yeah old Ubuntu, however my site isn’t now building. Looks like I’m going to have to troubleshoot that now! Is there any documentation around moving an old Jekyll site across to Ubuntu 16.04?

#6

Don’t worry, got it done. Thanks @samuel.bodin! I wonder if there’s somewhere more prominent you could put that Ubuntu requirement in the docs?

1 Like
#7

Thanks @jonnyburch the Ubuntu version is required by Netlify build plugin, not specifically by us.
Maybe Netlify should warn you instead, but we’ll add a small warning on top of our documentation :relaxed: