Algolia Webcrawler

  • jancurn/algolia-webcrawler
  • Modified
  • Users 60
  • Runs 319
  • Created by Author's avatarJan Čurn

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

The actor simply runs the algolia-webcrawler NPM package on the Apify cloud, so that you don't need to deploy it yourself. You can run it easily using API or scheduler.

On input, the actor accepts a JSON configuration required by algolia-webcrawler. For details, see https://www.npmjs.com/package/algolia-webcrawler#configuration-options

Industries

See how Algolia Webcrawler is used in industries around the world