Pricing

Pay per usage

Try for free

Go to Apify Store

Algolia Website Indexer

Try for free

The Indexer crawls recursively a website using the Puppeteer browser (headless Chrome) and indexes the selected pages to the Algolia index.

Pricing

Pay per usage

Rating

5.0

(5)

Developer

Apify

Actor stats

Bookmarked

Total users

Monthly active users

2 years ago

Last modified

Categories

Automation

Open source

Algolia App ID

algoliaAppId

Required

Your Algolia Application ID

Type:string

Algolia API Key

algoliaApiKey

Required

Your Algolia API key

Type:string

Algolia Index Name

algoliaIndexName

Required

Your Algolia index name

Type:string

Crawler Name

crawlerName

Optional

Crawler name, it updates/removes/adds pages into to index regarding this name. In this case, you can have more website in the index.

Type:string

Start URLs

startUrls

Required

URLs where to start crawling

Type:array

Selectors

selectors

Optional

Pick selectors, which text content you want to index. Key is name of attribute and value is CSS selector.

Type:array

Required attributes

requiredAttributes

Optional

Pick attributes, which are required in index. By default all attributes from selectors are required.

Type:array

Wait for element

waitForElement

Optional

Selector of element to wait on each page.

Type:string

Additional attributes

additionalPageAttrs

Optional

Pick additional attributes you want to attach to each record in index.

Type:object

Default:

{}

Skip Index Updated

skipIndexUpdate

Optional

If check crawler will not update Algolia index.

Type:boolean

Default:true

Pseudo-URLs

pseudoUrls

Optional

Overrides default pseudoUrls

Type:array

Page function

pageFunction

Optional

Overrides default pageFunction

Type:string

Clickable elements

clickableElements

Optional

Overrides default clickableElements

Type:string

Keep URL fragments

keepUrlFragments

Optional

Option to switch on enqueueing URL with URL fragments

Type:boolean

Default:false

Omit search params from URLs

omitSearchParamsFromUrl

Optional

Option to switch off enqueueing with search params.

Type:boolean

Default:false

Algolia Webcrawler

jancurn/algolia-webcrawler

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

Jan Čurn

Algolia API Scraper

rl1987/algolia-api-scraper

Generalised scraper for any Algolia-powered search index: scrape hits or discover facets and their values directly via the Algolia Search REST API.

R.L.

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

15K

5.0

Hacker News Algolia Search Scraper

atlas-data/hackernews-algolia-search-scraper

Search Hacker News stories through the Algolia API and extract titles, authors, points, comments, timestamps, tags, and canonical URLs.

Atlas

bcv-tasa-oficial

grupoaceivzla/bcv-tasa-oficial

Grupo ACEI

Y Combinator Companies API Scraper

devilscrapes/y-combinator-companies-scraper

Query the YC company directory by batch, industry, or status via the same Algolia index the website uses. Returns name, batch, status, industries, team size, website, one-liner, and YC profile URL as clean structured rows.

DevilScrapes

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

16K

3.8

HTML to PDF Converter

jancurn/url-to-pdf

Loads a web page in headless Chrome using Puppeteer and prints it to PDF. The input is a JSON object and output is a PDF file.

Jan Čurn

464

Hacker News Search Scraper (Algolia API)

chrisp1211/hackernews-scraper-max

Hacker News Search Scraper (Algolia API). No API key required. Pay only per result; empty or failed runs cost nothing.

Christian Pichichero

Google Indexer & Instant SEO Submitter

eunit/google-indexing

Instantly index your URLs with the Google Indexing API. Automate sitemap submissions, speed up crawling, and boost SEO rankings. Perfect for fresh content, bulk indexing, and removing dead links. Fast, secure, and pay-per-result!