Algolia API Scraper
Pricing
from $0.50 / 1,000 scraped items
Go to Apify Store
Algolia API Scraper
Generalised scraper for any Algolia-powered search index: scrape hits or discover facets and their values directly via the Algolia Search REST API.
Algolia API Scraper
Pricing
from $0.50 / 1,000 scraped items
Generalised scraper for any Algolia-powered search index: scrape hits or discover facets and their values directly via the Algolia Search REST API.
The Algolia Application ID (find it in the site's network requests as X-Algolia-Application-Id or in the request URL host <appId>-dsn.algolia.net). Defaults to Hacker News Search's own public Algolia integration (hn.algolia.com).
A search-only Algolia API key (header X-Algolia-API-Key). Most public sites expose this in their frontend JS bundle or network requests. Defaults to Hacker News Search's public search-only key.
Name of the Algolia index to query. Defaults to Hacker News Search's "Item_dev" index (stories and comments).
Free-text query string. Leave empty to match all records (browse mode).
Algolia filter expression, e.g. category:Shoes AND price < 50. See https://www.algolia.com/doc/api-reference/api-parameters/filters/
Algolia facetFilters array, e.g. ["category:Shoes", ["color:Red", "color:Blue"]]. Each entry is a string or a nested array (OR group).
[]Algolia numericFilters array, e.g. ["price>=10", "price<=100"].
[]Facet attribute names to request counts for. Use ["*"] to discover every facetable attribute and its values.
[ "*"]Maximum number of facet values returned per facet.
When enabled, the Actor makes a single hitsPerPage=0 request and only outputs the discovered facets and their values/counts, without scraping any search result items.
Limit which attributes are returned per hit. Leave empty to retrieve all attributes (*).
[]Number of hits fetched per Algolia request page.
Maximum number of items to scrape in total. 0 = unlimited (scrape all pages Algolia returns).