Algolia Website Indexer avatar

Algolia Website Indexer

Try for free

No credit card required

Go to Store
Algolia Website Indexer

Algolia Website Indexer

apify/algolia-website-indexer
Try for free

No credit card required

The Indexer crawls recursively a website using the Puppeteer browser (headless Chrome) and indexes the selected pages to the Algolia index.

Do you want to learn more about this Actor?

Get a demo

Algolia App ID

algoliaAppIdstringRequired

Your Algolia Application ID

Algolia API Key

algoliaApiKeystringRequired

Your Algolia API key

Algolia Index Name

algoliaIndexNamestringRequired

Your Algolia index name

Crawler Name

crawlerNamestringOptional

Crawler name, it updates/removes/adds pages into to index regarding this name. In this case, you can have more website in the index.

Start URLs

startUrlsarrayRequired

URLs where to start crawling

Selectors

selectorsarrayOptional

Pick selectors, which text content you want to index. Key is name of attribute and value is CSS selector.

Required attributes

requiredAttributesarrayOptional

Pick attributes, which are required in index. By default all attributes from selectors are required.

Wait for element

waitForElementstringOptional

Selector of element to wait on each page.

Additional attributes

additionalPageAttrsobjectOptional

Pick additional attributes you want to attach to each record in index.

Default value of this property is {}

Skip Index Updated

skipIndexUpdatebooleanOptional

If check crawler will not update Algolia index.

Default value of this property is true

Pseudo-URLs

pseudoUrlsarrayOptional

Overrides default pseudoUrls

Page function

pageFunctionstringOptional

Overrides default pageFunction

Clickable elements

clickableElementsstringOptional

Overrides default clickableElements

Keep URL fragments

keepUrlFragmentsbooleanOptional

Option to switch on enqueueing URL with URL fragments

Default value of this property is false

Omit search params from URLs

omitSearchParamsFromUrlbooleanOptional

Option to switch off enqueueing with search params.

Default value of this property is false

Developer
Maintained by Apify

Actor Metrics

  • 2 monthly users

  • 2 stars

  • >99% runs succeeded

  • Created in Jul 2019

  • Modified 6 months ago