OnTheList Scraper

mshopik/onthelist-scraper

E-commerce

Scrape OnTheList and extract data on from onthelist-store.com. Our OnTheList API lets you crawl product information and pricing. The saved data can be downloaded as HTML, JSON, CSV, Excel, and XML.

No credit card required

Mark Carter

Modified3 months ago
Users1
Runs187

OnTheList Scraper

Proxy configuration

proxyConfig

Required

object

It's required to use proxies when running on the platform.

Max items

maxRequestsPerCrawl

Optional

integer

How many items to extract from onthelist-store.com

Extend Output Function

extendOutputFunction

Optional

string

Add or remove properties on the output object or omit the output returning null

Extend Scraper Function

extendScraperFunction

Optional

string

Advanced function that allows you to extend the default scraper functionality, allowing you to manually perform actions on the page

Custom data

customData

Optional

object

Any data that you want to have available inside the Extend Output/Scraper Function

Fetch HTML

fetchHtml

Optional

boolean

If you decide to fetch the HTML of the pages, it will take twice as long. Make sure to only enable this if needed

Max concurrency

maxConcurrency

Optional

integer

Max concurrency to use

Max request retries

maxRequestRetries

Optional

integer

Set the max request retries

Debug Log

debugLog

Optional

boolean

Enable a more verbose logging to be able to understand what's happening during the scraping

Where next?

Build new tools

Are you a developer? Build your own actors and run them on Apify.

Get a custom solution

Get a custom web scraping or RPA solution.