Start URLs
URLs to search pages
Locations
Provide some locations for car search.
Scrape full data
Scrape full listing data or short
Default value of this property is
Limit
Search results limit
Default value of this property is
Min Concurrency
Sets the minimum concurrency (parallelism) for the crawl. Shortcut to the corresponding AutoscaledPool option.
Default value of this property is
Max Concurrency
Sets the maximum concurrency (parallelism) for the crawl. Shortcut to the corresponding AutoscaledPool option.
Default value of this property is
Max Request Retries
Indicates how many times the request is retried if BasicCrawlerOptions.handleRequestFunction fails.
Default value of this property is
Max Requests Per Crawl
Maximum number of pages that the crawler will open. The crawl will stop when this limit is reached.
Default value of this property is
Handle Page Timeout Secs
Timeout in which the function passed as handlePageFunction needs to finish, in seconds.
Default value of this property is
- 23 users
- 229 runs
- Modified 4 months ago