The maximum number of duplications per URL (either from the start or during the crawl).
Default value of this property is 0
Number of crawled pages per URL domain
maxCrawledPagesPerDomainintegerOptional
The maximum number of crawled pages per URL domain (either from the start or during the crawl).
Default value of this property is 0
Max handled pages per run
maxHandledPagesPerRunintegerOptional
Defines how many pages to handle in total. Use this option to prevent running infinitely.
Default value of this property is 20
Proxy configuration
proxyConfigurationobjectRequired
Use Apify Proxy or your custom Proxy.
Default value of this property is {"useApifyProxy":true}
Max handled pages per time
maxHandledPagesPerTimeintegerOptional
Defines how many pages to process in parallel. The bot automatically increases and decreases this based on available system resources. Use this option to set a hard limit.