Extract all Actors from the Apify Store. Includes cost, trial minutes, number of users, number of builds, version, author, and more. Optionally filter by category or search term. Download as JSON, JSONL, XML, CSV, Excel, or HTML formats.
The maximum number of requests per minute the crawler should run. We can pass any positive, non-zero integer.
maxRequestsPerCrawl
maxRequestsPerCrawlintegerOptional
Maximum number of pages that the crawler will open. The crawl will stop when this limit is reached.
NOTE: In cases of parallel crawling, the actual number of pages visited might be slightly higher than this value.
minConcurrency
minConcurrencyintegerOptional
Sets the minimum concurrency (parallelism) for the crawl.
WARNING: If we set this value too high with respect to the available system memory and CPU, our crawler will run extremely slow or crash. If not sure, it's better to keep the default value and the concurrency will scale up automatically.
maxConcurrency
maxConcurrencyintegerOptional
Sets the maximum concurrency (parallelism) for the crawl.
navigationTimeoutSecs
navigationTimeoutSecsintegerOptional
Timeout in which the HTTP request to the resource needs to finish, given in seconds.
Allows to keep the crawler alive even if the RequestQueue gets empty. With keepAlive: true the crawler will keep running, waiting for more requests to come.
additionalMimeTypes
additionalMimeTypesarrayOptional
An array of MIME types you want the crawler to load and process. By default, only text/html and application/xhtml+xml MIME types are supported.
suggestResponseEncoding
suggestResponseEncodingstringOptional
By default this crawler will extract correct encoding from the HTTP response headers. There are some websites which use invalid headers. Those are encoded using the UTF-8 encoding. If those sites actually use a different encoding, the response will be corrupted. You can use suggestResponseEncoding to fall back to a certain encoding, if you know that your target website uses it. To force a certain encoding, disregarding the response headers, use forceResponseEncoding.
forceResponseEncoding
forceResponseEncodingstringOptional
By default this crawler will extract correct encoding from the HTTP response headers. Use forceResponseEncoding to force a certain encoding, disregarding the response headers. To only provide a default for missing encodings, use suggestResponseEncoding.