Rust Scraper
No credit card required
Rust Scraper
No credit card required
Speed of light scraping with Rust programming language! This is an early alpha version for experimenting, use at your own risk!
Start URLs
urls
arrayRequired
URLs that will be scraped. Must be an array of objects with "url" property.
Extraction config
extract
arrayRequired
Array that defines what and how should be scraped from a page HTML. See readme for more info.
Proxy configuration
proxy_settings
objectOptional
Select proxies to be used by your crawler. For most use cases we recommend the default Apify automatic proxy.
Max concurrency
max_concurrency
integerOptional
Sets the maximum concurrency (parallelism) for the crawl. Keep this is reasonable level because this scraper can go really fast.
Default value of this property is 50
Max request retries
max_request_retries
integerOptional
Sets the maximum number of retries for each request(URL).
Default value of this property is 3
Debug log
debug_log
booleanOptional
Shows when each URL starts and ends scraping with timings. Don't use for larger runs as the log gets filled quickly.
Default value of this property is false
Actor Metrics
1 monthly user
-
3 stars
>99% runs succeeded
Created in Feb 2019
Modified 4 years ago