Fast Scraper avatar

Fast Scraper

Try Actor

$5.00/month

View all Actors
Fast Scraper

Fast Scraper

danielherman/fast-scraper
Try Actor

$5.00/month

Fast Scraper is a blazingly fast web scraper powered by Rust on the backend. It allows you to scrape static HTML pages extremely quickly while using only <128 MB of memory. With this scraper, you can maximize the efficiency of your credits on Apify.

Requests for scraping

requestsarrayRequired

Requests with given fields

Proxy configuration

proxy_settingsobjectOptional

Select proxies to be used by your crawler. For most use cases we recommend the default Apify automatic proxy.

Global Headers

headersobjectOptional

Global headers to be used for all requests.

Global User Agent

user_agentstringOptional

Global user agent used for all requests.

Default value of this property is "ApifyFastScraper/1.0"

Force Cloud

force_cloudbooleanOptional

Allows local runs to use cloud storage, mainly for testing. On Apify platform, this has no effect.

Default value of this property is false

Debug Log

debug_logbooleanOptional

Shows when each URL starts and ends scraping, with timings. Not recommended for larger runs as the log can get filled quickly.

Default value of this property is false

Push Data Buffer Size

push_data_sizeintegerOptional

Buffers results into an array before pushing to a dataset to prevent overwhelming the Apify API. The default number is usually a good choice.

Default value of this property is 50

Max Concurrency

max_concurrencyintegerOptional

Sets the maximum concurrency (parallelism) for the crawl. Keep this to a reasonable level because this scraper can go really fast.

Default value of this property is 10

Max Request Retries

max_request_retriesintegerOptional

Sets the maximum number of retries for each request (URL).

Default value of this property is 3

Max Request Retry Timeout (ms)

max_request_retry_timeout_msintegerOptional

Sets the maximum timeout in milliseconds to retry a failed request.

Default value of this property is 10000

Request Retry Wait (ms)

request_retry_wait_msintegerOptional

Sets the wait time in milliseconds before retrying a failed request.

Default value of this property is 5000

Developer
Maintained by Community
Actor metrics
  • 1 monthly user
  • 0 stars
  • 100.0% runs succeeded
  • Created in Jun 2024
  • Modified 3 months ago
Categories