Web Scraper avatar
Web Scraper
Try for free

No credit card required

View all Actors
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

User avatar

Increase Memory Usage

Closed

earnest_lawnmower opened this issue
3 months ago

Hi, I am curious how one can increase the memory usage to boost the overall speed of the web scraping actor. I've checked the documentation and have not found anything. Thanks!

User avatar

Hello,

You can increase memory up to 32 GB for a single run. For higher speed, you have to split your workload into multiple runs. The memory option is in the Run options at the bottom of the input. You can also pass it via API or API client as query parameter.

Developer
Maintained by Apify
Actor metrics
  • 3.7k monthly users
  • 98.8% runs succeeded
  • 3.6 days response time
  • Created in Mar 2019
  • Modified about 1 month ago