No credit card required
Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.
Hi, I am curious how one can increase the memory usage to boost the overall speed of the web scraping actor. I've checked the documentation and have not found anything. Thanks!
Hello,
You can increase memory up to 32 GB for a single run. For higher speed, you have to split your workload into multiple runs. The memory option is in the Run options at the bottom of the input. You can also pass it via API or API client as query parameter.
- 3.7k monthly users
- 98.8% runs succeeded
- 3.6 days response time
- Created in Mar 2019
- Modified about 1 month ago