Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
661
Monthly users
3.8k
Runs succeeded
>99%
Response time
21 days
Last modified
4 days ago
Way to bypass cloudflare human verification?
Closed
Hi, I recently made a new scraper 1:1 copy to my previous one which is working, but this scraper won't work. I think it's because the cloudflare verification that appears when the scraper visits the site.
How can I bypass this?
Thanks in Advance.
Hello quarterly_quicklime and thank you for reaching out!
It looks like the Actor is unable to access the page, even when using Hungarian residential proxies and headful Chrome — our usual workarounds. If your previous scraper was working but this one isn’t, the website may have updated its security settings. For example, they may have enabled Cloudflare’s "Under Attack" mode or changed their WAF configuration.
Unfortunately, in such cases, automated solutions like Web Scraper may not work. You might need to develop a custom solution (e.g. using our open-source library Crawlee), which gives you more flexibility in handling such challenges.
Sorry that we can’t provide a direct fix in this case. Let us know if you need any further guidance!
quarterly_quicklime
Thank you for your reply.
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
