Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
719
Total users
83.1k
Monthly users
4.1k
Runs succeeded
>99%
Issue response
38 days
Last modified
25 days ago
Way to bypass cloudflare human verification?
Closed
Hi, I recently made a new scraper 1:1 copy to my previous one which is working, but this scraper won't work. I think it's because the cloudflare verification that appears when the scraper visits the site.
How can I bypass this?
Thanks in Advance.
Hello quarterly_quicklime and thank you for reaching out!
It looks like the Actor is unable to access the page, even when using Hungarian residential proxies and headful Chrome — our usual workarounds. If your previous scraper was working but this one isn’t, the website may have updated its security settings. For example, they may have enabled Cloudflare’s "Under Attack" mode or changed their WAF configuration.
Unfortunately, in such cases, automated solutions like Web Scraper may not work. You might need to develop a custom solution (e.g. using our open-source library Crawlee), which gives you more flexibility in handling such challenges.
Sorry that we can’t provide a direct fix in this case. Let us know if you need any further guidance!
quarterly_quicklime
Thank you for your reply.
