Cloudflare Web Scraper avatar

Cloudflare Web Scraper

Try for free

1 day trial then $50.00/month - No credit card required now

Go to Store
Cloudflare Web Scraper

Cloudflare Web Scraper

dtrungtin/cloudflare-web-scraper
Try for free

1 day trial then $50.00/month - No credit card required now

Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems

The Actor loads web pages in the Puppeteer browser and renders dynamic content. The page content will be loaded by Cheerio. This Actor prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems. It behaves like a real browser.

Input Parameters

  • startUrls (required): List of Request objects, specifying the URL you want to scrape.
  • waitForUrl (optional): Wait for url which includes the text to consider as bypass bot protection successfully.
  • waitForTitle (optional): Wait for page title which doesn't include the text to consider as bypass bot protection successfully.
  • pageFunction (required): Query page elements in the web page using Cheerio.
  • proxyConfig (required): Specifies the proxy settings used while running the actor. When running this actor on the platform, the proxy setting must always be set on. The default value is { "useApifyProxy": true }

Output example

You will receive the such result in the dataset.

1[{
2  "title": "Assistenzarzt Chirurgie: > 1.000 Jobs, Arbeit, 19. September 2024| Indeed.com",
3  "count": "> 1.000 Jobs"
4}]

Epilogue

Thank you for trying my actor. I will be very glad for a feedback that you can send to my email dtrungtin@gmail.com.

Developer
Maintained by Community

Actor Metrics

  • 15 monthly users

  • 0 No stars yet

  • 93% runs succeeded

  • 5.7 hours response time

  • Created in Sep 2024

  • Modified a month ago