No credit card required
Cheerio Scraper
No credit card required
Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.
I want to rotate the proxy manually based on the condition. Is there a docs for it?
You need a custom actor for that, where you would set up the ProxyConfiguration object, probably with a newUrlFunction
callback to handle your conditional logic.
Few links to check out:
https://crawlee.dev/docs/guides/cheerio-crawler-guide https://crawlee.dev/docs/guides/proxy-management https://crawlee.dev/api/core/interface/ProxyConfigurationOptions#newUrlFunction
- 402 monthly users
- 99.8% runs succeeded
- 0.4 days response time
- Created in Apr 2019
- Modified about 1 month ago