Cheerio Scraper avatar
Cheerio Scraper

Pricing

Pay per usage

Go to Store
Cheerio Scraper

Cheerio Scraper

Developed by

Apify

Apify

Maintained by Apify

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

4.7 (10)

Pricing

Pay per usage

177

Total users

9.1K

Monthly users

924

Runs succeeded

>99%

Issues response

12 days

Last modified

2 months ago

MT

I want to rotate proxy manually base on condition

Closed

masstic_tech opened this issue
a year ago

I want to rotate the proxy manually based on the condition. Is there a docs for it?

adamek avatar

You need a custom actor for that, where you would set up the ProxyConfiguration object, probably with a newUrlFunction callback to handle your conditional logic.

Few links to check out:

https://crawlee.dev/docs/guides/cheerio-crawler-guide https://crawlee.dev/docs/guides/proxy-management https://crawlee.dev/api/core/interface/ProxyConfigurationOptions#newUrlFunction