Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
563
Monthly users
3.5k
Runs succeeded
>99%
Response time
10 days
Last modified
2 months ago
If I verify in pageFunction that the target website has been redirected by the anti-crawl mechanism, how do I get the latest page content.
If I verify in pageFunction that the target website has been redirected by the anti-crawl mechanism, how do I get the latest page content.
Hello and thank you for your interest in this Actor!
Pages like AliExpress invest heavily in anti-scraping protection, and the tricks available in Web Scraper might not always be enough. While you can try workarounds such as switching to Residential proxies or enabling media downloads, AliExpress may still recognize Web Scraper’s network fingerprints.
On the Apify Store, you can find multiple third-party Actors specifically designed for AliExpress scraping. These might be a better fit for your use case. Alternatively, you can develop your own custom solution and deploy it on Apify for more flexibility.
I'll go ahead and close this issue, but feel free to open a new one if you need further assistance!
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
