Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
563
Monthly users
3.5k
Runs succeeded
>99%
Response time
10 days
Last modified
2 months ago
Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds
Hey, I'm having this issue out of nowhere.
This actor worked just fine before.
Hello bartos.ondrej, thank you for reaching out!
It looks like the page might have changed recently. You currently have "Performance and limits > Navigation waits until" set to "networkidle2", which can sometimes wait indefinitely if there are long-polling network requests (e.g. initiated by on-page scripts and such.)
Try switching this setting to "load" or "domcontentloaded" — in both cases, this has resolved this issue for me. (see my fixed run here). You can find more details about these events in the MDN documentation.
I’ll go ahead and close this issue, but feel free to reach out if you need further assistance. Cheers!
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
