Web Scraper
No credit card required
Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds
Hey, I'm having this issue out of nowhere.
This actor worked just fine before.
Hello bartos.ondrej, thank you for reaching out!
It looks like the page might have changed recently. You currently have "Performance and limits > Navigation waits until" set to "networkidle2", which can sometimes wait indefinitely if there are long-polling network requests (e.g. initiated by on-page scripts and such.)
Try switching this setting to "load" or "domcontentloaded" — in both cases, this has resolved this issue for me. (see my fixed run here). You can find more details about these events in the MDN documentation.
I’ll go ahead and close this issue, but feel free to reach out if you need further assistance. Cheers!
ApifyActor Metrics
3.3k monthly users
-
456 bookmarks
>99% runs succeeded
4.8 days response time
Created in Mar 2019
Modified a month ago
