No credit card required
Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.
Crawl not working and eating up credits
Closed
When i was using the CRawl API, the crawl didnt work on my site kipper.ai and continued to retry without giving any results
Hi, thanks for reaching out, we'll look into it with the team and let you know.
Hello @chaxg and thank you for your interest in this Actor!
The problem you have encountered was most likely caused by some random proxy / network / server issue.
Rerunning the Actor with your input resulted in a 20-second run with one result, just like expected. The only difference is that I switched to PRODUCTION mode - the DEVELOPMENT mode requires much more setup and can slow down your Actor even more.
See my Actor rerun here: https://console.apify.com/view/runs/Zw5sEx7kPmyPwhve7
I'll close this issue now, but feel free to reopen it with more questions if the problem still persists. Thanks!
Apify- 2.3k monthly users
- 119 stars
- 99.9% runs succeeded
- 5.2 days response time
- Created in Mar 2019
- Modified about 1 month ago
