
Web Scraper
No credit card required

Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
The parametre "Max result records (optional)" is set to N-1
I try many times, i think there is a bug. When i set this parameter to 10 (that means: i want to stop the execution of the job when the number of saved result is 10) , but the job stops at 9 and i get only 9 items in the dataset !
Hello RedabenhAKO and thank you for your input!
You're right — this is a bug. The "Max result records" option also counts cases where the Page Function does not return any dataset items. In your case, this happens in the handleStart()
branch of the function, which is why the Actor stops at 9 instead of 10.
We've already created a tracking issue for this: GitHub Issue #353, and I’m currently collecting feedback from my team. I’ll let you know if there are any developments on this.
I appreciate your patience, and thanks again for reporting this!
RedabenhAKO
Thanks for your answer
Actor Metrics
3.3k monthly users
-
456 bookmarks
>99% runs succeeded
4.8 days response time
Created in Mar 2019
Modified a month ago