Web Scraper avatar

Web Scraper

Try for free

No credit card required

Go to Store
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

RE

The parametre "Max result records (optional)" is set to N-1

Open
RedabenhAKO opened this issue
23 days ago

I try many times, i think there is a bug. When i set this parameter to 10 (that means: i want to stop the execution of the job when the number of saved result is 10) , but the job stops at 9 and i get only 9 items in the dataset !

jindrich.bar avatar

Hello RedabenhAKO and thank you for your input!

You're right — this is a bug. The "Max result records" option also counts cases where the Page Function does not return any dataset items. In your case, this happens in the handleStart() branch of the function, which is why the Actor stops at 9 instead of 10.

We've already created a tracking issue for this: GitHub Issue #353, and I’m currently collecting feedback from my team. I’ll let you know if there are any developments on this.

I appreciate your patience, and thanks again for reporting this!

RE

RedabenhAKO

18 days ago

Thanks for your answer

Developer
Maintained by Apify

Actor Metrics

  • 3.3k monthly users

  • 456 bookmarks

  • >99% runs succeeded

  • 4.8 days response time

  • Created in Mar 2019

  • Modified a month ago