Indeed Scraper avatar

Indeed Scraper

Try for free

Pay $5.00 for 1,000 results

Go to Store
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

RR

Receive only 50 Results when Crawling for 100

Closed
rong_rong opened this issue
a month ago

For the past couple of days, the runs I set up for 100 results only returned 50 or 51 results consistently. The requests seemed to be handled successfully for over 100 results, so I'm not sure why only 50/51 results displayed. Is it because some of them are repetitive so they don't show up in the end? Or is there some other mechanism that prevented all results to show?

paja avatar

Hi, thanks for reaching out, we'll look into it and let you know what can be done.

RR

rong_rong

22 days ago

Thank you! Looking forward to hearing back!

lhotanok avatar

Hi, I checked your run and the issue is with the limit on maximum paid results, which was set to 50 instead of 100 (see the first screenshot). You need to change this value in Run options (as demonstrated on screenshots n. 2 and 3).

I understand that this is very confusing since there's also maxItems input field, which you correctly set to 100. If I'm not mistaken, maxItems is just a legacy field that was relevant before the pay-per-result pricing model. We'll discuss with the team whether it should be deprecated in favor of using the max paid results from the Run options.

For now, the scraper chooses the minimum from maxItems and max paid results.

Developer
Maintained by Apify

Actor Metrics

  • 1.3k monthly users

  • 221 bookmarks

  • >99% runs succeeded

  • 5.1 days response time

  • Created in Mar 2023

  • Modified a month ago

Categories