ZipRecruiter.com Job Listings Scraper avatar
ZipRecruiter.com Job Listings Scraper

Pricing

$15.00/month + usage

Go to Store
ZipRecruiter.com Job Listings Scraper

ZipRecruiter.com Job Listings Scraper

Developed by

Muhamed Didovic

Muhamed Didovic

Maintained by Community

Unlock the power of millions of job listings with our ZipRecruiter Scraper – Your gateway to real-time labor market insights! Navigate the job market like a pro with our ZipRecruiter Scraper. From salary trends to skill demands, access the data you need to stay ahead in today's competitive landscape

5.0 (1)

Pricing

$15.00/month + usage

4

Total users

126

Monthly users

35

Runs succeeded

99%

Issues response

5.1 hours

Last modified

a day ago

OP

Failed Pagination

Closed

openmart opened this issue
a month ago

When I've tried to run on the following urls:

https://www.ziprecruiter.com/jobs-search?search=field+sales&location=San+Mateo%2C+CA&refine_by_location_type=&radius=5000&days=10&refine_by_employment=employment_type%3Aall&refine_by_salary=&refine_by_salary_ceil=&lvk=JUjorh1MRagtHTdwjv0YJw.--Nn-e1GDIc

https://www.ziprecruiter.com/jobs-search?search=smb+sales&location=San+Mateo%2C+CA&refine_by_location_type=&radius=5000&days=10&refine_by_employment=employment_type%3Aall&refine_by_salary=&refine_by_salary_ceil=&lvk=JUjorh1MRagtHTdwjv0YJw.--Nn-e1GDIc

It seems like the scrape is ending prematurely. I can only ever get the first few pages of results from the first url before the actor ends. Sometimes I will get only the first page back, other times the first 2, other times the first 3 - I think this may be a race condition with respect to how pagination works?

memo23 avatar

Hey openmart, I’ll investigate and let you know…

memo23 avatar

hey mate, pushed new version, give it a try and let me know

OP

openmart

a month ago

Hey Muhamed, it's better but I still think there are issues with the run failing prematurely due to "CheerioCrawler: All requests from the queue have been processed, the crawler will shut down." I think this may be an issue with scraping outpacing pagination?

OP

openmart

a month ago

Thanks for getting in a fix though!

memo23 avatar

Hey mate, can you provide a run url with this issue?