Indeed job scraper avatar
Indeed job scraper
Try for free

1 day trial then $20.00/month - No credit card required now

View all Actors
Indeed job scraper

Indeed job scraper

curious_coder/indeed-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

User avatar

Not scraping all results

Closed

jamesjsavage4690 opened this issue
a month ago

This finished at 39 minutes (timeout was set at 60 minutes) scraping a total of 1500 or the 8k+ results. I tried to resurrect the run twice but finish after scrapping 15 more results each time.

User avatar

Thanks for opening the issue, Let me check and get back to you

User avatar

Last page is 61, 15 jobs per page. So total 900 jobs

Check the last page here: https://www.indeed.com/jobs?q=Diesel+Mechanic&fromage=14&start=600&vjk=5ec7429905c9fb05

User avatar

jamesjsavage4690

a month ago

Are you seeing something different than I am? I have a total of 8,820 but it only scrapped 1,500. [image: Screen Shot 2024-04-22 at 11.41.20 AM.png] _____________________________________________________________

James Savage

Sr. Director, NCA

GoToro, Inc. http://email.gotoro.io/b?y=49q24eh26lij0c1kc8qm8e9pc4rmae31cph3ip9k6gsjeopl75ijaor270h2o8ji48t24q3keho3kbpfetrnebj7dtq6usjf5pkmubp2

User avatar

Thats why I gave you the link to last page of search results for the same URL you've tried to scrape. You can check the bottom of the page and try to navigate to last page, then you will understand. There are no more than 61 pages in your search because indeed has hidden lots of identical jobs (again, check the previously attached screenshot properly)

Developer
Maintained by Community
Actor metrics
  • 72 monthly users
  • 99.6% runs succeeded
  • 4.6 days response time
  • Created in Jun 2023
  • Modified 4 months ago