Indeed job scraper avatar

Indeed job scraper

Try for free

1 day trial then $20.00/month - No credit card required now

Go to Store
Indeed job scraper

Indeed job scraper

curious_coder/indeed-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

WH

Expensive to crawl

Closed

wh938103 opened this issue
2 months ago

For some some of our runs, it costs 2 or 3 cents per results, meaning it would cost $30 for 1,000 results. Any suggestions on how to bring this cost down?

I'm using useBrowser: true and a US Residential proxy. Scraping doesn't seem to work without these two configurations

curious_coder avatar

I just did a run and scraped 100 jobs at $0.1

Also based on historical data, it costs $2.5 per 1000 jobs scraped on average when browser is enabled, which is fair considering the fact that this website is aggressively protected by cloudflare

WH

wh938103

2 months ago

Totally get what you're saying, not trying to complain just trying to see if there's anything I can do to lower the cost.

What settings are you using to scrape 100 jobs at $.1? My most recent scrape retrieved 26 results for $.41

curious_coder avatar

Sent an update fixing some bugs, check and let me know

WH

wh938103

2 months ago

Thank you! Costs seem a lot lower now

Developer
Maintained by Community

Actor Metrics

  • 142 monthly users

  • 32 stars

  • >99% runs succeeded

  • 3.8 days response time

  • Created in Jun 2023

  • Modified 23 days ago