Indeed job scraper avatar

Indeed job scraper

Try for free

1 day trial then $20.00/month - No credit card required now

View all Actors
Indeed job scraper

Indeed job scraper

curious_coder/indeed-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

WH

Expensive to crawl

Closed

wh938103 opened this issue
21 days ago

For some some of our runs, it costs 2 or 3 cents per results, meaning it would cost $30 for 1,000 results. Any suggestions on how to bring this cost down?

I'm using useBrowser: true and a US Residential proxy. Scraping doesn't seem to work without these two configurations

curious_coder avatar

I just did a run and scraped 100 jobs at $0.1

Also based on historical data, it costs $2.5 per 1000 jobs scraped on average when browser is enabled, which is fair considering the fact that this website is aggressively protected by cloudflare

WH

wh938103

17 days ago

Totally get what you're saying, not trying to complain just trying to see if there's anything I can do to lower the cost.

What settings are you using to scrape 100 jobs at $.1? My most recent scrape retrieved 26 results for $.41

curious_coder avatar

Sent an update fixing some bugs, check and let me know

WH

wh938103

3 days ago

Thank you! Costs seem a lot lower now

Developer
Maintained by Community

Actor Metrics

  • 101 monthly users

  • 19 stars

  • >99% runs succeeded

  • 3.3 days response time

  • Created in Jun 2023

  • Modified 2 days ago