🔥 Fast Indeed Jobs Scraper avatar
🔥 Fast Indeed Jobs Scraper

Pricing

$19.00/month + usage

Go to Store
🔥 Fast Indeed Jobs Scraper

🔥 Fast Indeed Jobs Scraper

Developed by

Muhamed Didovic

Muhamed Didovic

Maintained by Community

Web scraper for Indeed.com job listings. Add Indeed URLs to customize searches. Set max jobs, concurrency, and other parameters to optimize performance while respecting site resources. Efficiently extracts job data, balancing speed with ethical practices. Ideal for gathering targeted job market info

5.0 (1)

Pricing

$19.00/month + usage

20

Total users

264

Monthly users

53

Runs succeeded

96%

Issues response

3 hours

Last modified

2 days ago

WH

Requests timing out, do I need to adjust proxy settings?

Closed

wh938103 opened this issue
a month ago

Hi,

My compute / proxy costs have increased dramatically since switching from a previous Indeed scraper because many of my requests seem to be timing out.

https://console.apify.com/actors/BHmW0fR31G1EdI2B2/runs/31Yi8gRgfotejrJZE#log https://console.apify.com/actors/BHmW0fR31G1EdI2B2/runs/BjuummHg1JwL6Apvi#log https://console.apify.com/actors/BHmW0fR31G1EdI2B2/runs/aAZVGfbro9Sifo9p0#log

Many of them are still working, but like 30% of them seem to be timing out.

I plan to decrease the timeout from 1h down to 8m, but it seems like a band-aid solution.

Do you have suggestions on how I can overcome this issue?

Best,

memo23 avatar

Hey mate, thanks for the heads up, I guess in your case, all URLs from all 3 runs don't have any results: https://www.indeed.com/jobs?q=bonus&l=United+States&sc=0kf%3Afcckey(92ee9ae9d8345f93)%3B https://www.indeed.com/jobs?q=signing%20bonus&l=United+States&sc=0kf%3Afcckey(92ee9ae9d8345f93)%3B https://www.indeed.com/jobs?q=bonus&l=United+States&sc=0kf%3Afcckey(92ee9ae9d8345f93)%3B Correct me if I got his wrong or something?

Regarding the cost, there is also a pay-per-result version of this actor(everything is the same, just the pricing model is different). In that case, everything is on me like proxies, infrastructure and etc, you just pay for the results that you get. Here is the link: https://apify.com/memo23/apify-indeed-cheerio-ppr

WH

wh938103

a month ago

I see. I guess the scraper will time out if there are no results?

I think we can fix it by using your other scraper because we're just trying to get the jobs for a particular company, thanks for the fast results.

I think in our case it still makes the most sense to pay a flat fee (after we fix this issue) because we're trying to scrape tens of thousands of results.

memo23 avatar

I made some changes to check if there are no results. Regarding the other scraper, I guess making a 'test' with both scapers with same input would be maybe a good approach...