Indeed Scraper
Pay $5.00 for 1,000 results
Indeed Scraper
Pay $5.00 for 1,000 results
Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.
Not working anymore
WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by status code 403. 2024-12-20T09:41:47.930Z at isStatusCodeBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:18:24) {"id":"YgCq8uCaagDHfGR","url":"https://FR.indeed.com/jobs?q=software%20engineer&sort=date","retryCount":20} 2024-12-20T09:41:49.533Z ERROR CurlRequestsCheerioCrawler: Request failed and reached maximum retries. Error: Blocked by status code 403. 2024-12-20T09:41:49.534Z at isStatusCodeBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:18:24) 2024-12-20T09:41:49.535Z at isResponseBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:12:12) 2024-12-20T09:41:49.536Z at CurlRequestsCheerioCrawler.requestHandler (file:///home/myuser/dist/src/main.js:34:27) 2024-12-20T09:41:49.537Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
nunoms
Me too.
I'm paying for this service and nothing works.
cielmcliu
Same here😿
dave.dubois
Ditto. Not working, resulting in all status code 403 isStatusCodeBlocked
gajendra
yes, getting 403
Hi all, thanks for opening and joining this issue!
There is currently a big problem with blocking, we are working on ways to resolve this. We should get it done in the next few days :)
I will keep you updated here, thanks!
user-8eAwFBrQK8C2xeZg5
Any updates?
Hi again, I'm happy to inform you that we've updated the scraper with the fix!
We've been monitoring it for the past few days and the blocking seems to be overcome very well. Unfortunately, it cost us the speed of the scrape, which will now be a bit slower on average, especially the initial few requests. Still the blocking should now be almost very minimal, not disrupting any results :)
Let me know how it works now, thanks and happy scraping!
Misceres
