Indeed Scraper avatar

Indeed Scraper

Try for free

Pay $5.00 for 1,000 results

Go to Store
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Do you want to learn more about this Actor?

Get a demo
DC

Not working anymore

Closed

decisive_chimta opened this issue
a month ago

WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by status code 403. 2024-12-20T09:41:47.930Z at isStatusCodeBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:18:24) {"id":"YgCq8uCaagDHfGR","url":"https://FR.indeed.com/jobs?q=software%20engineer&sort=date","retryCount":20} 2024-12-20T09:41:49.533Z ERROR CurlRequestsCheerioCrawler: Request failed and reached maximum retries. Error: Blocked by status code 403. 2024-12-20T09:41:49.534Z at isStatusCodeBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:18:24) 2024-12-20T09:41:49.535Z at isResponseBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:12:12) 2024-12-20T09:41:49.536Z at CurlRequestsCheerioCrawler.requestHandler (file:///home/myuser/dist/src/main.js:34:27) 2024-12-20T09:41:49.537Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

NU

nunoms

a month ago

Me too.

I'm paying for this service and nothing works.

CI

cielmcliu

a month ago

Same here😿

DV

dave.dubois

a month ago

Ditto. Not working, resulting in all status code 403 isStatusCodeBlocked

GJ

gajendra

25 days ago

yes, getting 403

lukas.prusa avatar

Hi all, thanks for opening and joining this issue!

There is currently a big problem with blocking, we are working on ways to resolve this. We should get it done in the next few days :)

I will keep you updated here, thanks!

U8

user-8eAwFBrQK8C2xeZg5

20 days ago

Any updates?

lukas.prusa avatar

Hi again, I'm happy to inform you that we've updated the scraper with the fix!

We've been monitoring it for the past few days and the blocking seems to be overcome very well. Unfortunately, it cost us the speed of the scrape, which will now be a bit slower on average, especially the initial few requests. Still the blocking should now be almost very minimal, not disrupting any results :)

Let me know how it works now, thanks and happy scraping!

Developer
Maintained by Apify

Actor Metrics

  • 865 monthly users

  • 166 stars

  • >99% runs succeeded

  • 4.1 days response time

  • Created in Mar 2023

  • Modified 7 days ago

Categories