Indeed Scraper avatar

Indeed Scraper

Try for free

Pay $5.00 for 1,000 results

Go to Store
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Do you want to learn more about this Actor?

Get a demo
ST

71% success rate but 0 output : "Total 444 requests: 316 succeeded, 128 failed"

Closed

scenic_term opened this issue
2 months ago

Hi there, I've tried searching using search result URLs and also completing the form you provide but no results.

2024-11-21T02:23:26.495Z WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by HTML. 2024-11-21T02:23:26.496Z at isHtmlBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:28:24) {"id":"hrncZhxqaDu01T3","url":"https://www.indeed.com/viewjob?jk=692dbbe527f4ed1b&vjs=3","retryCount":19} 2024-11-21T02:23:26.504Z WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by HTML. 2024-11-21T02:23:26.504Z at isHtmlBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:28:24) {"id":"iTJIJttaBhIQQGS","url":"https://www.indeed.com/viewjob?jk=dfe688bc01ef4817&vjs=3","retryCount":19} 2024-11-21T02:23:26.543Z WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by HTML. 2024-11-21T02:23:26.544Z at isHtmlBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:28:24) {"id":"MEgcg12gEIA1yWV","url":"https://www.indeed.com/viewjob?jk=9e154f846045b8b2&vjs=3","retryCount":16} 2024-11-21T02:23:26.557Z WARN CurlRequestsCheerioCrawler: Reclaiming failed request back to the list or queue. Blocked by HTML. 2024-11-21T02:23:26.558Z at isHtmlBlocked (file:///home/myuser/dist/src/utils/blocking-detection.js:28:24) {"id":"NIgX9mWWRGcKzhX","url":"https://www.indeed.com/viewjob?jk=9086a2f8cb4d6f5a&vjs=3","retryCount":2

MI

amitchoudhary

2 months ago

Facing same issue

TO

tomamillerjobs

a month ago

same

SM

smnco

a month ago

Same here

RC

rich_cassone

a month ago

exactly same issue

lukas.prusa avatar

Hi, thank you all for joining this issue!

The problem is caused by heavy blocking from Indeed. We will investigate the situation and try to figure a way to get around the blocking so we can scrape again :)

I will keep you updated here, thanks!

KZ

kindhearted_zabra

a month ago

Please fix!

ST

scenic_term

a month ago

@Lukas. Thanks bro. Take your time; appreciate all the hard work you guys do. Stay safe!

lukas.prusa avatar

Hi again, I'm happy to inform you, that we've just updated the scraper with the fix :)

Try it out and let me know how it works now, thanks and happy scraping!

Developer
Maintained by Apify

Actor Metrics

  • 784 monthly users

  • 158 stars

  • >99% runs succeeded

  • 4 days response time

  • Created in Mar 2023

  • Modified a day ago

Categories