Indeed Scraper avatar

Indeed Scraper

Try for free

Pay $5.00 for 1,000 results

Go to Store
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Do you want to learn more about this Actor?

Get a demo
LE

No results for URL searching

Closed

lebattant0114 opened this issue
a month ago

After inputting a URL from the indeed page, the log says: WARN [DETAIL] Error: No initial data script found --- skipping [URL].

GB

grand_beatle

a month ago

I am also experiencing this issue

lukas.prusa avatar

Hi, thanks for opening this issue!

We've just updated the scraper with the fix :) We were incorrectly detecting the blocking from Indeed. Although the blocking itself is pretty severe, there is not much more that we can do about it. We will try to get around the blocking somehow :)

Let me know how it works now, thanks and happy scraping!

NU

nunoms

a month ago

The problem still remains

lukas.prusa avatar

I see, now that the blocking is properly detected, we are getting blocked pretty heavily. We will investigate the blocking further and reduce it as much as possible.

Just retry the run again, you should get some results unless you get blocked fully again.

RN

randybeaman

a month ago

I am still having issues as well, no results, have tried to run 5 times throughout today. any ideas?

DR

drok22

a month ago

Yeah block commin from indeed another scraper also got this

lukas.prusa avatar

Hi again, I'm happy to inform you that we've just updated the scraper with the fix :) We are now properly managing some anti-blocking features that we were lacking previously. Also, importantly, we are using straight after the Actor start, so you won't be getting blocked even on startup.

Let me know how it works now, thanks and happy scraping!

LE

lebattant0114

a month ago

The problem is still there. Requests with URL input meet maximum retries.

DN

DaniKimber

a month ago

Getting immediately blocked, all scrapes fail

lukas.prusa avatar

Wow, what a stupid timing. Seems like Indeed has once again updated their blocking through Cloudflare. They are now proactively serving CAPTCHAs for every request...

We're essentially getting fully blocked. We are working on ways to overcome the CAPTCHAs, but the development will take some time.

I will keep you updated here about the progress. Thank you!

lukas.prusa avatar

Hi again, turns out Indeed has reverted the blocking again back to the previous state - which we are successfully scraping :)

Try it out and let me know how it works now, thanks and happy scraping!

Developer
Maintained by Apify

Actor Metrics

  • 865 monthly users

  • 166 stars

  • >99% runs succeeded

  • 4.1 days response time

  • Created in Mar 2023

  • Modified 7 days ago

Categories