Indeed Scraper
Pay $5.00 for 1,000 results
Indeed Scraper
Pay $5.00 for 1,000 results
Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.
No results for URL searching
After inputting a URL from the indeed page, the log says: WARN [DETAIL] Error: No initial data script found --- skipping [URL].
grand_beatle
I am also experiencing this issue
Hi, thanks for opening this issue!
We've just updated the scraper with the fix :) We were incorrectly detecting the blocking from Indeed. Although the blocking itself is pretty severe, there is not much more that we can do about it. We will try to get around the blocking somehow :)
Let me know how it works now, thanks and happy scraping!
nunoms
The problem still remains
I see, now that the blocking is properly detected, we are getting blocked pretty heavily. We will investigate the blocking further and reduce it as much as possible.
Just retry the run again, you should get some results unless you get blocked fully again.
randybeaman
I am still having issues as well, no results, have tried to run 5 times throughout today. any ideas?
drok22
Yeah block commin from indeed another scraper also got this
Hi again, I'm happy to inform you that we've just updated the scraper with the fix :) We are now properly managing some anti-blocking features that we were lacking previously. Also, importantly, we are using straight after the Actor start, so you won't be getting blocked even on startup.
Let me know how it works now, thanks and happy scraping!
lebattant0114
The problem is still there. Requests with URL input meet maximum retries.
DaniKimber
Getting immediately blocked, all scrapes fail
Wow, what a stupid timing. Seems like Indeed has once again updated their blocking through Cloudflare. They are now proactively serving CAPTCHAs for every request...
We're essentially getting fully blocked. We are working on ways to overcome the CAPTCHAs, but the development will take some time.
I will keep you updated here about the progress. Thank you!
Hi again, turns out Indeed has reverted the blocking again back to the previous state - which we are successfully scraping :)
Try it out and let me know how it works now, thanks and happy scraping!
Misceres
