Wellfound Premium Jobs Scraper
Pricing
$24.99/month + usage
Wellfound Premium Jobs Scraper
Wellfound jobs scraper - Extract data like job title, description, salary range, location, job link and company socials. Specify the search based on job title, location or customized via URL. Supports search and URL lists. Download your data as HTML Table, JSON, JSON-L, CSV, Excel, XML, RSS
5.0 (1)
Pricing
$24.99/month + usage
11
Monthly users
66
Runs succeeded
95%
Response time
14 hours
Last modified
2 days ago
Rate limited. Therefor request was blocked, status code 403
Closed
after the page 10 it's returning over and over "Rate limited. Therefor request was blocked, status code 403"
Also: it forces me to use at least 512 MB when it could run on 128 MB (max memmory used was 94.8 MB)
Hey there, thank you for reporting this issue! We have lowered the minimum usable memory to 128MB as you suggested. Regarding the rate limiting:. Wellfound have significantly increased their scraping/bot protection. We are already working on a solution, but for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off.
Closing this issue for now, will reopen it if there are any updates to this issue.
All the best
sebagrin
about this: "for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off."
you mean to run the actor several times? in that case, the offset would work to where the scraper left off? or should I resurrect it?
The recommended solution would be to set the max_pages parameter to 10 and then adjust the page_offset to 10 then 20.. as you make the requests. Each time a new request. Resurrecting the run wouldn't work.
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
3 days
Price
$24.99
