Wellfound Premium Jobs Scraper avatar
Wellfound Premium Jobs Scraper

Pricing

$24.99/month + usage

Go to Store
Wellfound Premium Jobs Scraper

Wellfound Premium Jobs Scraper

radeance/wellfound-job-listings-scraper

Developed by

Radeance

Maintained by Community

Wellfound jobs scraper - Extract data like job title, description, salary range, location, job link and company socials. Specify the search based on job title, location or customized via URL. Supports search and URL lists. Download your data as HTML Table, JSON, JSON-L, CSV, Excel, XML, RSS

5.0 (1)

Pricing

$24.99/month + usage

11

Monthly users

36

Runs succeeded

99%

Response time

16 hours

Last modified

a month ago

SE

Rate limited. Therefor request was blocked, status code 403

Closed
sebagrin opened this issue
4 months ago

after the page 10 it's returning over and over "Rate limited. Therefor request was blocked, status code 403"

Also: it forces me to use at least 512 MB when it could run on 128 MB (max memmory used was 94.8 MB)

radeance avatar

Hey there, thank you for reporting this issue! We have lowered the minimum usable memory to 128MB as you suggested. Regarding the rate limiting:. Wellfound have significantly increased their scraping/bot protection. We are already working on a solution, but for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off.

Closing this issue for now, will reopen it if there are any updates to this issue.

All the best

SE

sebagrin

4 months ago

about this: "for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off."

you mean to run the actor several times? in that case, the offset would work to where the scraper left off? or should I resurrect it?

radeance avatar

The recommended solution would be to set the max_pages parameter to 10 and then adjust the page_offset to 10 then 20.. as you make the requests. Each time a new request. Resurrecting the run wouldn't work.

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

3 days

Price

$24.99