3 days trial then $24.99/month - No credit card required now

Wellfound Premium Jobs Scraper

radeance/wellfound-job-listings-scraper

3 days trial then $24.99/month - No credit card required now

Wellfound jobs scraper - Extract data like job title, description, salary range, location, job link and company socials. Specify the search based on job title, location or customized via URL. Supports search and URL lists. Download your data as HTML Table, JSON, JSON-L, CSV, Excel, XML, RSS

Back to issues Create new issue

Rate limited. Therefor request was blocked, status code 403

Closed

sebagrin opened this issue

after the page 10 it's returning over and over "Rate limited. Therefor request was blocked, status code 403"

Also: it forces me to use at least 512 MB when it could run on 128 MB (max memmory used was 94.8 MB)

Radeance (radeance)

Hey there, thank you for reporting this issue! We have lowered the minimum usable memory to 128MB as you suggested. Regarding the rate limiting:. Wellfound have significantly increased their scraping/bot protection. We are already working on a solution, but for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off.

Closing this issue for now, will reopen it if there are any updates to this issue.

All the best

sebagrin

about this: "for now the recommended solution is to scrape a maximum of 10 pages per request and set the page offset parameter to where the scraper left off."

you mean to run the actor several times? in that case, the offset would work to where the scraper left off? or should I resurrect it?

Radeance (radeance)

The recommended solution would be to set the max_pages parameter to 10 and then adjust the page_offset to 10 then 20.. as you make the requests. Each time a new request. Resurrecting the run wouldn't work.

Add comment

Developer

Radeance

Actor Metrics

13 monthly users
8 stars
>99% runs succeeded
1.7 days response time
Created in Jun 2024
Modified 6 days ago

Categories

Jobs

Automation

Other

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

21.1k

457

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

62k

591

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15.7k

204

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

25.4k

228

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

80.2k

630

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

25.9k

186

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.4k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

7.1k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

21.6k

172

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!