💎 Wellfound Premium Jobs Scraper

Version 0.7.8 - Major Improvement Update

Release Date: 2025-07-15

Improvements and Fixes:

Issues fixed

• Resolved some issue with monitoring mode

Improvements added

• Added reset_monitoring parameter to allow users to reset the monitoring state and start scraping all job posts from the specified query
• Added stream_output parameter to allow users to stream the output in real-time, which is useful for monitoring long-running scraping tasks
• Added keyword parameter to allow users to filter job listings by specific keywords in the job title or description
• Improved monitoring_mode to ensure it only returns new job postings, based on job id, published date and description instead of job url only (previously)
• Improved monitoring_mode to ensure it reclaims jobs that were previously scraped but are now new or updated
• Added support for gracefully aborting the scraper process, allowing users to stop the scraping process without losing progress
• Added support for migration events, allowing the scraper to handle server migrations without losing progress
• Sorted Input Parameters for better usability & readability
• Improved general stability & availability of the service

Version 0.7.6 - Major Improvement Update

Release Date: 2025-06-30

Improvements and Fixes:

Issues fixed

Improvements added

• Added prefiltering step so job pages will not be scraped unnecessarily
• Added monitoring_mode, which enables users to get only new job postings on runs, this will be enabled by default
• Added only_unique_jobs, which enables the users to get only unique job postings, this will be enabled by default
• Improved general performance
• Improved general stability & availability of the service

Version 0.7.5 - Stability Improvement Update

Release Date: 2025-06-27

Improvements and Fixes:

Issues fixed

Improvements added

• Added usage quota for free users to prevent recent abusive behaviour overloading our infrastructure
• Improved general stability & availability of the service

Version 0.7.4 - Bug Fixing Update

Release Date: 2025-06-24

Improvements and Fixes:

Issues fixed

• Resolved Actor crashing during high load times
• Changed default Residential Proxy Region

Improvements added

Version 0.7.2 - Bug Fixing Update

Release Date: 2025-06-24

Improvements and Fixes:

Issues fixed

• Fixed some data validation issues

Improvements added

Version 0.6.9 - Bug Fixing Update

Release Date: 2025-06-21

Improvements and Fixes:

Issues fixed

• Fixed some data validation issues

Improvements added

Version 0.6.8 - Major Improvement Update

Release Date: 2025-06-21

Improvements and Fixes:

Issues fixed

• Fixed some data validation issues

Improvements added

• Added several new filter options for job salary, job types, job skills, job experience
• Improved README documentation readability
• Improved general stability & availability of the service

Version 0.6.7 - Improvement Update

Release Date: 2025-06-12

Improvements and Fixes:

Issues fixed

Improvements added

• We added support for role-only listing urls
• Improved general stability & availability of the service

Version 0.6.6 - Improvement & Fix Update

Release Date: 2025-06-11

Improvements and Fixes:

Issues fixed

• Expired job listings will now be logged correctly

Improvements added

• Increased max_pages limit from 25 to 100 for paying users
• Improved general stability & availability of the service

Version 0.6.5 - Improvement & Fix Update

Release Date: 2025-06-11

Improvements and Fixes:

Issues fixed

• Fixed bug where page_offset parameter was not respected
• Increased minimum memory to 256 MB due to out-of-memory errors and maximum to 4096 due to input errors on default ui settings

Improvements added

• Improved general stability & availability of the service

Version 0.6.4 - Improvement & Fix Update

Release Date: 2025-06-09

Improvements and Fixes:

Issues fixed

• Improved error messages when job search ends up in a 404 error
• Improved general stability & availability of the service

Improvements added

• Sorted job locations and job titles selection
• 'url' parameter is now completly removed as it got replaced by 'urls' parameters to insert bulk listing or job page urls

Version 0.6.3 - Improvement Update

Release Date: 2025-06-04

Improvements and Fixes:

Issues fixed

• Improved general stability & availability of the service

Improvements added

• Added 15 new selectable locations including Canada, China, Japan, Nigeria and Poland

Version 0.6.2 - Major Improvement Update

Release Date: 2025-05-29

Improvements and Fixes:

Issues fixed

• Improved general stability & availability of the service

Improvements added

• Added new Output Table View
• Added support for location only Listing URL formats
• Added Bulk Listing URL support for up to 5 URLs at once for our paying users
• Added company category multi select filter with 400+ unique company categories

Version 0.6.1 - Stability Improvement Update

Release Date: 2025-05-25

Improvements and Fixes:

Issues fixed

Improvements added

• Improved general stability & availability of the service

Version 0.6 - Major Improvement Update

Release Date: 2025-05-22

Improvements and Fixes:

Issues fixed

• Resolved some parsing issues

Improvements added

• Added some new company fields

• Improved general stability

Version 0.5.5 - Major Improvement Update

Release Date: 2025-05-21

Improvements and Fixes:

Issues fixed

• Improved proxy rotation handling

Improvements added

• We rescaled our own infrastructure further due to increased throughput resulting in temporarily service outages

Version 0.5.0 - Major Improvement Update

Release Date: 2025-05-20

Improvements and Fixes:

Issues fixed

• General reliability and performance fixes across the scraping pipeline.

Improvements added

• Implemented a robust, self-managed scraping infrastructure to ensure high reliability and scalability under increased user demand. This upgrade addresses frequent 403 errors and rate-limiting issues caused by platform-level bot protection, significantly improving stability for all users
• Revamped filtering logic: enhanced support for last_x_days and remote_only parameters to provide more precise and user-centric job discovery
• Increased max_pages limit from 7 to 25, enabling deeper data extraction while maintaining fair usage practices.
• Improved log messages

Version 0.0.50 - Issue Resolving Update

Release Date: 2025-05-15

Improvements and Fixes:

Issues fixed

• Resolved an issue that triggered 403 responses during requests

Improvements added

Version 0.0.48 - Issue Resolving Update

Release Date: 2025-05-06

Improvements and Fixes:

Issues fixed

• Resolved an issue that triggered 403 responses during requests

Improvements added

Version 0.0.47 - Issue Resolving Update

Release Date: 2025-05-03

Improvements and Fixes:

Issues fixed

• Resolved an issue that triggered 403 responses during requests

Improvements added

Version 0.0.46 - Issue Resolving Update

Release Date: 2025-04-30

Improvements and Fixes:

Issues fixed

• Resolved an issue that triggered 403 responses during requests
• Corrected the log output to accurately reflect the 'last_x_days' parameter

Improvements added

Version 0.0.43 - Issue Resolving Update

Release Date: 2025-04-28

Improvements and Fixes:

Issues fixed

• Resolved issue when encountering 403 requests

Improvements added

Version 0.0.42 - Issue Resolving Update

Release Date: 2025-04-28

Improvements and Fixes:

Issues fixed

• Fixed an issue where the scraper collected all jobs on a listings page incorrectly due to frontend structure changes.

• Handled HTTP 403 errors gracefully when encountered during scraping.

Improvements added

• Introduced request throttling to significantly slow down the scraper, reducing the likelihood of being blocked by bot protection mechanisms.

Version 0.0.41 - Issue Resolving Update

Release Date: 2025-04-24

Improvements and Fixes:

Issues fixed

• Resolved issue when encountering 403 requests

Improvements added

Version 0.0.40 - Issue Resolving Update

Release Date: 2025-04-09

Improvements and Fixes:

Issues fixed

• Resolved issue when encountering 403 requests

Improvements added

Version 0.0.36 - Maintenance Update

Release Date: 2025-04-07

Improvements and Fixes:

Issues fixed

Improvements added

Version 0.0.35 - Improvement Update

Release Date: 2025-03-03

Improvements and Fixes:

Issues fixed

• Fixed 403 Error due to changes to bot protection

Improvements added

• Added remote_only parameter to allow users to filter only jobs with remote working policies that are truly open for fully remote work

Version 0.0.32 - Improvement Update

Release Date: 2025-02-25

Improvements and Fixes:

Issues fixed

Improvements added

• Added 40+ new jobs to select directly from the "Job Title" drop down menu
• Added 16 new locations to select directly from the "Job Location" drop down menu

Version 0.0.30 - Issue Resolving Update

Release Date: 2025-02-15

Improvements and Fixes:

Issues fixed

• Fixed 403 Error due to changes to bot protection

Improvements added

Version 0.0.30 - Issue Resolving Update

Release Date: 2024-12-12

Improvements and Fixes:

Issues fixed

• Extraction of job details failed with an unhandled exception if items were missing

Improvements added

Version 0.0.28 - Issue Resolving Update

Release Date: 2024-12-06

Improvements and Fixes:

Issues fixed

Improvements added

• Jobs are now saved directly to the dataset as they are extracted, rather than at the end of a run

Version 0.0.27 - Issue Resolving Update

Release Date: 2024-12-05

Improvements and Fixes:

Issues fixed

• Fixed parsing issues on company size

Improvements added

Version 0.0.26 - Issue Resolving Update

Release Date: 2024-10-13

Improvements and Fixes:

Issues fixed

• Fixed parsing issues on company name, job type

Improvements added

• Added residential proxy configuration as default

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.25 - Issue Resolving Update

Release Date: 2024-10-12

Improvements and Fixes:

Issues fixed

• Fixed parsing issues on multiple columns

Improvements added

Version 0.0.21 - Issue Resolving Update

Release Date: 2024-10-01

Improvements and Fixes:

Issues fixed

• Fixed filtering out expired jobs without a job id

Improvements added

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.20 - Improvement Update

Release Date: 2024-09-30

Improvements and Fixes:

Issues fixed

Improvements added

• Added last x days parameter to filter job retrieval by custom amount of days.
• Added offset parameter to offset the starting page from which the scraper should scrape.

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.19 - Issue Resolving Update

Release Date: 2024-09-16

Improvements and Fixes:

Issues fixed

• Fixed scraper failing because by using custom job title or job location

Improvements added

• Improved readme documentation on custom job titles / locations

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.18 - Issue Resolving Update

Release Date: 2024-09-15

Improvements and Fixes:

Issues fixed

• Fixed scraper failing fetching data with 403 error due to heavy bot protection

Improvements added

• Improved custom job url validation

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.16 - Issue Resolving Update

Release Date: 2024-08-30

Improvements and Fixes:

Issues fixed

• Fixed scraper failing fetching data with no error due to frontend changes

Improvements added

• /

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.15 - Issue Resolving Update

Release Date: 2024-08-19

Improvements and Fixes:

Issues fixed

• Fixed scraper failing fetching data with status 403 due to cloudflare protection on the frontend of Wellfound

Improvements added

• Enabled proxy settings for users if needed

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.14 - Issue Resolving Update

Release Date: 2024-07-15

Improvements and Fixes:

Issues fixed

• Fixed scraper failing by not beeing able to extract job details content due to changes on the frontend of Wellfound

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0.11 - Major Update

Release Date: 2024-06-04

Improvements and Fixes:

🔍 Search Customization:

• Added Custom Job Title input - enables users to enter a preferred job title that is not present in the job titles input list
• Added Custom Job Location input - enables users to enter preffered job location that is not present in the job locations input list

📝 Added new high qualitys output fields

• job_id: Unique identifier for the job.
• job_listing_posted: Timestamp of when the job listing was posted.
• job_min_salary: Minimum salary value as a number.
• job_max_salary: Maximum salary value as a number.
• job_salary_currency: Currency of the salary (e.g., USD).
• job_salary_unit: Unit of the salary (e.g., YEAR).
• job_experience: Required experience description.
• required_experience_years: Required years of experience.
• required_experience_months: Required months of experience.
• job_location_requirement: Location requirement for the job.
• hires_remotely: Areas where the company hires remotely.
• job_benefits: Description of job benefits.
• job_listing_valid_until: Timestamp of when the job listing expires.
• direct_application: Indicates if direct application is allowed.
• company.profile_url: URL to the company's profile.
• company.url: Company's website URL.
• company.logo_url: URL to the company's logo.
• company.twitter_url: URL to the company's Twitter profile.
• company.linkedin_url: URL to the company's LinkedIn profile.

🛠️ Error Handling and Logging:

• Added Additional comprehensive error handling to manage site-specific issues and changes.
• Added more input validations steps
• Added more logging information

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

Version 0.0 - Initial Release

Release Date: 2024-06-01

Features:

• 📝 Job Listings Extraction:

  • Scrapes job listings from Wellfound with pagination
  • Scrapes detailed job posting page for every job listing
  • Extracts key details such as job title, job description, job details, job url, company name, location, salary, and posting date and many more.

• 🔍 Search Customization:

  • Allows users to specify job titles, locations, and other filters.
  • Configurable search parameters to narrow down job listings according to user preferences.

• 📊 Data Output:

  • Outputs dataset as JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML for easy integration and analysis.
  • Provides a clean and structured data output for further processing or direct use.

• 🛠️ Error Handling and Logging:

  • Comprehensive error handling to manage site-specific issues and changes.
  • Detailed logging to assist in debugging and tracking scraping activities.

Improvements and Fixes:

• Initial release with all core features and functionalities fully tested.
• Resolved initial bugs identified

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

This changelog entry documents the initial release of the job listings web scraper actor, detailing its core features, functionalities, and initial bug fixes.