Wellfound Premium Jobs Scraper

🚀 Wellfound Job Listings Web Scraper

🌟 Version 0.0.28 - Issue Resolving Update

Release Date: 2024-12-06

Improvements and Fixes:

🩹 Issues fixed

🩹 Improvements added

• Jobs are now saved directly to the dataset as they are extracted, rather than at the end of a run

🌟 Version 0.0.27 - Issue Resolving Update

Release Date: 2024-12-05

Improvements and Fixes:

🩹 Issues fixed

• Fixed parsing issues on company size

🩹 Improvements added

🌟 Version 0.0.26 - Issue Resolving Update

Release Date: 2024-10-13

Improvements and Fixes:

🩹 Issues fixed

• Fixed parsing issues on company name, job type

🩹 Improvements added

• Added residential proxy configuration as default

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.25 - Issue Resolving Update

Release Date: 2024-10-12

Improvements and Fixes:

🩹 Issues fixed

• Fixed parsing issues on multiple columns

🩹 Improvements added

🌟 Version 0.0.21 - Issue Resolving Update

Release Date: 2024-10-01

Improvements and Fixes:

🩹 Issues fixed

• Fixed filtering out expired jobs without a job id

🩹 Improvements added

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.20 - Improvement Update

Release Date: 2024-09-30

Improvements and Fixes:

🩹 Issues fixed

🩹 Improvements added

• Added last x days parameter to filter job retrieval by custom amount of days.
• Added offset parameter to offset the starting page from which the scraper should scrape.

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.19 - Issue Resolving Update

Release Date: 2024-09-16

Improvements and Fixes:

🩹 Issues fixed

• Fixed scraper failing because by using custom job title or job location

🩹 Improvements added

• Improved readme documentation on custom job titles / locations

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.18 - Issue Resolving Update

Release Date: 2024-09-15

Improvements and Fixes:

🩹 Issues fixed

• Fixed scraper failing fetching data with 403 error due to heavy bot protection

🩹 Improvements added

• Improved custom job url validation

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.16 - Issue Resolving Update

Release Date: 2024-08-30

Improvements and Fixes:

🩹 Issues fixed

• Fixed scraper failing fetching data with no error due to frontend changes

🩹 Improvements added

• /

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.15 - Issue Resolving Update

Release Date: 2024-08-19

Improvements and Fixes:

🩹 Issues fixed

• Fixed scraper failing fetching data with status 403 due to cloudflare protection on the frontend of Wellfound

🩹 Improvements added

• Enabled proxy settings for users if needed

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.14 - Issue Resolving Update

Release Date: 2024-07-15

Improvements and Fixes:

🩹 Issues fixed

• Fixed scraper failing by not beeing able to extract job details content due to changes on the frontend of Wellfound

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0.11 - Major Update

Release Date: 2024-06-04

Improvements and Fixes:

🔍 Search Customization:

• Added Custom Job Title input - enables users to enter a preferred job title that is not present in the job titles input list
• Added Custom Job Location input - enables users to enter preffered job location that is not present in the job locations input list

📝 Added new high qualitys output fields

• job_id: Unique identifier for the job.
• job_listing_posted: Timestamp of when the job listing was posted.
• job_min_salary: Minimum salary value as a number.
• job_max_salary: Maximum salary value as a number.
• job_salary_currency: Currency of the salary (e.g., USD).
• job_salary_unit: Unit of the salary (e.g., YEAR).
• job_experience: Required experience description.
• required_experience_years: Required years of experience.
• required_experience_months: Required months of experience.
• job_location_requirement: Location requirement for the job.
• hires_remotely: Areas where the company hires remotely.
• job_benefits: Description of job benefits.
• job_listing_valid_until: Timestamp of when the job listing expires.
• direct_application: Indicates if direct application is allowed.
• company.profile_url: URL to the company's profile.
• company.url: Company's website URL.
• company.logo_url: URL to the company's logo.
• company.twitter_url: URL to the company's Twitter profile.
• company.linkedin_url: URL to the company's LinkedIn profile.

🛠️ Error Handling and Logging:

• Added Additional comprehensive error handling to manage site-specific issues and changes.
• Added more input validations steps
• Added more logging information

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

🌟 Version 0.0 - Initial Release

Release Date: 2024-06-01

Features:

• 📝 Job Listings Extraction:

  • Scrapes job listings from Wellfound with pagination
  • Scrapes detailed job posting page for every job listing
  • Extracts key details such as job title, job description, job details, job url, company name, location, salary, and posting date and many more.

• 🔍 Search Customization:

  • Allows users to specify job titles, locations, and other filters.
  • Configurable search parameters to narrow down job listings according to user preferences.

• 📊 Data Output:

  • Outputs dataset as JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML for easy integration and analysis.
  • Provides a clean and structured data output for further processing or direct use.

• 🛠️ Error Handling and Logging:

  • Comprehensive error handling to manage site-specific issues and changes.
  • Detailed logging to assist in debugging and tracking scraping activities.

Improvements and Fixes:

• Initial release with all core features and functionalities fully tested.
• Resolved initial bugs identified

Notes:

• Users are encouraged to provide feedback for further improvements.
• Future updates will focus on continuing to improve and enhance searching capabilities.

For any issues or suggestions, please open up an issue on the platform.

---

This changelog entry documents the initial release of the job listings web scraper actor, detailing its core features, functionalities, and initial bug fixes.