Upwork Job Listings Scraper

Introduction

Are you tired of manually searching for freelance gigs on Upwork? Introducing the Upwork Job Listings Scraper, your automated solution to find freelance opportunities tailored to your skills and preferences. Whether you're a developer, designer, writer, or consultant, our tool helps you filter and find jobs that match your expertise and expected pay range.

Perfect for freelancers who need to efficiently monitor new postings and for companies looking for specific talents on Upwork, this scraper simplifies your search and saves you valuable time.

Features

• Customizable Searches: Enter specific keywords, categories, budget ranges, and other criteria to tailor your job search.
• Flexible Filtering Options: Filter jobs by experience level, job type (hourly or fixed-price), budget ranges, and client history.
• Advanced Custom Filters: Apply custom filters to any job property using conditions like "includes", "equals", "notIncludes", and "notEquals".
• Job Age Filtering: Filter out jobs older than a specific time threshold (minutes, hours, days, or weeks).
• Raw URL Support: Directly use specific Upwork search URLs instead of constructing them from parameters.
• Cookie Authentication: Use cookies from your Upwork account to bypass protection mechanisms and access more job details.
• Detailed Information Extraction: Pulls comprehensive job information including title, description, client statistics, budget details, required skills, and posting time.
• Modern Architecture: Built with TypeScript and Node.js for reliability and maintainability.
• Cloudflare Protection Bypass: Advanced techniques to reliably access Upwork job data.
• Case-Insensitive Matching: All filtering is case-insensitive for more intuitive search experiences.

Use Cases

• Targeted Job Hunting: Find exactly the kind of projects you're qualified for without spending hours manually searching.
• Market Research: Understand what services are in demand and how much clients are willing to pay for different skills.
• Competitive Analysis: Track which skills are most requested in your field to guide your professional development.
• Opportunity Alerts: Stay updated with the latest job postings that match your skill set without the need for constant manual searching.
• Fresh Job Alerts: Focus only on recent job postings by filtering out older listings.
• Complex Search Criteria: Combine multiple filter conditions to find highly specific job matches.

How to Use

Getting started with the Upwork Job Listings Scraper is easy:

1. Set Your Parameters:

   • Enter your search query (optional if raw URL provided)
   • Provide a raw Upwork search URL (optional, overrides other search parameters)
   • Set maximum job age to filter out older jobs (e.g., 24 hours, 3 days)
   • Define custom filters for precise job matching
   • Choose which page to start from (default: 1)
   • Set results per page (default: 10)
   • Select sorting order (newest or relevance)
   • Filter by experience level (entry, intermediate, expert)
   • Specify job type (fixed or hourly)
   • Set budget ranges for both fixed and hourly jobs
   • Filter by client hiring history
   • Provide authentication cookies (optional, improves scraping reliability)

2. Run the Scraper: Launch the scraper and let it gather the job listings for you.

3. Analyze the Results: Review the detailed job data to find the perfect opportunities.

Using Authentication Cookies

For improved reliability and access to more job details, you can provide your Upwork cookies. This helps bypass protection mechanisms and gives you access to jobs as if you were logged in.

How to Get Your Cookies:

1. Log in to Upwork in your browser
2. Open the developer tools (F12 or right-click → Inspect)
3. Go to the Application tab (Chrome) or Storage tab (Firefox)
4. In the left panel, expand "Cookies" and select "www.upwork.com"
5. Copy the relevant cookies - the most important ones are:
   • UniversalSearchNuxt_vt
   • xsrf_token
   • connect.sid
   • oauth2_global_js_token

Cookies Format:

Provide cookies as an array of objects with this structure:

1[
2  {
3    "name": "UniversalSearchNuxt_vt",
4    "value": "your-cookie-value-here",
5    "domain": "www.upwork.com",
6    "path": "/",
7    "secure": true,
8    "httpOnly": false
9  },
10  {
11    "name": "xsrf_token",
12    "value": "another-cookie-value",
13    "domain": "www.upwork.com",
14    "path": "/",
15    "secure": true,
16    "httpOnly": false
17  }
18]

Only the name and value fields are required; the others will be filled automatically if not provided.

Example:

1{
2  "query": "web scraping",
3  "cookies": [
4    {
5      "name": "UniversalSearchNuxt_vt",
6      "value": "ABC123XYZ"
7    },
8    {
9      "name": "xsrf_token",
10      "value": "def456uvw"
11    }
12  ]
13}

For detailed information about using cookies, see the COOKIES.md file.

Output Format

After each run, the scraper generates a dataset of Upwork jobs with the following information:

• Job ID and URL: Unique identifiers and direct links to job listings
• Title and Description: Detailed information about what the job entails
• Budget Information: Fixed price amount or hourly rate ranges
• Client Statistics: Total spent, number of hires, feedback scores, etc.
• Job Requirements: Experience level, skills needed, and category
• Posting Time: When the job was published
• Additional Details: Tags, contract type, engagement duration, and more

Technical Details

This scraper is built using:

• TypeScript for type safety and better code organization
• Apify SDK for actor development and data storage
• Cheerio for HTML parsing
• Advanced techniques for handling Cloudflare protection

Supported Filtering Options

Standard Filters

• Experience Levels: Entry Level, Intermediate, Expert

• Job Types: Fixed Price, Hourly Rate

• Client History: No previous hires, 1-9 previous hires, 10+ previous hires

• Maximum Job Age: Filter by minutes, hours, days, or weeks

  Example Maximum Job Age Filter:

  1{
  2  "value": 24,
  3  "unit": "hours"
  4}
  

  This example would filter out jobs older than 24 hours. Supported units are "minutes", "hours", "days", and "weeks".

Custom Filters

Custom filters allow you to filter jobs based on any job property:

• Available Properties:

  • title
  • description
  • jobType
  • experienceLevel
  • budget
  • tags
  • relativeDate
  • absoluteDate

• Available Operators:

  • includes - checks if the value is included in the property
  • equals - checks if the value exactly matches the property
  • notIncludes - checks if the value is not included in the property
  • notEquals - checks if the value does not exactly match the property

• Example Custom Filters:

  1[
  2  {
  3    "key": "title",
  4    "operator": "includes",
  5    "value": "python"
  6  },
  7  {
  8    "key": "experienceLevel",
  9    "operator": "equals",
  10    "value": "Expert"
  11  },
  12  {
  13    "key": "tags",
  14    "operator": "notIncludes",
  15    "value": "wordpress"
  16  }
  17]
  

Supported Regions and Countries Search

The scraper supports filtering jobs from various regions and countries:

Regions

Africa, Americas, Antarctica, Asia, Europe, Oceania, Subregions, Australia and New Zealand, Caribbean, Central America, Central Asia, Eastern Africa, Eastern Asia, Eastern Europe, Melanesia, Micronesia, Middle Africa, Northern Africa, Northern America, Northern Europe, Polynesia, South America, South-Eastern Asia, Southern Africa, Southern Asia, Southern Europe, Western Africa, Western Asia, Western Europe

Countries

The scraper supports filtering jobs from over 200 countries worldwide, including but not limited to: United States, United Kingdom, Canada, Australia, Germany, France, India, Singapore, Japan, Brazil, and many more.