Indeed Job Scraper

Description

The Indeed Job Scraper is an Apify actor that scrapes job listings from Indeed based on specified search criteria. It retrieves job titles, companies, locations, job descriptions, and other relevant details from Indeed’s search pages, with support for pagination and dynamic input configuration. This actor can be used to gather data on job openings in various industries and locations worldwide.

Input

The input parameters for this actor are defined in input_schema.json. Here’s a breakdown of each parameter:

• searchQuery (string): The job title or keywords to search for on Indeed. Default is "developer".
• location (string): The location to search jobs in, such as a city or region. Default is "New York".
• paginationLimit (integer): The maximum number of pages to scrape. Default is 10.
• indeedUrl (string): The base URL of the Indeed site to scrape (e.g., www.indeed.com for the US, www.indeed.co.uk for the UK). Default is www.indeed.com.

Example Input

1{
2  "searchQuery": "software engineer",
3  "location": "San Francisco",
4  "paginationLimit": 5,
5  "indeedUrl": "www.indeed.com"
6}

Result

The output dataset includes the following fields for each job listing, as specified in dataset_schema.json:

title (string): The title of the job listing. company (string): The name of the company offering the job. location (string): The location of the job. jobLink (string): The URL link to the job listing. responsibilities (array of strings): A list of responsibilities or job description items.

Example Result

1[
2  {
3    "title": "Software Engineer",
4    "company": "Tech Corp",
5    "location": "San Francisco, CA",
6    "jobLink": "https://www.indeed.com/viewjob?jk=12345",
7    "responsibilities": [
8      "Develop and maintain software applications.",
9      "Collaborate with product managers and designers."
10    ]
11  },
12  {
13    "title": "Frontend Developer",
14    "company": "Web Solutions",
15    "location": "San Francisco, CA",
16    "jobLink": "https://www.indeed.com/viewjob?jk=67890",
17    "responsibilities": [
18      "Implement UI/UX designs.",
19      "Work closely with the backend team."
20    ]
21  }
22]

How to Use

Set up your input parameters based on your search needs. Run the actor on Apify or locally with the input. Retrieve the dataset containing job listings that match your criteria. This actor provides valuable data for job market analysis, competitor research, or finding job opportunities directly from Indeed.

Legal

Disclaimer

The Indeed Job Scraper is provided for educational and research purposes. Users are responsible for ensuring that their use of this scraper complies with all applicable laws, regulations, and Indeed's Terms of Service.

Usage of Scraped Data

Data obtained through this scraper is subject to the terms, conditions, and copyright policies set forth by Indeed. Users of this actor must adhere to the following guidelines:

Non-commercial Use: This tool is intended for educational, personal, or non-commercial use. Redistribution or resale of the scraped data without Indeed’s permission may violate their policies and local laws. Respect Robots.txt: Indeed’s robots.txt file specifies the areas of the site they do not permit automated scraping. Users should review and respect these restrictions. Data Privacy: Ensure that data obtained is handled in compliance with applicable data protection and privacy laws, including the GDPR and CCPA, where relevant. Responsibility Users are solely responsible for any legal implications arising from their use of this actor. The creator of this scraper is not liable for any misuse or unauthorized use of the data obtained.

Note: Violating Indeed's terms of service or applicable laws may result in legal consequences, including IP bans or further action from Indeed.