Job Search Scraper

Overview

The Job Search Scraper is an Apify Actor designed to automate the process of searching for job listings on LinkedIn based on specific keywords and locations. This Actor is ideal for users who want to collect job data in bulk for research, analysis, or automated job search processes.

Input Configuration

Input Parameters

• keyword: (string, required) - The job title or keyword you want to search for.
• location: (string, required) - The location where you're searching for jobs.
• limit: (integer, optional) - The maximum number of job listings to retrieve. Default is 50.

Example Input

1{
2  "keyword": "Data Scientist",
3  "location": "New York",
4  "limit": 100
5}

Actor Behavior

Workflow

1. Initialization: The Actor logs a start message and retrieves input parameters.
2. Job Search: The Actor calls the job_search function, which interacts with LinkedIn to fetch job listings based on the provided keyword and location.
3. Data Handling: The retrieved job listings are pushed to the Apify dataset for further processing or export.
4. Completion: The Actor logs a completion message with the number of jobs found.

Error Handling

• HTTP Errors: The Actor captures and logs any HTTP errors encountered during the job search.
• General Errors: Any other exceptions are logged with a detailed traceback to help identify the issue.

Output Data

The Actor outputs job listings in JSON format. Each job listing includes relevant details such as the job title, company, location, and a link to the job posting.

Example Output

1[
2    {
3        "title": "Senior Data Scientist - Emerging ML",
4        "location": "New York, NY",
5        "link": "https://www.linkedin.com/jobs/view/senior-data-scientist-emerging-ml-at-capital-one-4017086635",
6        "publishedAt": null,
7        "employer": "Capital One",
8        "employerUrl": "https://www.linkedin.com/company/capital-one"
9    {
10        "title": "Senior Data Scientist, AI Foundations",
11        "location": "New York, NY",
12        "link": "https://www.linkedin.com/jobs/view/senior-data-scientist-ai-foundations-at-capital-one-4014658083",
13        "publishedAt": "3 days ago",
14        "employer": "Capital One",
15        "employerUrl": "https://www.linkedin.com/company/capital-one"
16    }
17]

Usage

Scheduling

You can schedule the Actor to run at regular intervals (e.g., daily or weekly) to keep your job listings updated. Use the Apify Scheduler to automate this process.

Integrations

• Webhooks: Set up webhooks to trigger additional actions or notify other systems when the Actor completes its run.
• Data Export: Export the data to various formats (e.g., CSV, JSON) or directly to external systems using Apify's integrations.

Logging and Monitoring

The Actor logs detailed messages throughout its execution, including start and end times, number of jobs retrieved, and any errors encountered. These logs can be viewed in the Apify Console for real-time monitoring.

Troubleshooting

• No Jobs Found: If no jobs are retrieved, consider broadening your search terms or checking for network issues.
• Error Logs: Review the error logs in the Apify Console for any issues during execution.