Talent.com Job Scraper

Description

This scraper extracts job listings from Talent.com, providing structured data for job titles, companies, locations, salaries, and descriptions. It handles pagination and ensures reliable data extraction with multiple fallback mechanisms.

Features

• Extracts job details using structured data schemas
• Supports custom search queries and locations
• Handles pagination across multiple pages
• Includes proxy support for enhanced reliability
• Configurable delays and concurrency for respectful scraping
• Debug mode for troubleshooting

Input Parameters

The scraper accepts the following input parameters:

• searchQuery (string): Keywords for job search, e.g., "developer"
• location (string): City or region, e.g., "Lahore"
• maxItems (number): Maximum number of job items to collect (default: 100)
• maxPages (number): Number of listing pages to visit (default: 3)
• proxyConfiguration (object): Proxy configuration for requests
• delayBetweenRequests (number): Delay in milliseconds between requests (default: 1500)
• maxConcurrency (number): Maximum concurrent requests (default: 3)
• debugMode (boolean): Enable additional logging for debugging

Output

The scraper outputs job data to the default dataset. Each item includes:

{
  "title": "Frontend Developer",
  "company": "Talent Group",
  "location": "Karachi, Pakistan",
  "url": "https://www.talent.com/view?id=xxxx",
  "salary": "PKR 180,000/month",
  "date_posted": "2025-10-18",
  "description_html": "<div>Job details here...</div>",
  "description_text": "Job details here..."
}

Usage

Running on Apify Platform

1. Navigate to the Apify platform and select this actor.
2. Configure the input parameters as needed.
3. Run the actor and monitor the results in the dataset.

Running Locally

1. Ensure the environment is set up for local execution.

2. Provide input via INPUT.json in the project root, e.g.:

   {
     "searchQuery": "developer",
     "location": "Lahore",
     "maxItems": 20,
     "maxPages": 2
   }
   

3. Execute the scraper with the provided input.

Configuration

• Proxy Configuration: Use proxyConfiguration to route requests through proxies, helping avoid rate limits or blocks.
• Rate Limiting: Adjust delayBetweenRequests and maxConcurrency to control request frequency and parallelism.
• Debugging: Set debugMode to true for verbose logging during execution.

Notes

• If encountering access restrictions (e.g., 403 or 429 errors), consider enabling proxy configuration or increasing delays.
• For optimal performance, monitor resource usage and adjust concurrency based on target site response times.
• This scraper is designed for public job listings and should comply with website terms of service.

Troubleshooting

• No results: Verify searchQuery and location parameters.
• Slow performance: Reduce maxConcurrency or increase delayBetweenRequests.
• Errors: Check debug logs if debugMode is enabled.