OCC Jobs Scraper

Overview

Navigate OCC Mundial, Mexico's premier digital employment marketplace, to amass job market data from Latin America's second-largest economy. This actor scans OCC's extensive listings to extract position details, compensation ranges, employer profiles, and application pathways across Mexican states and industries.

Features

• Mexico's leading job platform with nationwide coverage
• Salary data in MXN with prestaciones (benefits)
• Estado and ciudad geographic categorization
• Nivel de educación and experiencia filtering
• Proxy rotation with automatic fallback (residential → datacenter)
• CAPTCHA detection and session rotation
• Automatic retry on failures with exponential backoff
• Deduplication of results by application URL
• Dataset validation with auto-fix capability

Supported Inputs

Field	Type	Default	Description
keyword	string	"software engineer"	Search terms for job discovery
location	string	"Ciudad de México"	Geographic filter for results
country	string	"MX"	Country code for proxy routing
maxItems	integer	50	Upper limit on extracted listings
proxyEnabled	boolean	true	Toggle proxy rotation on/off
sortBy	string	"relevance"	Result ordering (relevance/date/salary)
jobType	string	""	Employment type filter
experienceLevel	string	""	Seniority level filter
datePosted	string	""	Recency filter (24h/3d/7d/14d/30d)
remoteOnly	boolean	false	Restrict to remote positions only
includeCompanyDetails	boolean	true	Fetch extra company information
includeSalary	boolean	true	Include compensation data

Output Format

Each scraped listing produces a JSON object with these fields:

{
    "jobTitle": "Senior Software Engineer",
    "companyName": "Example Corp",
    "location": "Ciudad de México",
    "salary": "$120,000 - $160,000",
    "jobType": "Full-time",
    "experienceLevel": "Senior",
    "postedDate": "2 days ago",
    "applyUrl": "https://www.occ.com.mx/job/12345",
    "companyUrl": "https://www.occ.com.mx/company/example",
    "description": "We are looking for a skilled engineer...",
    "requirements": ["JavaScript", "Node.js", "React"],
    "benefits": ["Health Insurance", "Remote Work"],
    "sourcePortal": "OCC Mundial",
    "country": "MX",
    "scrapedAt": "2025-01-15T10:30:00.000Z"
}

Proxy Handling

A robust proxy pipeline handles connection failures transparently.

1. Apify Residential Proxy (country-targeted) — First choice for OCC Mundial
2. Apify Residential Proxy (any region) — Fallback if country proxy unavailable
3. Apify Datacenter Proxy — Secondary fallback for cost efficiency
4. Direct Connection — Last resort when all proxies fail

Proxies auto-rotate on each request. Blocked sessions are discarded and replaced automatically.

Retry Logic

Automatic recovery from failures with progressive retry intervals.

• Maximum 5 retries per request
• Fresh browser session on each retry
• Automatic proxy rotation between attempts
• Blocked status codes (401, 403, 429) trigger session refresh
• Configurable request timeout (120 seconds)

Anti-block Handling

Comprehensive stealth configuration keeps the actor under anti-bot radar.

• navigator.webdriver property masked
• Human-like delays between page interactions (2–5 seconds)
• Browser language and plugin fingerprints normalised
• Session pool with automatic rotation on blocks
• CAPTCHA detection with graceful retry
• Rate limit detection (HTTP 429) with backoff

Sample Input

{
    "keyword": "data analyst",
    "location": "Ciudad de México",
    "maxItems": 25,
    "proxyEnabled": true,
    "sortBy": "date",
    "remoteOnly": false
}

Sample Output

{
    "jobTitle": "Data Analyst",
    "companyName": "TechCorp International",
    "location": "Ciudad de México",
    "salary": "Competitive",
    "jobType": "Full-time",
    "experienceLevel": "Mid-level",
    "postedDate": "1 day ago",
    "applyUrl": "https://www.occ.com.mx/job/example-123",
    "companyUrl": "",
    "description": "Seeking a detail-oriented data analyst to join our growing team...",
    "requirements": ["SQL", "Python", "Tableau"],
    "benefits": ["Health Insurance", "Flexible Hours"],
    "sourcePortal": "OCC Mundial",
    "country": "MX",
    "scrapedAt": "2025-01-15T14:22:00.000Z"
}

Usage

Local Development

# Install dependencies
npm install

# Set Apify token (required for proxy)
export APIFY_TOKEN=your_token_here

# Run the actor
npm start

# Validate scraped data
node dataset-validator.js

Apify Platform

# Login to Apify
apify login

# Push actor to platform
apify push

# Run from Apify Console or API

Deployment

1. Ensure all dependencies are installed: npm install
2. Authenticate with Apify: apify login
3. Deploy the actor: apify push
4. Configure input in the Apify Console
5. Schedule runs or trigger via API / webhooks

Limitations

• Results depend on the portal's current HTML structure; layout changes may require selector updates
• Some job details (salary, benefits) may not be available for all listings
• Rate limiting by the portal may reduce throughput during high-volume scrapes
• CAPTCHA challenges may interrupt scraping on heavily protected pages
• OCC Mundial may modify their anti-bot measures, requiring periodic updates
• Maximum items per run is capped at 1000 to prevent excessive resource usage
• Proxy costs apply when using Apify residential or datacenter proxies

Transparent indexed fallback

If the direct public OCC route returns no records, the Actor calls Apify's official Google Search Scraper and returns public OCC job URLs already present in the search index. These records are labelled extractionMethod: "indexed_search_fallback" and extractionStatus: "indexed_listing_only"; unavailable detail fields are left empty rather than invented. The child Actor run consumes additional Apify platform usage and its run ID is exposed as fallbackRunId for traceability.