Fast Indeed Jobs Scraper [Bypass limit of 25 jobs]

Scrape unlimited job listings from Indeed.com with 70+ data fields per job. This actor bypasses Indeed's 25-job display limit and provides comprehensive job market data.

Key Features

• Multi-Query Search: Scrape multiple search queries simultaneously
• Bypass 25-Job Limit: Get hundreds or thousands of jobs per search
• 70+ Data Fields: Extract comprehensive job and company information
• Company Profile Scraping: Get CEO info, founded year, revenue, employee count
• Deduplication Storage: Avoid duplicate jobs across multiple runs
• External Jobs Filter: Filter out Indeed Apply jobs for external listings only
• Advanced Anti-Blocking: Browser fingerprint rotation, session management, smart delays

How to Use

Option 1: Search Queries

Enter job titles/keywords and a location:

{
  "searchQueries": ["software engineer", "data scientist"],
  "location": "San Francisco, CA",
  "maxJobsPerQuery": 100
}

Option 2: Start URLs

Paste Indeed search URLs directly:

{
  "startUrls": [
    { "url": "https://www.indeed.com/jobs?q=Teacher&l=California" }
  ],
  "maxJobsPerQuery": 200
}

Advanced Configuration

{
  "searchQueries": ["product manager"],
  "location": "New York, NY",
  "maxJobsPerQuery": 50,
  "jobType": "fulltime",
  "experienceLevel": "senior_level",
  "postedWithin": 7,
  "remoteOnly": false,
  "onlyExternalJobs": false,
  "includeCompanyDetails": true,
  "storageName": "indeed-jobs-storage",
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
  }
}

Input Parameters

Parameter	Type	Default	Description
searchQueries	string[]	["software engineer"]	Job titles or keywords to search
startUrls	object[]	-	Direct Indeed search URLs
location	string	"United States"	Location (city, state, or country)
maxJobsPerQuery	number	50	Max jobs per search query (up to 1000)
jobType	string	-	fulltime, parttime, contract, internship, temporary
experienceLevel	string	-	entry_level, mid_level, senior_level
postedWithin	number	-	1, 3, 7, or 14 days
radius	number	-	Search radius in miles
salaryMin	number	-	Minimum annual salary (USD)
remoteOnly	boolean	false	Only remote jobs
onlyExternalJobs	boolean	false	Exclude Indeed Apply jobs
includeCompanyDetails	boolean	false	Scrape company profiles
storageName	string	-	Key-value store name for deduplication

Output Fields (70+)

Basic Information

• jobKey - Unique job identifier
• url - Direct link to job posting
• title - Job title
• displayTitle - Display version of title
• normTitle - Normalized title

Company Information

• company - Company name
• companyIdEncrypted - Encrypted company ID
• companyRating - Company rating (1-5)
• companyReviewCount - Number of reviews
• companyUrl - Company profile URL
• companyOverviewLink - Company overview link
• companyReviewLink - Company reviews link
• companyBrandingAttributes.logoUrl - Company logo

Location

• location - Full location string
• formattedLocation - Formatted location
• city - City name
• state - State code
• isRemote - Is remote position
• locationCount - Number of locations

Salary

• salaryText - Salary as displayed
• salary.min - Minimum salary
• salary.max - Maximum salary
• salary.period - yearly, monthly, hourly, etc.
• salary.currency - Currency code
• salary.isEstimate - Is estimated salary
• estimatedSalary - Indeed's salary estimate

Job Details

• description - Full job description (text)
• descriptionHtml - Full description (HTML)
• snippet - Short description snippet
• qualifications - Required qualifications list
• benefits - Benefits list
• jobType - Employment type
• jobTypes - All job types
• taxonomyAttributes - Categories and tags

Posting Info

• postedText - "Posted 3 days ago"
• formattedRelativeTime - Relative posting time
• pubDate - Publication timestamp
• createDate - Creation timestamp

Flags

• isSponsored - Is sponsored listing
• isEasyApply - Has Easy Apply
• indeedApplyEnabled - Indeed Apply enabled
• urgentlyHiring - Urgently hiring flag
• newJob - Recently posted
• expired - Job expired
• highVolumeHiring - High volume hiring

Company Details (when enabled)

• companyDetails.ceo.name - CEO name
• companyDetails.ceo.photoUrls - CEO photos
• companyDetails.founded - Year founded
• companyDetails.revenue - Revenue bracket
• companyDetails.employeeRange - Employee count range
• companyDetails.industry - Industry classification
• companyDetails.headquarters - HQ location
• companyDetails.description - Company description
• companyDetails.totalJobCount - Active job count
• companyDetails.jobCategories - Job category breakdown

Metadata

• scrapedAt - Scrape timestamp
• searchQuery - Original search query
• searchLocation - Original search location

Output Example

{
  "jobKey": "abc123def456",
  "url": "https://www.indeed.com/viewjob?jk=abc123def456",
  "title": "Senior Software Engineer",
  "displayTitle": "Senior Software Engineer",
  "company": "Tech Corp",
  "companyIdEncrypted": "xyz789",
  "companyRating": 4.2,
  "companyReviewCount": 1500,
  "companyUrl": "https://www.indeed.com/cmp/Tech-Corp",
  "companyBrandingAttributes": {
    "logoUrl": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/256x256/..."
  },
  "location": "San Francisco, CA",
  "formattedLocation": "San Francisco, CA",
  "city": "San Francisco",
  "state": "CA",
  "isRemote": false,
  "salaryText": "$150,000 - $200,000 a year",
  "salary": {
    "text": "$150,000 - $200,000 a year",
    "min": 150000,
    "max": 200000,
    "period": "yearly",
    "currency": "USD",
    "isEstimate": false
  },
  "estimatedSalary": {
    "min": 150000,
    "max": 200000,
    "type": "YEARLY",
    "formattedRange": "$150K - $200K a year"
  },
  "jobType": "Full-time",
  "jobTypes": ["Full-time"],
  "description": "We are looking for a Senior Software Engineer to join our team...",
  "descriptionHtml": "<div>We are looking for a Senior Software Engineer...</div>",
  "qualifications": [
    "5+ years of experience in software development",
    "Bachelor's degree in Computer Science or equivalent",
    "Experience with Python, JavaScript, and cloud technologies"
  ],
  "benefits": [
    "Health insurance",
    "401(k) matching",
    "Remote work options",
    "Unlimited PTO"
  ],
  "postedText": "Posted 3 days ago",
  "pubDate": 1706140800000,
  "createDate": 1706140800000,
  "isSponsored": false,
  "isEasyApply": true,
  "indeedApplyEnabled": true,
  "urgentlyHiring": false,
  "newJob": true,
  "scrapedAt": "2024-01-26T12:00:00.000Z",
  "searchQuery": "software engineer",
  "searchLocation": "San Francisco, CA"
}

Deduplication

Use the storageName parameter to track seen jobs across multiple runs:

{
  "searchQueries": ["software engineer"],
  "location": "San Francisco, CA",
  "storageName": "sf-tech-jobs"
}

The scraper will:

1. Load previously seen job keys from the named storage
2. Skip jobs that were already scraped
3. Save new job keys after the run completes

This is perfect for daily/weekly monitoring of job postings without duplicates.

Tips for Best Results

1. Use Residential Proxies: Indeed blocks datacenter IPs aggressively. The default RESIDENTIAL proxy group works best.

2. Reasonable Limits: Start with 50-100 jobs per query. Very large scrapes may trigger more blocks.

3. Enable Deduplication: Use storageName for recurring scrapes to avoid duplicates.

4. External Jobs Filter: Set onlyExternalJobs: true if you only want jobs that link to external career sites.

5. Company Details: Only enable includeCompanyDetails if you need that data - it adds extra requests.

Cost Estimation

Approximate costs using Apify platform:

• ~$0.005 per job (with residential proxies)
• 100 jobs ≈ $0.50
• 1000 jobs ≈ $5.00

Actual costs depend on retry rates and proxy usage.

Integrations

This actor works seamlessly with:

• Webhooks: Get notified when scrapes complete
• Schedules: Run daily/weekly job monitoring
• API: Integrate into your applications
• Zapier/Make: Connect to 1000+ apps

Changelog

v2.0.0 (Current)

• Added company profile scraping
• Added deduplication storage
• Added external jobs filter
• Expanded output to 70+ fields
• Improved anti-blocking with fingerprint rotation
• Added mosaic JSON extraction for faster parsing

v1.0.0

• Initial release with basic job scraping

Support

• Issues: Report bugs or request features on GitHub
• Discord: Join Apify community for help
• Documentation: See Apify docs for platform features

Legal Notice

This actor is provided for educational and research purposes. Ensure your use of scraped data complies with Indeed's Terms of Service and applicable laws.