💼 Indeed Scraper

A powerful Apify Actor that scrapes detailed job listings from Indeed with comprehensive data extraction, keyword search, URL-based scraping, and smart proxy fallback.

✨ Features

• ✅ Keyword Search: Search jobs by position/keywords and location
• ✅ URL-Based Scraping: Scrape from job URLs, company pages, or search URLs
• ✅ Combined Mode: Use both search and URLs together (each limited independently)
• ✅ Multi-Country Support: Support for 60+ countries with country-specific domains
• ✅ Comprehensive Data: Extract position, company, location, salary, job type, description, and more
• ✅ Smart Proxy Fallback: Automatic fallback (no proxy → datacenter → residential with 3 retries)
• ✅ Duplicate Detection: Filter out duplicate job listings
• ✅ Company Details: Extract company ratings and review counts (optional)
• ✅ Apply Links: Extract external application URLs (optional)
• ✅ Real-time Logging: Detailed progress logs with proxy events
• ✅ Error Handling: Robust error handling with automatic retries

📋 Input

JSON Example

{
  "position": "web developer",
  "location": "San Francisco",
  "country": "United States",
  "maxItemsPerSearch": 100,
  "followApplyRedirects": false,
  "parseCompanyDetails": false,
  "saveOnlyUniqueItems": true,
  "startUrls": [
    { "url": "https://www.indeed.com/viewjob?jk=5916e62b577782e7" }
  ],
  "requestDelay": 1,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Input Fields

• position (optional): Positions/keywords for search (e.g., "web developer", "software engineer")
• location (optional): City, zip code or locality for search (e.g., "San Francisco", "New York, NY")
• country (optional, default: "United States"): Country for job search - supports 60+ countries
• maxItemsPerSearch (optional, default: 100): Maximum jobs per search/URL (each limited independently)
• followApplyRedirects (optional, default: false): Follow redirects to get final apply URLs
• parseCompanyDetails (optional, default: false): Extract company rating and reviews
• saveOnlyUniqueItems (optional, default: true): Filter duplicate job listings
• startUrls (optional): List of URLs to scrape (job URLs, company pages, search URLs)
• requestDelay (optional, default: 1): Delay between requests in seconds
• proxyConfiguration (optional): Proxy settings with automatic fallback

📊 Output

JSON Example

{
  "id": "5916e62b577782e7",
  "positionName": "Product Engineer (Frontend)",
  "company": "Relace",
  "location": "San Francisco, CA",
  "salary": null,
  "jobType": ["Full-time"],
  "postedAt": "15 weeks ago",
  "url": "https://www.indeed.com/viewjob?jk=5916e62b577782e7",
  "externalApplyLink": "https://www.indeed.com/applystart?jk=...",
  "rating": null,
  "reviewsCount": 26,
  "description": "About Us Relace is building...",
  "descriptionHTML": "<div>...</div>",
  "scrapedAt": "2026-02-14T12:06:18.917318Z",
  "postingDateParsed": "2025-10-29T04:37:40.749Z",
  "searchInput": {
    "position": "web developer",
    "location": "San Francisco",
    "country": "United States"
  },
  "isExpired": false,
  "success": true
}

🔄 Proxy Strategy

1. No Proxy (default): Direct connection to Indeed
2. Datacenter Proxy: If configured or if no proxy is blocked
3. Residential Proxy: Automatic fallback if datacenter is blocked (with 3 retries)

All proxy events are logged clearly for monitoring.

🚀 How to Use

1. Go to https://console.apify.com
2. Find the actor "indeed-scraper" and click it
3. Configure inputs:
   • Enter position/keywords and location for search
   • OR add Start URLs
   • OR use both together
   • Select country
   • Configure other settings as needed
4. Click Run
5. Monitor logs and access results in OUTPUT tab

🌍 Supported Countries

The actor supports 60+ countries including:

• 🇺🇸 United States
• 🇬🇧 United Kingdom
• 🇨🇦 Canada
• 🇦🇺 Australia
• 🇩🇪 Germany
• 🇫🇷 France
• 🇯🇵 Japan
• 🇮🇳 India
• And 50+ more...

⚠️ Cautions

• Data collected from publicly available sources only
• User responsible for legal compliance
• Respect Indeed's terms of service
• Use appropriate delays between requests

💬 Support

For custom solutions or feature requests, contact us at dev.scraperengine@gmail.com