🔥 Indeed Jobs Scraper - Enhanced Edition

The most powerful Indeed job scraper on the market! Extract job listings with NLP-based skill extraction, salary parsing, company enrichment (CEO, revenue, industry), and advanced filtering. Perfect for recruiters, job seekers, market researchers, and lead generation.

🌟 Features

• 🔍 Multi-Search Support: Search multiple keywords × multiple locations in a single run
• 🧠 NLP Skill Extraction: Automatically categorize skills (Languages, Frontend, Backend, Cloud, Databases, Data & ML, Mobile, Tools)
• 🎁 Benefits Detection: Extract benefits (401k, health insurance, remote work, equity, etc.)
• 💰 Salary Parsing: Extracts salary from Indeed data AND parses from job descriptions
• 🏢 Company Enrichment: CEO name/photo, revenue, industry, employee count, logo, website
• 👤 Posted By Filter: Filter jobs by employer (direct) vs staffing agency
• 📊 100+ Data Points: Most comprehensive Indeed data extraction
• 🌍 73 Countries: Global coverage across all Indeed domains
• 🔄 Smart Deduplication: Skip duplicate and similar job postings
• 📧 Email Extraction: Auto-extract contact emails from descriptions
• ⚡ Fast & Reliable: Optimized for speed with TLS fingerprinting

🚀 How to Use

Quick Start: Paste Indeed URL (Recommended)

The easiest way - just search on Indeed and paste the URL:

{
  "startUrls": [
    { "url": "https://www.indeed.com/jobs?q=software+engineer&l=San+Francisco%2C+CA" }
  ],
  "rows": 50
}

Simple Keyword Search

{
  "keyword": "software engineer",
  "location": "New York, NY",
  "country": "us",
  "rows": 100
}

Multi-Search (Keywords × Locations)

Search 3 job titles in 3 cities = 9 searches in one run:

{
  "keywords": ["Software Engineer", "Data Scientist", "Product Manager"],
  "locations": ["San Francisco, CA", "New York, NY", "Austin, TX"],
  "country": "us",
  "rows": 500
}

Advanced Search with All Filters

{
  "keyword": "Python Developer",
  "location": "Remote",
  "country": "us",
  "rows": 200,
  "datePosted": "7d",
  "jobType": "fulltime",
  "remoteType": "remote",
  "postedBy": "employer",
  "experienceLevel": "mid",
  "scrapeCompany": true,
  "extractSkills": true,
  "extractBenefits": true,
  "descriptionFormat": "plain",
  "skipDuplicates": true
}

Multiple Indeed URLs (Different Countries)

{
  "startUrls": [
    { "url": "https://www.indeed.com/jobs?q=developer&l=New+York" },
    { "url": "https://uk.indeed.com/jobs?q=developer&l=London" },
    { "url": "https://de.indeed.com/jobs?q=entwickler&l=Berlin" }
  ],
  "rows": 300
}

⚙️ Input Parameters

Note: You must provide either startUrls, keyword/keywords, OR searchUrl. All other parameters are optional with sensible defaults.

Search Options

Parameter	Type	Required	Description	Prefill/Example
startUrls	Array	⚠️	Indeed URLs from browser (recommended)	[{"url": "https://indeed.com/jobs?q=..."}]
keyword	String	⚠️	Job title or skills to search	"software engineer"
location	String	No	City, state, or zip code	"San Francisco, CA"
country	Enum	No	Indeed domain (default: us)	"us", "uk", "de", "fr" + 69 more
rows	Integer	No	Total jobs to scrape	25 (default)

⚠️ = Provide ONE of: startUrls, keyword, or keywords

Advanced Multi-Search

Parameter	Type	Description
keywords	Array	Multiple keywords (creates N searches)
locations	Array	Multiple locations (creates keyword × location combinations)
maxJobsPerSearch	Integer	Limit per search (useful for balanced results)

Filters

Parameter	Type	Description	Options
datePosted	Enum	Posting recency	"" (Any), "24h", "3d", "7d", "14d"
jobType	Enum	Employment type	"", "fulltime", "parttime", "contract", "temporary", "internship"
remoteType	Enum	Work location	"" (All), "remote", "hybrid"
postedBy	Enum	Job source	"" (All), "employer" (Direct), "staffing_agency"
experienceLevel	Enum	Seniority	"", "entry", "mid", "senior"
easyApply	Boolean	Indeed Easy Apply only	true / false
salaryMin	Integer	Minimum salary filter	50000
salaryMax	Integer	Maximum salary filter	150000
companyNames	Array	Filter by companies	["Google", "Meta"]
excludeWords	Array	Skip jobs with words	["senior", "manager"]
mustIncludeWords	Array	Require words	["python", "remote"]

Data Extraction

Parameter	Type	Default	Description
scrapeCompany	Boolean	true	Include company enrichment (CEO, revenue, industry)
extractSkills	Boolean	true	NLP-based skill categorization
extractBenefits	Boolean	true	Extract benefits from description
extractSalary	Boolean	true	Parse salary from description
enrichCompany	Boolean	true	Add guessed email domain & LinkedIn URL

Output Options

Parameter	Type	Default	Description
outputFormat	Enum	"enriched"	"simple", "full", "enriched"
descriptionFormat	Enum	"html"	"html", "markdown", "plain"
skipDuplicates	Boolean	true	Skip exact duplicate jobs
skipSimilarJobs	Boolean	false	Skip similar jobs (same title/company)
maxJobsPerSearch	Integer	0	Limit per keyword/location combo

📤 Output Format

{
  "id": "abc123xyz",
  "title": "Senior Software Engineer",
  "companyName": "Tech Corp",
  "companyUrl": "https://www.indeed.com/cmp/Tech-Corp",
  "companyWebsite": "https://techcorp.com",
  "companyLogo": "https://d2q79iu7y748jz.cloudfront.net/...",
  "companyHeaderImage": "https://d2q79iu7y748jz.cloudfront.net/...",
  "companyIndustry": "Information Technology",
  "companyDescription": "Leading tech company...",
  "companyRevenue": "$1B to $5B (USD)",
  "companyEmployeesCount": "5,001 to 10,000",
  "companyCEOName": "John Smith",
  "companyCEOPhoto": "https://d2q79iu7y748jz.cloudfront.net/...",
  "companyAddresses": ["San Francisco, CA"],
  "companyEmailDomain": "techcorp.com",
  "companyLinkedIn": "https://www.linkedin.com/company/techcorp",
  "location": "San Francisco, CA 94102",
  "city": "San Francisco",
  "state": "CA",
  "country": "United States",
  "postalCode": "94102",
  "isRemote": true,
  "remoteType": "Hybrid work",
  "jobUrl": "https://www.indeed.com/viewjob?jk=abc123xyz",
  "jobUrlDirect": "https://techcorp.com/careers/apply/123",
  "datePosted": "2025-01-15",
  "salaryMin": 150000,
  "salaryMax": 200000,
  "salaryCurrency": "USD",
  "salaryInterval": "YEARLY",
  "salaryEstimated": false,
  "jobTypes": ["Full-time", "Permanent"],
  "attributes": ["Health insurance", "401(k)", "Remote work"],
  "description": "We are looking for a talented engineer...",
  "emails": ["careers@techcorp.com", "hr@techcorp.com"],
  "skills": [
    {"category": "Languages", "skills": ["Python", "JavaScript", "TypeScript"]},
    {"category": "Backend", "skills": ["Node.js", "Django", "FastAPI"]},
    {"category": "Cloud & DevOps", "skills": ["AWS", "Docker", "Kubernetes"]},
    {"category": "Databases", "skills": ["PostgreSQL", "MongoDB", "Redis"]},
    {"category": "Data & ML", "skills": ["TensorFlow", "PyTorch"]}
  ],
  "benefits": ["Health Insurance", "401k", "Remote Work", "Equity", "PTO", "Parental Leave"],
  "educationLevel": "Bachelor's",
  "yearsExperienceMin": 3,
  "yearsExperienceMax": 5,
  "visaSponsorship": true,
  "indeedApply": false,
  "sponsored": false,
  "urgentlyHiring": false,
  "source": "Tech Corp",
  "searchQuery": "Software Engineer",
  "contentHash": "abc123...",
  "scrapedAt": "2025-01-20T10:30:00Z"
}

🧠 NLP Skill Categories

Skills are automatically extracted and categorized:

Category	Examples
Languages	Python, JavaScript, TypeScript, Java, Go, Rust, C++, Ruby, PHP
Frontend	React, Vue, Angular, Next.js, Svelte, HTML, CSS, Tailwind
Backend	Node.js, Django, FastAPI, Spring Boot, Express, Rails
Cloud & DevOps	AWS, Azure, GCP, Docker, Kubernetes, Terraform, CI/CD
Databases	PostgreSQL, MySQL, MongoDB, Redis, Elasticsearch, DynamoDB
Data & ML	TensorFlow, PyTorch, Pandas, Spark, Hadoop, LLM, NLP
Mobile	React Native, Flutter, Swift, Kotlin, iOS, Android
Tools	Git, Jira, Figma, Postman, REST API, GraphQL

🎁 Detected Benefits

Automatically extracted from job descriptions:

• Health Insurance, Dental, Vision
• 401(k), Pension, Retirement
• Paid Time Off, Vacation
• Remote Work, Work From Home
• Equity, Stock Options, RSU
• Parental Leave, Maternity, Paternity
• Tuition Reimbursement
• Wellness Programs
• Relocation Assistance
• Bonus, Commission
• And many more...

💡 Use Cases

👤 Job Seekers

• Find jobs matching your exact skills
• Filter out staffing agencies for direct employer postings
• Export to CSV/Excel for application tracking
• Monitor new postings with date filters

🏢 Recruiters & HR

• Analyze competitor job postings and salaries
• Benchmark compensation in your industry
• Identify trending skills in your market
• Find companies that are actively hiring

📊 Market Research

• Analyze job market trends by industry
• Study salary distributions by role and location
• Track demand for specific technologies
• Generate hiring trends reports

📈 Sales & Lead Generation

• Find hiring companies (active = growing!)
• Extract company contact information
• Build targeted lead lists by industry
• Identify decision-makers (CEO data)

🎯 Career Services & EdTech

• Identify in-demand skills for curriculum design
• Provide job market insights to students
• Power job recommendation engines
• Analyze education requirements by role

🌍 Supported Countries (73)

North America: United States, Canada, Mexico, Puerto Rico

Europe - Western: United Kingdom, Germany, France, Spain, Italy, Netherlands, Belgium, Switzerland, Austria, Ireland, Portugal, Luxembourg

Europe - Northern: Sweden, Norway, Denmark, Finland

Europe - Eastern: Poland, Czech Republic, Hungary, Romania, Ukraine, Slovakia, Greece, Bulgaria, Croatia, Serbia, Slovenia

Middle East: UAE, Saudi Arabia, Qatar, Kuwait, Bahrain, Oman, Israel, Turkey

Asia - East: Japan, South Korea, Taiwan, Hong Kong, China

Asia - Southeast: Singapore, Malaysia, Indonesia, Thailand, Vietnam, Philippines

Asia - South: India, Pakistan, Bangladesh, Sri Lanka

Oceania: Australia, New Zealand

South America: Brazil, Argentina, Chile, Colombia, Peru, Venezuela, Ecuador, Uruguay

Central America & Caribbean: Costa Rica, Panama

Africa: South Africa, Egypt, Nigeria, Kenya, Morocco, Ghana, Tunisia

💰 Cost Estimation

Configuration	Cost per 1,000 jobs
Basic (no proxy)	~$0.30
With datacenter proxy	~$0.50
With residential proxy (recommended)	~$1.00

💡 Tips for Best Results

1. Use Residential Proxies: Enable Apify residential proxies for highest success rate
2. Start Small: Test with rows: 25 before scaling to thousands
3. Use Posted By Filter: Set postedBy: "employer" to skip staffing agency spam
4. Multi-Search Efficiency: Combine keywords and locations to maximize value
5. Plain Text Descriptions: Use descriptionFormat: "plain" for easier processing
6. Skip Duplicates: Keep skipDuplicates: true to avoid repeat listings

🔧 Proxy Configuration

For best results, use residential proxies:

{
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

📞 Support

Having issues? Check the ../../issues or contact support.

---

Made by SilentFlow