# Indeed Company Scraper (`x.com/apify-indeed-reviews-scrape`) Actor Scrape reviews, salaries, jobs, interviews, company profiles, and FAQ from Indeed in one click. Supports all international Indeed domains with automatic localization. - **URL**: https://apify.com/x.com/apify-indeed-reviews-scrape.md - **Developed by:** [Girma Wakeyo](https://apify.com/x.com) (community) - **Categories:** Jobs, Social media, Lead generation - **Stats:** 2 total users, 1 monthly users, 75.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Indeed Company: Reviews, Jobs, Salary, Interviews, About Scraper Scrape **reviews, salaries, jobs, interviews, company profiles, and FAQ** from [Indeed](https://www.indeed.com) in one click. Transform raw data into recruitment strategies, competitive analysis, and market trends with enterprise-grade HR analytics. Supports **all international Indeed domains** (indeed.com, indeed.fr, indeed.de, etc.) with automatic localization. ### What does this Actor do? This advanced Indeed scraper collects **6 distinct data types** from company profiles: 1. **Company Reviews** - Employee evaluations with ratings, pros/cons, employment status 2. **Job Listings** - Position titles, salaries, descriptions, employment types 3. **Salary Information** - Position-specific compensation, bonus breakdowns, experience-level earnings 4. **Interview Experiences** - Interview questions, process stages, candidate experiences 5. **FAQ Sections** - Common employee questions with official company responses 6. **Company Profiles** - Headquarters, employee count, industry, revenue, mission statements ### Why use this Actor? - **Recruitment Intelligence** - Understand company culture and employee satisfaction before applying - **Competitive Analysis** - Compare salaries and reviews across companies in your industry - **Market Research** - Track hiring trends, salary ranges, and employee sentiment - **HR Analytics** - Build data-driven recruitment strategies based on real employee feedback - **Brand Monitoring** - Track your company's reputation on Indeed over time ### How to use 1. **Create an Apify account** if you don't have one at [apify.com](https://console.apify.com) 2. **Go to the Actor's Input tab** and configure your scraping parameters 3. **Enter Indeed company URLs** - supports `/reviews`, `/jobs`, `/interviews`, `/salaries`, `/faq`, `/about`, and root company pages 4. **Click "Start"** and wait for the results 5. **Download your data** in JSON, CSV, Excel, or HTML format ### Input Configure the scraper via the Input tab. Here's an example JSON input: ```json { "startUrls": [ { "url": "https://www.indeed.com/cmp/Microsoft/reviews" }, { "url": "https://www.indeed.com/cmp/Microsoft/jobs" }, { "url": "https://www.indeed.com/cmp/Microsoft/salaries" }, { "url": "https://www.indeed.com/cmp/Microsoft/interviews" }, { "url": "https://www.indeed.com/cmp/Microsoft/faq" }, { "url": "https://www.indeed.com/cmp/Microsoft/about" }, { "url": "https://uk.indeed.com/cmp/NHS/reviews" }, { "url": "https://de.indeed.com/cmp/Siemens/jobs" } ], "includeReviewStats": false, "includeMoreJobDetails": false, "monitoringModeForReviews": false, "maxItems": 100000, "targetDate": "2024-06-01", "maxConcurrency": 10, "minConcurrency": 1, "maxRequestRetries": 8, "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "FR" } } ```` #### Input Fields | Field | Type | Description | Default | |-------|------|-------------|---------| | `startUrls` | array | Indeed company URLs to scrape | Required | | `includeReviewStats` | boolean | Also scrape review stats from the company page | false | | `includeMoreJobDetails` | boolean | Also scrape more job details from job pages | false | | `monitoringModeForReviews` | boolean | Only collect new reviews not scraped before | false | | `maxItems` | integer | Maximum items per crawl | 100000 | | `targetDate` | string | Scrape data up to this date (YYYY-MM-DD) | "" | | `maxConcurrency` | integer | Parallel page processing (1+) | 10 | | `minConcurrency` | integer | Minimum parallel threads (1-10) | 1 | | `maxRequestRetries` | integer | Retries for failed requests (1+) | 8 | | `proxy` | object | Proxy settings (recommended for Indeed) | Residential FR Apify proxy | ### Output The Actor outputs structured JSON data to a dataset. You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. #### Example Review Output ```json { "type": "review", "companyName": "Microsoft", "reviewTitle": "Great work environment", "reviewBody": "Excellent company with great benefits and work-life balance...", "overallRating": 4.5, "pros": "Good benefits, smart colleagues, interesting projects", "cons": "Can be bureaucratic, work-life balance varies by team", "adviceToManagement": "Listen more to frontline employees", "employmentStatus": "Current Employee", "jobTitle": "Software Engineer", "location": "Redmond, WA", "date": "January 15, 2024", "helpfulCount": 12, "url": "https://www.indeed.com/cmp/Microsoft/reviews", "scrapedAt": "2024-06-15T10:30:00.000Z" } ``` #### Example Job Output ```json { "type": "job", "companyName": "Microsoft", "title": "Senior Software Engineer", "location": "Redmond, WA", "salary": "$150,000 - $200,000 per year", "jobType": "Full-time", "postedDate": "2 days ago", "description": "We are looking for a Senior Software Engineer...", "jobUrl": "https://www.indeed.com/viewjob?jk=abc123", "url": "https://www.indeed.com/cmp/Microsoft/jobs", "scrapedAt": "2024-06-15T10:30:00.000Z" } ``` #### Example Salary Output ```json { "type": "salary", "companyName": "Microsoft", "jobTitle": "Software Engineer", "salary": "$141,020 per year", "location": "Redmond, WA", "url": "https://www.indeed.com/cmp/Microsoft/salaries", "scrapedAt": "2024-06-15T10:30:00.000Z" } ``` ### Data Table | Data Type | Key Fields | |-----------|-----------| | **Reviews** | title, body, rating, pros, cons, employment status, job title, location, date | | **Jobs** | title, location, salary, job type, posted date, description, application URL | | **Salaries** | job title, salary amount, location, category | | **Interviews** | question, answer, job title, location, submission date | | **FAQ** | question, answer, author, date | | **Company Profile** | rating, total reviews, headquarters, employees, industry, revenue, description | ### Pricing The Actor runs on the Apify platform with pay-per-use pricing. Costs depend on: - **Compute units** - based on runtime and memory usage - **Proxy usage** - residential proxies are recommended for Indeed - **Data volume** - number of pages scraped **Tip:** Use `maxItems` and the concurrency settings to control costs. Start with a small test run before scraping large amounts of data. ### Tips & Advanced Options #### Monitoring Mode Enable `monitoringModeForReviews: true` for scheduled runs to only collect new reviews not scraped in previous runs. This is ideal for tracking changes over time. #### Review Stats Enable `includeReviewStats: true` when scraping review pages to add aggregate review statistics, such as overall rating, total reviews, rating distribution, and category ratings when those values are visible on Indeed. #### Job Details Enable `includeMoreJobDetails: true` when scraping job pages to open each job URL and enrich the output with detail-page fields such as full description, benefits, and job detail sections. #### Proxy Configuration Indeed uses Cloudflare protection. Using residential proxies is **strongly recommended**: ```json { "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "FR" } } ``` #### International Domains The scraper supports all Indeed domains: - `www.indeed.com` (US) - `uk.indeed.com` (UK) - `de.indeed.com` (Germany) - `fr.indeed.com` (France) - `ca.indeed.com` (Canada) - And more... #### URL Types The scraper automatically detects the URL type: - `/reviews` → Employee reviews - `/jobs` → Job listings - `/interviews` → Interview experiences - `/salaries` → Salary data - `/faq` → FAQ/Q\&A - `/about` → Company about page - Root `/cmp/Company` → Company profile (discovers and enqueues sub-pages) #### Scheduling Use Apify's scheduling feature to run the scraper automatically: 1. Go to the Actor's Schedules tab 2. Set up a cron job (e.g., daily at 9 AM) 3. Enable monitoring mode for reviews to avoid duplicates ### FAQ #### Is this scraper legal? This scraper extracts publicly available data from Indeed. Users are responsible for ensuring their use complies with Indeed's Terms of Service and applicable laws. We recommend reviewing Indeed's robots.txt and Terms of Service before running large-scale scraping operations. #### Why do I need proxies? Indeed uses Cloudflare protection that blocks automated requests. Residential proxies help bypass these protections by rotating IP addresses and appearing as legitimate user traffic. #### Can I scrape private company pages? No, this scraper only works with publicly accessible company pages on Indeed. #### How accurate is the data? The scraper extracts data as it appears on Indeed. However, Indeed may change their page structure at any time, which could affect extraction accuracy. We recommend testing with small runs first. ### Support - **Issues**: Report bugs or request features via the [Issues tab](https://github.com/your-repo/issues) - **Custom Solutions**: Need a custom scraping solution? Contact us for enterprise support - **Documentation**: [Apify SDK Documentation](https://docs.apify.com/sdk/python) ### Disclaimer This actor is provided as-is for educational and research purposes. Users are solely responsible for ensuring their scraping activities comply with Indeed's Terms of Service, robots.txt, and all applicable laws and regulations. The developer assumes no liability for misuse of this tool. # Actor input Schema ## `startUrls` (type: `array`): URLs to start with. ## `includeReviewStats` (type: `boolean`): If true, the scraper will also scrape review stats from the company page. ## `includeMoreJobDetails` (type: `boolean`): If true, the scraper will also scrape more job details from the job page. ## `monitoringModeForReviews` (type: `boolean`): If checked, it will only scrape newly reviews compared to what has been scraped in previous runs. ## `maxItems` (type: `integer`): Maximum number of items that will be scraped from each start URL ## `targetDate` (type: `string`): The date to filter reviews by (optional, YYYY-MM-DD format). Leave empty or omit to scrape all dates. ## `maxConcurrency` (type: `integer`): Maximum number of pages that can be processed at the same time. ## `minConcurrency` (type: `integer`): Minimum number of pages that will be processed at the same time. ## `maxRequestRetries` (type: `integer`): Number of times the crawler will retry a failed request before giving up. ## `proxy` (type: `object`): Specifies proxy servers that will be used by the scraper in order to hide its origin. For details, see Proxy configuration in README. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.indeed.com/cmp/Microsoft/reviews" } ], "includeReviewStats": false, "includeMoreJobDetails": false, "monitoringModeForReviews": false, "maxItems": 100000, "targetDate": "", "maxConcurrency": 10, "minConcurrency": 1, "maxRequestRetries": 8, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "FR" } } ``` # Actor output Schema ## `dataset` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.indeed.com/cmp/Microsoft/reviews" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("x.com/apify-indeed-reviews-scrape").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.indeed.com/cmp/Microsoft/reviews" }] } # Run the Actor and wait for it to finish run = client.actor("x.com/apify-indeed-reviews-scrape").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.indeed.com/cmp/Microsoft/reviews" } ] }' | apify call x.com/apify-indeed-reviews-scrape --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=x.com/apify-indeed-reviews-scrape", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Indeed Company Scraper", "description": "Scrape reviews, salaries, jobs, interviews, company profiles, and FAQ from Indeed in one click. Supports all international Indeed domains with automatic localization.", "version": "1.1", "x-build-id": "DyDfHNbh5Ue8udh6m" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/x.com~apify-indeed-reviews-scrape/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-x.com-apify-indeed-reviews-scrape", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/x.com~apify-indeed-reviews-scrape/runs": { "post": { "operationId": "runs-sync-x.com-apify-indeed-reviews-scrape", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/x.com~apify-indeed-reviews-scrape/run-sync": { "post": { "operationId": "run-sync-x.com-apify-indeed-reviews-scrape", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "URLs to start with.", "default": [ { "url": "https://www.indeed.com/cmp/Microsoft/reviews" } ], "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "includeReviewStats": { "title": "Include Review Stats when scraping Reviews", "type": "boolean", "description": "If true, the scraper will also scrape review stats from the company page.", "default": false }, "includeMoreJobDetails": { "title": "Include More Job Details when scraping Jobs", "type": "boolean", "description": "If true, the scraper will also scrape more job details from the job page.", "default": false }, "monitoringModeForReviews": { "title": "Run in monitoring mode where only newly reviews compared to previous runs will be scraped", "type": "boolean", "description": "If checked, it will only scrape newly reviews compared to what has been scraped in previous runs.", "default": false }, "maxItems": { "title": "Max number of 'items' to scrape per crawl", "minimum": 1, "type": "integer", "description": "Maximum number of items that will be scraped from each start URL", "default": 100000 }, "targetDate": { "title": "Max Date (so range is from today until Max date)", "type": "string", "description": "The date to filter reviews by (optional, YYYY-MM-DD format). Leave empty or omit to scrape all dates.", "default": "" }, "maxConcurrency": { "title": "Max Concurrency", "minimum": 1, "type": "integer", "description": "Maximum number of pages that can be processed at the same time.", "default": 10 }, "minConcurrency": { "title": "Min Concurrency", "minimum": 1, "type": "integer", "description": "Minimum number of pages that will be processed at the same time.", "default": 1 }, "maxRequestRetries": { "title": "Max Request Retries", "minimum": 1, "type": "integer", "description": "Number of times the crawler will retry a failed request before giving up.", "default": 8 }, "proxy": { "title": "Proxy configuration", "type": "object", "description": "Specifies proxy servers that will be used by the scraper in order to hide its origin. For details, see Proxy configuration in README.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "FR" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```