# Shine.com Jobs Scraper (`unfenced-group/shine-scraper`) Actor Scrape job listings from Shine.com โ€” India's top job portal. Keyword + location search, salary (INR), full description, no proxy needed. $1.99/1,000 results. - **URL**: https://apify.com/unfenced-group/shine-scraper.md - **Developed by:** [Unfenced Group](https://apify.com/unfenced-group) (community) - **Categories:** Jobs - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $0.99 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shine.com Jobs Scraper ![Shine.com Jobs Scraper](https://api.apify.com/v2/key-value-stores/lJlifu6C8YQfZMPKE/records/shine-scraper) ![Shine.com Jobs Scraper](https://i.imgur.com/pKLLl47.png) Scrape job listings from [Shine.com](https://www.shine.com) โ€” India's leading job portal with over 40 million registered job seekers and 500,000+ active listings. Extract structured data including job title, company, salary, location, experience level, and full job description. No API key required. --- ### Why this scraper? #### ๐Ÿ” Keyword + Location Search Search by any job title, skill, or keyword and optionally narrow results to a specific Indian city or region โ€” Bangalore, Mumbai, Delhi, Pune, Hyderabad, Chennai, and more. #### ๐Ÿ’ฐ Salary Data Included Shine.com publishes salary ranges for many listings. The scraper returns both the raw salary string and parsed numeric min/max values (in INR) and period (monthly/annual). #### ๐Ÿ“‹ Full Job Descriptions Every listing includes the complete HTML job description, plain text version, and Markdown-formatted version โ€” ready for NLP pipelines, LLM fine-tuning, or structured analysis. #### ๐Ÿ“… Freshness Filtering Use the `daysOld` parameter to limit results to jobs posted within the last N days โ€” ideal for daily monitoring feeds. #### โ™ป๏ธ Cross-Run Deduplication The `skipReposts` option tracks jobs already seen across previous runs (90-day TTL) and skips them โ€” eliminating duplicate processing costs. #### ๐Ÿ”— Custom Start URLs Supply your own Shine.com job-search URLs directly to scrape any combination of keyword and location. --- ### Input parameters | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `searchQuery` | string | `""` | Keyword(s) to search for, e.g. `Python developer`, `marketing manager`. Leave empty to browse all jobs. | | `location` | string | `""` | City or region filter, e.g. `Bangalore`, `Mumbai`, `Pune`. Leave empty for all locations. | | `maxResults` | integer | `100` | Maximum number of listings to return. | | `daysOld` | integer | `0` | Only return jobs posted within this many days. `0` = no age filter. | | `skipReposts` | boolean | `false` | Skip listings already seen in previous runs. | | `requestDelayMs` | integer | `1000` | Minimum delay between requests in milliseconds. | | `respectRobotsTxt` | boolean | `true` | Check robots.txt crawl-delay on startup. | | `startUrls` | array | `[]` | Specific Shine.com job-search URLs to scrape. When provided, `searchQuery` and `location` are ignored. | --- ### Output schema #### Always present | Field | Type | Description | |-------|------|-------------| | `id` | string | Unique Shine.com job ID | | `url` | string | Direct link to the job listing on Shine.com | | `title` | string | Job title | | `company` | string \| null | Employer name | | `companyId` | string \| null | Shine.com internal company identifier | | `locations` | array | All listed cities/regions (can be multiple) | | `city` | string \| null | Primary location (first in `locations` array) | | `experience` | string \| null | Required experience range, e.g. `3 to 7 Yrs` | | `industry` | string \| null | Industry sector | | `keywords` | array | Skills/keywords listed by the employer | | `vacancies` | integer \| null | Number of open positions | | `employmentType` | string \| null | `Regular`, `Contractual`, `Internship`, or `Work from Home` | | `jobType` | string \| null | `Full-time` or `Part-time` | | `contractType` | string \| null | `Permanent` or `Walkin` | | `workMode` | string \| null | `On-site`, `Hybrid`, or `Remote` | | `isTopCompany` | boolean | Whether the posting is from a top-ranked company on Shine.com | | `isEarlyApplicant` | boolean | Whether applying now qualifies as an early applicant | | `applicantCount` | integer \| null | Number of applicants, when disclosed by the platform | | `expiryDate` | string \| null | Listing expiry date (`YYYY-MM-DD`) | | `salaryRaw` | string \| null | Raw salary string as published, e.g. `Rs 14 - 26 Lakh/Yr` | | `salaryMin` | number \| null | Parsed minimum salary in INR | | `salaryMax` | number \| null | Parsed maximum salary in INR | | `salaryCurrency` | string \| null | Currency code, always `INR` when present | | `salaryPeriod` | string \| null | `YEAR` or `MONTH` | | `descriptionHtml` | string \| null | Full job description as HTML | | `descriptionText` | string \| null | Plain-text version of the job description | | `descriptionMarkdown` | string \| null | Markdown-formatted job description | | `publishDate` | string \| null | Posting date (`YYYY-MM-DD`) | | `publishDateISO` | string \| null | Posting date in ISO 8601 format | | `scrapedAt` | string | Timestamp when this record was scraped | | `source` | string | Always `shine.com` | | `contentHash` | string | MD5 fingerprint of the job ID for deduplication | | `isRepost` | boolean | `true` if this job was seen in a previous run | | `originalPublishDate` | string \| null | Date from the first time this job was seen (if `isRepost`) | | `originalUrl` | string \| null | URL from the first time this job was seen (if `isRepost`) | > **Privacy note:** Recruiter emails, phone numbers, and company logo URLs are explicitly excluded from all output. --- ### Sample output ```json { "id": "19049753", "url": "https://www.shine.com/job/c-net-wpf-developer/evoke-hr-solutions-pvt-ltd/19049753", "title": "C .NET WPF Developer", "company": "Evoke HR Solutions Pvt. Ltd.", "companyId": "772469", "locations": ["Bangalore"], "city": "Bangalore", "experience": "3 to 7 Yrs", "industry": "IT Services & Consulting", "keywords": [".net", "mvc", "wpf", "c#", "wpf developer"], "vacancies": 4, "employmentType": "Regular", "jobType": "Full-time", "contractType": "Permanent", "workMode": "On-site", "isTopCompany": false, "isEarlyApplicant": false, "applicantCount": null, "expiryDate": "2026-07-03", "salaryRaw": null, "salaryMin": null, "salaryMax": null, "salaryCurrency": null, "salaryPeriod": null, "descriptionHtml": "

Job Summary

...", "descriptionText": "Job Summary We are looking for a skilled C## .NET Developer...", "descriptionMarkdown": "**Job Summary**\n\nWe are looking for a skilled...", "publishDate": "2026-05-05", "publishDateISO": "2026-05-05T07:41:22.000Z", "scrapedAt": "2026-05-06T12:00:00.000Z", "source": "shine.com", "contentHash": "a3f8c1d2e9b47056", "isRepost": false, "originalPublishDate": null, "originalUrl": null } ```` *** ### Examples #### 1. Search Python developer jobs in Bangalore ```json { "searchQuery": "Python developer", "location": "Bangalore", "maxResults": 200 } ``` #### 2. All finance jobs posted in the last 7 days (nationwide) ```json { "searchQuery": "finance", "daysOld": 7, "maxResults": 500 } ``` #### 3. Custom start URLs โ€” scrape specific search pages ```json { "startUrls": [ { "url": "https://www.shine.com/job-search/data-engineer-jobs-in-pune" }, { "url": "https://www.shine.com/job-search/machine-learning-jobs-in-bangalore" } ], "maxResults": 1000 } ``` #### 4. Daily feed โ€” fresh jobs only, skip reposts ```json { "searchQuery": "software engineer", "location": "Mumbai", "daysOld": 1, "skipReposts": true, "maxResults": 500 } ``` #### 5. Work from home jobs ```json { "searchQuery": "work from home", "maxResults": 300 } ``` *** ### ๐Ÿ’ฐ Pricing **$1.99 per 1,000 results** โ€” you only pay for successfully retrieved listings. Failed retries and filtered reposts are never charged. | Results | Cost | |---------|------| | 100 | ~$0.20 | | 1,000 | ~$1.99 | | 10,000 | ~$19.90 | | 100,000 | ~$199.00 | > Flat-rate alternatives typically charge $29โ€“$49/month regardless of usage. Use the **Max results** cap in the input to control your spend exactly. *** ### Performance | Run size | Approx. time | |----------|-------------| | 100 jobs | ~25 seconds | | 1,000 jobs | ~4 minutes | | 10,000 jobs | ~40 minutes | Performance depends on Shine.com server response times. No proxy required โ€” datacenter IPs are accepted by the platform. *** ### Known limitations - Shine.com is India-focused. Listings are predominantly for the Indian market. - Salary data is only available for listings where the employer has disclosed it. - Individual recruiter contact details (email, phone) are excluded from output per privacy policy. - The `daysOld` filter uses the job's posting timestamp and may include pinned/featured jobs with refreshed dates. - `workMode` reflects the platform's own classification (`jWM` field); the majority of listings are `On-site`. Use `employmentType: "Work from Home"` to filter remote roles. *** ### Technical details - **Source:** shine.com โ€” India's leading job portal (40M+ registered job seekers) - **Architecture:** Direct REST API (`/api/v2/search/simple/`) โ€” no HTML parsing, no buildId dependency - **Memory:** 512 MB - **Repost storage:** KeyValueStore `shine-scraper-job-dedup`, 90-day TTL - **Retry:** Automatic retry on network errors, exponential backoff, 3 attempts per request *** ### Additional services Need a custom actor, additional filters, scheduled runs, or integration support? Send an email to โ€” we build on request. *** *Part of the [Unfenced Group](https://apify.com/unfenced-group) European job board scraper portfolio โ€” 50+ job markets covered.* *Built by [unfenced-group](https://apify.com/unfenced-group) ยท Issues? Open a ticket or send a message.* # Actor input Schema ## `searchQuery` (type: `string`): Keyword(s) to search for, e.g. 'Python developer', 'marketing manager'. Leave empty to browse all jobs. ## `location` (type: `string`): City or region to filter by, e.g. 'Bangalore', 'Mumbai', 'Delhi'. Leave empty for all locations. ## `maxResults` (type: `integer`): Maximum number of job listings to return. ## `daysOld` (type: `integer`): Only return jobs posted within this many days. Set to 0 to disable. ## `skipReposts` (type: `boolean`): Skip job listings already seen in previous runs (requires cross-run deduplication store). ## `requestDelayMs` (type: `integer`): Minimum delay between page requests in milliseconds. Increase to reduce request rate. ## `respectRobotsTxt` (type: `boolean`): Check and log robots.txt crawl-delay on startup. ## `startUrls` (type: `array`): Optional list of specific Shine.com job-search URLs to scrape, e.g. https://www.shine.com/job-search/data-engineer-jobs-in-pune. When provided, searchQuery and location are ignored. ## Actor input object example ```json { "searchQuery": "developer", "location": "Amsterdam", "maxResults": 5, "daysOld": 0, "skipReposts": false, "requestDelayMs": 1000, "respectRobotsTxt": true, "startUrls": [] } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchQuery": "developer", "location": "Amsterdam", "maxResults": 5 }; // Run the Actor and wait for it to finish const run = await client.actor("unfenced-group/shine-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchQuery": "developer", "location": "Amsterdam", "maxResults": 5, } # Run the Actor and wait for it to finish run = client.actor("unfenced-group/shine-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchQuery": "developer", "location": "Amsterdam", "maxResults": 5 }' | apify call unfenced-group/shine-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=unfenced-group/shine-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shine.com Jobs Scraper", "description": "Scrape job listings from Shine.com โ€” India's top job portal. Keyword + location search, salary (INR), full description, no proxy needed. $1.99/1,000 results.", "version": "0.0", "x-build-id": "PrEQI6xbNT3w40Ty3" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/unfenced-group~shine-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-unfenced-group-shine-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/unfenced-group~shine-scraper/runs": { "post": { "operationId": "runs-sync-unfenced-group-shine-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/unfenced-group~shine-scraper/run-sync": { "post": { "operationId": "run-sync-unfenced-group-shine-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchQuery": { "title": "Search query", "type": "string", "description": "Keyword(s) to search for, e.g. 'Python developer', 'marketing manager'. Leave empty to browse all jobs.", "default": "" }, "location": { "title": "Location", "type": "string", "description": "City or region to filter by, e.g. 'Bangalore', 'Mumbai', 'Delhi'. Leave empty for all locations.", "default": "" }, "maxResults": { "title": "Max results", "minimum": 1, "type": "integer", "description": "Maximum number of job listings to return.", "default": 100 }, "daysOld": { "title": "Max age (days)", "minimum": 0, "type": "integer", "description": "Only return jobs posted within this many days. Set to 0 to disable.", "default": 0 }, "skipReposts": { "title": "Skip reposts", "type": "boolean", "description": "Skip job listings already seen in previous runs (requires cross-run deduplication store).", "default": false }, "requestDelayMs": { "title": "Request delay (ms)", "minimum": 500, "type": "integer", "description": "Minimum delay between page requests in milliseconds. Increase to reduce request rate.", "default": 1000 }, "respectRobotsTxt": { "title": "Respect robots.txt", "type": "boolean", "description": "Check and log robots.txt crawl-delay on startup.", "default": true }, "startUrls": { "title": "Start URLs", "type": "array", "description": "Optional list of specific Shine.com job-search URLs to scrape, e.g. https://www.shine.com/job-search/data-engineer-jobs-in-pune. When provided, searchQuery and location are ignored.", "default": [], "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```