# Shine Jobs Scraper - India Hiring Data (`benthepythondev/shine-jobs-scraper`) Actor Scrape Shine.com jobs: title, company, location, experience, salary, skills, posted date and direct job URL. - **URL**: https://apify.com/benthepythondev/shine-jobs-scraper.md - **Developed by:** [Ben](https://apify.com/benthepythondev) (community) - **Categories:** Jobs, Business, Lead generation - **Stats:** 3 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shine Jobs Scraper - India Hiring Data Scrape job listings from **Shine.com** in one run. Get Indian hiring data with job title, company, location, experience range, salary text, skills, posted date and direct job URL from public Shine search pages. Export results to JSON, CSV or Excel, schedule recurring runs, call the actor through the Apify API, or connect the dataset to Google Sheets, Airtable, Clay, HubSpot, Make, Zapier or n8n. ### What is the Shine Jobs Scraper? Shine.com is a major Indian job board used across IT, software, engineering, sales, operations, finance, BPO, support, healthcare and management roles. It is useful for recruiters, sales teams, staffing agencies, market researchers and B2B lead-generation teams that need to monitor which Indian companies are actively hiring and what skills they mention in job ads. This actor turns public Shine.com search-result pages into structured data. Shine renders useful job cards directly in the HTML, including the job title, company, experience, salary, location and skill tags. The actor reads those cards with a lightweight HTTP parser, so it does not need a browser, login, API key or paid unblocker. If Shine ever blocks a cloud IP, the actor also has an optional Apify Residential IN fallback. #### What data does it extract? - **Job title** - role name from the Shine listing. - **Company** - hiring company or recruitment agency. - **Location** - listed city or region. - **Experience** - experience range shown by Shine. - **Salary** - salary text when shown on the card. - **Skills** - skill tags from the search card. - **Posted date** - relative posting age, such as `2 months ago`. - **Direct job URL** - stable Shine listing URL. - **Search URL** - the search page that produced the record. - **Stable ID** - numeric Shine job ID extracted from the URL. ### Input | Field | Type | Description | | --- | --- | --- | | `searchUrls` | array | Shine.com search-result URLs to scrape. | | `keyword` | string | Optional keyword used to build a Shine search URL. | | `location` | string | Optional city or region for keyword search. | | `useResidentialProxy` | boolean | Use Apify Residential IN proxy if needed. | | `proxyCountry` | string | Residential proxy country, normally `IN`. | | `maxResults` | integer | Maximum jobs to return per search. | #### Example input ```json { "searchUrls": ["https://www.shine.com/job-search/python-jobs"], "maxResults": 50 } ```` Keyword and location search: ```json { "keyword": "data analyst", "location": "Pune", "maxResults": 25 } ``` ### Output Each dataset item is one Shine job listing. ```json { "job_id": "19075393", "title": "AI Engineer | Python | Agentic Frameworks | REST APIs | 2+ Years | 8 LPA | Pune", "company": "WHITE HORSE MANPOWER CONSULTANCY (P) LTD", "location": "Pune", "url": "https://www.shine.com/jobs/ai-engineer-python-agentic-frameworks-rest-apis-2-years-8-lpa-pune/white-horse-manpower-consultancy-p-ltd/19075393", "posted": "2 months ago", "experience": "2 to 7 Yrs", "salary": "4.5 - 8 LPA", "skills": ["artificial intelligence", "machine learning", "llm", "langchain"], "search": "https://www.shine.com/job-search/python-jobs" } ``` ### Use cases - **India recruiting** - monitor companies hiring software developers, analysts, managers, support teams and operations roles. - **Skill-demand research** - track Python, Java, AI, cloud, sales, finance or support keywords across Indian job ads. - **Salary intelligence** - collect salary text for roles and locations where Shine exposes pay ranges. - **Lead generation** - identify companies and agencies currently advertising roles. - **Market mapping** - compare hiring demand across Pune, Bengaluru, Hyderabad, Mumbai, Delhi NCR and other Indian hubs. - **Job aggregation** - add Shine jobs to broader India or APAC job datasets. - **Automation** - send new jobs to Sheets, Airtable, Slack, HubSpot, Clay, Make, Zapier or n8n. ### How to use the data Use `job_id` or `url` as the deduplication key. For monitoring, run the actor daily with a small `maxResults` value and compare new IDs against previous runs. For market research, group rows by keyword, location, company, salary text or skills. For sales workflows, enrich companies that repeatedly hire for roles related to your product or service. Shine supports many filters on its website. Apply filters such as location, experience, salary, industry or date posted on Shine, then paste the resulting search URL into `searchUrls`. That keeps the actor flexible without needing a complicated input form. Pair this actor with Naukri, NaukriGulf, Bayt, Foundit, JobsDB, SEEK, StepStone, Reed, Totaljobs and Workable to cover both Indian hiring demand and international job-board coverage. Shine is especially useful for skill-based research because its search cards expose skill tags directly. For lead-generation workflows, treat a fresh Shine posting as a buying-intent signal. Companies hiring developers, analysts, support agents, sales teams or operations staff may need recruiting services, HR tools, payroll, training, IT vendors, cloud services, compliance software, office services or outsourcing partners. The output is intentionally flat so it can be enriched downstream with company domains, emails, phone numbers, funding data or CRM account records. ### FAQ **Does this require a Shine account?** No. It reads public search pages. **Does it use a browser?** No. It uses direct HTTP requests and parses server-rendered job cards. **Can I scrape filtered Shine URLs?** Yes. Paste filtered search URLs into `searchUrls`. **Can I search by keyword and location?** Yes. Use `keyword` and `location`. **Does it include salary?** Yes, when Shine shows salary text on the search card. **Does it include skills?** Yes. The actor extracts the skill tags visible on the search card. **Does it include full job descriptions?** This version focuses on search-result cards for speed and reliability. Detail-page enrichment can be added later if needed. **Why is a residential proxy option included?** It is optional. The direct path is fast, but an India residential fallback is available if cloud IPs are blocked. **Is this useful for lead generation?** Yes. Hiring activity is a strong signal for recruiting, HR tech, payroll, training, B2B SaaS and local services. **How do I avoid duplicates?** Use `job_id` or `url` as the stable key. **Is it legal to scrape Shine.com?** The actor collects publicly available job listing data. You are responsible for using the output lawfully and respecting privacy, employment, anti-spam and platform rules. ### You might also like - [Naukri Jobs Scraper](https://apify.com/benthepythondev/naukri-jobs-scraper) - [Bayt Jobs Scraper](https://apify.com/benthepythondev/bayt-jobs-scraper) - [JobsDB Jobs Scraper](https://apify.com/benthepythondev/jobsdb-jobs-scraper) - [SEEK Jobs Scraper](https://apify.com/benthepythondev/seek-jobs-scraper) - [StepStone Scraper](https://apify.com/benthepythondev/stepstone-scraper) - [Totaljobs Scraper](https://apify.com/benthepythondev/totaljobs-scraper) **Keywords:** Shine scraper, Shine jobs scraper, Shine.com scraper, India jobs scraper, scrape Shine, Indian hiring data, job postings scraper, skill demand data, salary jobs data, recruiting leads, hiring intelligence, Apify jobs scraper. # Actor input Schema ## `searchUrls` (type: `array`): Paste Shine.com search-results URLs. Filter on the site, then copy the URL. Leave empty to use keyword + location below. ## `keyword` (type: `string`): Job title or keyword to search, e.g. python developer. ## `location` (type: `string`): Optional city or region to combine with the keyword, e.g. Pune. ## `useResidentialProxy` (type: `boolean`): Use Apify Residential IN proxy. Leave off for the fast direct path; enable if your run is blocked. ## `proxyCountry` (type: `string`): Residential proxy country for fallback requests. Use IN for Shine.com. ## `maxResults` (type: `integer`): Maximum jobs to return per search URL/keyword. ## Actor input object example ```json { "searchUrls": [ "https://www.shine.com/job-search/python-jobs" ], "useResidentialProxy": false, "proxyCountry": "IN", "maxResults": 25 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchUrls": [ "https://www.shine.com/job-search/python-jobs" ], "useResidentialProxy": false, "proxyCountry": "IN", "maxResults": 25 }; // Run the Actor and wait for it to finish const run = await client.actor("benthepythondev/shine-jobs-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchUrls": ["https://www.shine.com/job-search/python-jobs"], "useResidentialProxy": False, "proxyCountry": "IN", "maxResults": 25, } # Run the Actor and wait for it to finish run = client.actor("benthepythondev/shine-jobs-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchUrls": [ "https://www.shine.com/job-search/python-jobs" ], "useResidentialProxy": false, "proxyCountry": "IN", "maxResults": 25 }' | apify call benthepythondev/shine-jobs-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=benthepythondev/shine-jobs-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shine Jobs Scraper - India Hiring Data", "description": "Scrape Shine.com jobs: title, company, location, experience, salary, skills, posted date and direct job URL.", "version": "1.0", "x-build-id": "JBhxpqI63hSUaPKkc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/benthepythondev~shine-jobs-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-benthepythondev-shine-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/benthepythondev~shine-jobs-scraper/runs": { "post": { "operationId": "runs-sync-benthepythondev-shine-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/benthepythondev~shine-jobs-scraper/run-sync": { "post": { "operationId": "run-sync-benthepythondev-shine-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchUrls": { "title": "Shine search URLs", "type": "array", "description": "Paste Shine.com search-results URLs. Filter on the site, then copy the URL. Leave empty to use keyword + location below.", "items": { "type": "string" } }, "keyword": { "title": "Keyword / job title", "type": "string", "description": "Job title or keyword to search, e.g. python developer." }, "location": { "title": "Location", "type": "string", "description": "Optional city or region to combine with the keyword, e.g. Pune." }, "useResidentialProxy": { "title": "Use residential proxy", "type": "boolean", "description": "Use Apify Residential IN proxy. Leave off for the fast direct path; enable if your run is blocked.", "default": false }, "proxyCountry": { "title": "Proxy country", "type": "string", "description": "Residential proxy country for fallback requests. Use IN for Shine.com.", "default": "IN" }, "maxResults": { "title": "Max results per search", "minimum": 1, "maximum": 2000, "type": "integer", "description": "Maximum jobs to return per search URL/keyword.", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```