# Shine Job Scraper - India Job Listings (`blackfalcondata/shine-scraper`) Actor
Scrape structured job listings from shine.com, one of India's largest job portals. Includes salaries, experience and optional recruiter contacts, with incremental monitoring and notifications.
- **URL**: https://apify.com/blackfalcondata/shine-scraper.md
- **Developed by:** [Black Falcon Data](https://apify.com/blackfalcondata) (community)
- **Categories:** Jobs, Lead generation, Automation
- **Stats:** 4 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $0.79 / 1,000 results
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
### What does Shine Job Scraper do?
Shine Job Scraper extracts structured job data from [shine.com](https://shine.com) — including salary data, apply URLs, company metadata, full descriptions, and skill tags. It supports keyword search, location filters, and controllable result limits, so you can run the same query consistently over time.
**New to Apify?** [Sign up free](https://console.apify.com/sign-up?fpr=1h3gvi&fp_sid=ctaplain) and use the included $5 monthly platform credit to test this actor.
### Key features
- **🔔 Notifications** — Telegram, Slack, Discord, WhatsApp Cloud API, and generic webhook out of the box. Pair with incremental for daily new-listing alerts without pipeline glue.
- **🔗 Paste-mode** — paste any shine URL straight from your browser — single-listing pages, search-results URLs, or category SEO URLs. Mix freely with keyword and IDs in the same run; results dedupe by ID.
- **🎯 Batch searches** — pass `["term1", "term2"]` for query, location, or city to batch multiple searches in one run — shared dedup state, single dataset, one Actor-Start charge instead of N.
- **📧 Email + phone extraction** — best-effort regex extraction of contact emails and phone numbers from descriptions — emitted as `extractedEmails[]` and `extractedPhones[]` on every record.
- **🔗 URL + social-profile extraction** — every record carries `extractedUrls[]` plus a structured `socialProfiles { linkedin, twitter, instagram, facebook, youtube, tiktok, github, xing }` parsed from the description.
- **📦 Compact mode** — AI-agent and MCP-friendly payloads with core fields only.
- **✂️ Description truncation** — cap description length with `descriptionMaxLength` to control LLM prompt cost and dataset size — set 0 for full descriptions, or any char-limit to trim.
- **📌 Change classification** — each record carries a `changeType` of NEW / UPDATED / UNCHANGED / REAPPEARED / EXPIRED. Default emits NEW + UPDATED + REAPPEARED; opt into the others with `emitUnchanged` / `emitExpired`. Repost detection flags previously-expired listings that come back.
- **🔌 MCP connectors** — export your results into Notion via Apify's MCP connectors — a clean run-summary page, no glue code. Opt-in via the App connector field; deterministic field-mapping, no AI. Built on Apify's connector framework, so more destinations open up as their catalog grows.
- **📝 Description format selection** — pick a single description representation — `text`, `html`, or `markdown` — and the unused variants are dropped from each record. Halves payload size when your pipeline only consumes one format.
- **♻️ Incremental mode** — recurring runs emit and charge only for listings that are new or whose tracked content changed. First run builds the baseline; subsequent runs emit only NEW / UPDATED / REAPPEARED records (UNCHANGED + EXPIRED opt-in). Saves 80–95% on daily monitoring.
### What data can you extract from shine.com?
Each result includes Core job fields (`jobId`, `jobKey`, `title`, `location`, `locations`, `salaryText`, `salaryMin`, and `salaryMax`, and more), extended fields (`description`, `descriptionText`, `descriptionHtml`, `descriptionMarkdown`, and `descriptionLength`), apply information (`applyUrl`), and company metadata (`company`, `clientCompany`, `companyId`, and `companyLogo`). In standard mode, all fields are always present — unavailable data points are returned as `null`, never omitted. In compact mode, only core fields are returned.
### Input
The main inputs are a search keyword, an optional location filter, and a result limit. Additional filters and options are available in the input schema.
Key parameters:
- **`query`** — Job search keywords. Use JSON array for multi-query.
- **`country`** — Which shine.com market to search. (default: `"IN"`)
- **`location`** — City, state, or region. Use JSON array for multi-location.
- **`startUrls`** — Direct search or job detail URLs.
- **`maxResults`** — Maximum total job listings to return (0 = unlimited). (default: `25`)
- **`maxPages`** — Maximum result pages to fetch per search. (default: `5`)
- **`experience`** — Filter by required years of experience.
- **`salaryBand`** — Filter by annual salary band (Indian Lakh brackets).
- **`experienceFrom`** — Keep only jobs whose required experience overlaps this minimum (in years). Precise range filter applied to each job's parsed experience — finer than the band selector above.
- **`experienceTo`** — Keep only jobs whose required experience overlaps this maximum (in years). Combine with Experience From for an exact range, e.g. 4 to 7 years.
- **`industryId`** — Advanced. Restrict results to a specific industry id (e.g. "18" for IT Services & Consulting).
- **`includeRecruiterContact`** — Add the recruiter's phone and email to each record where the listing provides them. Off by default — these are personal contact details, so enable only if you have a lawful basis to process them. (default: `false`)
- ...and 22 more parameters
### Input examples
**Basic search** — Keyword-driven search with a result cap.
→ Full payload per result — all standard fields populated where the source provides them.
```json
{
"query": "software engineer",
"maxResults": 50
}
````
**Incremental tracking** — Only emit jobs that changed since the previous run with this `stateKey`.
→ First run builds the baseline state. Subsequent runs emit only records that are new or whose tracked content changed. Set `emitUnchanged: true` to include unchanged records as well.
```json
{
"query": "software engineer",
"maxResults": 200,
"incrementalMode": true,
"stateKey": "software-engineer-tracker"
}
```
**Compact output for AI agents** — Return only core fields for AI-agent and MCP workflows.
→ Small payload with the most important fields — ideal for piping into LLMs without token overhead.
```json
{
"query": "software engineer",
"maxResults": 50,
"compact": true
}
```
### Output
Each run produces a dataset of structured job records. Results can be downloaded as JSON, CSV, or Excel from the Dataset tab in Apify Console.
### Example job record
```json
{
"jobId": "5379c011988ca3a900dc7f0a52ec7fd1ac74097d5ab10b0b08a411e8df7f544d",
"jobKey": "19075642",
"title": "Software Engineer",
"company": "Jobsplan Dot Com",
"companyId": "674874",
"location": "Manesar",
"locations": [
"Manesar"
],
"description": "JOB DESCRIPTION Job title: Software Engineer Base location: Manesar Experience: Minimum 3-6 years About the role Development and support for Track and Trace software. Windows application development u...",
"descriptionText": "JOB DESCRIPTION Job title: Software Engineer Base location: Manesar Experience: Minimum 3-6 years About the role Development and support for Track and Trace software. Windows application development u...",
"descriptionHtml": "JOB DESCRIPTION
\r\nJob title: Software Engineer
Base location: Manesar
\r\nExperience: Minimum 3-6 years
\r\nAbout the role
\r\nDevelopment...",
"descriptionMarkdown": "**JOB DESCRIPTION**\n\n\r\n\nJob title: Software Engineer\nBase location: Manesar\n\n\r\n\nExperience: Minimum 3-6 years\n\n\r\n\n**About the role**\n\n\r\n\nDevelopment and support for Track and Trace software.\nWindows a...",
"descriptionLength": 1176,
"employmentType": "FULL_TIME",
"engagementType": "Regular",
"isWalkin": false,
"experienceLabel": "2 to 7 Yrs",
"experienceMinYears": 2,
"experienceMaxYears": 7,
"industry": "Automation",
"skills": [
"software support",
"software development",
"software engineer"
],
"vacancies": 1,
"postedAt": "2026-05-20T00:00:00",
"validThrough": "2026-07-19T00:00:00",
"canonicalUrl": "https://www.shine.com/jobs/software-engineer/jobsplan-dot-com/19075642",
"applyUrl": "https://www.shine.com/jobs/software-engineer/jobsplan-dot-com/19075642",
"sourceUrl": "https://www.shine.com/jobs/software-engineer/jobsplan-dot-com/19075642",
"sourceCountry": "IN",
"sourceDomain": "www.shine.com",
"searchQuery": "software engineer",
"searchUrl": "https://www.shine.com/job-search/software-engineer-jobs",
"fetchedAt": "2026-07-16T10:43:40.379Z",
"contentQuality": "full",
"contentHash": "8a42387a62bcca2ce3c718bdda1dea998d898f16de048003341e569a76982dd3"
}
```
### Incremental fields
When incremental mode is on, each record also carries:
- `changeType` — one of `NEW`, `UPDATED`, `UNCHANGED`, `REAPPEARED`, `EXPIRED`. Default output covers `NEW` / `UPDATED` / `REAPPEARED`; set `emitUnchanged: true` or `emitExpired: true` to opt into the others.
- `firstSeenAt`, `lastSeenAt` — ISO-8601 timestamps tracking the listing across runs.
- `isRepost`, `repostOfId`, `repostDetectedAt` — populated when a new listing matches the tracked content of a previously expired one. Set `skipReposts: true` to drop detected reposts from the output.
### How to scrape shine.com
1. Go to [Shine Job Scraper](https://apify.com/blackfalcondata/shine-scraper?fpr=1h3gvi) in Apify Console.
2. Enter a search keyword and optional location filter.
3. Set `maxResults` to control how many results you need.
4. Click **Start** and wait for the run to finish.
5. Export the dataset as JSON, CSV, or Excel.
### Use cases
- Extract job data from shine.com for market research and competitive analysis.
- Track salary trends across regions and categories over time.
- Monitor new and changed jobs on scheduled runs without processing the full dataset every time.
- Auto-apply or feed apply URLs into your ATS / hiring pipeline.
- Research company hiring patterns, employer profiles, and industry distribution.
- Feed structured data into AI agents, MCP tools, and automated pipelines using compact mode.
- Export clean, structured data to dashboards, spreadsheets, or data warehouses.
- Analyze skill demand across listings using structured skill tags.
### How much does it cost to scrape shine.com?
Shine Job Scraper uses [pay-per-event](https://docs.apify.com/platform/actors/paid-actors/pay-per-event) pricing. You pay a small fee when the run starts and then for each result that is actually produced.
- **Run start:** $0.0005 per run
- **Per result:** $0.00079 per job record
Example costs:
- 10 results: **$0.0084**
- 25 results: **$0.02**
- 100 results: **$0.08**
- 200 results: **$0.16**
- 500 results: **$0.4**
#### Example: recurring monitoring savings
These examples compare full re-scrapes with incremental runs at different churn rates. Churn is the share of jobs that are new or whose tracked content changed since the previous run. Actual churn depends on your query breadth, source activity, and polling frequency — the scenarios below are examples, not predictions.
Example setup: 100 results per run, daily polling (30 runs/month). Event-pricing examples scale linearly with result count.
| Churn rate | Full re-scrape run cost | Incremental run cost | Savings vs full re-scrape | Monthly cost after baseline |
|---|---:|---:|---:|---:|
| 5% — stable niche query | $0.08 | $0.00445 | $0.08 (94%) | $0.13 |
| 15% — moderate broad query | $0.08 | $0.01 | $0.07 (84%) | $0.37 |
| 30% — high-volume aggregator | $0.08 | $0.02 | $0.06 (70%) | $0.73 |
Full re-scrape monthly cost at daily polling: $2.39. First month with incremental costs $0.21 / $0.44 / $0.78 for the 5% / 15% / 30% scenarios because the first run builds baseline state at full cost before incremental savings apply.
Platform usage is included in the per-result fee shown above.
### FAQ
#### How many results can I get from shine.com?
The number of results depends on the search query and available jobs on shine.com. Use the `maxResults` parameter to control how many results are returned per run.
#### Does Shine Job Scraper support recurring monitoring?
Yes. Enable incremental mode to only receive new or changed jobs on subsequent runs. This is ideal for scheduled monitoring where you want to track changes over time without re-processing the full dataset.
#### Can I integrate Shine Job Scraper with other apps?
Yes. Shine Job Scraper works with Apify's [integrations](https://apify.com/integrations?fpr=1h3gvi) to connect with tools like Zapier, Make, Google Sheets, Slack, and more. You can also use webhooks to trigger actions when a run completes.
#### Can I use Shine Job Scraper with the Apify API?
Yes. You can start runs, manage inputs, and retrieve results programmatically through the [Apify API](https://docs.apify.com/api/v2). Client libraries are available for JavaScript, Python, and other languages.
#### Can I use Shine Job Scraper through an MCP Server?
Yes. Apify provides an [MCP Server](https://apify.com/apify/actors-mcp-server?fpr=1h3gvi) that lets AI assistants and agents call this actor directly. Use compact mode, `descriptionMaxLength`, a single `descriptionFormat`, and `excludeEmptyFields` to keep payloads manageable for LLM context windows.
#### Is it legal to scrape shine.com?
This actor extracts publicly available data from shine.com. Web scraping of public information is generally considered legal, but you should always review the target site's terms of service and ensure your use case complies with applicable laws and regulations, including GDPR where relevant.
#### Your feedback
If you have questions, need a feature, or found a bug, please [open an issue](https://apify.com/blackfalcondata/shine-scraper/issues?fpr=1h3gvi) on the actor's page in Apify Console. Your feedback helps us improve.
### You might also like
- [⚡ LinkedIn Job Scraper — Salary, Company & No Cookies](https://apify.com/blackfalcondata/linkedin-job-scraper?fpr=1h3gvi) — 💰 $0.27 per 1,000 jobs ✅ Scrape linkedin.com job postings without login or cookies: salary, skills.
- [Actiris Brussels Job Scraper](https://apify.com/blackfalcondata/actiris-scraper?fpr=1h3gvi) — Scrape all active job listings from actiris.brussels — official Brussels public employment service..
- [AMS Austria Job Scraper — Austrian Public Employment Service](https://apify.com/blackfalcondata/ams-austria-job-scraper?fpr=1h3gvi) — Scrape jobs.ams.at — Austria's official AMS public employment portal, branded "alle jobs" ("all.
- [APEC.fr Scraper - French Executive Jobs](https://apify.com/blackfalcondata/apec-scraper?fpr=1h3gvi) — Scrape apec.fr - French executive job listings with salary ranges, company, location, skills,.
- [Arbeitsagentur Jobs Feed — German Federal Employment Agency](https://apify.com/blackfalcondata/arbeitsagentur-jobs-feed?fpr=1h3gvi) — Scrape arbeitsagentur.de — Germany's official public employment portal with over 1 million live job.
- [Arbetsformedlingen Job Scraper](https://apify.com/blackfalcondata/arbetsformedlingen-scraper?fpr=1h3gvi) — Scrape arbetsformedlingen.se (Platsbanken) — Sweden's official employment portal. Returns 84.
- [Bayt.com Scraper — MENA Jobs with Salary & Skills Filter](https://apify.com/blackfalcondata/bayt-scraper?fpr=1h3gvi) — Scrape bayt.com — the leading Middle East job board spanning UAE, Saudi Arabia, Qatar, Egypt.
- [BestJobs.eu Scraper — Romania job board](https://apify.com/blackfalcondata/bestjobs-eu-scraper?fpr=1h3gvi) — Scrape job listings from BestJobs.eu, a leading Romanian job board. Export salary ranges, remote.
### Getting started with Apify
New to Apify? [Create a free account with $5 credit](https://console.apify.com/sign-up?fpr=1h3gvi\&fp_sid=ctaplain) — no credit card required.
1. Sign up — $5 platform credit included
2. Open this actor and configure your input
3. Click **Start** — export results as JSON, CSV, or Excel
Need more later? [See Apify pricing](https://apify.com/pricing?fpr=1h3gvi).
# Actor input Schema
## `query` (type: `string`):
Job search keywords. Use JSON array for multi-query.
## `country` (type: `string`):
Which shine.com market to search.
## `location` (type: `string`):
City, state, or region. Use JSON array for multi-location.
## `startUrls` (type: `array`):
Direct search or job detail URLs.
## `maxResults` (type: `integer`):
Maximum total job listings to return (0 = unlimited).
## `maxPages` (type: `integer`):
Maximum result pages to fetch per search.
## `experience` (type: `string`):
Filter by required years of experience.
## `salaryBand` (type: `string`):
Filter by annual salary band (Indian Lakh brackets).
## `experienceFrom` (type: `integer`):
Keep only jobs whose required experience overlaps this minimum (in years). Precise range filter applied to each job's parsed experience — finer than the band selector above.
## `experienceTo` (type: `integer`):
Keep only jobs whose required experience overlaps this maximum (in years). Combine with Experience From for an exact range, e.g. 4 to 7 years.
## `industryId` (type: `string`):
Advanced. Restrict results to a specific industry id (e.g. "18" for IT Services & Consulting).
## `includeRecruiterContact` (type: `boolean`):
Add the recruiter's phone and email to each record where the listing provides them. Off by default — these are personal contact details, so enable only if you have a lawful basis to process them.
## `descriptionMaxLength` (type: `integer`):
Truncate description to this many characters. 0 = no truncation.
## `compact` (type: `boolean`):
Output only core fields (for AI-agent/MCP workflows).
## `incrementalMode` (type: `boolean`):
Compare against previous run state and return only new or changed listings. stateKey is optional — it defaults to a stable key derived from your search inputs (query, location, filters) so different searches never share state.
## `stateKey` (type: `string`):
Optional. Stable identifier for the tracked search universe (e.g. "us-software-nyc"). Leave empty to auto-generate from search inputs.
## `emitUnchanged` (type: `boolean`):
When incremental, also emit records that haven't changed.
## `emitExpired` (type: `boolean`):
When incremental, also emit records no longer found.
## `skipReposts` (type: `boolean`):
When incremental, skip jobs whose content matches an expired job from a prior run (cross-run repost detection).
## `telegramToken` (type: `string`):
Telegram bot token (from @BotFather). Required for Telegram notifications.
## `telegramChatId` (type: `string`):
Telegram chat or channel ID (e.g. "-100123456789"). Required when telegramToken is set.
## `discordWebhookUrl` (type: `string`):
Discord incoming webhook URL. Server Settings → Integrations → Webhooks → New Webhook.
## `slackWebhookUrl` (type: `string`):
Slack incoming webhook URL. api.slack.com/messaging/webhooks.
## `notificationLimit` (type: `integer`):
Maximum number of jobs included in each notification message (1–20).
## `notifyOnlyChanges` (type: `boolean`):
When Incremental Mode is on, only send notifications for NEW and UPDATED jobs. Has no effect outside incremental mode.
## `whatsappAccessToken` (type: `string`):
WhatsApp Cloud API permanent access token (System User token from Meta Business). Recipient must have messaged the business number within the last 24h (service-conversation window — free since Nov 2024).
## `whatsappPhoneNumberId` (type: `string`):
Your WhatsApp Business phone-number ID (numeric, from Meta dashboard). Required when whatsappAccessToken is set.
## `whatsappTo` (type: `string`):
Recipient phone in E.164 format without + (e.g. "436641234567"). Recipient must have messaged your business number within last 24h.
## `webhookUrl` (type: `string`):
Receives a JSON POST with {metadata, items} after each run. Universal escape hatch for n8n / Make / Zapier / custom backends.
## `webhookHeaders` (type: `object`):
Optional JSON object of custom headers (e.g. {"Authorization":"Bearer ..."}).
## `descriptionFormat` (type: `string`):
Pick a single description representation. `all` keeps every variant; `text` / `html` / `markdown` drop the others.
## `excludeEmptyFields` (type: `boolean`):
Drop null, empty-string, and empty-array fields from each record before push. Smaller payloads for AI agents and dashboards.
## `appConnector` (type: `string`):
Optional. Pick a connected app under Settings → API & Integrations to receive your results (including any contact details). Best-effort across MCP connectors as Apify expands its catalog.
## `mcpIssueTeam` (type: `string`):
Only when the connected app is an issue tracker: the team (name or ID) the summary issue is created under, if that app requires one.
## Actor input object example
```json
{
"query": "software engineer",
"country": "IN",
"maxResults": 5,
"maxPages": 5,
"includeRecruiterContact": false,
"descriptionMaxLength": 0,
"compact": false,
"incrementalMode": false,
"emitUnchanged": false,
"emitExpired": false,
"skipReposts": false,
"notificationLimit": 5,
"notifyOnlyChanges": false,
"descriptionFormat": "all",
"excludeEmptyFields": false
}
```
# Actor output Schema
## `results` (type: `string`):
No description
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"query": "software engineer",
"maxResults": 5,
"descriptionFormat": "all",
"excludeEmptyFields": false
};
// Run the Actor and wait for it to finish
const run = await client.actor("blackfalcondata/shine-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"query": "software engineer",
"maxResults": 5,
"descriptionFormat": "all",
"excludeEmptyFields": False,
}
# Run the Actor and wait for it to finish
run = client.actor("blackfalcondata/shine-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"query": "software engineer",
"maxResults": 5,
"descriptionFormat": "all",
"excludeEmptyFields": false
}' |
apify call blackfalcondata/shine-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=blackfalcondata/shine-scraper",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Shine Job Scraper - India Job Listings",
"description": "Scrape structured job listings from shine.com, one of India's largest job portals. Includes salaries, experience and optional recruiter contacts, with incremental monitoring and notifications.",
"version": "0.1",
"x-build-id": "iVSqPZKj39JBHjFEW"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/blackfalcondata~shine-scraper/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-blackfalcondata-shine-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/blackfalcondata~shine-scraper/runs": {
"post": {
"operationId": "runs-sync-blackfalcondata-shine-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/blackfalcondata~shine-scraper/run-sync": {
"post": {
"operationId": "run-sync-blackfalcondata-shine-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"properties": {
"query": {
"title": "🔍 Search Term(s)",
"type": "string",
"description": "Job search keywords. Use JSON array for multi-query."
},
"country": {
"title": "🌍 Country",
"enum": [
"IN"
],
"type": "string",
"description": "Which shine.com market to search.",
"default": "IN"
},
"location": {
"title": "📍 Location",
"type": "string",
"description": "City, state, or region. Use JSON array for multi-location."
},
"startUrls": {
"title": "🔗 Start URLs",
"type": "array",
"description": "Direct search or job detail URLs.",
"items": {
"type": "string"
}
},
"maxResults": {
"title": "💯 Max Results",
"minimum": 0,
"maximum": 1000,
"type": "integer",
"description": "Maximum total job listings to return (0 = unlimited).",
"default": 25
},
"maxPages": {
"title": "📄 Max Pages",
"minimum": 1,
"maximum": 50,
"type": "integer",
"description": "Maximum result pages to fetch per search.",
"default": 5
},
"experience": {
"title": "🧑💼 Experience",
"enum": [
"<1",
"1-2",
"3-5",
"6-8",
"9-10",
"11-15",
">15"
],
"type": "string",
"description": "Filter by required years of experience."
},
"salaryBand": {
"title": "💰 Salary Band",
"enum": [
"up-to-2L",
"3-5L",
"6-8L",
"9-12L",
"13-16L",
"17-25L",
">25L"
],
"type": "string",
"description": "Filter by annual salary band (Indian Lakh brackets)."
},
"experienceFrom": {
"title": "🧭 Experience From (years)",
"minimum": 0,
"maximum": 50,
"type": "integer",
"description": "Keep only jobs whose required experience overlaps this minimum (in years). Precise range filter applied to each job's parsed experience — finer than the band selector above."
},
"experienceTo": {
"title": "🧭 Experience To (years)",
"minimum": 0,
"maximum": 50,
"type": "integer",
"description": "Keep only jobs whose required experience overlaps this maximum (in years). Combine with Experience From for an exact range, e.g. 4 to 7 years."
},
"industryId": {
"title": "🏭 Industry ID",
"type": "string",
"description": "Advanced. Restrict results to a specific industry id (e.g. \"18\" for IT Services & Consulting)."
},
"includeRecruiterContact": {
"title": "📇 Include Recruiter Contact",
"type": "boolean",
"description": "Add the recruiter's phone and email to each record where the listing provides them. Off by default — these are personal contact details, so enable only if you have a lawful basis to process them.",
"default": false
},
"descriptionMaxLength": {
"title": "✂️ Description Max Length",
"minimum": 0,
"type": "integer",
"description": "Truncate description to this many characters. 0 = no truncation.",
"default": 0
},
"compact": {
"title": "📦 Compact Output",
"type": "boolean",
"description": "Output only core fields (for AI-agent/MCP workflows).",
"default": false
},
"incrementalMode": {
"title": "♻️ Incremental Mode",
"type": "boolean",
"description": "Compare against previous run state and return only new or changed listings. stateKey is optional — it defaults to a stable key derived from your search inputs (query, location, filters) so different searches never share state.",
"default": false
},
"stateKey": {
"title": "🔑 State Key",
"type": "string",
"description": "Optional. Stable identifier for the tracked search universe (e.g. \"us-software-nyc\"). Leave empty to auto-generate from search inputs."
},
"emitUnchanged": {
"title": "♻️ Emit Unchanged Records",
"type": "boolean",
"description": "When incremental, also emit records that haven't changed.",
"default": false
},
"emitExpired": {
"title": "⚰️ Emit Expired Records",
"type": "boolean",
"description": "When incremental, also emit records no longer found.",
"default": false
},
"skipReposts": {
"title": "🚫 Skip Reposts",
"type": "boolean",
"description": "When incremental, skip jobs whose content matches an expired job from a prior run (cross-run repost detection).",
"default": false
},
"telegramToken": {
"title": "🔑 Telegram Bot Token",
"type": "string",
"description": "Telegram bot token (from @BotFather). Required for Telegram notifications."
},
"telegramChatId": {
"title": "💬 Telegram Chat ID",
"type": "string",
"description": "Telegram chat or channel ID (e.g. \"-100123456789\"). Required when telegramToken is set."
},
"discordWebhookUrl": {
"title": "🎮 Discord Webhook URL",
"type": "string",
"description": "Discord incoming webhook URL. Server Settings → Integrations → Webhooks → New Webhook."
},
"slackWebhookUrl": {
"title": "💼 Slack Webhook URL",
"type": "string",
"description": "Slack incoming webhook URL. api.slack.com/messaging/webhooks."
},
"notificationLimit": {
"title": "📊 Max Jobs Per Notification",
"minimum": 1,
"maximum": 20,
"type": "integer",
"description": "Maximum number of jobs included in each notification message (1–20).",
"default": 5
},
"notifyOnlyChanges": {
"title": "🔄 Notify Only New/Updated",
"type": "boolean",
"description": "When Incremental Mode is on, only send notifications for NEW and UPDATED jobs. Has no effect outside incremental mode.",
"default": false
},
"whatsappAccessToken": {
"title": "📱 WhatsApp Access Token",
"type": "string",
"description": "WhatsApp Cloud API permanent access token (System User token from Meta Business). Recipient must have messaged the business number within the last 24h (service-conversation window — free since Nov 2024)."
},
"whatsappPhoneNumberId": {
"title": "📞 WhatsApp Phone Number ID",
"type": "string",
"description": "Your WhatsApp Business phone-number ID (numeric, from Meta dashboard). Required when whatsappAccessToken is set."
},
"whatsappTo": {
"title": "📲 WhatsApp Recipient",
"type": "string",
"description": "Recipient phone in E.164 format without + (e.g. \"436641234567\"). Recipient must have messaged your business number within last 24h."
},
"webhookUrl": {
"title": "🪝 Generic Webhook URL",
"type": "string",
"description": "Receives a JSON POST with {metadata, items} after each run. Universal escape hatch for n8n / Make / Zapier / custom backends."
},
"webhookHeaders": {
"title": "📋 Webhook Headers",
"type": "object",
"description": "Optional JSON object of custom headers (e.g. {\"Authorization\":\"Bearer ...\"})."
},
"descriptionFormat": {
"title": "Description format",
"enum": [
"all",
"text",
"html",
"markdown"
],
"type": "string",
"description": "Pick a single description representation. `all` keeps every variant; `text` / `html` / `markdown` drop the others.",
"default": "all"
},
"excludeEmptyFields": {
"title": "Exclude empty fields from output",
"type": "boolean",
"description": "Drop null, empty-string, and empty-array fields from each record before push. Smaller payloads for AI agents and dashboards.",
"default": false
},
"appConnector": {
"title": "Send results to a connected app",
"type": "string",
"description": "Optional. Pick a connected app under Settings → API & Integrations to receive your results (including any contact details). Best-effort across MCP connectors as Apify expands its catalog."
},
"mcpIssueTeam": {
"title": "Issue tracker team",
"type": "string",
"description": "Only when the connected app is an issue tracker: the team (name or ID) the summary issue is created under, if that app requires one."
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```