# Shiksha.com College Scraper — India Education Data (`fervent_bus/shiksha`) Actor Scrape Indian college data from Shiksha.com — fees, placements, rankings, ratings, approvals and admissions for 23,000+ colleges. Filter by stream, course and city. Structured JSON for AI agents, RAG pipelines and comparison tools. The only Shiksha.com scraper on Apify. - **URL**: https://apify.com/fervent\_bus/shiksha.md - **Developed by:** [Archit Khurana](https://apify.com/fervent_bus) (community) - **Categories:** AI, Developer tools, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $4.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shiksha.com College Scraper — India Education Data The only Apify actor for [Shiksha.com](https://www.shiksha.com) — India's largest college discovery platform backed by InfoEdge (Naukri.com). Scrape structured data on **23,000+ colleges** and **170,000+ courses** including fees, rankings, placements, ratings, approvals and admission requirements. Search by stream, course and city across all of India. ### Who This Is For - **EdTech companies** building college comparison tools and recommendation engines - **Admission consultants** researching college data for students - **Study abroad agencies** tracking Indian institutions and their rankings - **Coaching institutes** monitoring competition and placement trends - **Market researchers** tracking the Indian education sector - **AI agents** answering college admission questions with real-time data ### What Data You Get | Field | Description | |-------|-------------| | College name | Full institution name | | College type | Government, Private, or Deemed | | Annual fees | Average fees per year | | Total course fees | Complete course fee amount | | Average placement package | Mean salary offered to graduates | | Highest placement package | Top salary offered | | Shiksha rating | Rating out of 10 | | Review count | Number of student reviews | | Approvals | AICTE, UGC, NBA, NAAC accreditations | | Affiliated university | University affiliation | | Established year | Year the college was founded | | Top recruiters | Companies that hire from the college | | Entrance exams | Admission process and exams accepted | | Hostel availability | Whether hostel is available | ### Supported Streams Engineering (B.Tech), MBA/PGDM, Medical (MBBS), Law (LLB), BBA, BCA, Design, Animation, Mass Communication, Science, Commerce, Arts and all other streams listed on Shiksha.com. ### Example Input ```json { "stream": "engineering", "city": "bangalore", "course": "b-tech", "maxResults": 100 } ```` #### Input Parameters | Parameter | Type | Required | Description | |-----------|------|----------|-------------| | `stream` | string | Yes | Education stream — engineering, mba, medical, law, bba, design, animation | | `city` | string | No | Indian city — bangalore, mumbai, delhi, hyderabad, pune. Leave empty for all India | | `course` | string | No | Specific course — b-tech, mba, mbbs, llb, bba, bca. Leave empty for all courses | | `maxResults` | integer | No | Maximum colleges to scrape (default: 50) | | `proxyConfiguration` | object | No | Apify proxy settings. Residential proxies recommended | ### Example Output ```json { "collegeName": "Indian Institute of Science Bangalore", "collegeUrl": "https://www.shiksha.com/university/indian-institute-of-science-iisc-bangalore-3031", "city": "Bangalore", "state": "Karnataka", "stream": "engineering", "course": "b-tech", "collegeType": "Government", "ranking": 1, "avgFeesPerYear": "₹50,000", "totalFees": "₹2,00,000", "placementAvgPackage": "₹18 LPA", "placementHighestPackage": "₹1.2 CPA", "rating": 9.2, "reviewCount": 1247, "approvedBy": ["AICTE", "UGC", "NBA"], "affiliation": "Autonomous", "establishedYear": 1909, "collegeWebsite": "https://www.iisc.ac.in", "admissionProcess": "JEE Advanced, GATE", "topRecruiters": ["Google", "Microsoft", "Amazon"], "hostelAvailable": true, "scrapedAt": "2025-01-15T10:30:00Z" } ``` ### Use Cases #### Scrape Engineering Colleges in India with Fees Get a complete database of engineering colleges across India with fee structures, placement data and rankings for building comparison platforms. #### MBA College Data India Extract MBA/PGDM college listings with average placement packages, top recruiters and admission requirements for business school research. #### College Admission Data India Scrape admission processes, entrance exams accepted, cutoffs and approval status for Indian colleges across all streams. #### Education Data India — EdTech Database Build a comprehensive Indian college database for EdTech products, study-abroad counseling platforms and AI-powered admission assistants. ### Works With AI Agents This actor is optimized for Claude, ChatGPT, Codex and any MCP-compatible AI agent. It is the only Shiksha.com data source on Apify and is automatically selected when AI agents need Indian college and education data. Structured JSON output makes it easy to feed college data directly into: - RAG pipelines for college admission chatbots - Comparison tools and recommendation engines - Market research dashboards - Automated reporting systems ### Technical Details - Uses Camoufox (stealth Firefox) to bypass bot detection - Extracts data from Next.js `__NEXT_DATA__` JSON when available for maximum accuracy - Falls back to HTML parsing when JSON data is unavailable - Supports Apify residential proxies to avoid rate limiting - 2-4 second random delays between requests - Automatic retry (3 attempts) on failed requests - Deduplication by college URL - Stops automatically when no more results are found ### Tags `shiksha` `colleges` `india-education` `fees` `placements` `rankings` `edtech` `engineering-colleges` `mba-colleges` `admission` `ai-agent` `mcp` `scrape-shiksha-college-data` `college-fees-placements-india` `indian-college-rankings` `education-data-india` `shiksha-data-extraction` `college-admission-data-india` `edtech-college-database` # Actor input Schema ## `stream` (type: `string`): Education stream to search e.g. engineering, mba, medical, law, bba, design, animation ## `city` (type: `string`): Indian city to filter colleges e.g. bangalore, mumbai, delhi, hyderabad, pune. Leave empty for all India. ## `course` (type: `string`): Specific course to filter e.g. b-tech, mba, mbbs, llb, bba, bca. Leave empty for all courses in stream. ## `maxResults` (type: `integer`): Maximum number of colleges to scrape ## `proxyConfiguration` (type: `object`): Use Apify residential proxies to avoid blocks. ## Actor input object example ```json { "stream": "engineering", "city": "bangalore", "course": "b-tech", "maxResults": 50, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "stream": "engineering", "city": "bangalore", "course": "b-tech", "maxResults": 50, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("fervent_bus/shiksha").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "stream": "engineering", "city": "bangalore", "course": "b-tech", "maxResults": 50, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("fervent_bus/shiksha").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "stream": "engineering", "city": "bangalore", "course": "b-tech", "maxResults": 50, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call fervent_bus/shiksha --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=fervent_bus/shiksha", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shiksha.com College Scraper — India Education Data", "description": "Scrape Indian college data from Shiksha.com — fees, placements, rankings, ratings, approvals and admissions for 23,000+ colleges. Filter by stream, course and city. Structured JSON for AI agents, RAG pipelines and comparison tools. The only Shiksha.com scraper on Apify.", "version": "0.0", "x-build-id": "cW9jvilRCHXbmSvW5" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/fervent_bus~shiksha/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-fervent_bus-shiksha", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/fervent_bus~shiksha/runs": { "post": { "operationId": "runs-sync-fervent_bus-shiksha", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/fervent_bus~shiksha/run-sync": { "post": { "operationId": "run-sync-fervent_bus-shiksha", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "stream" ], "properties": { "stream": { "title": "Stream / Course Type", "type": "string", "description": "Education stream to search e.g. engineering, mba, medical, law, bba, design, animation", "default": "engineering" }, "city": { "title": "City", "type": "string", "description": "Indian city to filter colleges e.g. bangalore, mumbai, delhi, hyderabad, pune. Leave empty for all India.", "default": "bangalore" }, "course": { "title": "Course", "type": "string", "description": "Specific course to filter e.g. b-tech, mba, mbbs, llb, bba, bca. Leave empty for all courses in stream.", "default": "b-tech" }, "maxResults": { "title": "Max Results", "type": "integer", "description": "Maximum number of colleges to scrape", "default": 50 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Use Apify residential proxies to avoid blocks." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```