# RateMyProfessors Professors & Schools Scraper (`crawlerbros/ratemyprofessors-scraper`) Actor Scrape professors and school data from RateMyProfessors. Extract ratings, difficulty, would-take-again %, department, school name, and review counts - **URL**: https://apify.com/crawlerbros/ratemyprofessors-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Developer tools, Automation, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 7 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## RateMyProfessors Scraper Scrape public professor and school data from [RateMyProfessors](https://www.ratemyprofessors.com) using the page state already embedded in the site HTML. This actor returns real professor profiles, school matches, ratings metrics, and optional recent-rating snapshots without logging in. Use it for: - education-market research - professor discovery and comparisons - school discovery by name - collecting direct professor profile URLs ### Modes - `searchProfessors`: Search professors globally by name - `bySchoolProfessors`: Search professors within one school ID - `searchSchools`: Search schools by name - `byProfessorIds`: Resolve exact professor IDs - `byProfessorUrls`: Resolve exact professor profile URLs ### Main Inputs - `searchQuery`: Search term for professor search modes - `schoolQuery`: Search term for school search mode - `schoolId`: Exact RateMyProfessors school ID for bySchoolProfessors - `professorIds`: Exact professor IDs - `professorUrls`: Exact professor URLs - `minRating`: Minimum professor average rating - `minWouldTakeAgainPercent`: Minimum would-take-again percentage - `maxDifficulty`: Maximum difficulty - `departmentContains`: Optional department substring filter - `countryCodes`: Optional country filter (`US`, `CA`, `GB`) - `sortBy`: Result sorting - `includeRatingsSnapshot`: Include first-page rating snapshots on detail lookups - `maxItems`: Maximum records to emit ### Output The actor emits `professor`, `school`, or `error` records. #### Professor fields - professor ID and direct URL - first name, last name, full name - department - average rating - number of ratings - would-take-again percentage - average difficulty - school ID, school name, city, state, country code - course codes - related professors - optional ratings snapshot from the professor page #### School fields - school ID - school name - city and state - country code - rounded average school rating - number of school ratings ### Notes - This actor uses public HTML pages only. - No cookies, login, or API key are required. - Invalid lookup inputs return typed `error` records instead of failing silently. ### Daily Test The default prefill uses a broad professor-name query that reliably returns live data: ```json { "mode": "searchProfessors", "searchQuery": "smith", "maxItems": 5 } ```` # Actor input Schema ## `mode` (type: `string`): Choose what to scrape from RateMyProfessors. ## `searchQuery` (type: `string`): Professor name search query for searchProfessors or bySchoolProfessors. ## `schoolQuery` (type: `string`): School-name query for searchSchools mode. ## `schoolId` (type: `string`): Exact RateMyProfessors school legacy ID for bySchoolProfessors mode. ## `professorIds` (type: `array`): List of RateMyProfessors professor IDs for byProfessorIds mode. ## `professorUrls` (type: `array`): List of RateMyProfessors professor profile URLs for byProfessorUrls mode. ## `minRating` (type: `number`): Only include professors with an average rating at or above this value (0–5). ## `minWouldTakeAgainPercent` (type: `number`): Only include professors where at least this percentage of students would take them again (0–100). ## `maxDifficulty` (type: `number`): Only include professors with a difficulty rating at or below this value (0–5). ## `departmentContains` (type: `string`): Case-insensitive substring filter on the professor's department name. ## `countryCodes` (type: `array`): Limit results to professors at schools in these countries. Leave empty for all countries. Allowed values: US, CA, GB. ## `sortBy` (type: `string`): Sort order for professor search results. ## `includeRatingsSnapshot` (type: `boolean`): Include the first recent ratings from professor detail lookups. ## `maxItems` (type: `integer`): Maximum number of records to extract. ## Actor input object example ```json { "mode": "searchProfessors", "searchQuery": "smith", "countryCodes": [], "sortBy": "numRatingsDesc", "includeRatingsSnapshot": true, "maxItems": 5 } ``` # Actor output Schema ## `items` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "searchProfessors", "searchQuery": "smith", "sortBy": "numRatingsDesc", "includeRatingsSnapshot": true, "maxItems": 5 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/ratemyprofessors-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "searchProfessors", "searchQuery": "smith", "sortBy": "numRatingsDesc", "includeRatingsSnapshot": True, "maxItems": 5, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/ratemyprofessors-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "searchProfessors", "searchQuery": "smith", "sortBy": "numRatingsDesc", "includeRatingsSnapshot": true, "maxItems": 5 }' | apify call crawlerbros/ratemyprofessors-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/ratemyprofessors-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "RateMyProfessors Professors & Schools Scraper", "description": "Scrape professors and school data from RateMyProfessors. Extract ratings, difficulty, would-take-again %, department, school name, and review counts", "version": "0.1", "x-build-id": "JZnG0oFZqrUcYgJGK" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~ratemyprofessors-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-ratemyprofessors-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~ratemyprofessors-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-ratemyprofessors-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~ratemyprofessors-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-ratemyprofessors-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Mode", "enum": [ "searchProfessors", "bySchoolProfessors", "searchSchools", "byProfessorIds", "byProfessorUrls" ], "type": "string", "description": "Choose what to scrape from RateMyProfessors.", "default": "searchProfessors" }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Professor name search query for searchProfessors or bySchoolProfessors." }, "schoolQuery": { "title": "School Query", "type": "string", "description": "School-name query for searchSchools mode." }, "schoolId": { "title": "School ID", "type": "string", "description": "Exact RateMyProfessors school legacy ID for bySchoolProfessors mode." }, "professorIds": { "title": "Professor IDs", "type": "array", "description": "List of RateMyProfessors professor IDs for byProfessorIds mode.", "items": { "type": "string" } }, "professorUrls": { "title": "Professor URLs", "type": "array", "description": "List of RateMyProfessors professor profile URLs for byProfessorUrls mode.", "items": { "type": "string" } }, "minRating": { "title": "Minimum Rating", "minimum": 0, "maximum": 5, "type": "number", "description": "Only include professors with an average rating at or above this value (0–5)." }, "minWouldTakeAgainPercent": { "title": "Minimum Would-Take-Again Percent", "minimum": 0, "maximum": 100, "type": "number", "description": "Only include professors where at least this percentage of students would take them again (0–100)." }, "maxDifficulty": { "title": "Maximum Difficulty", "minimum": 0, "maximum": 5, "type": "number", "description": "Only include professors with a difficulty rating at or below this value (0–5)." }, "departmentContains": { "title": "Department Contains", "type": "string", "description": "Case-insensitive substring filter on the professor's department name." }, "countryCodes": { "title": "Country Codes", "type": "array", "description": "Limit results to professors at schools in these countries. Leave empty for all countries. Allowed values: US, CA, GB.", "default": [], "items": { "type": "string" } }, "sortBy": { "title": "Sort By", "enum": [ "numRatingsDesc", "avgRatingDesc", "avgDifficultyAsc", "nameAsc" ], "type": "string", "description": "Sort order for professor search results.", "default": "numRatingsDesc" }, "includeRatingsSnapshot": { "title": "Include Ratings Snapshot", "type": "boolean", "description": "Include the first recent ratings from professor detail lookups.", "default": true }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 5000, "type": "integer", "description": "Maximum number of records to extract.", "default": 5 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```