# Udemy Course Scraper πŸ“š (`excitable_pickle/udemy-coursera-bestseller-scraper`) Actor Extract detailed course information from Udemy.com with this powerful scraper. Collect comprehensive data about online courses, including ratings, content details, instructors, and pricing. Perfect for market research, content aggregation, and educational platform development. - **URL**: https://apify.com/excitable\_pickle/udemy-coursera-bestseller-scraper.md - **Developed by:** [Pavan](https://apify.com/excitable_pickle) (community) - **Categories:** Integrations, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-usage ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** β€” the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** β€” [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** β€” the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** β€” the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** β€” the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README

Udemy Course Scraper πŸ“š Logo

## Udemy Course Scraper πŸ“š Powerful scraper for extracting detailed course information from Udemy.com. Get comprehensive data about online courses including ratings, content details, instructors, and pricing. ### πŸ” Features - Extract detailed course information from Udemy search results - Support multiple search URLs - Customizable maximum items limit - Built-in proxy rotation support - Smart pagination handling - Rate limiting and random delays for reliable scraping - Rich course metadata including: - Course title and URL - Rating and number of reviews - Course duration and content details - Instructor information - Course objectives - Badge and certification details - Pricing information - Image URLs in various sizes ### 🎯 Use Cases - Market research and competitive analysis - Course content aggregation - Educational platform development - Price monitoring - Course recommendation systems - Learning resource cataloging ### πŸ’‘ Sample Output The scraper provides detailed JSON output for each course, including: - Complete course details - Instructor profiles - Content statistics - Rating metrics - Media assets - Pricing information ### πŸ“‹ Input Parameters - `searchUrls`: Array of Udemy search URLs to scrape - `maxItems`: Maximum number of items to collect (optional) - `proxyConfiguration`: Proxy settings (optional) ### πŸš€ Getting Started 1. Input your desired Udemy search URLs 2. Set maximum items limit (optional) 3. Configure proxy settings if needed 4. Run the actor and collect your data! ### πŸ“Š Output Format Results are stored in JSON format, with each entry containing comprehensive course information including title, rating, instructor details, content duration, and more. #### Input Example A full explanation of an input example in JSON. ```json { "searchUrls": [ "https://www.udemy.com/courses/search/?src=ukw&q=ai" ], "maxItems": 80 } ``` #### Output sample The results will be wrapped into a dataset which you can always find in theΒ **Storage**Β tab. Here's an excerpt from the data you'd get if you apply the input parameters above: And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML. ```json [ { "searchUrl": "https://www.udemy.com/courses/search/?src=ukw&q=ai", "headline": "25+ Generative AI Tools to 10x Business, Productivity, Creativity | Prompt Engineering, ChatGPT, Custom GPTs, Midjourney", "rating": 4.51503, "image_100x100": "https://img-c.udemycdn.com/course/100x100/5170404_d282_9.jpg", "image_304x171": "https://img-c.udemycdn.com/course/304x171/5170404_d282_9.jpg", "primary_labelIds_is": "[158002]", "hrs_of_content_f": "30.7148991", "num_reviews": 44584, "num_practice_test_i": "0", "visible_instructors": [ { "title": "Julian Melanson", "display_name": "Julian Melanson" }, { "title": "Benza Maman", "display_name": "Benza Maman" }, { "title": "Leap Year Learning", "display_name": "Leap Year Learning" } ], "image_240x135": "https://img-c.udemycdn.com/course/240x135/5170404_d282_9.jpg", "_class": "course", "hrs_of_video_f": "30.5958328", "num_resources_download_i": "22", "num_simple_quiz_i": "0", "objectives_summary": [ "ChatGPT: Create content, synthesize information, and learn faster than ever with effective prompt engineering!", "ChatGPT: Turn your creativity into paid work, generate fresh ideas, reach new audiences, and scale your projects!", "Productivity: Achieve your goals faster with ChatGPT, manage your time, prioritize tasks, and create an optimized daily schedule!" ], "num_asset_video_i": "433", "ppi_all_funnels_f": "0.002151019687886661", "id": 5170404, "is_practice_test_course": false, "url": "/course/complete-ai-guide/", "image_480x270": "https://img-c.udemycdn.com/course/480x270/5170404_d282_9.jpg", "num_coding_exercise_i": "0", "num_published_lectures": 454, "badge_families": [ "bestseller", "bestseller", "bestseller" ], "lang_s": "en", "title": "ChatGPT Complete Guide: Learn Generative AI, ChatGPT & More", "primary_label_ids": "[158002]", "badge_types": [ "best_seller_category_topic", "best_seller_subcategory", "best_seller_subcategory_topic" ], "is_paid": true, "image_125_H": "https://img-c.udemycdn.com/course/125_H/5170404_d282_9.jpg", "predictive_score": 1.1040643453598022, "relevancy_score": 13001.2548828125, "tracking_id": "K3rttbxbTKKeU4ZhCuYZzg", "content_info": "30.5 total hours", "instructional_level_simple": "All Levels", "badges": [ { "_class": "ds_course_badge", "id": "65fd46b1b6364f91ba4f1fc9dba37419", "badge_text": "Bestseller", "badge_family": "bestseller", "context_info": { "category": { "id": 292, "title": "Office Productivity", "url": "/courses/office-productivity/", "tracking_object_type": "cat" }, "subcategory": null, "label": { "id": 158002, "display_name": "ChatGPT", "title": "ChatGPT", "topic_channel_url": "/topic/chatgpt/", "url": "/topic/chatgpt/", "tracking_object_type": "cl" } } } ], "is_in_user_subscription": false, "learn_url": "/course/complete-ai-guide/learn/", "buyable_object_type": "course", "free_course_subscribe_url": null, "is_in_personal_plan_collection": false, "num_coding_exercises": 0, "is_coding_exercises_badge_eligible": false }, ... ] ``` ### Related Actors - πŸ“š [Udemy Course Reviews Scraper](https://apify.com/excitable_pickle/udemy-course-reviews-scraper) - Extract detailed course reviews, ratings and student feedback from Udemy courses. - πŸŽ“ [arXiv Search Scraper](https://apify.com/excitable_pickle/arxiv-search-scraper) - Extract research papers data for academic research and trend analysis. - πŸ”¬ [Nature Search Results Scraper](https://apify.com/excitable_pickle/nature-search-results-scraper) - Scrape comprehensive research article data from Nature.com. - πŸ“š [Goodreads Book Scraper](https://apify.com/excitable_pickle/goodreads-book-scraper) - Extract detailed book information from Goodreads search results. - πŸ“š [Goodreads Review Scraper](https://apify.com/excitable_pickle/goodreads-review-scraper) - Extract detailed book reviews and ratings from Goodreads. - 🎧 [Audible Book Search Scraper](https://apify.com/excitable_pickle/audible-book-search-scraper) - Extract comprehensive audiobook information from Audible. - πŸ“š [Wattpad Story Scraper](https://apify.com/excitable_pickle/wattpad-story-scraper) - Scrape stories and related content from Wattpad search results. - πŸ“š [Substack Posts Scraper](https://apify.com/excitable_pickle/substack-posts-scraper) - Extract articles and posts from Substack newsletters. - πŸ“š [Substack Publications Scraper](https://apify.com/excitable_pickle/substack-publications-scraper) - Scrape detailed publication information from Substack. - πŸ“„ [Article Content Extractor](https://apify.com/excitable_pickle/article-content-extractor) - Extract clean article content and metadata from any web page. - πŸ” [Keyword Discovery Tool](https://apify.com/excitable_pickle/keyword-discovery-tool) - Discover new keyword ideas and search insights for content optimization. - 🎯 [YouTube Tags Extractor](https://apify.com/excitable_pickle/youtube-tags-extractor) - Extract and analyze tags from YouTube videos for content optimization. - πŸ“ [YouTube Description Extractor](https://apify.com/excitable_pickle/youtube-description-extractor) - Extract complete descriptions from YouTube videos. - πŸ” [Keyword Density Checker](https://apify.com/excitable_pickle/keyword-density-checker) - Analyze webpage content for keyword density and optimization. - 🧠 [Website Content to Markdown for LLM Training](https://apify.com/excitable_pickle/website-content-to-markdown-for-llm-training) - Transform web content into clean, LLM-ready Markdown format. ### Connect to Claude / AI Agent (MCP) Connect this Actor directly to Claude Desktop, Cursor, or any MCP client via the Model Context Protocol endpoint: ```text https://mcp.apify.com/?token=YOUR_APIFY_TOKEN_HERE&tools=actors,docs,excitable_pickle/udemy-coursera-bestseller-scraper ``` #### Claude Copy-Paste Prompt ```text MCP Server URL: https://mcp.apify.com/?token=YOUR_APIFY_TOKEN_HERE&tools=actors,docs,excitable_pickle/udemy-coursera-bestseller-scraper Apify Token: YOUR_APIFY_TOKEN_HERE Execute Actor: excitable_pickle/udemy-coursera-bestseller-scraper Task: "Execute search with parameters, extract structured results, and present key intelligence in a markdown table." ``` # Actor input Schema ## `searchUrls` (type: `array`): List of Udemy search URLs to scrape ## `maxItems` (type: `integer`): Maximum number of courses to scrape (default: 100) ## `proxyConfiguration` (type: `object`): Proxy settings for the scraper ## Actor input object example ```json { "searchUrls": [ "https://www.udemy.com/courses/search/?src=ukw&q=python" ], "maxItems": 30, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `courses` (type: `string`): No description ## `summary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("excitable_pickle/udemy-coursera-bestseller-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("excitable_pickle/udemy-coursera-bestseller-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call excitable_pickle/udemy-coursera-bestseller-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,excitable_pickle/udemy-coursera-bestseller-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/b9KFbm2GSq1E2Fyhf/builds/W6lgqL0zNaJJwVi89/openapi.json