Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

What does Udemy Course Scraper do?

Introduction

Udemy is an online learning and teaching marketplace with over 250,000 courses and 80 million students, making it one of the world's largest e-learning platforms covering programming, marketing, data science, and countless other subjects. For businesses, researchers, educators, and market analysts, accessing structured data from Udemy courses is crucial for competitive analysis, market research, course comparison, and educational trend monitoring.

The challenge lies in manually collecting course information from thousands of individual course pages - a time-consuming and inefficient process. Our Udemy Course Scraper addresses this challenge by automatically extracting comprehensive course data, transforming hours of manual work into minutes of automated data collection.

Overview of Udemy Course Scraper

The Udemy Course Scraper is a sophisticated data extraction tool designed specifically for gathering detailed course information from Udemy's platform. This powerful scraper utilizes advanced web scraping techniques with proxy support to ensure reliable and undetected data collection from specific course URLs.

Key advantages of this scraper include its ability to handle multiple course URLs simultaneously, comprehensive data extraction covering all essential course metrics, and built-in proxy rotation to prevent detection. The tool is particularly valuable for educational technology companies, market researchers, content creators, and business analysts who need structured access to Udemy's course ecosystem.

Target users include EdTech companies conducting competitive analysis, researchers studying online education trends, course creators benchmarking their offerings, marketing agencies analyzing educational markets, and business intelligence teams tracking e-learning industry developments.

Input and Output Details

Input Format

Scrape with URLs

When you provide a list of URLs from search result pages for scraping, all options in the "scrape with search filters" section will be disabled. The system will only collect data from the URLs you specified, and the "scrape with urls" method will use the options listed below:

• urls
  Add the URLs of the Courses list pages you want to scrape. You can enter URLs one at a time or use the Bulk edit feature to add multiple links at once.
  (When using keyword search, keep this field empty or set to null.)

• scrape_type
  Select the type of data scraping operation. If "Get Courses by Search Filters" is chosen, input parameters for URLs will not have any effect.

• ignore_url_failures
  If set to true, the scraper will skip URLs that fail after the maximum number of retries and continue processing the rest, ensuring your job doesn’t stop due to a single problematic link.

Scrape with Filters Options

When using search filters for scraping, you need to leave the urls field in the configuration empty (or set it to null). The "scrape with search filters" method will use the options listed below:

• keyword
  Enter the keyword to search for items. This is the main search term and works in combination with filters to narrow down results.

• rating
  Filter items by their ratings (e.g., "4.5 & up"). This refines results to only show items that meet your minimum quality threshold.

• level
  Filter items by content level, such as "Beginner", "Intermediate", "Expert", or "All Levels" to find courses that match your experience or learning goals.

• page
  Specify the page number to start scraping results from. Useful for starting at a particular position in large result sets.

General Options

Here are the general options that apply to all scraping modes:

• max_items_per_url
  Limit the number of items collected per URL or search filter. This helps manage the volume of data and controls batch sizes.

• max_retries_per_url
  Set the maximum number of retry attempts for each URL or set of search filters. This improves reliability by handling temporary errors due to network or site issues.

• proxy
  Choose proxy settings to keep your scraper anonymous and avoid detection. Using reliable proxies helps avoid blocking and ensures consistent data collection.

Output Format

The scraper returns comprehensive course data in a structured format with detailed information across multiple categories:

Course Identification & Basic Info:

• Title: Complete course name for identification and cataloging
• Url: Canonical course URL for direct access and reference linking
• Locale: Language/region setting indicating course language and target market
• Created: Course publication date for timeline analysis and trend identification
• Image: Course thumbnail URL for visual content and marketing materials
• Primary category/subcategory: Course classification for categorization and filtering

Pricing & Commercial Data:

• Price detail: Original course pricing in local currency for cost analysis
• Discount: Current discount percentage for promotional tracking
• Discount price: Final price after discount application for purchase decisions
• Num subscribers: Total enrollment count indicating course popularity and market demand

Quality & Engagement Metrics:

• Rating: Average course rating (1-5 scale) reflecting student satisfaction
• Num reviews: Total review count indicating engagement level and credibility
• Instructional level: Difficulty level (beginner/intermediate/advanced) for audience targeting

Content Structure:

• Description: Detailed course overview for content understanding and marketing copy
• Headline: Course tagline for marketing and quick identification
• Num lectures/quizzes: Content quantity metrics for scope assessment
• Curriculum items/lectures: Detailed course structure for content analysis
• Content info: Additional metadata about course materials and resources

Educational Framework:

• Requirements data: Prerequisites and technical requirements for student preparation
• What you will learn data: Learning outcomes and skill acquisitions for benefit communication
• Objectives: Specific learning goals for course planning and comparison
• Target audiences: Intended student demographics for market targeting

Instructor & Additional Features:

• Visible instructors: Instructor profiles and credentials for authority assessment
• Features: Course features like certificates, lifetime access, mobile compatibility
• Preview url: Course preview video URL for content sampling
• Labels: Course tags and keywords for SEO and categorization

Udemy course scraper offers 5 different types of data collection, including:

1. Collect course data from course information pages

Example url 1: https://www.udemy.com/course/30-days-of-code-the-complete-python-bootcamp-vietnamese/?couponCode=2021PM25

Example url 2: https://www.udemy.com/course/python-for-data-science-and-machine-learning-bootcamp/

Example url 3: https://www.udemy.com/course/spark-and-python-for-big-data-with-pyspark/

Example Screenshot of course information page:

Input:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "scrape_type": "specific_course_urls", // Get courses by Specific course urls
  "ignore_url_failures": true,
  "urls": [ // Links to course information pages.
    "https://www.udemy.com/course/30-days-of-code-the-complete-python-bootcamp-vietnamese/?couponCode=2021PM25",
	"https://www.udemy.com/course/python-for-data-science-and-machine-learning-bootcamp/",
	"https://www.udemy.com/course/spark-and-python-for-big-data-with-pyspark/"
  ]
}

Output:

You get the output from the Udemy course scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of course information
	{
		"title": "6 Practice Exams | AWS Certified Cloud Practitioner CLF-C02",
		"url": "/course/practice-exams-aws-certified-cloud-practitioner/",
		"price_detail": {
			"amount": 81.49,
    		"currency": "$",
    		"price_string": "$81.49",
    		"currency_symbol": "$"
		},
		"visible_instructors": [
			{
			"_class": "user",
			"title": "Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer",
			"name": "Stephane Maarek",
			"display_name": "Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer",
			"job_title": "Best Selling Instructor, 11x AWS Certified, Kafka Guru",
			"image_50x50": "https://img-c.udemycdn.com/user/50x50/16122994_284f_18.jpg",
			"image_100x100": "https://img-c.udemycdn.com/user/100x100/16122994_284f_18.jpg",
			"initials": "S|",
			"url": "/user/stephane-maarek/"
			},
			{
			"_class": "user",
			"title": "Abhishek Singh",
			"name": "Abhishek",
			"display_name": "Abhishek Singh",
			"job_title": "Cloud Evangelist",
			"image_50x50": "https://img-c.udemycdn.com/user/50x50/94372896_f90c_3.jpg",
			"image_100x100": "https://img-c.udemycdn.com/user/100x100/94372896_f90c_3.jpg",
			"initials": "AS",
			"url": "/user/abhishek-singh-20032/"
			}
		],
		"locale": {
			"_class": "locale",
			"locale": "en_US",
			"title": "English (US)",
			"english_title": "English (US)",
			"simple_english_title": "English"
		},
		"description": "<p><strong>Preparing for AWS Certified Cloud Practitioner CLF-C02?</strong> <strong>This is</strong> <strong>THE practice exams course to give you the winning edge</strong>.</p><p>These practice exams have been co-authored by Stephane Maarek and Abhishek Singh who bring their collective experience of passing<strong> 18 AWS Certifications </strong>to the table.</p><p><strong>The tone and tenor of the questions mimic the real exam.</strong> Along with the <strong>detailed description and “exam alert” </strong>provided within the explanations, we have also <strong>extensively referenced AWS documentation</strong> to get you up to speed on all domain areas being tested for the CLF-C02 exam.</p><p><strong>We want you to think of this course as the final pit-stop so that you can cross the winning line with absolute confidence and get AWS Certified! Trust our process, you are in good hands.</strong></p><p>All questions have been <strong>written from scratch! </strong>You can see for yourself some of the amazing <strong>testimonials</strong> from our students who have aced the real exam:</p><p><br></p><p><br></p><p><strong>FEATURED REVIEWS:</strong></p><p><strong>5&nbsp;stars:</strong><em> Took the exam on 9/4 and </em><strong><em>got 1000/1000 on first try</em></strong><em>. I have no previous cloud experience. Took Stephane's lecture course and then this one. Watching all lectures and drilled on the practice exams are all I did for preparation. You don't need anything else to pass the test. Highly recommended. - Myron C.</em></p><p><strong>5&nbsp;stars:</strong> <em>Thank you Stephane for providing a consolidated exam questions with excellent explanation for each multiple choices. With the help of this practice exam and the detailed explanation, I have cleared the Cloud Practitioner Certification with ease and</em><strong><em> I have scored 979</em></strong><em>. By practicing this exam questions, </em><strong><em>I could finish the CCP exam in just 20 minutes</em></strong><em>. Kudos to you and will start my learning again with Associate Developer course. Thanks much and keep up the good work - Santhosh K.</em></p><p><strong>5&nbsp;stars: </strong><em>Thanks Stephen for this course. </em><strong><em>I managed to</em></strong><em> </em><strong><em>get 979/1000 in exam</em></strong><em> (appeared on 31st Aug 2020). </em><strong><em>Almost every questions in the real exam appeared familiar.</em></strong><em> In these practice test , I got scores between 73% to 84%. I also purchased your other actual course on CLF-C01. Extremely satisfied. Thanks again looking forward for Solution Arch Cert. - Nitesh K.</em></p><p><strong>5&nbsp;stars:</strong><em> I gave my CLF-C01 exam on 15th Aug 2020 and </em><strong><em>scored 982</em></strong><em>. Would like to thank Stephane for his amazing and engaging prep material on Udemy - Chandan M.</em></p><p><strong>5&nbsp;stars:</strong><em> Amazing practice test. I had used together with the course and passed on AWS certification with 965 as score. Congratulations, Stephane. - Edson M.</em></p><p><br></p><p><br></p><p>You will get<strong> SIX high-quality practice exams</strong> to be ready for your certification</p><p><br></p><p><br></p><p><strong>Quality speaks for itself:</strong></p><p><strong>SAMPLE QUESTION:</strong></p><p>A startup wants to set up its IT infrastructure on AWS Cloud. The CTO would like to get an estimate of the monthly AWS bill based on the AWS services that the startup wants to use. As a Cloud Practitioner, which AWS service would you suggest for this use-case?</p><ol><li><p>AWS Pricing Calculator</p></li><li><p>AWS Cost Explorer</p></li><li><p>AWS Budgets</p></li><li><p>AWS Cost &amp; Usage Report (AWS CUR)</p></li></ol><p><strong>What's your guess? Scroll below for the answer</strong></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><em>Correct: 1.</em></p><p>Correct option:</p><p><strong>AWS Pricing Calculator</strong></p><p>AWS Pricing Calculator lets you explore AWS services and create an estimate for the cost of your use cases on AWS. You can model your solutions before building them, explore the price points and calculations behind your estimate, and find the available instance types and contract terms that meet your needs. This enables you to make informed decisions about using AWS. You can plan your AWS costs and usage or price out setting up a new set of instances and services. AWS Pricing Calculator can provide the estimate of the AWS service usage based on the list of AWS services.</p><p>You should also note AWS is in the process of deprecating a similar tool called the Simple Monthly Calculator. This calculator provides an estimate of usage charges for AWS services based on certain information you provide. It helps customers and prospects estimate their monthly AWS bill more efficiently. </p><p><br></p><p>Incorrect options:</p><p><strong>AWS Cost &amp; Usage Report (AWS CUR)</strong> - The AWS Cost &amp; Usage Report (AWS CUR) contains the most comprehensive set of AWS cost and usage data available, including additional metadata about AWS services, pricing, credit, fees, taxes, discounts, cost categories, Reserved Instances, and Savings Plans. The AWS Cost &amp; Usage Report (AWS CUR) itemizes usage at the account or Organization level by product code, usage type and operation. These costs can be further organized by Cost Allocation tags and Cost Categories. The AWS Cost &amp; Usage Report (AWS CUR) is available at an hourly, daily, or monthly level of granularity, as well as at the management or member account level. The AWS Cost &amp; Usage Report (AWS CUR) cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p><strong>AWS Cost Explorer</strong> - AWS Cost Explorer has an easy-to-use interface that lets you visualize, understand, and manage your AWS costs and usage over time. AWS Cost Explorer includes a default report that helps you visualize the costs and usage associated with your top five cost-accruing AWS services, and gives you a detailed breakdown of all services in the table view. The reports let you adjust the time range to view historical data going back up to twelve months to gain an understanding of your cost trends. AWS Cost Explorer cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p><strong>AWS Budgets</strong> - AWS Budgets gives the ability to set custom budgets that alert you when your costs or usage exceed (or are forecasted to exceed) your budgeted amount. You can also use AWS Budgets to set reservation utilization or coverage targets and receive alerts when your utilization drops below the threshold you define. Budgets can be created at the monthly, quarterly, or yearly level, and you can customize the start and end dates. You can further refine your budget to track costs associated with multiple dimensions, such as AWS service, linked account, tag, and others.&nbsp; AWS Budgets cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p>And reference links to help you learn further!</p><p><br></p><p><br></p><p><strong>Instructor</strong></p><p>My name is Stéphane Maarek,&nbsp;I am passionate about Cloud Computing, and I will be your instructor in this course. I teach about AWS certifications, focusing on helping my students improve their professional proficiencies in AWS.</p><p>I have already taught 1,500,000+ students and gotten 500,000+ reviews throughout my career in designing and delivering these certifications and courses!</p><p>I'm delighted to welcome Abhishek Singh as my co-instructor for these practice exams!</p><p><br></p><p><br></p><p><br></p><p>Welcome to the best practice exams to help you prepare for your <strong>AWS Certified Cloud Practitioner</strong> exam.</p><ul><li><p>You can retake the exams as many times as you want</p></li><li><p>This is a huge original question bank</p></li><li><p>You get support from instructors if you have questions</p></li><li><p>Each question has a <strong>detailed explanation</strong></p></li><li><p>Mobile-compatible with the Udemy app</p></li><li><p>30-days money-back guarantee if you're not satisfied</p></li></ul><p><strong>We hope that by now you're convinced! </strong>And there are a lot more questions inside the course.</p><p><strong>Happy learning and best of luck for your AWS Certified Cloud Practitioner exam!</strong></p>",
		"headline": "Prepare the AWS Certified Cloud Practitioner CLF-C02. 390 unique high-quality test questions with detailed explanations!",
		"created": "2020-05-18T13:35:10Z",
		"num_subscribers": 294335,
		"discount": null,
		"discount_price": null,
		"rating": 4.602401,
		"num_reviews": 35113,
		"num_quizzes": null,
		"num_lectures": 0,
		"curriculum_items": null,
		"curriculum_lectures": null,
		"features": null,
		"image": "https://img-c.udemycdn.com/course/750x422/3142170_19fd_4.jpg",
		"preview_url": "/course/3142170/preview/",
		"primary_category": {
			"id": 294,
			"title": "IT & Software",
			"url": "/courses/it-and-software/",
			"tracking_object_type": "cat"
		},
		"primary_subcategory": null,
		"requirements_data": {
			"items": [
			"Recommended: Preparing for the exam with \"Ultimate AWS Certified Cloud Practitioner\" course by Stephane Maarek"
			]
		},
		"what_you_will_learn_data": {
			"items": [
			"Guaranteed chance to pass the exam if you score 90%+ on each practice exam",
			"Ace your AWS Certified Cloud Practitioner (CLF-C02) exam",
			"Practice with high quality practice exams alongside detailed explanation to learn concepts",
			"The CLF-C02 practice exams have been written from scratch",
			"Perfect companion to the \"Ultimate AWS Certified Cloud Practitioner\" course by Stephane Maarek"
			]
		},
		"labels": {
			"id": 46868,
			"display_name": "AWS Certified Cloud Practitioner",
			"title": "AWS Certified Cloud Practitioner",
			"topic_channel_url": "/topic/aws-certified-cloud-practitioner/",
			"url": "/topic/aws-certified-cloud-practitioner/",
			"tracking_object_type": "cl"
		},
		"target_audiences": [
			"Anyone preparing for the AWS Certified Cloud Practitioner (CLF-C02)"
		],
		"objectives": null,
		"content_info": "390 questions",
		"instructional_level": "Beginner Level"
	}, // ... Many other course details
]

2. Collect course data from courses from Authors

Example url 1: https://www.udemy.com/user/stephane-maarek/

Example url 2: https://www.udemy.com/user/joseportilla/

Example url 3: https://www.udemy.com/user/pierian-training-2/

Example Screenshot of Author course list page:

Input:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "max_items_per_url": 20,
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "scrape_type": "author_course_list", // Get courses by Author urls
  "ignore_url_failures": true,
  "urls": [ // List of Course list page from Author
        "https://www.udemy.com/user/stephane-maarek/",
		"https://www.udemy.com/user/joseportilla/",
		"https://www.udemy.com/user/pierian-training-2/"
    ]
}

Output:

You get the output from the Udemy course scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[
    {
    	"title": "6 Practice Exams | AWS Certified Cloud Practitioner CLF-C02",
    	"url": "/course/practice-exams-aws-certified-cloud-practitioner/",
    	"price_detail": {
    		"amount": 81.49,
    		"currency": "$",
    		"price_string": "$81.49",
    		"currency_symbol": "$"
    	},
    	"visible_instructors": [
    		{
    			"_class": "user",
    			"title": "Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer",
    			"name": "Stephane Maarek",
    			"display_name": "Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer",
    			"job_title": "Best Selling Instructor, 10x AWS Certified, Kafka Guru",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/16122994_284f_18.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/16122994_284f_18.jpg",
    			"initials": "S|",
    			"url": "/user/stephane-maarek/"
    		},
    		{
    			"_class": "user",
    			"title": "Abhishek Singh",
    			"name": "Abhishek",
    			"display_name": "Abhishek Singh",
    			"job_title": "Skills Assessment Specialist for Cloud",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/94372896_f90c_3.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/94372896_f90c_3.jpg",
    			"initials": "AS",
    			"url": "/user/abhishek-singh-20032/"
    		}
    	],
    	"locale": {
    		"_class": "locale",
    		"locale": "en_US",
    		"title": "English (US)",
    		"english_title": "English (US)",
    		"simple_english_title": "English"
    	},
    	"description": "<p><strong>Preparing for AWS Certified Cloud Practitioner CLF-C02?</strong> <strong>This is</strong> <strong>THE practice exams course to give you the winning edge</strong>.</p><p>These practice exams have been co-authored by Stephane Maarek and Abhishek Singh who bring their collective experience of passing<strong> 18 AWS Certifications </strong>to the table.</p><p><strong>The tone and tenor of the questions mimic the real exam.</strong> Along with the <strong>detailed description and “exam alert” </strong>provided within the explanations, we have also <strong>extensively referenced AWS documentation</strong> to get you up to speed on all domain areas being tested for the CLF-C02 exam.</p><p><strong>We want you to think of this course as the final pit-stop so that you can cross the winning line with absolute confidence and get AWS Certified! Trust our process, you are in good hands.</strong></p><p>All questions have been <strong>written from scratch! </strong>You can see for yourself some of the amazing <strong>testimonials</strong> from our students who have aced the real exam:</p><p><br></p><p><br></p><p><strong>FEATURED REVIEWS:</strong></p><p><strong>5&nbsp;stars:</strong><em> Took the exam on 9/4 and </em><strong><em>got 1000/1000 on first try</em></strong><em>. I have no previous cloud experience. Took Stephane's lecture course and then this one. Watching all lectures and drilled on the practice exams are all I did for preparation. You don't need anything else to pass the test. Highly recommended. - Myron C.</em></p><p><strong>5&nbsp;stars:</strong> <em>Thank you Stephane for providing a consolidated exam questions with excellent explanation for each multiple choices. With the help of this practice exam and the detailed explanation, I have cleared the Cloud Practitioner Certification with ease and</em><strong><em> I have scored 979</em></strong><em>. By practicing this exam questions, </em><strong><em>I could finish the CCP exam in just 20 minutes</em></strong><em>. Kudos to you and will start my learning again with Associate Developer course. Thanks much and keep up the good work - Santhosh K.</em></p><p><strong>5&nbsp;stars: </strong><em>Thanks Stephen for this course. </em><strong><em>I managed to</em></strong><em> </em><strong><em>get 979/1000 in exam</em></strong><em> (appeared on 31st Aug 2020). </em><strong><em>Almost every questions in the real exam appeared familiar.</em></strong><em> In these practice test , I got scores between 73% to 84%. I also purchased your other actual course on CLF-C01. Extremely satisfied. Thanks again looking forward for Solution Arch Cert. - Nitesh K.</em></p><p><strong>5&nbsp;stars:</strong><em> I gave my CLF-C01 exam on 15th Aug 2020 and </em><strong><em>scored 982</em></strong><em>. Would like to thank Stephane for his amazing and engaging prep material on Udemy - Chandan M.</em></p><p><strong>5&nbsp;stars:</strong><em> Amazing practice test. I had used together with the course and passed on AWS certification with 965 as score. Congratulations, Stephane. - Edson M.</em></p><p><br></p><p><br></p><p>You will get<strong> SIX high-quality practice exams</strong> to be ready for your certification</p><p><br></p><p><br></p><p><strong>Quality speaks for itself:</strong></p><p><strong>SAMPLE QUESTION:</strong></p><p>A startup wants to set up its IT infrastructure on AWS Cloud. The CTO would like to get an estimate of the monthly AWS bill based on the AWS services that the startup wants to use. As a Cloud Practitioner, which AWS service would you suggest for this use-case?</p><ol><li><p>AWS Pricing Calculator</p></li><li><p>AWS Cost Explorer</p></li><li><p>AWS Budgets</p></li><li><p>AWS Cost &amp; Usage Report (AWS CUR)</p></li></ol><p><strong>What's your guess? Scroll below for the answer</strong></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><em>Correct: 1.</em></p><p>Correct option:</p><p><strong>AWS Pricing Calculator</strong></p><p>AWS Pricing Calculator lets you explore AWS services and create an estimate for the cost of your use cases on AWS. You can model your solutions before building them, explore the price points and calculations behind your estimate, and find the available instance types and contract terms that meet your needs. This enables you to make informed decisions about using AWS. You can plan your AWS costs and usage or price out setting up a new set of instances and services. AWS Pricing Calculator can provide the estimate of the AWS service usage based on the list of AWS services.</p><p>You should also note AWS is in the process of deprecating a similar tool called the Simple Monthly Calculator. This calculator provides an estimate of usage charges for AWS services based on certain information you provide. It helps customers and prospects estimate their monthly AWS bill more efficiently. </p><p><br></p><p>Incorrect options:</p><p><strong>AWS Cost &amp; Usage Report (AWS CUR)</strong> - The AWS Cost &amp; Usage Report (AWS CUR) contains the most comprehensive set of AWS cost and usage data available, including additional metadata about AWS services, pricing, credit, fees, taxes, discounts, cost categories, Reserved Instances, and Savings Plans. The AWS Cost &amp; Usage Report (AWS CUR) itemizes usage at the account or Organization level by product code, usage type and operation. These costs can be further organized by Cost Allocation tags and Cost Categories. The AWS Cost &amp; Usage Report (AWS CUR) is available at an hourly, daily, or monthly level of granularity, as well as at the management or member account level. The AWS Cost &amp; Usage Report (AWS CUR) cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p><strong>AWS Cost Explorer</strong> - AWS Cost Explorer has an easy-to-use interface that lets you visualize, understand, and manage your AWS costs and usage over time. AWS Cost Explorer includes a default report that helps you visualize the costs and usage associated with your top five cost-accruing AWS services, and gives you a detailed breakdown of all services in the table view. The reports let you adjust the time range to view historical data going back up to twelve months to gain an understanding of your cost trends. AWS Cost Explorer cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p><strong>AWS Budgets</strong> - AWS Budgets gives the ability to set custom budgets that alert you when your costs or usage exceed (or are forecasted to exceed) your budgeted amount. You can also use AWS Budgets to set reservation utilization or coverage targets and receive alerts when your utilization drops below the threshold you define. Budgets can be created at the monthly, quarterly, or yearly level, and you can customize the start and end dates. You can further refine your budget to track costs associated with multiple dimensions, such as AWS service, linked account, tag, and others.&nbsp; AWS Budgets cannot provide the estimate of the monthly AWS bill based on the list of AWS services.</p><p>And reference links to help you learn further!</p><p><br></p><p><br></p><p><strong>Instructor</strong></p><p>My name is Stéphane Maarek,&nbsp;I am passionate about Cloud Computing, and I will be your instructor in this course. I teach about AWS certifications, focusing on helping my students improve their professional proficiencies in AWS.</p><p>I have already taught 1,500,000+ students and gotten 500,000+ reviews throughout my career in designing and delivering these certifications and courses!</p><p>I'm delighted to welcome Abhishek Singh as my co-instructor for these practice exams!</p><p><br></p><p><br></p><p><br></p><p>Welcome to the best practice exams to help you prepare for your <strong>AWS Certified Cloud Practitioner</strong> exam.</p><ul><li><p>You can retake the exams as many times as you want</p></li><li><p>This is a huge original question bank</p></li><li><p>You get support from instructors if you have questions</p></li><li><p>Each question has a <strong>detailed explanation</strong></p></li><li><p>Mobile-compatible with the Udemy app</p></li><li><p>30-days money-back guarantee if you're not satisfied</p></li></ul><p><strong>We hope that by now you're convinced! </strong>And there are a lot more questions inside the course.</p><p><strong>Happy learning and best of luck for your AWS Certified Cloud Practitioner exam!</strong></p>",
    	"headline": "Prepare the AWS Certified Cloud Practitioner CLF-C02. 390 unique high-quality test questions with detailed explanations!",
    	"created": "2020-05-18T13:35:10Z",
    	"num_subscribers": 268593,
    	"discount": null,
    	"discount_price": null,
    	"rating": 4.6276197,
    	"num_reviews": 32504,
    	"num_quizzes": null,
    	"num_lectures": 0,
    	"curriculum_items": [],
    	"curriculum_lectures": [],
    	"features": null,
    	"image": "https://img-c.udemycdn.com/course/750x422/3142170_19fd_4.jpg",
    	"preview_url": "/course/3142170/preview/",
    	"primary_category": {
    		"id": 294,
    		"title": "IT & Software",
    		"url": "/courses/it-and-software/",
    		"tracking_object_type": "cat"
    	},
    	"primary_subcategory": null,
    	"requirements_data": {
    		"items": [
    			"Recommended: Preparing for the exam with \"Ultimate AWS Certified Cloud Practitioner\" course by Stephane Maarek"
    		]
    	},
    	"what_you_will_learn_data": {
    		"items": [
    			"Guaranteed chance to pass the exam if you score 90%+ on each practice exam",
    			"Ace your AWS Certified Cloud Practitioner (CLF-C02) exam",
    			"Practice with high quality practice exams alongside detailed explanation to learn concepts",
    			"The CLF-C02 practice exams have been written from scratch",
    			"Perfect companion to the \"Ultimate AWS Certified Cloud Practitioner\" course by Stephane Maarek"
    		]
    	},
    	"labels": {
    		"id": 46868,
    		"display_name": "AWS Certified Cloud Practitioner",
    		"title": "AWS Certified Cloud Practitioner",
    		"topic_channel_url": "/topic/aws-certified-cloud-practitioner/",
    		"url": "/topic/aws-certified-cloud-practitioner/",
    		"tracking_object_type": "cl"
    	},
    	"target_audiences": [
    		"Anyone preparing for the AWS Certified Cloud Practitioner (CLF-C02)"
    	],
    	"objectives": null,
    	"estimated_content_length": null,
    	"content_info": "390 questions",
    	"instructional_level": "Beginner Level",
    	"from_url": "https://www.udemy.com/user/stephane-maarek/",
    	"page": 1
    }, // ... Many other course details
]

3. Collect course data from courses by Category

Example url 1: https://www.udemy.com/courses/it-and-software/it-certification/

Example url 2: https://www.udemy.com/courses/it-and-software/hardware/

Example url 3: https://www.udemy.com/courses/it-and-software/network-and-security/

Example Screenshot of course list page:

Input:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "max_items_per_url": 20,
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "scrape_type": "course_list_by_category", // Get courses by search query page urls
  "ignore_url_failures": true, 
  "urls": [ // List of course list page from query urls
    "https://www.udemy.com/courses/it-and-software/it-certification/",
	"https://www.udemy.com/courses/it-and-software/hardware/",
	"https://www.udemy.com/courses/it-and-software/network-and-security/"
    ]
}

Output:

You get the output from the Udemy course scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[
    {
    	"title": "Certified Kubernetes Administrator (CKA) with Practice Tests",
    	"url": "/course/certified-kubernetes-administrator-with-practice-tests/",
    	"price_detail": {
    		"amount": 100.0,
    		"currency": "$",
    		"price_string": "$100.0",
    		"currency_symbol": "$"
    	},
    	"visible_instructors": [
    		{
    			"_class": "user",
    			"id": 31303958,
    			"title": "Mumshad Mannambeth",
    			"name": "Mumshad",
    			"display_name": "Mumshad Mannambeth",
    			"job_title": "Best Selling Instructor | Teaches Kubernetes",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/31303958_8529_3.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/31303958_8529_3.jpg",
    			"initials": "MM",
    			"url": "/user/mumshad-mannambeth/"
    		},
    		{
    			"_class": "user",
    			"id": 61457358,
    			"title": "KodeKloud Training",
    			"name": "KodeKloud",
    			"display_name": "KodeKloud Training",
    			"job_title": "Hands-On Online Training Academy",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/61457358_a661_18.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/61457358_a661_18.jpg",
    			"initials": "KT",
    			"url": "/user/kodekloud/"
    		}
    	],
    	"locale": {
    		"_class": "locale",
    		"locale": "en_US",
    		"title": "English (US)",
    		"english_title": "English (US)",
    		"simple_english_title": "English"
    	},
    	"description": "<p><strong>***CNCF Endorsed Content***</strong></p><p><strong><em><br></em>*** Updated for latest CKA(2024) 1.30 version of Exam ***<br></strong><br>Kubernetes is one of the highest trending technology in Cloud Computing as of today. Kubernetes had the fastest growth in job searches, over 173% from a year before, as reported recently by a survey conducted by Indeed.</p><p>Learn, practice, and get certified on Kubernetes with <strong>hands-on labs right in your browser</strong>.</p><p><em>\"I have compared this to other courses at Udemy and Linux Academy. All have the strengths and gaps; so far this is a winner!\"</em> -&nbsp; Thomas Trauss, Student.</p><p>Learning&nbsp;<strong>Kubernetes</strong>&nbsp;is essential for any DevOps professional. DevOps engineers are always in demand. Currently, the average Silicon Valley salary for a DevOps engineer is 20% higher than what a software engineer makes. <strong>DevOps engineers make an average of $140,000 to $200,000 annually.&nbsp;</strong>And one of the most in-demand skills is&nbsp;<strong>Kubernetes Administration.</strong></p><p>Kubernetes is an open-source system for automating containerized application deployment, scaling, and management. It was originally designed by Google and is now maintained by the Cloud Native Computing Foundation.<br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Simplify Complex Technology</strong></p><p><strong>Kubernetes</strong>&nbsp;is at the cutting edge of application deployment. To elevate your DevOps career, learn how to deploy applications on Kubernetes effectively.</p><p>This course helps you gain the knowledge required to design and deploy cloud-native applications on a <strong>Kubernetes </strong>cluster.&nbsp; A series of well-designed lectures with animation and illustrations help you understand complex concepts easily. </p><p><br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Practice! Practice! Practice!</strong></p><p><strong>Lectures alone won’t help you clear the certification.&nbsp;</strong>The Kubernetes Certification is a practical <strong>hands-on exam</strong>. You need hands-on experience, you need to get fast, and you need practice. That is what our integrated hands-on lab experience gives you. Our coding quizzes can be accessed right in your browser without having to set up any lab environment yourself. We validate your work and give you feedback instantly. Preview a few lab exercises for <strong>Free!!</strong></p><p>After you have completed the lectures and coding exercises, you will have the opportunity to complete a series of assignments that put your new skills to the test. You will be given the challenge to solve using the Kubernetes skills you have learned.</p><p><strong>This will give you real-world experience and the chance to work with other students in the community.</strong>&nbsp;You will develop a Kubernetes deployment and get feedback for your work.</p><p><br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Join Our Community!</strong></p><p>Once you enroll in the course, you will get access to our community of teachers and learners, where we discuss important topics, tips, and tricks to pass the exam. This is a great place for you to clear your doubts and get answers to your questions instantly.</p><p><br></p><p>This course is the best way to get Certified in Kubernetes for an Absolute Beginner<strong>.</strong></p><p>Don’t waste any more time wondering what course is best for you. You’ve already found it. Get started right away!</p><p><br></p><p><em>\"Straight to the point covers the necessary to take the exam with some additional practice. Very good course and a very good teacher. Top-notch! Update: I passed the exam using this course!\" - Christopher Williamson, Student, Udemy</em></p><p>Legal Notice:</p><p><em>Kubernetes and the Kubernetes logo are trademarks or registered trademarks of The Linux Foundation. in the United States and/or other countries. The Linux Foundation&nbsp;and other parties may also have trademark rights in other terms used herein.&nbsp;This course is not certified, accredited, affiliated with, nor endorsed by Kubernetes or&nbsp;The Linux Foundation.</em></p><p><br></p><p><strong>Course Update History<br></strong></p><ul><li><p>July 15, 2024 - Lab environment upgrade to 1.30v </p></li><li><p>Feb 17, 2024 – Lab environment upgrade to 1.29v</p></li><li><p>June 15, 2023 – Lab environment upgrade to 1.27v</p></li><li><p>Feb 2, 2023 – Lab environment upgrade to 1.26v</p></li><li><p>Oct 10, 2022 – Lab environment upgrade to 1.24v</p></li><li><p>Sept 2, 2022 - New lab on etcd added</p></li><li><p>May 15, 2022 - Mock Exam solution videos updated</p></li><li><p>May 1, 2022 – Lab environment upgrade to 1.23v</p></li><li><p>Oct 20, 2021 – Lab environment upgrade to 1.22v</p></li><li><p>May 10, 2021 – Lab environment upgrade to 1.20v</p></li><li><p>Aug 24, 2020 – New updates<br>Lab environment upgrade to v1.19<br>New lectures Storage Section, Troubleshooting Section, kubectl apply, Solution videos, and labs were added.<br>Updated Kubernetes Imperative Commands Lab.</p></li><li><p>Jun 16, 2020 – Lab environment upgrade to v1.18</p></li><li><p>Dec 3, 2019 – New labs added</p></li><li><p>Jul 5, 2019 – New Mock Exam to the Kubernetes Certification Courses added</p></li><li><p>Jun 7, 2019 – New lectures on Practice Imperative Commands, Multi Container PODs, and Init Containers, along with labs, were added</p></li><li><p>May 21, 2019 – Lab Updates and fixes</p></li></ul><p><br></p><p>By the end of this course, you'll be ready to take the <strong>Certified Kubernetes Administrator (CKA) </strong>certification exam. </p>",
    	"headline": "Prepare for the Certified Kubernetes Administrators Certification with live practice tests right in your browser - CKA",
    	"created": "2019-04-01T05:31:31Z",
    	"num_subscribers": 351695,
    	"discount": null,
    	"discount_price": null,
    	"rating": 4.708187,
    	"num_reviews": 76955,
    	"num_quizzes": null,
    	"num_lectures": 278,
    	"curriculum_items": [],
    	"curriculum_lectures": [],
    	"features": null,
    	"image": "https://img-c.udemycdn.com/course/750x422/2301254_26c8_7.jpg",
    	"preview_url": "/course/2301254/preview/",
    	"primary_category": {
    		"id": 294,
    		"title": "IT & Software",
    		"url": "/courses/it-and-software/",
    		"tracking_object_type": "cat"
    	},
    	"primary_subcategory": null,
    	"requirements_data": {
    		"items": [
    			"Basic understanding of Docker",
    			"YAML Language",
    			"Basic understanding of Linux"
    		]
    	},
    	"what_you_will_learn_data": {
    		"items": [
    			"How to Administer a Kubernetes Cluster",
    			"How to Design a Kubernetes Cluster",
    			"How to Build a Kubernetes Cluster from scratch - \"The Hard Way\"",
    			"How to Test a Kubernetes Cluster end-to-end",
    			"How to Troubleshoot a Kubernetes Cluster",
    			"How to Secure a Kubernetes Cluster",
    			"How to Configure Storage on a Kubernetes Cluster",
    			"How to Configure Network on a Kubernetes Cluster"
    		]
    	},
    	"labels": {
    		"id": 6472,
    		"display_name": "Kubernetes",
    		"title": "Kubernetes",
    		"topic_channel_url": "/topic/kubernetes/",
    		"url": "/topic/kubernetes/",
    		"tracking_object_type": "cl"
    	},
    	"target_audiences": [
    		"System Administrators",
    		"DevOps Professionals",
    		"Application Developers"
    	],
    	"objectives": null,
    	"estimated_content_length": null,
    	"content_info": "23.5 total hours",
    	"instructional_level": "All Levels",
    	"from_url": "https://www.udemy.com/courses/it-and-software/it-certification/",
    	"page": 1
    }, // ... Many other course details
]

4. Collect course data from courses by Queries

Example url 1: https://www.udemy.com/courses/search/?instructional_level=beginner&p=2&q=python&ratings=4.0&src=ukw

Example url 2: https://www.udemy.com/courses/search/?src=ukw&q=python

Example url 3: https://www.udemy.com/courses/search/?src=ukw&q=aws

Example Screenshot of course list page:

Input:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "max_items_per_url": 20,
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "scrape_type": "course_list_by_query", // Get courses by search query page urls
  "ignore_url_failures": true,
  "urls": [ // List of course list page from query urls
    "https://www.udemy.com/courses/search/?instructional_level=beginner&p=2&q=python&ratings=4.0&src=ukw",
	"https://www.udemy.com/courses/search/?src=ukw&q=python",
	"https://www.udemy.com/courses/search/?src=ukw&q=aws"
    ]
}

Output:

You get the output from the Udemy course scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[
    {
    	"title": "Certified Kubernetes Administrator (CKA) with Practice Tests",
    	"url": "/course/certified-kubernetes-administrator-with-practice-tests/",
    	"price_detail": {
    		"amount": 100.0,
    		"currency": "$",
    		"price_string": "$100.0",
    		"currency_symbol": "$"
    	},
    	"visible_instructors": [
    		{
    			"_class": "user",
    			"id": 31303958,
    			"title": "Mumshad Mannambeth",
    			"name": "Mumshad",
    			"display_name": "Mumshad Mannambeth",
    			"job_title": "Best Selling Instructor | Teaches Kubernetes",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/31303958_8529_3.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/31303958_8529_3.jpg",
    			"initials": "MM",
    			"url": "/user/mumshad-mannambeth/"
    		},
    		{
    			"_class": "user",
    			"id": 61457358,
    			"title": "KodeKloud Training",
    			"name": "KodeKloud",
    			"display_name": "KodeKloud Training",
    			"job_title": "Hands-On Online Training Academy",
    			"image_50x50": "https://img-c.udemycdn.com/user/50x50/61457358_a661_18.jpg",
    			"image_100x100": "https://img-c.udemycdn.com/user/100x100/61457358_a661_18.jpg",
    			"initials": "KT",
    			"url": "/user/kodekloud/"
    		}
    	],
    	"locale": {
    		"_class": "locale",
    		"locale": "en_US",
    		"title": "English (US)",
    		"english_title": "English (US)",
    		"simple_english_title": "English"
    	},
    	"description": "<p><strong>***CNCF Endorsed Content***</strong></p><p><strong><em><br></em>*** Updated for latest CKA(2024) 1.30 version of Exam ***<br></strong><br>Kubernetes is one of the highest trending technology in Cloud Computing as of today. Kubernetes had the fastest growth in job searches, over 173% from a year before, as reported recently by a survey conducted by Indeed.</p><p>Learn, practice, and get certified on Kubernetes with <strong>hands-on labs right in your browser</strong>.</p><p><em>\"I have compared this to other courses at Udemy and Linux Academy. All have the strengths and gaps; so far this is a winner!\"</em> -&nbsp; Thomas Trauss, Student.</p><p>Learning&nbsp;<strong>Kubernetes</strong>&nbsp;is essential for any DevOps professional. DevOps engineers are always in demand. Currently, the average Silicon Valley salary for a DevOps engineer is 20% higher than what a software engineer makes. <strong>DevOps engineers make an average of $140,000 to $200,000 annually.&nbsp;</strong>And one of the most in-demand skills is&nbsp;<strong>Kubernetes Administration.</strong></p><p>Kubernetes is an open-source system for automating containerized application deployment, scaling, and management. It was originally designed by Google and is now maintained by the Cloud Native Computing Foundation.<br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Simplify Complex Technology</strong></p><p><strong>Kubernetes</strong>&nbsp;is at the cutting edge of application deployment. To elevate your DevOps career, learn how to deploy applications on Kubernetes effectively.</p><p>This course helps you gain the knowledge required to design and deploy cloud-native applications on a <strong>Kubernetes </strong>cluster.&nbsp; A series of well-designed lectures with animation and illustrations help you understand complex concepts easily. </p><p><br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Practice! Practice! Practice!</strong></p><p><strong>Lectures alone won’t help you clear the certification.&nbsp;</strong>The Kubernetes Certification is a practical <strong>hands-on exam</strong>. You need hands-on experience, you need to get fast, and you need practice. That is what our integrated hands-on lab experience gives you. Our coding quizzes can be accessed right in your browser without having to set up any lab environment yourself. We validate your work and give you feedback instantly. Preview a few lab exercises for <strong>Free!!</strong></p><p>After you have completed the lectures and coding exercises, you will have the opportunity to complete a series of assignments that put your new skills to the test. You will be given the challenge to solve using the Kubernetes skills you have learned.</p><p><strong>This will give you real-world experience and the chance to work with other students in the community.</strong>&nbsp;You will develop a Kubernetes deployment and get feedback for your work.</p><p><br></p><p><strong>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Join Our Community!</strong></p><p>Once you enroll in the course, you will get access to our community of teachers and learners, where we discuss important topics, tips, and tricks to pass the exam. This is a great place for you to clear your doubts and get answers to your questions instantly.</p><p><br></p><p>This course is the best way to get Certified in Kubernetes for an Absolute Beginner<strong>.</strong></p><p>Don’t waste any more time wondering what course is best for you. You’ve already found it. Get started right away!</p><p><br></p><p><em>\"Straight to the point covers the necessary to take the exam with some additional practice. Very good course and a very good teacher. Top-notch! Update: I passed the exam using this course!\" - Christopher Williamson, Student, Udemy</em></p><p>Legal Notice:</p><p><em>Kubernetes and the Kubernetes logo are trademarks or registered trademarks of The Linux Foundation. in the United States and/or other countries. The Linux Foundation&nbsp;and other parties may also have trademark rights in other terms used herein.&nbsp;This course is not certified, accredited, affiliated with, nor endorsed by Kubernetes or&nbsp;The Linux Foundation.</em></p><p><br></p><p><strong>Course Update History<br></strong></p><ul><li><p>July 15, 2024 - Lab environment upgrade to 1.30v </p></li><li><p>Feb 17, 2024 – Lab environment upgrade to 1.29v</p></li><li><p>June 15, 2023 – Lab environment upgrade to 1.27v</p></li><li><p>Feb 2, 2023 – Lab environment upgrade to 1.26v</p></li><li><p>Oct 10, 2022 – Lab environment upgrade to 1.24v</p></li><li><p>Sept 2, 2022 - New lab on etcd added</p></li><li><p>May 15, 2022 - Mock Exam solution videos updated</p></li><li><p>May 1, 2022 – Lab environment upgrade to 1.23v</p></li><li><p>Oct 20, 2021 – Lab environment upgrade to 1.22v</p></li><li><p>May 10, 2021 – Lab environment upgrade to 1.20v</p></li><li><p>Aug 24, 2020 – New updates<br>Lab environment upgrade to v1.19<br>New lectures Storage Section, Troubleshooting Section, kubectl apply, Solution videos, and labs were added.<br>Updated Kubernetes Imperative Commands Lab.</p></li><li><p>Jun 16, 2020 – Lab environment upgrade to v1.18</p></li><li><p>Dec 3, 2019 – New labs added</p></li><li><p>Jul 5, 2019 – New Mock Exam to the Kubernetes Certification Courses added</p></li><li><p>Jun 7, 2019 – New lectures on Practice Imperative Commands, Multi Container PODs, and Init Containers, along with labs, were added</p></li><li><p>May 21, 2019 – Lab Updates and fixes</p></li></ul><p><br></p><p>By the end of this course, you'll be ready to take the <strong>Certified Kubernetes Administrator (CKA) </strong>certification exam. </p>",
    	"headline": "Prepare for the Certified Kubernetes Administrators Certification with live practice tests right in your browser - CKA",
    	"created": "2019-04-01T05:31:31Z",
    	"num_subscribers": 351695,
    	"discount": null,
    	"discount_price": null,
    	"rating": 4.708187,
    	"num_reviews": 76955,
    	"num_quizzes": null,
    	"num_lectures": 278,
    	"curriculum_items": [],
    	"curriculum_lectures": [],
    	"features": null,
    	"image": "https://img-c.udemycdn.com/course/750x422/2301254_26c8_7.jpg",
    	"preview_url": "/course/2301254/preview/",
    	"primary_category": {
    		"id": 294,
    		"title": "IT & Software",
    		"url": "/courses/it-and-software/",
    		"tracking_object_type": "cat"
    	},
    	"primary_subcategory": null,
    	"requirements_data": {
    		"items": [
    			"Basic understanding of Docker",
    			"YAML Language",
    			"Basic understanding of Linux"
    		]
    	},
    	"what_you_will_learn_data": {
    		"items": [
    			"How to Administer a Kubernetes Cluster",
    			"How to Design a Kubernetes Cluster",
    			"How to Build a Kubernetes Cluster from scratch - \"The Hard Way\"",
    			"How to Test a Kubernetes Cluster end-to-end",
    			"How to Troubleshoot a Kubernetes Cluster",
    			"How to Secure a Kubernetes Cluster",
    			"How to Configure Storage on a Kubernetes Cluster",
    			"How to Configure Network on a Kubernetes Cluster"
    		]
    	},
    	"labels": {
    		"id": 6472,
    		"display_name": "Kubernetes",
    		"title": "Kubernetes",
    		"topic_channel_url": "/topic/kubernetes/",
    		"url": "/topic/kubernetes/",
    		"tracking_object_type": "cl"
    	},
    	"target_audiences": [
    		"System Administrators",
    		"DevOps Professionals",
    		"Application Developers"
    	],
    	"objectives": null,
    	"estimated_content_length": null,
    	"content_info": "23.5 total hours",
    	"instructional_level": "All Levels",
    	"from_url": "https://www.udemy.com/courses/it-and-software/it-certification/",
    	"page": 1
    }, // ... Many other course details
]

5. Collect course data from Search Filters

Example Screenshot of course list page:

Input:

{
	"max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
	"max_items_per_url": 20,
	"proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
		"useApifyProxy": true,
		"apifyProxyGroups": [
		"RESIDENTIAL" 
		],
		"apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
	},
	"keyword": "aws",
	"rating": 3,
	"level": "all",
	"page": 1,
}

Output:

You get the output from the Udemy course scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[
    {
  "id": "2196488",
  "title": "Ultimate AWS Certified Solutions Architect Associate 2025",
  "headline": "Full Practice Exam | Learn Cloud Computing | Pass the AWS Certified Solutions Architect Associate Certification SAA-C03!",
  "description": null,
  "url": "https://www.udemy.com/course/aws-certified-solutions-architect-associate-saa-c03",
  "price": {
    "_class": "pricing_result",
    "price_serve_tracking_id": "fsRLUnOgT2atYz0fhAK-Cg",
    "price": {
      "amount": 98,
      "currency": "$",
      "price_string": "$98",
      "currency_symbol": "$"
    },
    "list_price": {},
    "discount_price": null,
    "price_detail": null
  },
  "discount": null,
  "discount_price": null,
  "is_free": false,
  "instructors": [
    {
      "id": "16122994",
      "name": "Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer"
    }
  ],
  "visible_instructors": null,
  "locale": "en-US",
  "images": {
    "height125": "https://img-c.udemycdn.com/course/125_H/2196488_8fc7_10.jpg",
    "px100x100": "https://img-c.udemycdn.com/course/100x100/2196488_8fc7_10.jpg",
    "px240x135": "https://img-c.udemycdn.com/course/240x135/2196488_8fc7_10.jpg",
    "px304x171": "https://img-c.udemycdn.com/course/304x171/2196488_8fc7_10.jpg",
    "px480x270": "https://img-c.udemycdn.com/course/480x270/2196488_8fc7_10.jpg",
    "px50x50": "https://img-c.udemycdn.com/course/50x50/2196488_8fc7_10.jpg"
  },
  "rating": {
    "average": 4.720059871673584,
    "count": 273105
  },
  "level": "ALL_LEVELS",
  "duration_in_seconds": 97813,
  "content_info": null,
  "num_lectures": null,
  "num_quizzes": null,
  "curriculum": {
    "content_counts": {
      "lectures_count": 398,
      "practice_test_questions_count": 65
    }
  },
  "learning_outcomes": [
    "FULLY UPDATED FOR SAA-C03: Pass the AWS Certified Solutions Architect Associate Certification",
    "Full Practice Exam with Explanations included!",
    "All 800+ slides available as downloadable PDF",
    "Perform Real-World Solution Architecture on AWS",
    "Learn the AWS Fundamentals (EC2, ELB, ASG, RDS, ElastiCache, S3)",
    "Learn the Serverless Fundamentals (Lambda, DynamoDB, Cognito, API Gateway)",
    "Analyze 10+ Solution Architectures (traditional & serverless)",
    "Understand the Well Architected Framework, Disaster Recovery",
    "Master all the differences of Databases on AWS",
    "Secure your entire AWS Cloud using KMS, IAM Policies & SSM"
  ],
  "requirements_data": null,
  "objectives": null,
  "target_audiences": null,
  "primary_category": null,
  "primary_subcategory": null,
  "labels": null,
  "features": null,
  "badges": [
    {
      "__typename": "BeginnerTopRatedSubcategoryTopicBadge",
      "name": "Good for Beginners"
    },
    {
      "__typename": "BestSellerCategoryTopicBadge",
      "name": "Bestseller"
    },
    {
      "__typename": "BeginnerTopRatedCategoryTopicBadge",
      "name": "Good for Beginners"
    },
    {
      "__typename": "BestSellerSubcategoryBadge",
      "name": "Bestseller"
    },
    {
      "__typename": "BestSellerSubcategoryTopicBadge",
      "name": "Bestseller"
    }
  ],
  "created": null,
  "updated_on": "2025-11-01",
  "num_subscribers": null,
  "subscription_info": null,
  "from_url": "https://www.udemy.com/courses/search/?q=aws&ratings=3&instructional_level=all&page=1"
}, // ... Many other course details
]

Usage Guide

Step 1: Prepare Your Input Decide whether you want to scrape by providing a list of course URLs or by using search filters (such as keyword, rating, or level).

• If scraping with URLs, collect full Udemy course or course list page URLs you wish to extract.
• If using filters, specify your filters (keyword, rating, level, etc.) and leave the urls field empty or null.

Step 2: Configure Proxy Settings Set up your proxy configuration according to your needs.
Use residential proxies and select proxy groups and countries that align with your target regions for best accessibility and to avoid detection and rate limiting.

Step 3: Set Retry and Item Parameters Configure the max_retries_per_url parameter based on your desired reliability; higher values improve success rate for unstable URLs.
Set max_items_per_url to control the batch size and total data volume extracted from each URL or filter.

Step 4: Execute Scraping Run the scraper with your specified configuration. Monitor progress through logs, and review any errors or warnings to ensure your data collection is proceeding as intended.

Best Practices:

• Use residential proxies for higher success rates and minimized detection risk.
• Implement delays between requests to prevent server overload and avoid IP bans.
• Regularly validate extracted data for completeness and accuracy.
• Export and store results in structured formats such as JSON or CSV for easy integration and analysis.
• Update configurations promptly if there are changes to the Udemy site structure or scraping requirements.

Common Error Handling:

• URL accessibility issues: Verify course URLs are public and active
• Rate limiting: Adjust proxy settings and request frequency
• Data inconsistencies: Implement validation checks for critical fields

Benefits and Applications

The Udemy Course Scraper delivers significant time savings by automating what would otherwise be hours of manual data collection into minutes of automated processing. This efficiency enables real-time competitive analysis, allowing businesses to monitor competitor pricing, course launches, and market trends immediately.

Practical applications include market research for EdTech companies analyzing competition, content strategy development for online educators, pricing optimization based on market data, and investment analysis for education-focused businesses. The comprehensive data enables informed decision-making across course development, marketing strategies, and business planning.

The business value extends to creating data-driven insights for course creators, enabling affiliate marketers to identify high-performing courses, and supporting academic researchers studying online education trends and effectiveness.

Conclusion

The Udemy Course Scraper provides a powerful solution for anyone needing structured access to Udemy's vast course database. By combining comprehensive data extraction with robust proxy support and detailed configuration options, this tool transforms complex data collection challenges into streamlined automated processes.

Whether you're conducting market research, analyzing competitors, or building educational technology solutions, this scraper delivers the reliable, comprehensive course data you need to make informed decisions and drive business success.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Udemy course scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.