🎓 IDP Study Scraper

Want IDP study-abroad courses in a spreadsheet? This scraper makes it easy.

Use structured filters — better for AI agents — or paste an input_url. When input_url is set it overrides the filters.

IDP lists more than 150,000 courses at universities and colleges in Australia, Canada, Ireland, Malaysia, New Zealand, the United Kingdom, and the United States. Every row includes the course description. This actor returns up to 2000 rows per run.

💡 Perfect for...

• Students: Compare course titles, tuition, duration, and deadlines by country or subject.
• Counsellors: Pull a shortlist for one institution or study level.
• Dashboards: Keep a fresh table of public IDP courses.
• Data analysts: Export structured rows with public course URLs.
• 🤖 AI Agents: Power Claude, Cursor, Codex, the Hermes Agent, and OpenClaw workflows with live IDP courses.
• 📚 RAG Systems: Feed course titles, institutions, and descriptions into retrieval pipelines.
• 🔗 AI Workflows: Plug into LangChain, AutoGPT, CrewAI, and similar stacks.

✨ Why you'll love this scraper

• 🔗 Input URL or Filters: Paste an IDP course search, institution, or course page, or set the same filters as the course finder. input_url always wins when set.
• 🎯 Website-Matched Filters: Keyword, subject, country, study level, institution, duration, yearly tuition, and IELTS score.
• 🌐 Course pages: Title, institution, country, subject, level, tuition, duration, deadline, and the full course description.

📦 What's inside the data?

title, institution, country, subject, level, tuition, duration, deadline, url, description

🚀 Quick start

Option A: paste https://www.idp.com/find-a-course/chemical-engineering/doctorate/united-states/. Option B: set a subject, country, or study level and set max_results.

Input Example (filters):

{
  "subject": "Chemical Engineering",
  "level": "Doctorate",
  "country": "United States",
  "max_results": 100
}

Input Example (URL):

{
  "input_url": "https://www.idp.com/find-a-course/chemical-engineering/doctorate/united-states/",
  "max_results": 100
}

Output Example:

{
  "title": "Doctor of Philosophy (PhD) in Chemical Engineering",
  "institution": "University of Wisconsin - Madison",
  "country": "United States",
  "subject": "Chemical Engineering",
  "level": "Doctorate",
  "tuition": "25766 USD",
  "duration": "6 Semester",
  "deadline": "2026-09-01",
  "url": "https://www.idp.com/universities-and-colleges/university-of-wisconsin-madison/doctor-of-philosophy-phd-in-chemical-engineering/PRG-US-00005589/",
  "description": "The Department of Chemical and Biological Engineering (CBE) at UW-Madison was established in 1905. It has a tradition of excellence dating back to its founding and consistently ranks among the best programs in the world. The department has 21 core faculty and eight affiliate faculty who conduct experimental and theoretical research to address pressing societal, economic, and environmental challenges. Research in CBE is highly collaborative and often involves diverse teams from within the department, across campus, at other campuses, and in industry. CBE researchers address the most pressing challenges facing society including developing approaches to sustainably produce new fuels and chemicals, combat the plastic pollution crisis, create new therapeutic molecules and materials, optimize energy infrastructure, computationally design new materials and chemical processes, understand transport in complex environments, engineer bacteria to produce biofuels, and more."
}

Output fields:

Field	Description
title	Course name.
institution	University or college.
country	Country where the course is taught.
subject	Subject names on the course.
level	Study level, such as Undergraduate or Doctorate.
tuition	Yearly tuition and currency, when IDP shows it.
duration	Length of the course, such as 6 Semester or 3 Year.
deadline	Earliest application deadline.
url	Public course page.
description	Course description from the course page.

📋 Input reference

Parameter	Type	Required	Default	Description
input_url	string	No	—	IDP course search, institution, or course page. Overrides every filter.
keyword	string	No	—	Subject search words, such as Nursing. Ignored when subject is set.
subject	string	No	—	Course subject, such as Chemical Engineering.
country	string	No	—	Australia, Canada, Ireland, Malaysia, New Zealand, United Kingdom, or United States.
level	string	No	—	Doctorate, English, English Language, Foundation, Postgraduate, Pre-Degree & Vocational, School, Undergraduate, University Preparation, or VET.
institution	string	No	—	Institution name, such as University of Greenwich.
duration	string	No	—	Less than 1 year, 1 year to 2 years, or 2 years to 4 years.
budget_min	integer	No	—	Lowest yearly tuition in US dollars.
budget_max	integer	No	—	Highest yearly tuition in US dollars.
ielts_min	string	No	—	Lowest IELTS score, for example 6.5.
ielts_max	string	No	—	Highest IELTS score, for example 7.5.
max_results	integer	No	50	Maximum rows (1–2000).