Massachusetts Institute of Technology Course Catalog Scraper
Pricing
from $5.00 / 1,000 results
Massachusetts Institute of Technology Course Catalog Scraper
Scrapes the complete Massachusetts Institute of Technology course catalog: every course with code, title, credit hours, full description and prerequisites, straight from the official MIT catalog.
Pricing
from $5.00 / 1,000 results
Rating
0.0
(0)
Developer
Brian Webster
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
6 days ago
Last modified
Categories
Share
Scrapes the complete course catalog of Massachusetts Institute of Technology — every course with its code, title, credit hours, full description and prerequisites — from the official MIT catalog at catalog.mit.edu.
Massachusetts Institute of Technology publishes no bulk download of its catalog. The data exists only as HTML, one subject page at a time.
What you get
| Field | Example |
|---|---|
courseKey | CS 101 |
subject, catalogNumber | CS, 101 |
title | Introduction to Computer Science |
credits | 3 |
description | full catalog text |
descriptionWordCount | 64 |
prerequisites | MATH 151 with a grade of C or better |
institution, institutionName | mit, Massachusetts Institute of Technology |
sourceUrl | link back to the subject page |
Input
Everything is optional — run with no input for the whole catalog.
| Field | Default | Notes |
|---|---|---|
subjects | all | e.g. ["CS","MATH"] |
maxItems | 0 (no limit) | cap for a trial run |
requestDelayMs | 600 | politeness delay |
Uses
- Course search and degree-planning tools that need the full MIT catalog
- Prerequisite-chain analysis — which courses gate which
- Curriculum comparison against other institutions
- Tracking catalog changes between academic years
Notes
Only public catalog data is collected — the same pages any visitor can read. No login, no credentials, no student data. The actor self-throttles (600 ms between requests by default) and identifies itself in the User-Agent.
Individual subject pages that fail are logged as warnings and skipped, so one bad page cannot lose a run. A summary is written to the key-value store under RUN_SUMMARY.
Need several institutions at once? The University Course Data actor covers multiple universities in one run with an institution filter.
Not affiliated with or endorsed by Massachusetts Institute of Technology. All data is public information published by Massachusetts Institute of Technology.
