Substack Scraper — Posts to JSON & AI-Ready Markdown
Pricing
from $2.00 / 1,000 post scrapeds
Substack Scraper — Posts to JSON & AI-Ready Markdown
Scrape every post from any Substack newsletter (including custom domains). Get titles, authors, dates, likes, comments, paywall status, tags and full post text as clean Markdown for AI/RAG. No login, no browser.
Pricing
from $2.00 / 1,000 post scrapeds
Rating
0.0
(0)
Developer
Clean Data Labs
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
19 hours ago
Last modified
Categories
Share
Substack Scraper: Posts to JSON & AI-Ready Markdown
Scrape every post from any Substack newsletter, including publications on custom domains. You get clean, structured data plus the full text of free posts as Markdown, ready to drop into ChatGPT, Claude, a vector database, or a RAG pipeline.
No login. No browser. Fast and cheap.
What you get for each post
| Field | Example |
|---|---|
title, subtitle | "Shea Serrano did the math on podcasting..." |
url, slug | https://on.substack.com/p/shea-serrano-podcast |
postDate | 2026-09-10T17:58:26Z |
authors | ["Arielle Swedback", "Shea Serrano"] |
likes, comments, restacks | 1350, 0, 63 |
wordCount | 3649 |
audience, isPaywalled | everyone, false |
section, tags | Stories, [] |
type | newsletter / podcast / thread |
markdown | Full post body as clean Markdown (free posts) |
coverImage, podcastUrl | URLs |
Use cases
- AI & RAG: turn a newsletter's whole archive into a Markdown knowledge base
- Competitor & content research: see which topics get the most likes and comments
- Sponsorship & partnership research: find active newsletters in your niche
- Monitoring: schedule daily runs with
sinceto capture only new posts
How to use
- Add one or more publications:
lenny,on.substack.com, orhttps://www.lennysnewsletter.com - (Optional) Set Max posts, Only posts after a date, or Keyword filter
- Click Start and export as JSON, CSV, Excel, or via API
Example input
{"publications": ["https://www.lennysnewsletter.com", "on.substack.com"],"maxPostsPerPublication": 100,"since": "2026-01-01","includeMarkdown": true}
Pricing
You pay per post saved. There are no monthly fees, and filtered-out posts cost nothing.
Notes
- Paywalled posts return metadata only. Full text is included for free posts.
- Only publicly available data is collected.
Support
Found a bug or need a field added? Open an issue on the Issues tab. Replies usually come within 24 hours.