Substack Scraper: Posts, Full Text, Comments & Newsletters
Pricing
from $1.00 / 1,000 posts
Substack Scraper: Posts, Full Text, Comments & Newsletters
Scrape Substack posts with full text as clean Markdown, comments, search across all of Substack, and top newsletters per category with subscriber counts and prices. No login.
Pricing
from $1.00 / 1,000 posts
Rating
0.0
(0)
Developer
Lean Pilar
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
9 days ago
Last modified
Categories
Features
Share
Get Substack posts with the full article as clean Markdown, their comments, search results from all of Substack, and top newsletters per category with subscriber counts and subscription prices. Works with custom domains (like www.lennysnewsletter.com) and profile links (substack.com/@lenny). No login, no cookies, no proxy needed.
What you can do
- Read a newsletter's archive: newest or most popular posts, filtered by date ("last 30 days"), free/paid, post type, likes, or a keyword.
- Get full text for AI: every free post comes as Markdown and plain text, without Subscribe buttons and share widgets. Ready for RAG, summaries and LLM pipelines. Paid posts include the public preview.
- Collect comments: best comments first, with replies, author, likes and date.
- Search all of Substack: find posts and newsletters about any topic, e.g. "ai marketing".
- Find newsletters to sponsor or pitch: Substack's leaderboards for 32 categories (Technology, Business, Finance, Culture...), top overall or top paid, with approximate subscribers, paid subscriber band, monthly and yearly price, author, X/Twitter handle and launch date. Filter by minimum subscribers.
Input examples
Latest posts of two newsletters, last 30 days, with full text:
{"newsletters": ["lenny", "www.astralcodexten.com"],"publishedAfter": "30 days","maxPostsPerNewsletter": 50}
Top 100 paid Business newsletters with at least 10,000 subscribers:
{"categories": ["business"],"leaderboard": "paid","maxNewslettersPerCategory": 100,"minSubscribers": 10000}
Search Substack for a topic and get posts plus comments:
{"searchQueries": ["ai marketing"],"maxPostsPerSearch": 30,"includeComments": true,"maxCommentsPerPost": 50}
Output
Every row has a type: post, comment or newsletter. The dataset has a separate table view for each.
Post
{"type": "post","url": "https://www.noahpinion.blog/p/for-the-democrats-now-comes-the-hard","title": "For the Democrats, now comes the hard part","subtitle": "The Dems have to figure out what they stand for, and what they want to do.","newsletter": "Noahpinion","authors": ["Noah Smith"],"publishedAt": "2026-11-06T06:46:24.428Z","isPaid": false,"postType": "newsletter","wordCount": 3544,"likes": 374,"comments": 114,"restacks": 41,"markdown": "Democrats won a historic victory in Tuesday's election. ...","text": "Democrats won a historic victory ...","isFullText": true}
Newsletter
{"type": "newsletter","name": "Lenny's Newsletter","url": "https://www.lennysnewsletter.com","author": "Lenny Rachitsky","subscribers": 1200000,"subscribersText": "Over 1,200,000 subscribers","paidSubscribersText": "Tens of thousands of paid subscribers","isPaid": true,"monthlyPrice": 20,"yearlyPrice": 200,"currency": "USD","twitter": "lennysan","category": "business","rank": 1}
Comment: postUrl, postTitle, author, authorHandle, text, likes, replies, depth, parentId, publishedAt.
Pricing
Pay only for rows you get. No start fee.
| Row | Price |
|---|---|
| Post (full text included) | $1.00 per 1,000 |
| Newsletter | $2.00 per 1,000 |
| Comment | $0.30 per 1,000 |
Set a maximum cost per run in Apify and the scraper stops when it is reached.
Notes
- Subscriber numbers are the rounded figures Substack shows publicly (for example "271K+"). Substack does not publish exact counts.
- Paid posts: only the free preview text is public, so
isFullTextisfalsefor them. - Only public data is collected. Respect authors' copyright when you reuse full text.
More tools from the same developer
- Google Trends Scraper: interest over time, by region, related queries and trending searches.
- Google Ads Transparency Scraper: every Google ad a competitor runs, with text, landing page, regions and dates.
- Google AI Mode & AI Overview Tracker: see if Google's AI answers mention and cite your brand.
- YouTube Transcript & Subtitles Scraper: transcripts of videos, channels, playlists and Shorts.
- Google Hotels Scraper: hotel prices and every booking site's price for your dates.
- Funded Startups Feed (SEC Form D): companies that just raised money, with executives and phone.