Substack Scraper - Newsletter Posts and Top Newsletters
Pricing
$3.00 / 1,000 post or newsletter delivereds
Substack Scraper - Newsletter Posts and Top Newsletters
Posts from any Substack newsletter with title, date, free or paid, likes, comments, restacks, word count and optional full text, plus the top newsletters in any Substack category with author, bio, X profile and paid plan.
Pricing
$3.00 / 1,000 post or newsletter delivereds
Rating
0.0
(0)
Developer
Moses Ndambuki
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
4 days ago
Last modified
Categories
Features
Share
Substack Scraper: Newsletter Posts and Top Newsletters by Category
Get posts from any Substack newsletter, with title, date, free or paid, likes, comments, restacks, word count and optional full text. Or list the top newsletters in any Substack category, with author, bio, X profile and paid plan. Works with substack.com subdomains and custom domains. No login.
In one test, the actor read 60 posts each from Lenny's Newsletter, Noahpinion and Astral Codex Ten, plus the top Technology newsletters, 185 rows in under 20 seconds.
Who this is for
- Sponsors and ad buyers comparing newsletters by engagement before buying a slot
- Newsletter writers studying what gets likes and comments in their niche
- PR and partnerships teams building lists of writers to pitch
- Researchers and AI teams collecting long-form writing with dates and engagement
- Investors and analysts following a set of expert newsletters
What you get
A post row:
{"type": "post","newsletter": "Lenny's Newsletter","title": "35 premium tools free for a year","url": "https://www.lennysnewsletter.com/p/35-premium-tools-free-for-a-yearnow","publishedAt": "2026-11-17T18:02:02.477Z","audience": "free","postType": "newsletter","wordCount": 1752,"likes": 205,"comments": 12,"restacks": 2,"authors": ["Lenny Rachitsky"]}
A newsletter row from a category:
{"type": "newsletter","category": "Technology","categoryRank": 2,"name": "The Pragmatic Engineer","url": "https://newsletter.pragmaticengineer.com","authorName": "Gergely Orosz","authorBio": "Big Tech and startups from the inside...","twitterUrl": "https://x.com/...","hasPaidPlan": true,"language": "en"}
How it works
flowchart LRA[Newsletter URLs or subdomains] --> B[Newsletter's public posts feed]B --> C[Date and free-only filters]C --> D[Post rows with engagement]E[Categories] --> F[Substack category rankings]F --> G[Newsletter rows with author]
Every Substack publication serves its post list as public JSON, and Substack publishes ranked newsletter lists per category. The actor reads both.
Quick start
- Click Try for free.
- Add Newsletters, like
https://www.lennysnewsletter.com,noahpinionorsubstack.com/@author. - Or add Categories like
technology,businessorfinanceto list the top newsletters. - Click Start, then export to CSV, JSON or Google Sheets.
API
curl -X POST "https://api.apify.com/v2/acts/Turboextract~substack-newsletter-scraper/run-sync-get-dataset-items?token=YOUR_TOKEN" \-H "Content-Type: application/json" \-d '{"newsletters": ["https://www.lennysnewsletter.com", "noahpinion"],"maxPostsPerNewsletter": 50}'
Python
from apify_client import ApifyClientclient = ApifyClient("YOUR_TOKEN")run = client.actor("Turboextract/substack-newsletter-scraper").call(run_input={"categories": ["technology", "business"],"maxNewslettersPerCategory": 100,})for n in client.dataset(run["defaultDatasetId"]).iterate_items():print(n["categoryRank"], n["name"], n["url"], n["authorName"])
Input
| Field | Default | What it does |
|---|---|---|
newsletters | – | Newsletter URLs, custom domains or subdomains |
maxPostsPerNewsletter | 20 | Newest posts first |
postedWithinDays | 0 (all) | Only posts from the last N days |
freeOnly | false | Skip paid posts |
includeContent | false | Add post text (free preview for paid posts) |
categories | – | List top newsletters in these categories |
maxNewslettersPerCategory | 25 | Ranked order |
maxResults | 500 | Total cap per run |
Pricing
$0.003 per post or newsletter delivered. The last 50 posts from 20 newsletters (1,000 rows) cost $3.
| Option | 1,000 rows |
|---|---|
| Substack Scraper | $3, posts and category rankings |
| Other Substack actors on Apify | $3 to $5, some charge extra per run |
| Newsletter sponsorship databases | $100+ a month |
Use cases
- Sponsorship shortlists: top 100 newsletters in your category with the author and paid plan
- Content research: which topics get the most likes and comments in your niche
- Writer outreach: authors with their bio and X profile for podcast or PR pitches
- Archive export: every post from a newsletter with dates and links
- Datasets: free post text for analysis or AI training, with clear sources
Tips
- Custom domains work. The actor reads the newsletter's own posts feed on that domain.
- Category names match Substack's: technology, business, finance, culture, science, politics and more.
- Use
postedWithinDays: 7on a weekly schedule to track new posts only.
Pairs well with
- Google News Scraper: news articles by search or topic
- Podcast Transcript Dataset: podcast episodes as text
- Bluesky Scraper: what writers are posting on Bluesky
FAQ
Can it read paid posts? It returns the title, date and engagement for every post. For paid posts, the text is the free preview only.
Does it give subscriber counts? Substack only shows ranges for some newsletters. When it does, they appear in subscriberCountLabel.
Does it work with custom domains? Yes, like lennysnewsletter.com. Non-Substack sites return a warning.
Do I need a login? No.
Is it legal? It reads public post lists and rankings that Substack shows to every visitor.
Support
- Docs and examples: https://github.com/andersonjames38phd-cpu/substack-newsletter-scraper
- Community Discord: https://discord.gg/8SrXSCpvgj
Built and maintained by Turboextract on the Apify platform.