Substack Scraper - Newsletter Posts & Full Text
Pricing
from $0.35 / 1,000 posts
Substack Scraper - Newsletter Posts & Full Text
Substack scraper, $0.50 per 1,000 posts: Substack posts from any Substack newsletter archive, custom domains included, with title, date, author, likes, comments, restacks, paid flag and Substack full text. Newsletter posts scraper; newest or top, no login.
Pricing
from $0.35 / 1,000 posts
Rating
0.0
(0)
Developer
Sumitr Mardy
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
42 minutes ago
Last modified
Categories
Features
Share
Scrape every post of any Substack newsletter, custom domains included: title, date, author, likes, comments, restacks, word count, paid flag and, if you want, the full text as clean text and HTML. Newest first or most liked, with an optional date cut-off.
Built for newsletter writers studying competitors, marketers tracking a niche, researchers, and AI pipelines that need newsletter text.
$0.50 per 1,000 posts. Failed newsletters are free. No login, no Substack account.
What you get
| Field | Example |
|---|---|
newsletter, newsletterUrl | Astral Codex Ten, https://astralcodexten.substack.com |
postId, title, subtitle, url, slug | 225455324, Varieties Of Discourseposting, https://www.astralcodexten.com/p/... |
type, postDate | newsletter, 2026-11-18T07:47:03.648Z |
audience, isPaid | everyone, false |
author, authors | Scott Alexander, ["Scott Alexander"] |
wordCount, likes, comments, restacks | 1552, 218, 152, 15 |
section, tags, coverImage, podcastUrl | |
contentText, contentHtml | full body with Include full text |
status | ok, no_results, failed, not_found, invalid_input |
Fixed shape: numbers 0 when unknown, lists always lists, text "" when missing.
How to use it
- Newsletters: one per line, as a subdomain (
astralcodexten), a URL (https://www.lennysnewsletter.com) or any post URL from the newsletter. - Max posts per newsletter: newest first, or most liked with Sort = Top.
- Include full text: adds the body as text and HTML (one extra request per post, same price).
- Published after: only posts on or after a date (with Newest first).
Pricing
Pay per event, $0.0005 per post ($0.50 per 1,000), cheaper on higher Apify plans. Full text costs nothing extra. Failed newsletters and invalid inputs are free; each post is billed once per run. Apify adds its standard tiny start event per run.
Honest limits
- Paid posts: only the free preview Substack shows to non-subscribers.
isPaidtells you which ones. - No subscriber counts per post or open rates: Substack does not publish them.
- No comment text in this version, only the comment count.
- Public data only. Use it in line with Substack's terms.
Use it from AI agents (MCP)
Hosted, with OAuth sign-in:
{"mcpServers": {"substack": {"url": "https://mcp.apify.com/?tools=sumitr_mardy/substack-scraper"}}}
With an API token instead of OAuth:
{"mcpServers": {"substack": {"url": "https://mcp.apify.com/?tools=sumitr_mardy/substack-scraper","headers": { "Authorization": "Bearer YOUR_APIFY_TOKEN" }}}}
Local stdio:
{"mcpServers": {"substack": {"command": "npx","args": ["-y", "@apify/actors-mcp-server", "--actors", "sumitr_mardy/substack-scraper"],"env": { "APIFY_TOKEN": "YOUR_APIFY_TOKEN" }}}}
Run it from code
Python:
from apify_client import ApifyClientclient = ApifyClient("YOUR_APIFY_TOKEN")run = client.actor("sumitr_mardy/substack-scraper").call(run_input={"newsletters": ["astralcodexten"],"maxPostsPerNewsletter": 20,"includeContent": True,})for p in client.dataset(run["defaultDatasetId"]).iterate_items():print(p["postDate"][:10], p["title"], p["likes"], len(p["contentText"]))
cURL (waits for the run and returns the rows):
curl -X POST "https://api.apify.com/v2/acts/sumitr_mardy~substack-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \-H "Content-Type: application/json" \-d '{"newsletters":["https://www.lennysnewsletter.com"],"maxPostsPerNewsletter":25,"sort":"top"}'
FAQ
Do custom domains work? Yes. Paste the newsletter's own address, e.g. https://www.lennysnewsletter.com.
Which posts did best? Set Sort to Top: posts come back most liked first, with likes, comments and restacks.
Can I keep an archive up to date? Schedule the actor with Published after set to your last run's date.