Substack Scraper - Newsletter Posts, Full Text & Comments
Pricing
from $0.80 / 1,000 posts
Substack Scraper - Newsletter Posts, Full Text & Comments
Substack newsletter scraper (incl. custom domains): Substack posts with full text, likes, restacks, authors and tags, plus Substack comments. Top/newest, keyword search, date range. No login. $1 per 1,000 posts.
Pricing
from $0.80 / 1,000 posts
Rating
0.0
(0)
Developer
Leping Gong
Maintained by CommunityActor stats
0
Bookmarked
3
Total users
2
Monthly active users
5 days ago
Last modified
Categories
Features
Share
Substack Scraper — Newsletter Posts, Full Text & Comments
Scrape any Substack newsletter — including custom domains like www.lennysnewsletter.com — without login or API keys. Get every post with full text, likes, comments count, restacks, word count, authors, tags, cover image and links, plus the comments and replies.
Why this scraper?
- 🌐 Works with custom domains — not only
*.substack.com - 📝 Full clean text of free posts (Markdown-like headings and lists), optional raw HTML
- 🔥 Top posts or newest — find a newsletter's most popular posts in one click
- 🔎 Keyword search inside a newsletter, date range, free posts only
- 💬 Comments & replies with author, likes and thread depth
- ⚡ Fast & cheap — public JSON API, no browser, no start fee
- 💸 Pay per post — invalid newsletters and errors are free
Input
{"newsletters": ["simonw", "www.lennysnewsletter.com", "https://www.astralcodexten.com/p/some-post"],"maxPostsPerNewsletter": 100,"sortBy": "top","searchQuery": "AI","postsFrom": "2026-01-01","maxCommentsPerPost": 20}
Accepted formats: name, name.substack.com, custom domain, substack.com/@handle, open.substack.com/pub/name/p/slug, post URL.
Output
Post:
{"type": "post","newsletter": "https://simonw.substack.com","postId": 224270395,"title": "Locating the source of a mysterious beep with Claude","subtitle": "Plus Hide your slop PR descriptions behind <details><summary>","url": "https://simonw.substack.com/p/locating-the-source-of-a-mysterious","date": "2026-11-10T07:41:51.409Z","audience": "everyone","isPaid": false,"bodyIsFull": true,"author": "Simon Willison","tags": ["ai"],"wordcount": 5034,"reactions": 30,"comments": 11,"restacks": 2,"text": "In this newsletter: ...","links": ["https://github.com/simonw/beep-locator"]}
Comment:
{"type": "comment","postUrl": "https://simonw.substack.com/p/locating-the-source-of-a-mysterious","commentId": 383527088,"parentId": null,"depth": 0,"date": "2026-11-10T08:22:06.052Z","authorName": "Harish Gupta","text": "The carbon monoxide detector was an important find...","reactions": 1}
Use cases
- Content research & competitor analysis — which posts of a newsletter get the most likes and comments
- AI / RAG datasets — clean full text of thousands of newsletter posts for LLMs
- Media monitoring — schedule daily runs with Posts from date and a keyword
- Audience research — comments show what readers care about
- Lead generation — find active writers in your niche
Limits
Paid posts return only the public preview (isPaid: true, bodyIsFull: false). Only public data is collected — no login, no subscriber data.
Pricing
- Post — per post row (full text included)
- Comment — per comment row (only if you set Max comments per post)
Discounts for Apify Silver, Gold and higher plans.
How to use Substack Scraper
- Click Try for free (the Apify free plan includes monthly credit).
- Fill in the input — the example input is already pre-filled, so you can just press Start.
- Download results as JSON, CSV, Excel or HTML, or open them in the dataset table view.
Integrations & API
- API — run it from Python, Node.js or any language with the Apify API /
apify-clientand get results as JSON. - Schedules & monitoring — run it hourly, daily or weekly and get only fresh data.
- Zapier, Make, n8n, Google Sheets, Slack, webhooks — send results to your tools automatically.
- AI agents (MCP) — use it from Claude, ChatGPT, Cursor or any MCP client through the Apify MCP server.
FAQ
Do I need an API key, login or cookies? No. It reads publicly available data only.
How much does it cost? You pay only for results (see the Pricing tab), no start fee. Error rows are free. Higher Apify plans get automatic discounts.
Is it legal? It collects public data only. Make sure your use complies with the website's terms and data-protection laws (e.g. GDPR) — don't collect personal data without a legal basis.
Something doesn't work or you need a feature? Open an issue in the Issues tab — we usually reply within a day.