Substack Scraper: Newsletter Posts, Likes & Full Text
Pricing
Pay per event
Substack Scraper: Newsletter Posts, Likes & Full Text
Scrape posts from any Substack newsletter (substack.com or custom domain), single post URLs or newsletters found by keyword: title, authors, date, likes, comments, restacks, word count, paywall flag, tags and full text of free posts. No login.
Scrape posts from any Substack newsletter, on name.substack.com or a custom domain, or from single post URLs. You can also find newsletters by keyword and scrape their latest posts. You get the title, subtitle, authors, date, likes, comments, restacks, word count, paywall flag and tags, and optionally the full text of free posts.
No login, no browser. Pay only per post delivered.
What you can paste
- Newsletter URLs:
https://www.lennysnewsletter.com,https://astralcodexten.substack.com - Bare subdomain names:
lenny,astralcodexten - Single post URLs:
https://www.lennysnewsletter.com/p/how-to-tell-if-a-startup-has-a-moat,open.substack.com/pub/name/p/slug - Keywords in Find newsletters by keyword, for example
productivityorAI startups
What you get
| Field | Example |
|---|---|
postId, title, subtitle, url, slug | post identity |
publicationUrl | https://www.lennysnewsletter.com |
publishedAt | 2026-09-29T13:15:57.512Z |
type | newsletter / podcast / thread |
audience, isPaywalled | everyone / only_paid, false |
authors, authorHandles | ["Lenny Rachitsky"], ["lenny"] |
wordCount, likeCount, commentCount, restackCount | 1276, 291, 7, 5 |
tags, section, description, coverImage, language | metadata |
podcastUrl, podcastDurationSeconds | for podcast episodes |
contentText, contentHtml, contentIsPreview | with Include full text |
Use cases
- Newsletter research and competitive analysis: which topics and formats get the most likes, comments and restacks.
- Content curation and monitoring: track new posts from the newsletters you follow (use Published after).
- AI and RAG: clean full text of free posts for summaries, search and LLM pipelines.
- Lead and partner discovery: find newsletters in a niche by keyword.
How to use
- Add newsletters or post URLs, and/or keywords.
- Set Max posts per newsletter (newest first) and optionally Published after.
- Turn on Include full text if you need the post body.
- Run. Each post is one dataset record.
Example input
{"startUrls": ["https://www.lennysnewsletter.com", "astralcodexten"],"searchQueries": ["productivity"],"maxPublicationsPerQuery": 5,"maxPostsPerPublication": 50,"includeContent": true,"publishedAfter": "2026-06-01"}
Pricing
- Post: charged per post with metadata.
- Post full text: charged additionally only when Include full text is on and the post has text.
Proxies and compute are included.
Notes
- Paid-subscriber posts are listed with all metadata, but only the public preview of their text is available (
contentIsPreview: true). This actor does not bypass paywalls. - Use Only free posts to skip paid posts entirely.
FAQ
Do I need a Substack account? No.
Something broke? Open an issue on the Issues tab and it will be fixed quickly.