Substack Scraper - Newsletter Posts, Full Text & Comments avatar

Substack Scraper - Newsletter Posts, Full Text & Comments

Pricing

from $0.80 / 1,000 posts

Go to Apify Store
Substack Scraper - Newsletter Posts, Full Text & Comments

Substack Scraper - Newsletter Posts, Full Text & Comments

Substack newsletter scraper (incl. custom domains): Substack posts with full text, likes, restacks, authors and tags, plus Substack comments. Top/newest, keyword search, date range. No login. $1 per 1,000 posts.

Pricing

from $0.80 / 1,000 posts

Rating

0.0

(0)

Developer

Leping Gong

Leping Gong

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

5 days ago

Last modified

Features

Limited permissions

Share

Substack Scraper — Newsletter Posts, Full Text & Comments

Scrape any Substack newsletter — including custom domains like www.lennysnewsletter.com — without login or API keys. Get every post with full text, likes, comments count, restacks, word count, authors, tags, cover image and links, plus the comments and replies.

Why this scraper?

  • 🌐 Works with custom domains — not only *.substack.com
  • 📝 Full clean text of free posts (Markdown-like headings and lists), optional raw HTML
  • 🔥 Top posts or newest — find a newsletter's most popular posts in one click
  • 🔎 Keyword search inside a newsletter, date range, free posts only
  • 💬 Comments & replies with author, likes and thread depth
  • ⚡ Fast & cheap — public JSON API, no browser, no start fee
  • 💸 Pay per post — invalid newsletters and errors are free

Input

{
"newsletters": ["simonw", "www.lennysnewsletter.com", "https://www.astralcodexten.com/p/some-post"],
"maxPostsPerNewsletter": 100,
"sortBy": "top",
"searchQuery": "AI",
"postsFrom": "2026-01-01",
"maxCommentsPerPost": 20
}

Accepted formats: name, name.substack.com, custom domain, substack.com/@handle, open.substack.com/pub/name/p/slug, post URL.

Output

Post:

{
"type": "post",
"newsletter": "https://simonw.substack.com",
"postId": 224270395,
"title": "Locating the source of a mysterious beep with Claude",
"subtitle": "Plus Hide your slop PR descriptions behind <details><summary>",
"url": "https://simonw.substack.com/p/locating-the-source-of-a-mysterious",
"date": "2026-11-10T07:41:51.409Z",
"audience": "everyone",
"isPaid": false,
"bodyIsFull": true,
"author": "Simon Willison",
"tags": ["ai"],
"wordcount": 5034,
"reactions": 30,
"comments": 11,
"restacks": 2,
"text": "In this newsletter: ...",
"links": ["https://github.com/simonw/beep-locator"]
}

Comment:

{
"type": "comment",
"postUrl": "https://simonw.substack.com/p/locating-the-source-of-a-mysterious",
"commentId": 383527088,
"parentId": null,
"depth": 0,
"date": "2026-11-10T08:22:06.052Z",
"authorName": "Harish Gupta",
"text": "The carbon monoxide detector was an important find...",
"reactions": 1
}

Use cases

  • Content research & competitor analysis — which posts of a newsletter get the most likes and comments
  • AI / RAG datasets — clean full text of thousands of newsletter posts for LLMs
  • Media monitoring — schedule daily runs with Posts from date and a keyword
  • Audience research — comments show what readers care about
  • Lead generation — find active writers in your niche

Limits

Paid posts return only the public preview (isPaid: true, bodyIsFull: false). Only public data is collected — no login, no subscriber data.

Pricing

  • Post — per post row (full text included)
  • Comment — per comment row (only if you set Max comments per post)

Discounts for Apify Silver, Gold and higher plans.

How to use Substack Scraper

  1. Click Try for free (the Apify free plan includes monthly credit).
  2. Fill in the input — the example input is already pre-filled, so you can just press Start.
  3. Download results as JSON, CSV, Excel or HTML, or open them in the dataset table view.

Integrations & API

  • API — run it from Python, Node.js or any language with the Apify API / apify-client and get results as JSON.
  • Schedules & monitoring — run it hourly, daily or weekly and get only fresh data.
  • Zapier, Make, n8n, Google Sheets, Slack, webhooks — send results to your tools automatically.
  • AI agents (MCP) — use it from Claude, ChatGPT, Cursor or any MCP client through the Apify MCP server.

FAQ

Do I need an API key, login or cookies? No. It reads publicly available data only.

How much does it cost? You pay only for results (see the Pricing tab), no start fee. Error rows are free. Higher Apify plans get automatic discounts.

Is it legal? It collects public data only. Make sure your use complies with the website's terms and data-protection laws (e.g. GDPR) — don't collect personal data without a legal basis.

Something doesn't work or you need a feature? Open an issue in the Issues tab — we usually reply within a day.

More from ScrolahData