Substack Scraper: Posts, Full Text, Comments & Newsletters avatar

Substack Scraper: Posts, Full Text, Comments & Newsletters

Pricing

from $1.00 / 1,000 posts

Go to Apify Store
Substack Scraper: Posts, Full Text, Comments & Newsletters

Substack Scraper: Posts, Full Text, Comments & Newsletters

Scrape Substack posts with full text as clean Markdown, comments, search across all of Substack, and top newsletters per category with subscriber counts and prices. No login.

Pricing

from $1.00 / 1,000 posts

Rating

0.0

(0)

Developer

Lean Pilar

Lean Pilar

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 days ago

Last modified

Features

Limited permissions

Share

Get Substack posts with the full article as clean Markdown, their comments, search results from all of Substack, and top newsletters per category with subscriber counts and subscription prices. Works with custom domains (like www.lennysnewsletter.com) and profile links (substack.com/@lenny). No login, no cookies, no proxy needed.

What you can do

  • Read a newsletter's archive: newest or most popular posts, filtered by date ("last 30 days"), free/paid, post type, likes, or a keyword.
  • Get full text for AI: every free post comes as Markdown and plain text, without Subscribe buttons and share widgets. Ready for RAG, summaries and LLM pipelines. Paid posts include the public preview.
  • Collect comments: best comments first, with replies, author, likes and date.
  • Search all of Substack: find posts and newsletters about any topic, e.g. "ai marketing".
  • Find newsletters to sponsor or pitch: Substack's leaderboards for 32 categories (Technology, Business, Finance, Culture...), top overall or top paid, with approximate subscribers, paid subscriber band, monthly and yearly price, author, X/Twitter handle and launch date. Filter by minimum subscribers.

Input examples

Latest posts of two newsletters, last 30 days, with full text:

{
"newsletters": ["lenny", "www.astralcodexten.com"],
"publishedAfter": "30 days",
"maxPostsPerNewsletter": 50
}

Top 100 paid Business newsletters with at least 10,000 subscribers:

{
"categories": ["business"],
"leaderboard": "paid",
"maxNewslettersPerCategory": 100,
"minSubscribers": 10000
}

Search Substack for a topic and get posts plus comments:

{
"searchQueries": ["ai marketing"],
"maxPostsPerSearch": 30,
"includeComments": true,
"maxCommentsPerPost": 50
}

Output

Every row has a type: post, comment or newsletter. The dataset has a separate table view for each.

Post

{
"type": "post",
"url": "https://www.noahpinion.blog/p/for-the-democrats-now-comes-the-hard",
"title": "For the Democrats, now comes the hard part",
"subtitle": "The Dems have to figure out what they stand for, and what they want to do.",
"newsletter": "Noahpinion",
"authors": ["Noah Smith"],
"publishedAt": "2026-11-06T06:46:24.428Z",
"isPaid": false,
"postType": "newsletter",
"wordCount": 3544,
"likes": 374,
"comments": 114,
"restacks": 41,
"markdown": "Democrats won a historic victory in Tuesday's election. ...",
"text": "Democrats won a historic victory ...",
"isFullText": true
}

Newsletter

{
"type": "newsletter",
"name": "Lenny's Newsletter",
"url": "https://www.lennysnewsletter.com",
"author": "Lenny Rachitsky",
"subscribers": 1200000,
"subscribersText": "Over 1,200,000 subscribers",
"paidSubscribersText": "Tens of thousands of paid subscribers",
"isPaid": true,
"monthlyPrice": 20,
"yearlyPrice": 200,
"currency": "USD",
"twitter": "lennysan",
"category": "business",
"rank": 1
}

Comment: postUrl, postTitle, author, authorHandle, text, likes, replies, depth, parentId, publishedAt.

Pricing

Pay only for rows you get. No start fee.

RowPrice
Post (full text included)$1.00 per 1,000
Newsletter$2.00 per 1,000
Comment$0.30 per 1,000

Set a maximum cost per run in Apify and the scraper stops when it is reached.

Notes

  • Subscriber numbers are the rounded figures Substack shows publicly (for example "271K+"). Substack does not publish exact counts.
  • Paid posts: only the free preview text is public, so isFullText is false for them.
  • Only public data is collected. Respect authors' copyright when you reuse full text.

More tools from the same developer