Substack Posts Scraper — Newsletter Archive & Stats

Scrape the complete post archive of any Substack publication — including custom-domain ones — with engagement stats and optional full post text. One JSON item per post.

What you get per post

• Title, subtitle, description, slug, canonical URL
• Publish date and post type (newsletter / podcast / thread)
• Likes and comment counts
• Paywall status (audience + isPaywalled)
• Full post text of public posts (optional, includeBody: true)

Who is this for?

• Newsletter operators — study what performs in your niche before writing
• Content & trend research — track topics and engagement across publications
• AI / RAG pipelines — clean long-form text with metadata
• Journalists & analysts — archive and monitor influential newsletters

Input

{
  "publications": ["astralcodexten", "https://www.noahpinion.blog"],
  "maxPostsPerPublication": 100,
  "includeBody": false
}

Accepts bare names (astralcodexten), subdomains (name.substack.com), or full URLs — custom domains work too.

Output (one item per post)

{
  "publication": "https://astralcodexten.substack.com",
  "title": "Your Book Review: ...",
  "publishedAt": "2026-06-20T12:01:33.000Z",
  "type": "newsletter",
  "audience": "everyone",
  "isPaywalled": false,
  "wordCount": 8214,
  "likes": 312,
  "comments": 447,
  "url": "https://www.astralcodexten.com/p/your-book-review"
}

Pricing

Pay per event: a small fee per post scraped. Scan one archive or a hundred.

FAQ

Does it get paywalled content? No. Paywalled posts return their public metadata and preview only — bodyText is fetched exclusively for public posts.

How far back does it go? The whole archive — Substack's API paginates from newest to oldest with no hard cap.