Substack Scraper: Posts, Full Text, Comments

Scrape any Substack newsletter into clean data: every post with full text as Markdown, likes, comments, restacks, authors, dates and cover images, plus the comments themselves. Works with custom domains (e.g. lennysnewsletter.com).

Use cases

• 📚 AI / RAG datasets: newsletter archives as Markdown, ready for LLMs
• 📈 Content research: which posts get the most likes, comments and restacks
• 🔔 Monitoring: schedule daily with Only posts since to catch new posts from competitors or creators you follow
• 🧑‍💻 Creator & sponsor research: engagement per newsletter, posting frequency, authors

Input example

{
  "publications": ["https://www.lennysnewsletter.com", "astralcodexten"],
  "maxPostsPerPublication": 100,
  "sinceDate": "2026-01-01",
  "includeContent": true,
  "contentFormat": "markdown",
  "includeComments": true
}

Publications can be a full URL, a name.substack.com subdomain, or just the name.

Output example

{
  "publication": "https://www.lennysnewsletter.com",
  "title": "All of the Lenny & Friends Summit talks are now online!",
  "subtitle": "Plus, some reflections and takeaways from the day",
  "url": "https://www.lennysnewsletter.com/p/all-of-the-lenny-and-friends-summit",
  "date": "2026-09-29T13:15:57.512Z",
  "audience": "everyone",
  "isPaid": false,
  "authors": [{ "name": "Lenny Rachitsky", "handle": "lenny" }],
  "wordCount": 1276,
  "likes": 273,
  "commentsCount": 6,
  "restacks": 4,
  "coverImage": "https://substack-post-media.s3.amazonaws.com/…",
  "content": "# All of the Lenny & Friends Summit talks…",
  "contentIsTruncated": false,
  "comments": [{ "author": "…", "body": "thank you for existing", "reactions": 12, "depth": 0 }]
}

Paid posts

Paid (subscriber-only) posts include only the public preview that Substack shows to every visitor, and are flagged with isPaid: true and contentIsTruncated: true. Use Only free posts to skip them entirely. This Actor never accesses paywalled content.

FAQ

Do I need an account or cookies? No.

How fast is it? Post lists are fetched 50 at a time; with full content it fetches one post at a time, politely.

Is it legal? It collects publicly available posts. Respect the authors' copyright when reusing content.