Substack Scraper - Posts, Full Text, Search & Newsletter Leads

All of Substack in one Actor: scrape any newsletter's posts with full text and comments, search all of Substack by keyword, and export the top newsletters of any category with subscriber counts, author social links, paid plan prices and current sponsors.

No login, no browser, fast JSON output. From $1 per 1,000 posts.

What you can scrape

Input	You get
Publications (lennysnewsletter.com, name.substack.com, substack.com/@handle)	Every post: title, subtitle, date, URL, likes, restacks, comment count, word count, paywall status, tags, authors, cover image, podcast audio, full text
Comments (optional)	Every comment and reply: author, handle, date, text, likes, thread depth & parent
Search queries (ai agents, real estate investing…)	Matching posts from all of Substack plus matching authors with subscriber & follower counts
Categories (technology, business, finance, health, culture, crypto…)	Top newsletters from Substack leaderboards (Top paid / Trending): rank, author, bio, subscriber count, followers, X / LinkedIn / YouTube / website links, monthly & annual price, bestseller tier, active sponsors, podcast feed

Use cases

• Newsletter sponsorships & influencer outreach — build a list of the top newsletters in your niche with subscriber counts, prices and social links. See who already sponsors them.
• Content & trend research — what topics get the most likes, restacks and comments.
• Competitor tracking — follow competitor newsletters; get only new posts each day (monitoring mode).
• AI / RAG datasets — clean full-text articles with metadata.
• Audience research — read what readers actually say in comments.

Monitoring new posts

Enable "Monitoring: only new posts since last run" and create a daily Schedule. Each run returns only posts published since the previous run — connect Slack, email, Google Sheets or a webhook to get alerts.

Pricing (pay per event)

Event	Price
Post (incl. full text)	$0.001
Comment	$0.0003
Newsletter / author record (leaderboards & search)	$0.003

Examples: 1,000 posts with full text = $1. The top 100 newsletters in a category with subscriber counts and socials = $0.30.

Example: newsletter record

{
  "type": "publication",
  "rank": 1,
  "category": "Technology",
  "name": "SemiAnalysis",
  "url": "https://newsletter.semianalysis.com",
  "authorName": "Dylan Patel",
  "subscriberCount": 319000,
  "subscriberCountText": "319K+ subscribers",
  "authorFollowers": 371194,
  "authorSocialLinks": { "twitter": "https://x.com/dylan522p", "website": "https://www.semianalysis.com" },
  "isPaid": true,
  "monthlyPrice": 50.0,
  "annualPrice": 500.0,
  "currency": "USD",
  "bestsellerTier": 1000,
  "activeSponsors": [],
  "firstPostDate": "2020-05-22T21:26:00.000Z"
}

Example: post record

{
  "type": "post",
  "publication": "Lenny's Newsletter",
  "title": "All of the Lenny & Friends Summit talks are now online!",
  "url": "https://www.lennysnewsletter.com/p/all-of-the-lenny-and-friends-summit",
  "postDate": "2026-09-29T13:15:57.512Z",
  "audience": "everyone",
  "isPaywalled": false,
  "wordCount": 1276,
  "likes": 277,
  "restacks": 4,
  "comments": 6,
  "authors": [{ "name": "Lenny Rachitsky", "handle": "lenny" }],
  "content": "Full article text…"
}

enrichAuthors adds subscriber counts and social links to leaderboard records (one extra request per newsletter).

FAQ

Can it scrape paywalled posts? It returns all metadata and the public preview of paid posts (contentIsPreview: true). It does not bypass paywalls.

Does it work with custom domains? Yes — any Substack publication, including custom domains like lennysnewsletter.com.

Are subscriber counts always available? Substack shows them for most authors; a few authors hide them, in which case the field is empty.

Need another field? Open an issue — I usually reply within 24 hours.