Substack Scraper - Newsletter Posts and Top Newsletters avatar

Substack Scraper - Newsletter Posts and Top Newsletters

Pricing

$3.00 / 1,000 post or newsletter delivereds

Go to Apify Store
Substack Scraper - Newsletter Posts and Top Newsletters

Substack Scraper - Newsletter Posts and Top Newsletters

Posts from any Substack newsletter with title, date, free or paid, likes, comments, restacks, word count and optional full text, plus the top newsletters in any Substack category with author, bio, X profile and paid plan.

Pricing

$3.00 / 1,000 post or newsletter delivereds

Rating

0.0

(0)

Developer

Moses Ndambuki

Moses Ndambuki

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 days ago

Last modified

Categories

Features

Limited permissions

Share

Substack Scraper: Newsletter Posts and Top Newsletters by Category

Get posts from any Substack newsletter, with title, date, free or paid, likes, comments, restacks, word count and optional full text. Or list the top newsletters in any Substack category, with author, bio, X profile and paid plan. Works with substack.com subdomains and custom domains. No login.

In one test, the actor read 60 posts each from Lenny's Newsletter, Noahpinion and Astral Codex Ten, plus the top Technology newsletters, 185 rows in under 20 seconds.


Who this is for

  • Sponsors and ad buyers comparing newsletters by engagement before buying a slot
  • Newsletter writers studying what gets likes and comments in their niche
  • PR and partnerships teams building lists of writers to pitch
  • Researchers and AI teams collecting long-form writing with dates and engagement
  • Investors and analysts following a set of expert newsletters

What you get

A post row:

{
"type": "post",
"newsletter": "Lenny's Newsletter",
"title": "35 premium tools free for a year",
"url": "https://www.lennysnewsletter.com/p/35-premium-tools-free-for-a-yearnow",
"publishedAt": "2026-11-17T18:02:02.477Z",
"audience": "free",
"postType": "newsletter",
"wordCount": 1752,
"likes": 205,
"comments": 12,
"restacks": 2,
"authors": ["Lenny Rachitsky"]
}

A newsletter row from a category:

{
"type": "newsletter",
"category": "Technology",
"categoryRank": 2,
"name": "The Pragmatic Engineer",
"url": "https://newsletter.pragmaticengineer.com",
"authorName": "Gergely Orosz",
"authorBio": "Big Tech and startups from the inside...",
"twitterUrl": "https://x.com/...",
"hasPaidPlan": true,
"language": "en"
}

How it works

flowchart LR
A[Newsletter URLs or subdomains] --> B[Newsletter's public posts feed]
B --> C[Date and free-only filters]
C --> D[Post rows with engagement]
E[Categories] --> F[Substack category rankings]
F --> G[Newsletter rows with author]

Every Substack publication serves its post list as public JSON, and Substack publishes ranked newsletter lists per category. The actor reads both.


Quick start

  1. Click Try for free.
  2. Add Newsletters, like https://www.lennysnewsletter.com, noahpinion or substack.com/@author.
  3. Or add Categories like technology, business or finance to list the top newsletters.
  4. Click Start, then export to CSV, JSON or Google Sheets.

API

curl -X POST "https://api.apify.com/v2/acts/Turboextract~substack-newsletter-scraper/run-sync-get-dataset-items?token=YOUR_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"newsletters": ["https://www.lennysnewsletter.com", "noahpinion"],
"maxPostsPerNewsletter": 50
}'

Python

from apify_client import ApifyClient
client = ApifyClient("YOUR_TOKEN")
run = client.actor("Turboextract/substack-newsletter-scraper").call(run_input={
"categories": ["technology", "business"],
"maxNewslettersPerCategory": 100,
})
for n in client.dataset(run["defaultDatasetId"]).iterate_items():
print(n["categoryRank"], n["name"], n["url"], n["authorName"])

Input

FieldDefaultWhat it does
newsletters–Newsletter URLs, custom domains or subdomains
maxPostsPerNewsletter20Newest posts first
postedWithinDays0 (all)Only posts from the last N days
freeOnlyfalseSkip paid posts
includeContentfalseAdd post text (free preview for paid posts)
categories–List top newsletters in these categories
maxNewslettersPerCategory25Ranked order
maxResults500Total cap per run

Pricing

$0.003 per post or newsletter delivered. The last 50 posts from 20 newsletters (1,000 rows) cost $3.

Option1,000 rows
Substack Scraper$3, posts and category rankings
Other Substack actors on Apify$3 to $5, some charge extra per run
Newsletter sponsorship databases$100+ a month

Use cases

  • Sponsorship shortlists: top 100 newsletters in your category with the author and paid plan
  • Content research: which topics get the most likes and comments in your niche
  • Writer outreach: authors with their bio and X profile for podcast or PR pitches
  • Archive export: every post from a newsletter with dates and links
  • Datasets: free post text for analysis or AI training, with clear sources

Tips

  • Custom domains work. The actor reads the newsletter's own posts feed on that domain.
  • Category names match Substack's: technology, business, finance, culture, science, politics and more.
  • Use postedWithinDays: 7 on a weekly schedule to track new posts only.

Pairs well with


FAQ

Can it read paid posts? It returns the title, date and engagement for every post. For paid posts, the text is the free preview only.

Does it give subscriber counts? Substack only shows ranges for some newsletters. When it does, they appear in subscriberCountLabel.

Does it work with custom domains? Yes, like lennysnewsletter.com. Non-Substack sites return a warning.

Do I need a login? No.

Is it legal? It reads public post lists and rankings that Substack shows to every visitor.


Support

Built and maintained by Turboextract on the Apify platform.