Substack Scraper - Posts, Authors & Search avatar

Substack Scraper - Posts, Authors & Search

Pricing

from $1.20 / 1,000 results

Go to Apify Store
Substack Scraper - Posts, Authors & Search

Substack Scraper - Posts, Authors & Search

Scrape Substack publications: titles, subtitles, authors, dates, reactions, comment counts, and full post content. Keyword search across any newsletter.

Pricing

from $1.20 / 1,000 results

Rating

0.0

(0)

Developer

Thirdwatch

Thirdwatch

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 hours ago

Last modified

Categories

Share

Substack Scraper — Posts, Authors & Search

Thirdwatch portfolio: 5K users across 97 public Actors, 2M+ records delivered, and >99% run success. Explore all Thirdwatch Actors.

Scrape any public Substack publication through its own JSON API — no browser, no login. Pull post listings with titles, authors, dates, and engagement, optionally expand to full post content, or keyword-search a publication's archive.

Use it for newsletter research, content monitoring, competitive analysis, and building post datasets for AI workflows.

Why this Actor

  • Official public API: uses api/v1/archive and api/v1/posts/{slug} — fast, stable, and cheap (~$0.0003/run).
  • Full post content: set includeContent to get rendered post bodies, not just metadata.
  • Keyword search: search queries the publication's own search index.
  • Publication context on every row: newsletter name, subdomain, and description.
  • Sorting and limits: newest/oldest ordering plus maxPosts to bound runs.

Quick start

{
"publicationUrls": ["https://newsletter.pragmaticengineer.com"],
"maxPosts": 20,
"includeContent": false
}

Search a publication:

{
"publicationUrls": ["https://newsletter.pragmaticengineer.com"],
"search": "hiring",
"maxPosts": 10
}

Input

FieldRequiredDescription
publicationUrlsYesSubstack publication URLs or subdomains.
searchNoKeyword to search within each publication's archive.
maxPostsNoMax posts per publication. Default: 50.
includeContentNoFetch full post body per post (one extra request each). Default: false.
sortNonew or top ordering where supported.

Output

FieldDescription
title, subtitle, slug, urlPost identity and link.
authorPost author name.
postDatePublication timestamp.
descriptionPost excerpt/social description.
reactions, commentCountEngagement counts.
coverImage, podcastUrlMedia assets when present.
publicationNewsletter name/subdomain.
typepost or search_result.
bodyFull post content when includeContent is set.

Notes & limitations

  • Private/paid posts return metadata only — paywalled bodies aren't fetched.
  • Custom-domain publications are supported; the Actor resolves the underlying Substack API host automatically.