Substack Scraper - Posts, Authors & Search
Pricing
from $1.20 / 1,000 results
Substack Scraper - Posts, Authors & Search
Scrape Substack publications: titles, subtitles, authors, dates, reactions, comment counts, and full post content. Keyword search across any newsletter.
Pricing
from $1.20 / 1,000 results
Rating
0.0
(0)
Developer
Thirdwatch
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
4 hours ago
Last modified
Share
Substack Scraper — Posts, Authors & Search
Thirdwatch portfolio: 5K users across 97 public Actors, 2M+ records delivered, and >99% run success. Explore all Thirdwatch Actors.
Scrape any public Substack publication through its own JSON API — no browser, no login. Pull post listings with titles, authors, dates, and engagement, optionally expand to full post content, or keyword-search a publication's archive.
Use it for newsletter research, content monitoring, competitive analysis, and building post datasets for AI workflows.
Why this Actor
- Official public API: uses
api/v1/archiveandapi/v1/posts/{slug}— fast, stable, and cheap (~$0.0003/run). - Full post content: set
includeContentto get rendered post bodies, not just metadata. - Keyword search:
searchqueries the publication's own search index. - Publication context on every row: newsletter name, subdomain, and description.
- Sorting and limits: newest/oldest ordering plus
maxPoststo bound runs.
Quick start
{"publicationUrls": ["https://newsletter.pragmaticengineer.com"],"maxPosts": 20,"includeContent": false}
Search a publication:
{"publicationUrls": ["https://newsletter.pragmaticengineer.com"],"search": "hiring","maxPosts": 10}
Input
| Field | Required | Description |
|---|---|---|
publicationUrls | Yes | Substack publication URLs or subdomains. |
search | No | Keyword to search within each publication's archive. |
maxPosts | No | Max posts per publication. Default: 50. |
includeContent | No | Fetch full post body per post (one extra request each). Default: false. |
sort | No | new or top ordering where supported. |
Output
| Field | Description |
|---|---|
title, subtitle, slug, url | Post identity and link. |
author | Post author name. |
postDate | Publication timestamp. |
description | Post excerpt/social description. |
reactions, commentCount | Engagement counts. |
coverImage, podcastUrl | Media assets when present. |
publication | Newsletter name/subdomain. |
type | post or search_result. |
body | Full post content when includeContent is set. |
Notes & limitations
- Private/paid posts return metadata only — paywalled bodies aren't fetched.
- Custom-domain publications are supported; the Actor resolves the underlying Substack API host automatically.