Pricing

from $1.99 / 1,000 results

Substack Posts Scraper 📚

Substack Posts scraper extracts publicly available newsletter posts, titles, authors, publication dates, tags, post URLs, and metadata 📰📊 Perfect for content research, trend analysis, competitive intelligence, and newsletter monitoring.

Pricing

from $1.99 / 1,000 results

Rating

0.0

(0)

Developer

Scrapers Hub

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Substack Keyword Search Scraper

An Apify actor that searches Substack posts by keyword and exports the full post objects returned by Substack's search API.

Input

{
  "keywords": ["hi", "apify.com"],
  "maxItems": 50,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Field	Type	Description
`keywords`	string[]	Search terms matched against Substack publications. Required.
`maxItems`	integer	Max posts per keyword. `0` = unlimited. Default `50`.

Proxy is handled internally (rotating US residential) and is not a user input.

Why residential proxies? From datacenter IPs, Substack silently returns an empty results array (a soft block). Residential IPs return real posts.

Output

Each dataset item is the full Substack post object from the search endpoint, plus two added fields:

keyword — the search term that surfaced this post.
scrapedAt — ISO-8601 UTC timestamp of when it was scraped.
body_text — plain-text version of body_html (only when body_html is present).

Example (trimmed):

{
  "keyword": "hi",
  "id": 204336086,
  "title": "Jagged Edge (1985) Tonight",
  "canonical_url": "https://hinrg.substack.com/p/jagged-edge-1985-tonight",
  "post_date": "2026-07-01T15:01:19.284Z",
  "subtitle": "Let's talk about movies.",
  "reaction_count": 7,
  "scrapedAt": "2026-07-06T05:54:23.716Z"
}

How it works

For each keyword, page through https://substack.com/api/v1/post/search?query=<keyword>&page=<n>.
HTTP is done with requests. If a response looks blocked (HTTP 403/429/503 or a Cloudflare challenge page), the request is retried through cloudscraper.
HTML fragments are cleaned to plain text with parsel + re.
Pagination stops when Substack reports more: false, a page has no new posts, or the per-keyword maxItems limit is hit.

Run locally

pip install -r requirements.txt
apify run            # via the Apify CLI, or:
python -m src        # sets up the Actor from ./storage

Substack Posts Scraper 📚

easyapi/substack-posts-scraper

Scrape Substack posts and articles by keywords. Extract comprehensive post data including title, author, publication details, podcast information, reactions, and more. Perfect for content analysis and research.

EasyApi

209

1.9

(2)

Article Content Extractor 📄

easyapi/article-content-extractor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

EasyApi

140

5.0

(1)

Udemy Course Scraper 📚

easyapi/udemy-course-scraper

Extract detailed course information from Udemy.com with this powerful scraper. Collect comprehensive data about online courses, including ratings, content details, instructors, and pricing. Perfect for market research, content aggregation, and educational platform development.

EasyApi

116

5.0

(1)

Substack Notes Scraper 🔍

easyapi/substack-notes-scraper

Extract notes and comments from Substack's search results with images, user info, and engagement metrics. Perfect for content analysis, user research, and tracking discussions around specific topics on Substack.

EasyApi

arXiv Search Scraper 📚

easyapi/arxiv-search-scraper

Extract comprehensive research paper data from arXiv search results. Get detailed metadata including titles, authors, abstracts, categories and more. Perfect for academic research monitoring, trend analysis and building paper databases. 🎓📚

EasyApi

Wattpad Story Scraper 📚

easyapi/wattpad-story-scraper

Scrape stories from Wattpad search results with advanced filtering options. Extract comprehensive story details including title, description, stats, tags and more. Perfect for content analysis, market research and story discovery.

EasyApi

Audible Book Search Scraper 📚

easyapi/audible-book-search-scraper

A powerful scraper that extracts comprehensive audiobook information from Audible search results, including titles, authors, narrators, ratings, and pricing. Perfect for market research, price monitoring, and content analysis. 🎧📚

EasyApi

Nature Search Results Scraper 🔬

easyapi/nature-search-results-scraper

Extract comprehensive research article data from Nature.com search results. Automatically scrape article details, author information, metadata, and preview images. Perfect for research monitoring, trend analysis, and building scientific literature databases. 🔬📚

EasyApi

Substack Posts Scraper - Low-cost💲🔥📰📚

delectable_incubator/substack-posts-scraper-low-cost

📰🔍 Extract Substack posts by profile or keyword with ease. Collect post titles, authors, publish dates, tags, reactions, word counts, excerpts, post URLs & newsletter metadata. Ideal for content research, newsletter monitoring, creator analysis, media intelligence & publishing trend analysis 📊🚀

Prime Scrape

Substack Publications Scraper 📚

easyapi/substack-publications-scraper

Scrape detailed publication information from Substack based on keywords. Get comprehensive data about newsletters, authors, subscriber counts, and publication metrics in structured JSON format.

EasyApi

1.8

(2)

Substack Publication Scraper

parseforge/substack-publication-scraper

Pull every public post from any Substack publication with title, subtitle, body preview, author, publish date, podcast URL, audience type, comment count, and reactions. Filter by post type and date range. Export to JSON, CSV, or Excel for newsletter research and competitive intelligence.