Substack Public RSS Posts Scraper avatar

Substack Public RSS Posts Scraper

Pricing

from $2.99 / 1,000 posts

Go to Apify Store
Substack Public RSS Posts Scraper

Substack Public RSS Posts Scraper

Extract structured posts, publication metadata, categories, and optional public body content from newsletter RSS feeds.

Pricing

from $2.99 / 1,000 posts

Rating

0.0

(0)

Developer

w3crawler

w3crawler

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

5 days ago

Last modified

Categories

Features

Limited permissions

Share

Substack Scraper extracts public newsletter posts through Substack-compatible RSS feeds. Supply Substack names, subdomains, custom publication domains, or complete publication URLs and receive structured post titles, URLs, stable identities, authors, publication dates, descriptions, optional body HTML and text, categories, enclosures, and publication metadata. No account or API key is required.

Get started

  1. Open the Actor Store page and select Try for free or open the Input tab.
  2. Enter one or more publications in publications, such as noahpinion.substack.com, https://www.noahpinion.blog/, or a full feed URL.
  3. Optionally narrow the result with categoryAnyOf, publishedAfter, or containsKeyword, and set maxItems.
  4. Start the Actor, open the dataset, and export the saved records as JSON, CSV, or Excel. Open Run summary (OUTPUT) to check the outcome and counts.

Input

publications is required; the other fields are optional. Unsupported field names and out-of-range values are rejected before requests start.

FieldTypeRequired?DefaultMeaning
publicationsstring arrayRequired["noahpinion.substack.com"] (schema prefill)One to 50 publication URLs, domains, Substack subdomains, or short Substack names. Replace the sample with your own targets.
categoryAnyOfstring arrayOptional[]Keep posts matching at least one RSS category, case-insensitively. Up to 50 values, each up to 200 characters.
publishedAfterstringOptionalNot suppliedInclusive lower date boundary in YYYY-MM-DD form; a date without a time zone.
containsKeywordstringOptionalNot suppliedKeep posts whose title or description contains this text, case-insensitively; up to 200 characters.
includeBodybooleanOptionaltrueInclude content:encoded HTML when the public feed exposes it.
maxItemsintegerOptional50Maximum unique posts saved across all feeds, from 1 to 1,000.
minDelayMsintegerOptional500Minimum delay between publication feeds, from 250 to 10,000 ms.
requestTimeoutSecsintegerOptional30Per-feed request timeout, from 10 to 90 seconds.

Default input:

{
"publications": [
"noahpinion.substack.com"
],
"categoryAnyOf": [],
"includeBody": true,
"maxItems": 50,
"minDelayMs": 500,
"requestTimeoutSecs": 30
}

The Actor reads public data from Substack over anonymous HTTPS RSS requests. It does not use a browser, account, cookie, API key, or proxy.

Output

The dataset contains one row per unique post accepted by the filters. Optional information appears only when the public feed publishes it; missing values are omitted rather than inferred. No diagnostic or placeholder rows are written.

FieldTypeAvailabilityMeaning
recordIdstringAlwaysDeterministic row ID built from the normalized post URL and a short hash.
recordTypestring enumAlwaysRow discriminator; always substackPost.
postIdstringAlwaysStable source identity from the RSS guid, falling back to the canonical post URL. The saved rows use the post URL, not a numeric Substack API ID.
titlestringAlwaysPublic RSS post title.
urlstringAlwaysCanonical public post URL from the feed item.
authorstringWhen publishedRSS author or byline name when the feed supplies one; present in the archived rows.
publishedAtstringWhen publishedRSS publication time in ISO UTC.
descriptionstringWhen publishedFeed description or summary text; present in the archived rows.
bodyHtmlstringWhen includeBody is enabled and the feed exposes itcontent:encoded HTML from the public feed.
bodyTextstringWhen the feed exposes body HTML or a descriptionPlain text derived from public body HTML, or from the feed description when no body HTML is exposed; capped in length.
categoriesstring arrayWhen the feed exposes RSS categoriesRSS category labels. No archived row in this storage contains them, so the example omits the field.
enclosureobjectWhen the feed exposes an enclosureRSS enclosure with url, type, and declared length. It can describe audio or an image/media attachment; the saved example is an image enclosure with length: 0, not a podcast episode.
publicationobjectWhen the feed exposes channel metadataPublication object with title, url, feedUrl, description, imageUrl, and generator.
sourcestringAlwaysSource label; public_substack_rss.
provenancestringAlwaysExtraction lineage label; public_newsletter_rss_feed.
sourceUrlstringAlwaysFinal public feed URL used for the row.
extractionMethodstringAlwaysExtraction label; rss_xml.
scrapedAtstringAlwaysTime the row was written, in ISO UTC.

bodyHtml and bodyText are only present when the feed carries content:encoded. A feed can expose a description, enclosure, or categories without exposing the full body. postId repeats the normalized post URL because that is how this RSS Actor identifies posts; it is not a numeric ID from Substack's API.

The example below is a real saved row from the 2026-10-25 run. Long bodyHtml and bodyText strings are shortened with an ellipsis; all other values are complete.

{
"recordId": "substack_post_https-www-noahpinion-blog-p-the-internet-breaks_78fa83ccab0f",
"recordType": "substackPost",
"postId": "https://www.noahpinion.blog/p/the-internet-breaks",
"title": "The internet breaks",
"url": "https://www.noahpinion.blog/p/the-internet-breaks",
"author": "Noah Smith",
"publishedAt": "2026-10-25T07:19:36.000Z",
"description": "What will be next to break?",
"bodyHtml": "<div class=\"captioned-image-container\"><figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https://substackcdn.com/image/fetch/$s_!o244!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7188959d-9dd1-4495-b047-a37f0ee21d86_1075x717.jpeg\" data-component-name=\"Image2ToDOM\"><div class=\"image2-inset\"><picture><source …",
"bodyText": "Art by GPT-6“No man could bind him, no, not with chains…neither could any man tame him” — Mark 5:3—4When I was 14 or 15 — I don’t quite remember — I first got access to the World Wide Web. I remember clicking on the little blue square of the Netscape Navigator icon — that little ship wheel with a starry sky behind it — and feeling like an entire new magical world had opened up. My life changed tha…",
"enclosure": {
"url": "https://substackcdn.com/image/fetch/$s_!o244!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7188959d-9dd1-4495-b047-a37f0ee21d86_1075x717.jpeg",
"type": "image/jpeg",
"length": 0
},
"publication": {
"title": "Noahpinion",
"url": "https://www.noahpinion.blog/",
"feedUrl": "https://www.noahpinion.blog/feed",
"description": "Economics and other interesting stuff",
"imageUrl": "https://substackcdn.com/image/fetch/$s_!l14h!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F04281755-2cd6-42e5-a496-e69153abebb2_281x281.png",
"generator": "Substack"
},
"source": "public_substack_rss",
"provenance": "public_newsletter_rss_feed",
"sourceUrl": "https://www.noahpinion.blog/feed",
"extractionMethod": "rss_xml",
"scrapedAt": "2026-10-25T21:09:12.601Z"
}

Run summary

Run summary is stored separately from the dataset in the run's key-value store under OUTPUT.

FieldMeaning
recordTypeSummary discriminator; substack_run_summary.
statusRun outcome; the saved example records SUCCEEDED.
runStatusCanonical run status; matches status.
dataStatusDataset completeness: COMPLETE, PARTIAL, NO_RESULTS, or FAILED.
dataAvailableWhether at least one source-backed post row was saved.
sourceUrlRequested feed URL, before any custom-domain redirect.
requestedPublicationCountNumber of validated publications requested.
requestedMaxItemsGlobal post limit requested.
itemsEmittedUnique post rows written.
itemCountCompatibility count equal to itemsEmitted.
diagnosticCountOperational issues recorded for the run.
duplicateCountDuplicate post identities skipped across feeds.
failureCountFeed or summary-write failures recorded.
outputWriteFailureCountFailed key-value summary writes.
filtersApplied categoryAnyOf, containsKeyword, and includeBody values.
sourceSource label; public_substack_rss.
provenanceExtraction lineage; public_newsletter_rss_feed.
completedAtTime the summary was written, in ISO UTC.
StatusData statusMeaning
SUCCEEDEDCOMPLETEEligible posts were saved without an extraction problem.
SUCCEEDEDPARTIALPosts were saved, but a later feed or parse problem prevented a complete run. Saved rows remain available.
SUCCEEDEDNO_RESULTSThe feeds completed cleanly and returned no posts matching the filters.
FAILEDFAILEDA fatal error occurred before any usable post was saved.

Example OUTPUT from the saved run:

{
"recordType": "substack_run_summary",
"status": "SUCCEEDED",
"runStatus": "SUCCEEDED",
"dataStatus": "COMPLETE",
"dataAvailable": true,
"sourceUrl": "https://noahpinion.substack.com/feed",
"requestedPublicationCount": 1,
"requestedMaxItems": 3,
"itemsEmitted": 3,
"itemCount": 3,
"diagnosticCount": 0,
"duplicateCount": 0,
"failureCount": 0,
"outputWriteFailureCount": 0,
"filters": {
"categoryAnyOf": [],
"containsKeyword": "",
"includeBody": true
},
"source": "public_substack_rss",
"provenance": "public_newsletter_rss_feed",
"completedAt": "2026-10-25T21:09:12.972Z"
}

The summary's sourceUrl is the requested Substack feed, while rows can record a custom-domain feed such as https://www.noahpinion.blog/feed after the publication redirects.

Coverage and limitations

The Actor reads public RSS feeds only. It does not sign in, call a private API, bypass paywalls, or fetch a separate post page to invent missing body content. bodyHtml appears only when the feed includes content:encoded and includeBody is enabled. bodyText is derived from that body HTML or, when no body HTML is present, from the feed description; a description-only row is not full text.

categoryAnyOf, publishedAfter, and containsKeyword filter posts after the feed is read, so they reduce saved rows but do not reduce feed requests. maxItems is a global cap, and one row is written per unique post identity. Optional fields are omitted when the feed does not publish them; values are not inferred. Source availability can change, and blocked, empty, or partial feed responses are counted in OUTPUT rather than written as data rows.

Usage and support

Cost depends on Apify compute and one HTTPS feed request per publication plus bounded retries. There is no browser or proxy step, so runs are lightweight; increasing publications increases request count, while filters mainly reduce output size. See the Actor's Pricing tab for current account rates.

Use the Actor Issues page to report a problem. Include the run ID, the input used, and the OUTPUT summary; do not include tokens, cookies, or private data. This Actor is not affiliated with Substack. Use it only for public data and in accordance with the source's terms, robots guidance, and applicable law. Public posts can contain personal information; do not use the output for unauthorized profiling or contact.