Substack Post Detail Scraper avatar

Substack Post Detail Scraper

Pricing

from $2.25 / 1,000 results

Go to Apify Store
Substack Post Detail Scraper

Substack Post Detail Scraper

Fetch a Substack post by URL or '<publication>/<slug>' shorthand. Returns full post body HTML, author, audience, paywall, podcast metadata.

Pricing

from $2.25 / 1,000 results

Rating

0.0

(0)

Developer

Farhan Febrian Nauval

Farhan Febrian Nauval

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

7 days ago

Last modified

Features

Limited permissions

Share

Extract the full body, author, publication date, free or paid status, comment count, and image URLs from any public Substack post in bulk — clean structured JSON, one row per post.

Why use this actor

  • No account / no login required — paste a Substack URL and get the full post back.
  • Full post body — both clean HTML (body_html) and word count, not just a teaser snippet.
  • Author detail included — display name, handle, profile photo, and the publication they write for.
  • Paid-post detection — audience field tells you whether the post is free (everyone), paid (only_paid), or founding-only, so you can filter before billing.
  • Engagement signals — comment_count, reaction_count, restacks, and per-emoji reactions map for every post.
  • Cover image + audio — direct CDN URL for the cover image and any text-to-speech audio Substack auto-generated for the post.
  • Bulk input — pass a list of URLs in one run; one clean dataset row per post.
  • Automatic retries — transient failures retry with backoff; deleted or draft posts surface as _error: "not_found" so you can triage failures.

How it works

  1. You provide a list of Substack post URLs — full URLs (https://www.astralcodexten.com/p/links-for-january-2025), custom-domain URLs, or <publication>/<slug> shorthand.
  2. The actor fetches each post the same way Substack's web app does and assembles a flat JSON record with the full body, author, and engagement counts.
  3. Results stream into your dataset, ready to download as JSON, CSV, or Excel.

You do not need to manage scrapers, browsers, or rotating IPs — all handled internally.

Input

{
"posts": [
"https://www.astralcodexten.com/p/links-for-january-2025",
"stratechery/p/the-windows-pc-renaissance"
],
"proxyConfiguration": {
"useApifyProxy": true,
"apifyProxyGroups": ["DATACENTER"]
}
}
FieldTypeDescription
postsarrayList of Substack post URLs or <publication>/<slug> shorthand. Full URLs, custom-domain URLs (https://www.example.com/p/<slug>), and shorthand all work.
proxyConfigurationobjectApify Proxy settings. Datacenter proxy works for most public posts.

Output

Input: https://www.astralcodexten.com/p/links-for-january-2025

{
"_input": "https://www.astralcodexten.com/p/links-for-january-2025",
"_publication": "www.astralcodexten.com",
"_slug": "links-for-january-2025",
"_source": "S1-api",
"_scrapedAt": "2026-05-18T10:24:08.187026+00:00",
"id": 154699327,
"canonical_url": "https://www.astralcodexten.com/p/links-for-january-2025",
"slug": "links-for-january-2025",
"title": "Links For January 2025",
"social_title": "Links For January 2025",
"subtitle": "...",
"description": "...",
"type": "newsletter",
"audience": "everyone",
"post_date": "2025-01-17T00:18:10.411Z",
"updated_at": "2025-01-20T12:43:04.768Z",
"is_published": true,
"language": "en",
"wordcount": 4404,
"body_html": "<p><em>[I haven't independently verified each link. On average, commenters will end up spotting evidence that around two or three of the links in each links post are wrong or misleading. I correct these as I see them, and will highlight important corrections later, but I can't guarantee I will have caught them all by the time you read this.]</em></p><p><strong>1: </strong><a href=\"https://x.com/HedgeDirty/status/1869555974966808794\">Why running for Congress will ruin your life</a> ... 67000 more chars",
"cover_image": "https://substack-post-media.s3.amazonaws.com/public/images/a8cc61f4-a715-4858-b76a-583d668f9617_800x533.jpeg",
"cover_image_is_explicit": false,
"comment_count": 877,
"child_comment_count": 877,
"reaction_count": 236,
"reactions": {"❤": 236},
"restacks": 40,
"publication_id": 89120,
"section_id": null,
"previous_post_slug": "highlights-from-the-comments-on-lynn",
"next_post_slug": "open-thread-365",
"postTags": [],
"audio_items": [
{
"post_id": 154699327,
"voice_id": "en-US-OnyxTurboMultilingualNeural",
"audio_url": "https://substack-video.s3.amazonaws.com/video_upload/post/154699327/tts/09d83c97-c0d4-403a-af0b-8b8571e0dfff/en-US-OnyxTurboMultilingualNeural.mp3",
"type": "tts",
"status": "completed"
}
],
"publishedBylines": [
{
"id": 12009663,
"name": "Scott Alexander",
"handle": "astralcodexten",
"photo_url": "https://substackcdn.com/image/fetch/.../7b500d22-1176-42ad-afaa-5d72bc36a809_44x44.png",
"bio": "",
"is_guest": false,
"publicationUsers": [
{
"id": 18921,
"user_id": 12009663,
"publication_id": 89120,
"role": "admin",
"is_primary": true,
"publication": {
"id": 89120,
"name": "Astral Codex Ten",
"subdomain": "astralcodexten",
"custom_domain": "www.astralcodexten.com",
"hero_text": "P(A|B) = [P(A)*P(B|A)]/P(B), all the rest is commentary."
}
}
]
}
]
}
FieldTypeDescription
_inputstringThe URL or shorthand exactly as you supplied it. Use to join results back to your input list.
_publicationstringResolved publication host (e.g. www.astralcodexten.com or <subdomain>.substack.com).
_slugstringThe post slug parsed from the URL (the part after /p/).
_sourcestringInternal tag for the path used to fetch the record. S1-api is the fastest, richest path; values starting with S2- indicate a fallback was used.
_scrapedAtstringISO-8601 UTC timestamp when the record was scraped.
idintegerSubstack's internal numeric post ID. Stable across slug changes.
canonical_urlstringCanonical post URL (custom domain if the publication has one).
slugstringURL slug of the post.
titlestringPost title as shown on the page.
social_titlestringTitle used when the post is shared on social networks (often the same as title).
subtitlestringOptional subtitle shown under the title.
descriptionstringShort description used in social/SEO previews.
typestringnewsletter, podcast, thread, or video.
audiencestringeveryone (free), only_paid (subscriber-only), or founding. Use this to spot paid posts.
post_datestringISO-8601 publish timestamp.
updated_atstringISO-8601 last-update timestamp.
is_publishedbooleantrue for published posts; drafts return _error: "not_found".
languagestringISO 639-1 language code (e.g. en).
wordcountintegerWord count of the full body.
body_htmlstringFull post body as clean HTML. Preserves headings, links, embedded images, and footnotes.
cover_imagestringDirect CDN URL of the post's cover/hero image. null if none.
cover_image_is_explicitbooleantrue if the cover image is flagged as explicit.
comment_countintegerTotal number of comments on the post (top-level + replies).
child_comment_countintegerTotal comment count including nested replies.
reaction_countintegerSum of all reactions across emoji.
reactionsobjectMap of emoji to count (e.g. {"❤": 236}).
restacksintegerNumber of times the post was re-shared inside Substack.
publication_idintegerNumeric ID of the publication that owns the post.
section_idintegerSection/category ID, or null for un-sectioned publications.
previous_post_slugstringSlug of the post immediately before this one in the archive.
next_post_slugstringSlug of the post immediately after this one in the archive.
postTagsarrayTags applied to the post.
audio_itemsarrayAny audio versions of the post — including Substack's auto-generated text-to-speech. Each item has audio_url, voice_id, type, and status.
publishedBylinesarrayAuthors of the post. Each entry includes id, name, handle, photo_url, bio, plus a nested publicationUsers array linking the author to one or more publications.

Error envelope

Posts that don't exist or fail to fetch return a structured error instead of crashing the run:

{
"_input": "astralcodexten/p/this-post-does-not-exist",
"_publication": "astralcodexten",
"_slug": "this-post-does-not-exist",
"_error": "not_found",
"_errorDetail": "NotFound https://astralcodexten.substack.com/api/v1/posts/this-post-does-not-exist",
"_source": "S1-api",
"_scrapedAt": "2026-05-18T10:24:10.012345+00:00"
}

Filter on _error to triage failed rows.

Pricing

This actor is billed per result: $2.50 per 1,000 posts. Each successful post = 1 result. Errors (not-found, deleted, draft) are not billed.

Other Sosmed Actors

PlatformActorBest for
SubstackSubstack Publication ScraperPublication metadata + subscriber counts
SubstackSubstack Publication Posts ScraperList every post from a Substack publication
MediumMedium Post Detail ScraperFull Medium article body + clap count
TumblrTumblr Post Detail ScraperTumblr post body + reblog chain
TelegramTelegram Post Detail ScraperPublic Telegram channel post + views
RedditReddit Post Detail ScraperFull Reddit post + score + flair
XX Post Detail ScraperTweet body + engagement counters

Browse the full catalog at apify.com/xtracto.

Notes

  • Paid posts (audience: "only_paid" or "founding") return only the public intro snippet in body_html; the full body requires a paid subscription, which this anonymous scraper does not provide. Use the audience field to detect and filter these before processing.
  • Comments are not included in the response by default — only the comment_count. If you need the actual comment thread, request the upcoming Substack comments scraper.
  • Custom-domain publications are fully supported. Pass either the custom-domain URL (https://www.astralcodexten.com/p/<slug>) or the underlying subdomain shorthand (astralcodexten/p/<slug>).
  • Deleted, draft, or unpublished posts return {"_error": "not_found", "_input": "..."}.
  • The internal id (integer) is the most stable identifier — slugs can be edited by the author after publication, id cannot.