Go to example tasks

Substack newsletter to RAG-ready Markdown chunks

Reads the latest public posts of a Substack newsletter and returns clean Markdown with full text for free posts. Each article also gets a chunks array split on paragraph boundaries, ready for embeddings and vector databases. Paywalled posts are skipped so only complete text is delivered and billed.

Try for free
Substack & Medium Scraper: Articles, Markdown, Likes
Substack & Medium Scraper: Articles, Markdown, Likesactose/substack-medium-feeds
Platform
Published
Title
Author
+7 fields
Text
Number
Boolean
List
Object

Input

Substack newsletters or authors:simonw
Max articles per source:10
Max articles in total (optional):10
Fetch full text (Substack):true
Skip paywalled / preview-only articles:true
Keep images in Markdown:false
Add RAG chunks:true
Chunk size (characters):2000

Output fields

Platform
Published
Title
Author
Publication
Likes
Comments
Words
Content
URL
Markdown

How it works

Sign up on Apify or log in

The Substack & Medium Scraper: Articles, Markdown, Likes Actor is ready to run with the inputs already set for "Substack newsletter to RAG-ready Markdown chunks". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Substack newsletter to RAG-ready Markdown chunks" task

The Substack & Medium Scraper: Articles, Markdown, Likes Actor will start running based on the input automatically. You can also change all the input fields, like substack newsletters or authors, max articles per source, and more, to match your specific use case.

Receive the "Substack newsletter to RAG-ready Markdown chunks" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as platform, published, title, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Substack newsletter to RAG-ready Markdown chunks" task via API.

Image

Integrate "Substack newsletter to RAG-ready Markdown chunks" into your workflow

Connect "Substack newsletter to RAG-ready Markdown chunks" with 100+ integrations, or run it via API or MCP.

Webhook

Webhook

n8n

n8n

Make

Make

Zapier

Zapier

Airbyte

Airbyte

Keboola

Keboola

IFTTT

IFTTT

Hubspot

Hubspot

GDrive

GDrive

Gmail

Gmail

Apify MCP

Apify MCP

GitHub

GitHub

Slack

Slack

LangChain

LangChain

LlamaIndex

LlamaIndex

Flowise

Flowise

Pinecone

Pinecone

OpenAI

OpenAI

Mastra

Mastra

Clay

Clay