Pricing

from $50.00 / 1,000 article scrapeds

Blog Post Scraper for LLM

Extract blog posts as clean, image-free text optimized for AI/LLM training and fine-tuning. Filters by word count and outputs combined JSONL format ready for ML pipelines.

Pricing

from $50.00 / 1,000 article scrapeds

Rating

0.0

(0)

Developer

Extreme Scrapes

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Blog Post for AI Training Data

Extract blog posts as clean, image-free text optimized for AI/LLM training and fine-tuning. Filters by word count and outputs combined JSONL format ready for ML pipelines.

Features

Image-free output — strips all images for pure text training data
Word count filtering — skip short posts that don't meet your quality threshold
JSONL output — combined output file ready for fine-tuning pipelines
Batch processing — extract hundreds of blog posts in a single run
Dataset + KV store — results in both Apify dataset and as a single JSONL file

How It Works

Provide blog post URLs and set a minimum word count threshold.
The Actor fetches each post and strips all images.
Posts below the word count threshold are skipped.
Valid posts are stored in the dataset AND as a combined JSONL file in the Key-Value store.

Input

{
    "startUrls": [
        { "url": "https://lilianweng.github.io/posts/2023-06-23-agent/" },
        { "url": "https://blog.google/technology/ai/google-gemini-ai/" }
    ],
    "minWordCount": 200
}

Output

Dataset record:

{
    "url": "https://lilianweng.github.io/posts/2023-06-23-agent/",
    "wordCount": 8542,
    "markdown": "# LLM Powered Autonomous Agents\n\nContent..."
}

Key-Value store: A single OUTPUT file in JSONL format containing all records.

Use Cases

Build fine-tuning datasets for LLMs
Create training corpora from technical blogs
Collect AI/ML research blog content
Generate evaluation datasets

Keywords

blog scraper, AI training data, LLM dataset, fine-tuning data, blog to jsonl, training corpus

Pricing

$50 per 1,000 blog post extractions.

AI-Ready Web Content Crawler (LLM/RAG Optimized)

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.

Yuliia Kulakova

Content Gap Analyzer

fabian_maume/content-gap-analyzer

Identifies topics, insights, and questions that top-ranking competitors cover but your blog post misses. Runs a Google search, classifies each competitor page, extracts key insights via LLM, and reports what's missing from your own article.

Fabian Maume

5.0

(1)

Website Content to Markdown for LLM Training

easyapi/website-content-to-markdown-for-llm-training

🚀 Transform web content into clean, LLM-ready Markdown! 📘 Scrape multiple pages, extract main content, and convert to Markdown format. Perfect for AI researchers, data scientists, and LLM developers. Fast, efficient, and customizable. Supercharge your AI training data today! 🌐📝🧠

EasyApi

319

5.0

(2)

Sitemap URL Extractor

crawlerbros/sitemap-url-extractor

Extract every URL from any site's sitemap.xml with handles sitemap index files (nested sitemaps), gzipped sitemaps, and robots.txt discovery. Returns URL, lastmod, changefreq, priority, and optional image/video/alternate-language fields. No proxy, no cookies, no login.

Crawler Bros

LLM Markdown Crawler

sleek_waveform/llm-markdown-crawler

Crawl any website and extract clean, boilerplate-free Markdown optimized for LLMs, RAG pipelines, and AI training datasets. Uses Mozilla Readability to strip navigation and ads, then converts to clean Markdown. No browser required — fast and cheap.

Daniel Dimitrov

Broken Link Checker — Recursive Site Crawler

accurate_pouch/broken-link-checker

Recursively crawl your website and find every broken link, 404, redirect, and timeout. Checks internal and external links with configurable depth. 100 links free per run.

Manchitt Sanan

Website Change Monitor — Content Diff & Alerts

accurate_pouch/website-change-monitor

Monitor websites for content changes. Text diff, hash comparison, CSS selector targeting. Webhook alerts when content changes. Use with Apify scheduling for daily monitoring. 5 URLs free.

Manchitt Sanan

Article to Text Extractor (for TTS/LLMs)

andok/tts-reader

Extract the core readable text of any article or blog post, stripping out boilerplate. Perfect for Text-to-Speech or AI summaries.

Andok

AI Web to Markdown - LLM-Ready Extractor

wiry_kingdom/ai-web-to-markdown

Convert any URL into clean LLM-ready markdown. Strips ads, nav, footer. Preserves headings, lists, tables, code blocks. Returns token count. Perfect for RAG, fine-tuning, AI agents. 10x cheaper than Firecrawl.

Mohieldin Mohamed

🔥 AI HTML to JSON Extractor (Fast, Free LLM for Data)

autoscaler/ai-html-to-json-extractor

Eliminate messy HTML cleanup and high LLM costs. This Actor uses a high-speed, zero-cost large language model to turn unstructured content (HTML, text, reviews, blog posts) into valid, structured JSON.