Vertical Corpora Builder - Domain Datasets for LLM Fine-Tuning

Scrape arXiv research papers by keyword, category, or author. Extracts titles, abstracts, authors, citations, and metadata. Perfect for AI/ML research monitoring, literature reviews, and LLM training data collection.

DomainForge LLM Dataset Builder

actorify/domainforge-llm-dataset-builder

Crawls websites and transforms web content into clean, structured datasets optimized for LLM fine-tuning, RAG applications, and knowledge base construction

AI Training Dataset Builder: Articles, Blogs & Web Pages

turboextract/ai-training-dataset-builder

Turn any list of URLs into clean, structured training data for AI models, RAG systems, and LLM fine-tuning. Built for ML engineers and AI teams.

Reddit RAG Dataset — LLM Training Data

blackfalcondata/reddit-rag-dataset

Scrape reddit.com — build clean LLM and RAG datasets from posts with full comment threads as ready-to-chunk text · HTML & Markdown · only text-bearing records with parent/child thread structure. Mix subreddit, keyword-search and direct-post inputs in one run.

Website to Markdown Crawler - Full-Site Text for LLMs & RAG

entranced_gelato/website-to-markdown-crawler

Crawl any website from a start URL and get every page as clean text + Markdown for LLMs, RAG, and AI agents. Follows internal links with depth and page limits, strips nav and ads, and returns one structured record per page. A fast, no-config site-to-Markdown crawler.

Turn any website into clean, LLM-ready Markdown for RAG pipelines, AI agents and knowledge bases. Scrape single pages or crawl entire sites. Compliance-first: robots.txt honored.

Scrape posts from any list of niche subreddits with automatic keyword tagging. Filter by date, score, comments. Output: clean JSON ready for LLM training, social listening, or brand monitoring. FREE during launch preview.

Japan Courts Judgment Scraper (saibansho / 裁判所)

jungle_synthesizer/courts-go-jp-hanrei-scraper

Extract Japanese court judgments from courts.go.jp (裁判所) — Supreme Court, lower courts, IP High Court, administrative, and labor cases. Returns case number, case name, ruling date (wareki + Gregorian), court, ruling type, result, and full-text PDF URL. Free alternative to Westlaw Japan.

Douban Pro Scraper — Reviews, Discussions & Subject Data

zhorex/douban-scraper

The most-used Douban scraper on Apify. Scrape long-form reviews, comments and group discussions from Douban (豆瓣) — China's leading reviews and interest community. Movies, books, music, plus subject search. For Chinese-LLM training corpora, sentiment analysis and academic NLP. No auth.

Crawl any website and extract clean, LLM-ready Markdown for RAG pipelines, vector databases and AI agents. Boilerplate, navigation and cookie banners removed. No browser, no login.