AI Training Data Curator

Ai Training Data Curator

omarchydev/ai-training-data-curator

Crawl websites and curate high-quality training data for LLM fine-tuning. Automatic deduplication, quality scoring, and language detection. Export to JSONL, Parquet, or CSV formats ready for OpenAI, Claude, or Llama training.

AI Training Data Curator

ryanclinton/ai-training-data-curator

Crawl any website and extract clean, structured text data ready for LLM fine-tuning, RAG pipelines, and AI model training.

📰 Substack Posts Monitor

skootle/substack-posts

Pull every post from any Substack publication via the public archive API: title, author, paywall flag, full body, engagement counts, reading time. For newsletter aggregators, content marketers, and AI summarizers. Export, run via API, schedule, or integrate with other tools.

AI Training Data Quality MCP Server

ryanclinton/ai-training-data-quality-mcp

AI training data quality assessment, bias detection, and governance scoring for AI agents via the Model Context Protocol.

Anthropic News & Research Scraper

automation-lab/anthropic-scraper

Scrapes news articles and research papers from Anthropic's website. Returns title, date, categories, description, image URL, and optionally full article text.

AI Training Dataset Builder: Articles, Blogs & Web Pages

turboextract/ai-training-dataset-builder

Turn any list of URLs into clean, structured training data for AI models, RAG systems, and LLM fine-tuning. Built for ML engineers and AI teams.

medRxiv Scraper

parseforge/medrxiv-scraper

Extract comprehensive preprint data from medRxiv, including titles, authors, abstracts, full text, DOIs, citations, and metadata. Automate access to health-science preprints with structured outputs, ideal for researchers and analysts who need reliable, large-scale article data without manual work.

Tatoeba Sentence Corpus Scraper

parseforge/tatoeba-sentence-corpus-scraper

Extract Tatoeba sentence corpus with millions of bilingual example sentences. Capture sentence ID, language, text, owner, audio URL, translations, tags, and license. Export to JSON, CSV, or Excel for language learning, NLP training data, translation memory, and linguistic research.

Genius Lyrics Scraper | Songs Artists and Annotations

parseforge/genius-lyrics-scraper

Scrape song lyrics, artist pages, album info, release dates, producers, writers, and Genius annotations. Build music datasets, lyric search apps, NLP corpora, sentiment analysis pipelines, and song recommendation tools from one of the largest lyric archives online.

TED Talks Transcript Scraper

jungle_synthesizer/ted-talks-transcript-scraper

Extracts full transcripts from TED.com talks in any available language. Returns timed segments (JSON), plain text, SRT, and WebVTT formats alongside speaker metadata, tags, and multi-language availability.