JSON to JSONL Converter

HTML Readability to Markdown Converter

automation-lab/html-readability-markdown-converter

Convert raw HTML or one anonymous public webpage into clean Markdown with headings, links, source metadata, and a content hash for RAG ingestion or archives.

Stream a JSONL/NDJSON document (inline text or public URL) into a CSV. Auto-discovers columns from the union of all keys in document order of first appearance. No scraping required when text is provided inline.

Paste a curated URL list and get clean Markdown, document JSONL, vector chunks, ingest manifest, and failed URL report.

Ahrefs Scraper

radeance/ahrefs-scraper

Extract key SEO data from Ahrefs including keyword rankings, backlink profiles, organic traffic, competitor analysis & domain authority. Supports bulk domain analysis across 180+ countries. Download as CSV, JSON, Excel, XML & more formats.

Turn any PDF URL into clean, LLM-ready Markdown and structured JSON. Extracts text + tables + document metadata for RAG, agents, and fine-tuning. No AGPL components.

RAG Dataset Linter

sebastian-actors/rag-dataset-linter

Audit RAG chunks for duplicates, broken ordering, excessive overlap, missing provenance, and malformed content before vector database ingestion.

Website Content Crawler for AI Datasets

boztek-ltd/website-content-crawler

Crawl any website and turn its content into AI-ready data: clean Markdown, token-aware RAG chunks, Q&A pairs, and OpenAI fine-tuning JSONL. Removes navigation and boilerplate, scores content quality, and deduplicates pages. Works with 🦜🔗 LangChain, LlamaIndex, Pinecone, and Qdrant.

OpenAPI Spec Scraper — APIs to LLM Agent Tools (MCP-Ready)

scrapersdelight/openapi-spec-scraper

Bulk-scrape machine-readable API specs from the apis.guru directory (2,500+ APIs) or any spec URL, normalized into LLM-agent-ready rows — one per endpoint: method, path, summary, parameters, auth, tags. Build agent-tool / RAG datasets in one run. $4 per 1,000 endpoints.

RAG Web Browser — URL & Website to Markdown for LLM & RAG

s-r/rag-web-browser

Search the web or pass URLs, get clean Markdown, plain text or HTML for LLM and RAG pipelines. Follows links, streams results, no per-run fee.

RAG-Ready Markdown Converter & Chunker

foxpink/apify-rag-markdown-chunker

Convert raw HTML/text into clean Markdown and split into ready-to-ingest chunks for RAG pipelines, Vector DBs, and LLM fine-tuning workflows.