Web to Markdown for LLMs

Web Scraper For Llms

abotapi/web-scraper-for-llms

Stealth web scraping engine built for LLMs. Converts any web page to clean markdown or HTML

Web Content Extractor API — URL to JSON

george.the.developer/web-content-extractor-api

Extract structured JSON from any webpage. Articles, products, recipes, jobs. Auto-detects content type. Returns metadata, headings, images, links. For AI agents and RAG.

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

AI Text Humanizer API — Make AI Writing Sound Human

george.the.developer/ai-text-humanizer-api

Transform AI text into natural human writing. 12-pass engine: phrase replacement, contractions, sentence variation, imperfections. Before/after AI detection scores. 5 styles, 3 levels. Sub-500ms.

YouTube Video Transcript and Subtitles Scraper API

george.the.developer/youtube-transcript-scraper

YouTube video transcript scraper and subtitles API. Get transcripts, captions, timestamps and video metadata in bulk from videos, Shorts, playlists and channels. Pay per video, no API key needed. Callable from any MCP client such as Claude, Cursor or ChatGPT. Built for RAG and LLM datasets.

Google Scholar Scraper, Papers, Citations and Authors

george.the.developer/google-scholar-scraper

Scrape Google Scholar for academic papers, citations, author profiles. No API key needed. Extract titles, authors, abstracts, citation counts, PDF links, h-index, i10-index. Export JSON, CSV, Excel. Anti-bot protection with residential proxies, UA rotation, CAPTCHA detection.

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Website Screenshot & PDF API — Fast Captures

george.the.developer/screenshot-pdf-api

Capture pixel-perfect screenshots and PDFs from any URL in under 3 seconds. PNG/JPEG/WebP formats, custom viewports, full-page capture, batch up to 20 URLs.

Convert any URL, sitemap, or whole website into clean, LLM-ready Markdown for RAG, vector databases, and AI agents. Hosted Crawl4AI in a real Chromium browser — renders JavaScript and SPAs, strips boilerplate, and exports JSON/CSV. Callable over MCP from Claude and Cursor.

AI Content Detector - GPT, Claude, Gemini Text Check

george.the.developer/ai-content-detector

Detect AI-generated text using statistical analysis. Analyzes perplexity, burstiness, sentence patterns, vocabulary diversity, and more. No external API key needed.