MDN Web Docs Scraper

Extract API documentation from Swagger/OpenAPI specs, Postman docs, and API reference pages. Perfect for building API clients, SDKs, and documentation.

High accuracy web search: people, news, docs

interfaze/web-search

AI-powered web search using interfaze.ai that is consistently updated with our scraper engine. Search across people, research indexes, social platforms, financial data, and the general web, all through a single query. Great for enrichment.

LLMs.txt Scraper - AI Documentation Index Data

benthepythondev/llms-txt-scraper

Scrape llms.txt files and extract AI-readable documentation links, headings, titles and source metadata.

HTML to Markdown Converter - Bulk Web Content to MD

santamaria-automations/html-to-markdown

Extract main article content from any website and convert to clean Markdown including headings, links, images, tables, and code blocks. Perfect for LLM training, AI pipelines, and documentation. Export data, run via API, schedule and monitor runs, or integrate with other tools.

Product Documentation Change Monitor scraper

funny_electrician/Korak1910

Product Documentation Change Monitor scraper: Alerts AI agents when an API or library's documentation updates.

Docs MCP Server Starter — Live Docs: Claude, Cursor & AI Agents

joeslade/docs-mcp-server-starter

Persistent MCP server that gives Claude, Cursor, and any MCP-compatible AI assistant queryable access to technical documentation. Indexes any docs site, exposes search and fetch tools over MCP, caches pages for speed. Ships with templates for Next.js, Tailwind, React, TypeScript, Prisma.

Convert web pages, documentation, and blog posts into structured AI training datasets in formats like Q&A pairs, instruction-following examples, and cleaned raw text.

Example Web Server

apify/example-web-server

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Web Scraper For Llms

abotapi/web-scraper-for-llms

Stealth web scraping engine built for LLMs. Converts any web page to clean markdown or HTML

Llm Ready Documentation Scraper

direct_duty/llm-ready-documentation-scraper

Developers and AI agents need to read documentation (e.g. Stripe Docs, Next.js Docs), but standard scrapers return noisy HTML that includes: navigation bars headers / footers ads / cookie banners This Actor must return pure content-only Markdown, suitable for vectorization and semantic search.