AI Web Search Scraper - SERP & Page Content for LLM RAG

GCC Jobs Aggregator - Bayt, GulfTalent & NaukriGulf

get_anything/gcc-jobs-aggregator

Search Bayt, GulfTalent and NaukriGulf in one run. Deduplicated Gulf job listings for UAE, Saudi Arabia, Qatar, Kuwait, Bahrain and Oman with seniority detection and optional Arabic labels.

Web Unblocker - Anti-Bot Scraper (Cloudflare, DataDome)

get_anything/web-unblocker

Fetch any URL even behind anti-bot walls (Cloudflare, DataDome, PerimeterX, Akamai, Imperva). Returns HTML plus optional Markdown/text and a screenshot, detects which protection guards the site, and retries via a hardened browser on a fresh residential IP when blocked. No API key.

Website Content Crawler — Markdown for LLM & RAG

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

Markdown Maker: HTML to Markdown 📝

shahidirfan/Markdown-Maker

Instantly convert complex HTML into clean, structured Markdown. This lightweight actor is optimized to render web content into a format that is easily readable for AI LLMs, reducing token usage and improving context. Perfect for RAG pipelines and preparing data for training.

LLM Web Scraper - Website to Markdown for RAG & ChatGPT

get_anything/llm-web-scraper

Turn any URL or website into clean, LLM-ready Markdown or text - boilerplate, ads and nav stripped - with metadata and token count. Feed ChatGPT/Claude context or build RAG pipelines. HTTP-fast with a hardened-browser fallback for JS-heavy pages. Export JSON, CSV or Markdown.

Crawl websites and convert to clean markdown for AI/RAG, LLM fine-tuning, and document pipelines.

Stack Overflow Search Scraper

jeremy_frost/stack-overflow-search-scraper

Specify a 🔍search expression for retrieving Stack Overflow search results.

AI Training Data Scraper

blukaze/AI-Training-Data-Scraper

AI Training Data Scraper converts websites into clean, semantically-chunked, vector-ready data for LLMs, RAG pipelines, and AI search. Built for documentation, tutorials, and code-heavy content, with smart chunking and rich metadata.