Crawl4AI

Camoufox Scraper

apify/camoufox-scraper

Crawls websites with stealthy Camoufox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Real Subdomain Finder

onescales/real-subdomain-finder

Discover every subdomain for any domain. Queries 40+ OSINT sources including cert transparency, DNS archives & web scanners. Results enriched with DNS validation, HTTP probing, and subdomain takeover detection. No API keys required.

Firecrawl Agent - Web Crawler

alizarin_refrigerator-owner/firecrawl-agent

Advanced web crawling with Firecrawl. Extract clean markdown, handle JavaScript sites & manage large-scale crawls with built-in rate limiting & error handling.

Cloudflare Bypasser

macheta/universal-bypasser

🛡️ Universal Bypasser provides professional-grade access to websites secured by advanced security challenges. Optimized for AI agents and developers, it automatically resolves complex behavioral analysis to deliver clean HTML, parsed JSON, and session cookies. Seamless data extraction at scale.

Keywords Extractor

lukaskrivka/keywords-extractor

Use our free website keyword extractor to crawl any website and extract keyword counts on each page.

AI Model Comparison

onescales/ai-model-comparison

Compare responses from multiple AI models side by side and let AI analyze them to deliver the single best answer.

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

A high-performance web-to-markdown crawler for AI agents, optimized for LLM data extraction using Crawl4AI. Features stealth browsing and high-fidelity content extraction.