Website RAG & Lead Intelligence Crawler

Website Crawler Scraper

automation-lab/website-content-crawler

Crawl public websites into page-level metadata, links, clean text, and Markdown for search indexes and LLM knowledge bases.

Local Business Leads, Emails & Contact Data

datavaultlabs/local-business-lead-intelligence

Find local business leads by city and niche, including dentists, roofers, HVAC, plumbers and lawyers. Enrich public websites with emails, phones, socials, technologies and lead scores.

Website RAG Crawler - Clean Chunks & Change Tracking

ntriqpro/website-rag-refresh

Private development and release validation. Not yet approved for public use.

Australian Government Contract Intelligence

datavaultlabs/aus-gov-contract-intelligence

Search Australian Government contract awards by supplier, ABN, agency, UNSPSC, value and expiry. Analyze supplier and agency spend, identify high-value awards and expiring contracts, and export structured procurement data via API or dataset.

Website Contacts & Social Links Scraper

springlike_meadowland/website-contacts-scraper

Extract public emails, phone numbers and social profile links from supplied websites, page by page. Crawl bounded same-origin contact/about links and export source URLs plus coverage and errors. Public HTTPS HTML only; no enrichment.

Website Crawler - Crawl a Site to Markdown for LLMs

leadproof/website-crawler

Crawl one public website to Markdown within page, depth and time limits: clean text, Markdown, links and metadata per page for LLMs and RAG, plus a coverage report of what was read and missed.

Turn any URL or website into clean, LLM-ready Markdown or text - boilerplate, ads and nav stripped - with metadata and token count. Feed ChatGPT/Claude context or build RAG pipelines. HTTP-fast with a hardened-browser fallback for JS-heavy pages. Export JSON, CSV or Markdown.

Convert one public web page or JavaScript-rendered article into clean Markdown for LLM, RAG, and AI-agent pipelines using lightweight HTTP fetching with an SSRF-hardened Playwright fallback.

Website Content Extractor

aurenic/website-content-extractor

Extract clean, structured content from any website: title, meta description, headings, and main text.

Instagram Competitor & Creator Intelligence

datavaultlabs/instagram-competitor-intelligence

Instagram competitor analysis, engagement analysis and creator intelligence using public profiles, posts, reels, likes, comments, followers, posting frequency, CTA and sponsorship signals.