AI Web QA Extractor - Extract Answers from Pages

Web Page Scraper + AI Summary/Answer: Scrapes any URL, extracts content (text, links, images, tables, lists,raw html,tech stack), auto-falls back to headless browser for JS sites, and optionally generates an AI summary/answer from your prompt. Try with frontend at-https://aiscraperweb.netlify.app/

RAG Spider - Web to Markdown Crawler for AI Training Data

lenient_grove/RAG-Spider

Enterprise-grade web crawler that converts messy websites into clean, chunked Markdown for AI systems. Uses Mozilla Readability for 95% cleaner extraction than competitors. Outputs RAG-ready data with metadata and token estimates. Perfect for building knowledge bases and training AI chatbots.

Extract Stack Overflow Q&A pairs by tag. Output question-answer-score triples in JSONL for code assistant training.

Clutch.co Scraper

shahidirfan/Clutch-co-Scraper

Introducing the Clutch.co Scraper, a lightweight actor for extracting company profiles, client reviews, and ratings from Clutch.co. Quick and effective. For best results and reliable data extraction, the use of residential proxies is strongly advised. Get the B2B insights you need!

Web Scraper RAG Ready

traorealexy/Web-Sraper-RAG-Ready

Turn any website into clean, token-efficient Markdown ready for RAG and LLM pipelines. Removes boilerplate, handles JavaScript rendering, and outputs structured JSON for LangChain, LlamaIndex, and vector databases.

Walmart Data Extractor

epctex/walmart-scraper

Access a vast array of product data from Walmart with our Walmart Scraper. Extract images, brand details, prices, variations, and more. Customize your search with filters, categories, and lists to gather the information you need.

Scrape Quora questions and answers to extract answer text, upvotes, author credentials, and view counts. This actor uses Puppeteer with stealth plugins to handle Quora's dynamic JavaScript rendering and lazy-loaded content.

Scrape Upwork job listings and freelancer profiles. Extract job titles, descriptions, budgets, required skills, client countries, client ratings, proposal counts, experience levels, and posting dates. Also scrape freelancer profiles with hourly rates, job success scores, total earnings, skills, and

Web Crawler & Semantic Schema-Enhanced Extractor

devil_port369-owner/web-crawler

Depth-controlled web crawler that transforms websites into structured analytics-ready data. Starting from one or more URLs, it crawls internal links up to a configurable depth and outputs detailed JSON records per page

Docs to Markdown + AI Embeddings → Vector DB Crawler

badruddeen/docs-to-markdown-ai-embeddings---vector-db-crawler

Turn any documentation site into clean Markdown, intelligently chunked content with embeddings (Azure/OpenAI), and directly upsert into MongoDB Atlas, Pinecone, Weaviate, Qdrant, or Milvus — ready for RAG, AI assistants, and semantic search in minutes.