Pricing

from $20.00 / 1,000 processed knowledge pages

Website RAG Knowledge Builder

Crawl public website pages and build clean RAG-ready knowledge records with page summaries, key facts, FAQs, links, and retrieval chunks.

Pricing

from $20.00 / 1,000 processed knowledge pages

Rating

0.0

(0)

Developer

Ushba Khan

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

What it is useful for

Use it to prepare website knowledge before embedding, vector indexing, chatbot ingestion, or documentation review.
Building cleaner research exports from messy public web surfaces.
Prioritizing prospects, pages, communities, or knowledge sources before manual review.
Feeding structured records into spreadsheets, CRMs, dashboards, or automation workflows.

Input

Provide one or more values in startUrls.

{
  "startUrls": [
    "https://docs.apify.com/platform/actors"
  ],
  "maxItems": 8,
  "requestTimeoutSecs": 25,
  "maxConcurrency": 3
}

Output you get

The dataset is intentionally compact and buyer-facing. Important fields include:

sourceWebsite
pageUrl
pageTitle
knowledgeSummary
keyFacts
faqCandidates
internalLinks
ragChunks.chunkId
ragChunks.text

Practical workflow

Start with a small list of searches or URLs.
Review the first dataset rows and confirm the signals match your market.
Increase the input list for larger research batches.
Export the dataset to CSV, JSON, Google Sheets, or your automation pipeline.

Notes and limitations

The actor uses public web data and does not bypass login walls, private content, CAPTCHA, or protected dashboards.
Public search snippets and pages can change, so results should be treated as research signals rather than legal, financial, or valuation advice.
The output avoids raw HTML and noisy debug fields so buyers can act on the data immediately.

Website to RAG Knowledge Dataset

ghostgrid/website-to-rag-knowledge-dataset

Convert a website sitemap into clean text and markdown rows for RAG, AI search, chatbots, and knowledge base workflows.

GhostGrid

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

Ryan Clinton

Website To LLM Knowledge Pack

attainable_iota/website-to-llm-knowledge-pack

Crawl any website and turn it into an LLM-ready knowledge pack. This Actor extracts clean main text + metadata, follows links with depth/URL filters, and outputs per-page dataset items plus knowledge.jsonl, knowledge.md, and manifest.json for RAG/embeddings pipelines.

M Junaid Shaukat

Website Content Scraper

qaseemiqbal/website-content-scraper

Extract clean Markdown, plain text, linked files, and RAG-ready chunks from websites, documentation, help centers, knowledge bases, and authenticated portals. Preserve structure, metadata, URLs, and crawl context for AI search, training, and retrieval workflows.

Muhammad Qaseem Iqbal

RAG Web Browser

scraper-engine/rag-web-browser

RAG Web Browser websites and extract relevant content for Retrieval-Augmented Generation (RAG). Collect clean text, metadata, links, and documents from web pages, then export structured data to JSON, CSV, Excel, or XML for AI assistants, knowledge bases, and semantic search.

Scraper Engine

RAG Web Extractor — Clean Markdown, HTML & Chunks

junipr/rag-web-extractor

Extract clean website content for RAG and AI search. Crawl pages, remove boilerplate, preserve structure, and export markdown, HTML, text, JSON, and chunks.

junipr

Rag Knowledge Graph Builder

cspnair/rag-knowledge-graph-builder

Transform websites into RAG-ready datasets. Crawls pages, chunks content into semantic segments (500-1000 tokens), and generates hypothetical questions for each chunk. No API key needed with native mode. Output: pre-indexed JSON optimized for AI retrieval with 3x better accuracy than raw text.

csp

130

5.0

Site Crawler: Website → Markdown Corpus for LLM/RAG

boxbox10/site-crawler

Crawl a whole website or docs site and get one clean, LLM-ready Markdown + JSON record per page (title, headings, content, links, token count). Built for RAG ingestion and AI knowledge bases.