Pricing

$15.00 / 1,000 rag chunks

Techionik Website RAG MCP

Prompt-first MCP-ready Apify tool for AI agents to crawl public websites and return clean RAG chunks with URLs, titles, markdown, and token estimates.

Pricing

$15.00 / 1,000 rag chunks

Rating

0.0

(0)

Developer

Techionik

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

Prompt for this MCP tool

prompt

Optional

Describe the job in natural language. The actor extracts URLs, entities, and settings from this prompt, then returns structured dataset records.

Type:string

Structured start URLs

startUrls

Optional

Optional structured fallback for API users. MCP agents should prefer prompt.

Type:array

Max pages

maxPages

Optional

Maximum pages to fetch across all start URLs.

Type:integer

Minimum:1

Maximum:1000

Default:25

Same domain only

sameDomainOnly

Optional

Only follow links on the same hostname as each start URL.

Type:boolean

Default:true

Chunk size

chunkSize

Optional

Approximate maximum characters per chunk.

Type:integer

Minimum:500

Maximum:8000

Default:1800

Chunk overlap

chunkOverlap

Optional

Characters of overlap between neighboring chunks.

Type:integer

Minimum:0

Maximum:1000

Default:200

Include Markdown

includeMarkdown

Optional

Include a lightweight Markdown version of each chunk.

Type:boolean

Default:true

Delay between requests

requestDelayMs

Optional

Polite delay in milliseconds between public page requests.

Type:integer

Minimum:0

Maximum:5000

Default:500

MCP Website RAG Ingestion Tool

glowing_glove/mcp-website-rag-ingestion-tool

MCP-ready website ingestion for AI agents using a prompt-first interface that turns public webpages into source-linked RAG chunks with markdown and token estimates.

Ushba Khan

RAG Website Crawler - Markdown Chunks for LLMs & MCP

themineworks/rag-crawler

Crawl any website into clean, pre-chunked Markdown with per-chunk token counts for RAG pipelines, vector DBs (Pinecone, Qdrant) and LLM context. MCP-native for Claude & ChatGPT. SPA support via Playwright. Pay only for pages that crawl. A Firecrawl alternative.

The Mine Works

Actor-to-MCP Bridge — Expose Any Apify Actor as an AI Tool

busy_donkey/actor-mcp-bridge

Wraps any Apify actor as an MCP (Model Context Protocol) server. Connect Claude, GPT, or any AI agent to run Apify scrapers as native tools.

busy_donkey

AI-Ready Content Extractor — Structured Web Data for LLM & MCP

yuchiaoniu/ai-content-extractor

Extract structured JSON from any URL for LLM, RAG, and MCP integration. Outputs title, sections, contact info, links, structured data, and clean plain text.

Niu Yuchiao

AI Web Extract — Structured Data from Any URL

logiover/ai-web-extract

Give a URL, get clean structured JSON — no LLM, no API key. Keyless Firecrawl Extract alternative that pulls schema.org JSON-LD, OpenGraph/meta, microdata, tables, prices, dates and contacts from any page. Built for AI agents, RAG and MCP.

Logiover

Website to Markdown Scraper - HTML to MD for RAG API

pink_comic/website-content-to-markdown

Convert web pages and HTML to clean Markdown for RAG, LLM training, AI knowledge bases, and content migration. Strips nav, ads, scripts, and styling while preserving structure. Bulk output includes word/link/image counts.

Ava Torres

Web Scraper 🚀

datascoutapi/web-scraper

Web Scraper Pro extracts clean structured data for LLMs/RAG. Browser-based, 10x faster with anti-detection bypassing Cloudflare/CAPTCHA & proxy rotation. Bulk/recursive crawl 50k URLs at 500 pages/min. JSON/CSV/API, free tier.

halam

🧠 RAG Web Browser — Web Content for AI & LLMs

nexgendata/rag-web-browser

Web browser for RAG pipelines and AI agents. Search Google, scrape top results, return clean Markdown. Feed your LLM with real-time web data. Works with Claude, GPT, LangChain, CrewAI. No API key needed.

NexGenData

RSS Feed Reader (with MCP)

fetch_cat/rss-feed-reader

Read RSS and Atom feeds, normalize feed items, and export clean dataset rows for monitoring, alerts, AI, MCP, and integrations.

Hanna Nosova

Github Tech Intelligence

credible_sandal/github-tech-intelligence

GitHub Trending highlights what’s popular today. This surfaces what’s about to take off tomorrow—and shows which repos are healthy, safe to adopt, and truly gaining traction.