RAG Knowledge Loader

Front Knowledge Base

canadesk/front-knowledge-base

Get Categories and Articles from any public Front Knowledge Base. It's fast and costs little.

Crawls websites to extract clean, structured content for AI/LLM use, ideal for training datasets, knowledge bases, and RAG systems. Json output includes: * text: Normalized page content * links: Extracted sub-URLs

Real-time knowledge for LLMs

ai-developer/real-time-knowledge-for-llms

Unlock the Full Potential of Your LLM with Real-Time Web Knowledge! Say goodbye to outdated responses, misinformation, and hallucinations. Now you can ground your Language Model with the freshest information from the web. NO API NEEDED!

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs.

RAG Browser

visita/rag-browser

This Actor provides essential web browsing and content extraction functionality for AI Agents, LLM applications, and Retrieval-Augmented Generation (RAG) pipelines. It functions similarly to the web search feature in popular LLM chatbots, providing fresh, contextualized data directly from the web.

Blog / Dated Content Crawler

diarmuidr/blog-content-crawler

Crawl an entire blog / knowledge base or filter to just the new content. Supporting relevant AI queries by filtering pages by date

Simple URL Loader / Virtual Cronjob

chris_gentleman/simple-url-loader

This lightweight actor loads (NOT JUST PINGS) the provided URLs inside the actor. Perfect to read and process a URLs content and/or status, create your own cronjob, or check on the health of a url. GET, POST and other methods are possible. There's also an option to save the returned content.

Markdownify MCP Server

crawlerbros/markdownify-mcp-server

Convert any webpage to clean, formatted Markdown perfect for AI consumption. Ideal for building knowledge bases, documentation scrapers, and content migration tools.

website-change-monitor

desmond-dev/website-change-monitor

Monitor any website for changes. If content updates, convert it to clean Markdown. Perfect for RAG, AI Agents, and competitor tracking. Ignores ads and navigation.

Gitmcp Universal Repository Processor

theguide/gitmcp-universal-repository-processor

Turn any public or private GitHub repository into a ready-to-use knowledge pack you can hand to your favorite AI assistant in minutes.