Pricing

from $1.00 / 1,000 result scrapeds

Try for free

Go to Apify Store

RAG Web Search - Results as Markdown for AI

Try for free

Web search for AI agents and RAG: for any query you get the top results with title, URL and snippet, plus each page converted to clean Markdown with its title, author and date. Region and time filters, search-only mode. $0.001 per result, free when a page cannot be read.

Pricing

from $1.00 / 1,000 result scrapeds

Rating

0.0

(0)

Developer

Antonio del Olmo Tena

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Configure MCP server with Web Search API for AI Agents - Results as Markdown

The configuration above connects to the hosted Apify MCP server with the Web Search API for AI Agents - Results as Markdown Actor already loaded. It uses OAuth, so your client opens a browser window to sign you in to Apify on first use. No API token is needed. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

Get a ready-to-use configuration for your MCP client with the Web Search API for AI Agents - Results as Markdown Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,aolmo/rag-web-search.

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.

Top Api

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Raizen Technology

357

1.0

(1)

RAG Web Browser — Web Content for AI & LLMs

nexgendata/rag-web-browser

Web browser for RAG pipelines and AI agents. Searches DuckDuckGo, scrapes the top results, returns clean Markdown with citation URLs. Feed your LLM with real-time web data. Works with Claude, GPT, LangChain, CrewAI. No API key needed.

NexGenData

Website Content Crawler — Markdown for LLM & RAG

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.

Yuliia Kulakova

Universal Web to Markdown (Bulk & AI-Ready)

lentic_october/web-to-markdown-converter

Bulk convert any website URLs to clean Markdown for AI & LLMs. Universal scraper that removes ads, scripts, and clutter. Optimized for RAG, ChatGPT, Claude, and LangChain. Fast, async, and API-ready.

kalthireddy Abhishek

Web Search for AI (DuckDuckGo)

desmond-dev/duckduckgo-web-search

Perform anonymous web searches and extract clean results (Title, Link, Snippet). No API key required. Perfect for RAG pipelines, grounding LLMs, and market research.

Desmond Chigariro

AI-Powered Smart Web Scraper

cloud9_ai/ai-web-scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

cloud9

LinkedIn Profile Scraper - No Cookies, No Login

aolmo/linkedin-profile

Public LinkedIn profiles without cookies or an account: name, headline, location, about, current job, full experience with dates, education, skills, languages, followers, connections and recent posts. $0.003 per profile; job changes flagged on scheduled runs.

Antonio del Olmo Tena

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

SmartApi

5.0

(1)

Web to LLM Spanish — RAG-ready content extractor

fanciful_geode/web-to-llm-es

Crawls Spanish-language websites and extracts clean markdown content optimized for LLM RAG pipelines. Handles Spanish character encoding, removes boilerplate, and outputs structured chunks ready for embedding.