Pricing

from $100.00 / 1,000 web searches

Try for free

Go to Apify Store

MCP Research Agent: Web Scraping Tool for AI

Try for free

Structured web research tool for AI agents: search, fetch and shape web data into the JSON schema you request. Clean, predictable output for Claude and MCP workflows, ready for RAG pipelines.

Pricing

from $100.00 / 1,000 web searches

Rating

0.0

(0)

Developer

Turgay NANTA

Actor stats

Bookmarked

Total users

Monthly active users

5 hours ago

Last modified

MCP Web Research Agent: Structured Data for AI API through CLI

The Apify CLI is the official tool that allows you to use MCP Research Agent: Web Scraping Tool for AI locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

MCP Research Agent: Web Scraping Tool for AI API in Python

MCP Research Agent: Web Scraping Tool for AI API in JavaScript

MCP Research Agent: Web Scraping Tool for AI OpenAPI definition

MCP Research Agent: Web Scraping Tool for AI API

🧠 RAG Web Browser — Web Content for AI & LLMs

nexgendata/rag-web-browser

Web browser for RAG pipelines and AI agents. Search Google, scrape top results, return clean Markdown. Feed your LLM with real-time web data. Works with Claude, GPT, LangChain, CrewAI. No API key needed.

NexGenData

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

168K

4.7

MCP Web Scraper Server — AI-Ready Web Extraction

junipr/mcp-web-scraper

Run an MCP-compatible web scraping server for AI agents with domain allowlists, content extraction, markdown conversion, and safe tool-call limits.

junipr

RAG Web Browser

travelmonitorlab/rag-web-browser

Search Google & extract clean Markdown from any URL — built for AI agents, RAG pipelines & LLM apps. Structured JSON output. API + MCP ready. $0.003/page.

Travel Monitor Lab

Universal Web Scraper & Data Extractor

motivational_nickel/universal-scraper

Fast AI-ready webpage extraction with structured JSON output for automation workflows, AI agents, RAG pipelines, SEO analysis, and website intelligence.

Leoncio Jr Coronado

MCP AI Agent Research Brief Tool

glowing_glove/mcp-ai-agent-research-brief-tool

Gives AI agents a clean research tool that turns web sources into a decision-ready answer, evidence, recommended actions, and gaps.

Ushba Khan

MCP Website RAG Ingestion Tool

glowing_glove/mcp-website-rag-ingestion-tool

MCP-ready tool for AI agents to crawl public webpages, clean text, and return source-linked chunks for RAG and knowledge-base workflows.

Ushba Khan

Universal Web Data Scraper & Extractor Tool

enezli/ai-review-intelligence

Extract data from any website with this web scraper tool. Collect structured data such as text, prices, listings, and details into clean JSON datasets. Flexible, fast, and easy to configure for various web scraping tasks.

Turgay NANTA

RAG Web Browser Lite — Cheap Markdown for AI Agents

subimpact/rag-web-browser-lite

Web search and fetch tool for AI agents and RAG pipelines. Queries Google Search, scrapes the top N pages over raw HTTP, and returns clean Markdown. Fixed $0.002 per page — no surprise compute bills.