Pricing

Pay per usage

Go to Store

RAG Web Browser

Try for free

Developed by

Apify

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

4.4 (11)

Pricing

Pay per usage

Total users

2.6k

Monthly users

957

Runs succeeded

>99%

Issues response

4.7 days

Last modified

16 days ago

Open source

You can access the RAG Web Browser programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "query": "web browser for RAG pipelines -site:reddit.com",
10    "proxyConfiguration": { "useApifyProxy": True },
11    "removeElementsCssSelector": """nav, footer, script, style, noscript, svg, img[src^='data:'],
12[role=\"alert\"],
13[role=\"banner\"],
14[role=\"dialog\"],
15[role=\"alertdialog\"],
16[role=\"region\"][aria-label*=\"skip\" i],
17[aria-modal=\"true\"]""",
18    "htmlTransformer": "none",
19}
20
21# Run the Actor and wait for it to finish
22run = client.actor("apify/rag-web-browser").call(run_input=run_input)
23
24# Fetch and print Actor results from the run's dataset (if there are any)
25print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
26for item in client.dataset(run["defaultDatasetId"]).iterate_items():
27    print(item)
28
29# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

RAG Web Browser API in Python

The Apify API client for Python is the official library that allows you to use RAG Web Browser API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

RAG Web Browser API in JavaScript

RAG Web Browser API through CLI

RAG Web Browser OpenAPI definition

RAG Web Browser API

GPT Browser

anchor/gpt-browser

A GPT browser to use OpenAI prompt on any website. Put a list of URLs and a prompt, then the GPT agent will give you the answer you need. Fast, easy, and not limited with OpenAI ChatGPT restrictions. The best way to search and use GPT on large number of websites. Upload Excel or CSV. Screenshots 📸

Anchor

Browser Use Apify

lexis-solutions/browser-use-apify

Open-source AI-powered browser automation based on browser-use and hosted on Apify. Run any task using Apify's platform and LLMs like ChatGPT, Claude, etc. Easy, scalable, resilient, and hosted solution for web-enabled AI agents.

Lexis Solutions

122

5.0

Playwright MCP

jiri.spilka/playwright-mcp

A Model Context Protocol (MCP) server that provides browser automation capabilities using Playwright

Jiří Spilka

Actors MCP Server

apify/actors-mcp-server

Connect Apify Actors to AI applications (AI Agents) using Anthropic's Model Context Protocol (MCP). This MCP server provides integration of any Apify Actor through the MCP framework.

Apify

1.1k

4.6

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Raizen Technology

1.0

Browserbase MCP

jakub.kopecky/browserbase-mcp

A Model Context Protocol (MCP) server that provides browser automation capabilities using Browserbase.

Jakub Kopecký

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

50.9k

4.5

Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

Pepa <b>J</b>

Mastra.ai MCP Agent

jakub.kopecky/actor-mastra-mcp-agent

🤖 AI agent using mastra.ai with Apify MCP Server. 🚀 Runs queries via OpenAI models, taps Apify Actors for web data, and outputs to datasets. 🛠️

Jakub Kopecký

Tester MCP Client

jiri.spilka/tester-mcp-client

A model context protocol (MCP) client that connects to any MCP server using Server-Sent Events (SSE) and displays the conversation in a chat-like UI. It is a standalone Actor server designed for testing MCP servers over SSE.

Jiří Spilka

374

4.8