Pricing

from $2.00 / 1,000 result scrapes

Try for free

Go to Apify Store

RAG Web Browser Scraper

Try for free

RAG Web Browser Search & Crawl Actor uses to search Bing or crawl URLs, then extracts page content as clean markdown. It captures title, description, language, HTTP status, and structured metadata. Supports multiple queries, proxies, and outputs organized crawl + search results.

Pricing

from $2.00 / 1,000 result scrapes

Rating

0.0

(0)

Developer

Data Pilot

Actor stats

Bookmarked

Total users

Monthly active users

8 hours ago

Last modified

Categories

Other

You can access the RAG Web Browser Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "queries": "artificial intelligence,https://example.com"
12};
13
14// Run the Actor and wait for it to finish
15const run = await client.actor("datapilot/rag-web-browser-scraper").call(input);
16
17// Fetch and print Actor results from the run's dataset (if any)
18console.log('Results from dataset');
19console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
20const { items } = await client.dataset(run.defaultDatasetId).listItems();
21items.forEach((item) => {
22    console.dir(item);
23});
24
25// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

RAG Web Browser Scraper API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use RAG Web Browser Scraper API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

RAG Web Browser Scraper API in Python

RAG Web Browser Scraper API through CLI

RAG Web Browser Scraper OpenAPI definition

RAG Web Browser Scraper API

RAG Web Browser

parseforge/rag-web-browser

Fetches web pages from search queries or direct URLs and returns clean content as markdown, text, and optional HTML. Designed to feed RAG pipelines and LLMs with structured data.

ParseForge

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

177K

4.7

Web Search API for RAG — Search & Extract

tugelbay/rag-web-browser

Web search API that turns Google results and public URLs into Markdown, text, or HTML for RAG and AI agents. Guide: https://konabayev.com/tools/rag-web-browser/?utm_source=apify_info&utm_medium=referral&utm_campaign=rag-web-browser

Tugelbay Konabayev

RAG Web Browser

muhammadafzal/rag-web-browser

Crawl public web pages and return clean, source-linked text chunks for RAG pipelines, vector search, question answering, and AI agents.

Muhammad Afzal

RAG Web Browser — URL & Website to Markdown for LLM & RAG

s-r/rag-web-browser

Search the web or pass URLs, get clean Markdown, plain text or HTML for LLM and RAG pipelines. Follows links, streams results, no per-run fee.

AI Web Search Scraper - SERP & Page Content for LLM RAG

get_anything/ai-web-search-scraper

Web search API for LLMs: query -> clean results (title, URL, snippet, position, domain) and OPTIONALLY each page's full content as LLM-ready Markdown. Ground ChatGPT/Claude and RAG pipelines with live web results. Google (browser-rendered) or DuckDuckGo engine. Export JSON, CSV or Markdown.

Get Anything

Website Content Scraper: Clean Markdown for AI and RAG

scrapemint/website-content-scraper

Crawl any website and get clean markdown, text, or HTML per page, ready for RAG pipelines, chatbots, and LLM fine tuning. Plain HTTP, no browser, no API key. Pay per page.

Ken M

🧠 RAG Web Browser — Web Content for AI & LLMs

nexgendata/rag-web-browser

Web browser for RAG pipelines and AI agents. Search Google, scrape top results, return clean Markdown. Feed your LLM with real-time web data. Works with Claude, GPT, LangChain, CrewAI. No API key needed.

NexGenData

Crawl4ai

kael_odin/crawl4ai

Extract page content (markdown/HTML/text), metadata, and link stats. Uses crawl4ai.

Kael Odin

RAG Web Browser

travelmonitorlab/rag-web-browser

Search Google & extract clean Markdown from any URL — built for AI agents, RAG pipelines & LLM apps. Structured JSON output. API + MCP ready. $0.003/page.