Pricing

from $10.00 / 1,000 web pages

Try for free

Go to Apify Store

RAG Web Browser — Web Content for AI & LLMs

Try for free

Web browser for RAG pipelines and AI agents. Searches DuckDuckGo, scrapes the top results, returns clean Markdown with citation URLs. Feed your LLM with real-time web data. Works with Claude, GPT, LangChain, CrewAI. No API key needed.

Pricing

from $10.00 / 1,000 web pages

Rating

0.0

(0)

Developer

NexGenData

Actor stats

Bookmarked

Total users

Monthly active users

10 days ago

Last modified

RAG Web Browser

Web Content for AI & LLMs

Public web content, RAG-ready.

📊 Sample Output

3 real rows delivered by RAG Web Browser — Web Content for AI & LLMs — run mzd1reqGkenJ2bnlD on build 0.0.59

`url`	`title`	`description`	`markdown_content`	`content_length`	`scraped_at`
https://lushbinary.com/blog/rag-retrieval-augmented-generation-produc…	RAG Production Guide 2026: Retrieval-Augmented Generation \| Lushbinary	Complete RAG production guide: hybrid search, agentic RAG, reranking,…	## One Subscription. Every Flagship AI Model. Stop juggling multiple…	173	2026-09-25T04:04:46.428037+00:00
https://datarmatics.com/how-to-build-rag-pipeline-guide-2026/	How to Build a RAG Pipeline: Complete Guide for 2026 \| Datarmatics	Learn how to build a RAG pipeline from scratch — chunking, embeddings…	Retrieval-Augmented Generation (RAG) has become the default architect…	10021	2026-09-25T04:04:48.344719+00:00
https://aipromptshub.co/blog/rag-pipeline-architecture-best-practices	RAG Pipeline Architecture Best Practices (2026): The Complete Enginee…	A sourced, model-specific guide to RAG pipeline architecture best pra…	## 8. Generation Model Selection: Matching Model Capability to RAG U…	2636	2026-09-25T04:04:49.512400+00:00

Real rows from run mzd1reqGkenJ2bnlD on build 0.0.59 (2026-09-25), unedited apart from masked emails/phones and shortened long text; fields the source does not publish are empty.

⚙️ Sample inputs

This is the Store example input — the same input Apify's automated check runs — so it is proven to return rows on the current build. Paste it into the input form, or send it through the API, CLI or a schedule:

{
  "query": "best practices for RAG pipelines 2026",
  "maxResults": 3,
  "includeMetadata": true,
  "maxContentLength": 10000
}

🔧 Input reference

Field	Type	Default	What it does
`query`	string	`"best practices for RAG pipelines 2026"`	A search query (the actor searches and reads top results) or a direct URL to read.
`maxResults`	integer	`3`	Maximum pages to fetch and return. Defaults to 5 (evaluation-sized); raise it for full runs (each result is billed).
`maxContentLength`	integer	`10000`	Maximum characters of cleaned content to return per page.
`includeMetadata`	boolean	`true`	If enabled, includes page metadata (title, description, etc.).

🧾 JSON sample record

One real record from run mzd1reqGkenJ2bnlD (emails/phones masked, long text shortened):

{
  "url": "https://lushbinary.com/blog/rag-retrieval-augmented-generation-production-guide/",
  "title": "RAG Production Guide 2026: Retrieval-Augmented Generation | Lushbinary",
  "description": "Complete RAG production guide: hybrid search, agentic RAG, reranking, chunking strategies, vector DBs (Pinecone, Weaviate), and RAGAS evaluation. Updated April 2026.",
  "markdown_content": "## One Subscription. Every Flagship AI Model.\n\nStop juggling multiple AI subscriptions. WidelAI gives you access to Claude, GPT, Gemini, and more - all under a single plan.",
  "content_length": 173,
  "scraped_at": "2026-09-25T04:04:46.428037+00:00"
}

💰 Pricing

Event	Price (USD)	When it is charged
Actor Start (`apify-actor-start`)	$0.005	Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
Web page (`apify-default-dataset-item`)	$0.01	Charge per web page extracted and converted to Markdown

Pay-per-event: you pay only for what the run delivers. A run that delivers nothing bills no result events (only the actor-start event, when the actor defines one). Example: a run that delivers 100 results costs 100 × $0.01 = $1.00 plus the start fee.

More from the NexGenData Social, video & reviews family:

6 more in this family on the NexGenData Store page.

📊 What you get

Clean JSON output (6 fields):

url — Url
title — Title
description — Description
markdown_content — Markdown content
content_length — Content length
scraped_at — Scraped at

Pricing: $0.010 per page (Pay-Per-Event) — about 100 pages per $1.

🤖 Use with AI agents

Point Claude, the OpenAI Agents SDK, an n8n flow or any MCP-aware client at it.

Sample agent prompt:

Run RAG Web Browser on my input and return the structured results.

Agentic payments (x402): Supports agentic payment via x402 — call this actor with USDC, no API key required.

Website Content Crawler

A NexGenData utility actor.

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

192K

4.7

(35)

Web Fetch

apify/web-fetch

Download any web page by URL and convert it to clean Markdown, plain text, HTML, and other formats. Automatically renders JavaScript and works around bot blocking. The Actor provides a real-time API for quick response times.

Apify

27K

5.0

(3)

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

126K

4.7

(100)

Facebook Ads Library Scraper

apify/facebook-ads-scraper

Extract advertising data from Facebook, Instagram, WhatsApp, Threads. Get ads, publishers, prices, reach estimates, impressions, links, images, IDs, timestamps, product info, and more from Facebook Ad Library. Export ad data, schedule runs via API, and integrate with other tools or AI workflows.

Apify

43K

4.0

(59)

Reddit Scraper - Posts, Comments, Search & Subreddits

harshmaur/reddit-scraper

Scrape Reddit posts, comments, subreddits, user profiles, and keyword search results - no API key, no rate limits, no login. From $2 per 1,000 results, pay only for what you use. Full comment threads, 60+ fields per post, media and galleries. Works with AI Agents, MCP, n8n, Make, Zapier and more.

Harsh Maur

16K

4.5

(41)

LinkedIn Company Employees Scraper (No Cookies)

harvestapi/linkedin-company-employees

Extract all LinkedIn Company employees with filters and detailed profile information, including complete work experience, and more. No cookies or account required. This actor can try to find contact emails.

HarvestAPI

33K

4.0

(49)

GPT Browser

anchor/gpt-browser

A GPT browser to use OpenAI prompt on any website. Put a list of URLs and a prompt, then the GPT agent will give you the answer you need. Fast, easy, and not limited with OpenAI ChatGPT restrictions. The best way to search and use GPT on large number of websites. Upload Excel or CSV. Screenshots 📸

Anchor

5.0

(2)

⚡️Rapid Linkedin Jobs Scraper

worldunboxer/rapid-linkedin-scraper

🔥 $0.45/1K Jobs. Scrape LinkedIn Jobs without cookies 🍪. Extract job listings by keyword, company, city, or country. Get complete structured data including titles, descriptions, locations, salaries, experience, skills, company details, apply links, contact emails, and more.

Umesh Patidar

16K

3.8

(28)

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.

Hounderd

Web Search API for RAG — Search & Extract

tugelbay/rag-web-browser

Web search API that turns Google results and public URLs into Markdown, text, or HTML for RAG and AI agents. Guide: https://konabayev.com/tools/rag-web-browser/?utm_source=apify_info&utm_medium=referral&utm_campaign=rag-web-browser