Pricing

from $2.00 / 1,000 page extracteds

Try for free

Go to Apify Store

RAG Web Browser Lite — Cheap Markdown for AI Agents

Try for free

Web search and fetch tool for AI agents and RAG pipelines. Queries Google Search, scrapes the top N pages over raw HTTP, and returns clean Markdown. Fixed $0.002 per page — no surprise compute bills.

Pricing

from $2.00 / 1,000 page extracteds

Rating

0.0

(0)

Developer

subimpact

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Why it's cheaper

	apify/rag-web-browser	rag-web-browser-lite
Engine	Crawlee + Playwright + MCP SDK	raw HTTP + cheerio + turndown
Browser launch per page	Yes (heavy)	Never
Billing	Pay per usage (variable)	PPE: $0.002/page, fixed
Container	~1GB+ (Playwright)	~200MB
Output shape	`{crawl, searchResult, metadata, markdown}`	Identical

The official actor's own docs say raw HTTP is "about two times faster" than the browser tool — we made that the only mode.

Usage

Normal mode (one request per run)

curl -X POST "https://api.apify.com/v2/acts/subimpact~rag-web-browser-lite/runs" \
  -H "Content-Type: application/json" \
  -d '{"query": "best crm for startups", "maxResults": 3}'

Standby mode (agent-facing HTTP endpoint)

$curl "https://subimpact--rag-web-browser-lite.apify.actor/search?query=apify+mcp&maxResults=2&token=<APIFY_API_TOKEN>"

Input

Field	Type	Default	Description
`query`	string	—	Search term or URL (required)
`maxResults`	int	3	Top N organic results to extract (1-100)
`outputFormats`	array	`["markdown"]`	`markdown`, `text`, `html`
`gl` / `hl`	string	`us` / `en`	Google country / language
`serpProxyGroup`	string	`GOOGLE_SERP`	Proxy group for SERP fetch
`serpMaxRetries`	int	2	SERP retries (0-5)
`proxyConfiguration`	object	Apify proxy	Proxy for target pages
`removeElementsCssSelector`	string	nav/footer/script/...	Elements to strip before conversion

Output row

{
  "crawl": { "httpStatusCode": 200, "httpStatusMessage": "OK", "loadedAt": "...", "uniqueKey": "...", "requestStatus": "handled" },
  "searchResult": { "title": "...", "description": "...", "url": "...", "resultType": "ORGANIC", "position": 1 },
  "metadata": { "url": "...", "title": "...", "description": "...", "languageCode": "en", "canonicalUrl": "...", "openGraph": [...], "jsonLd": [...], "headers": {...} },
  "markdown": "# ..."
}

Pricing

$0.002 per page extracted (pay-per-event, page-extracted)
Platform usage (proxy, compute) is paid by the buyer
No charge for failed/blocked/empty pages — only pages with ≥100 chars of real content are billed
SERP fetch is billed as platform usage (GOOGLE_SERP proxy), not as an event

Development

npm install
npm test        # unit tests (parser + content pipeline)
apify push      # build to Apify

Notes

SERP parsing reuses the battle-tested goto-map + organic parser from google-serp-ai-overviews (verified 2026-08-27: top-organic 100% mappable).
GOOGLE_SERP proxy requires http:// (not https://) for the SERP fetch.
Standby detection: Actor.getEnv().metaOrigin === 'STANDBY'; port from Actor.config.get('containerPort').
Reddit and other JS-heavy sites that block raw HTTP return stub pages — those are not charged (content gate).

📰 AI News Brief | Multi-Source Research Agent

kay_abraham/news-intelligence-agent

Plain English question in → cited intelligence brief out. Pulls Google News, RSS, Reddit, and Twitter. Routes tier-1 publishers to bypass paywalls. Claude analyses each article, flags anomalies, and corroborates across sources. Wikipedia grounds entities. Built for analysts and policy teams.

Kirubel Abraham

Cloudflare & Anti-Bot Fetcher – Gap-Filler for Crawlers

vietaro/cloudflare-bypass-scraper

Fast HTTP by default, automatic Cloudflare/anti-bot bypass when blocked. The gap-filler for Website Content Crawler, RAG Web Browser, or any crawler that got blocked — retries just their failed pages and returns clean, LLM-ready Markdown.

Vietaro Tools

Web Page to Markdown & Text - URL Reader for LLMs & RAG

entranced_gelato/ai-web-page-reader

Read any web page as clean text + Markdown for LLMs and automations. Strips ads, nav, and scripts; returns the main content, metadata (title, author, date, word count), and an optional AI TL;DR + key points. The web-reading primitive for AI agents, RAG pipelines, and no-code flows.

AIDevs

Job Postings API — Greenhouse, Lever & Ashby | $1.20/1K

fetchbase/job-postings-scraper

Fetch live job postings from company career boards via the public job-board APIs of Greenhouse, Lever, Ashby, Workable, SmartRecruiters and Recruitee. Auto-detects the ATS from a URL or company slug. Markdown descriptions, salary where published, remote flags. Charged per posting returned.

Fetchbase

URL to Markdown Converter

zinin/url-to-markdown

Convert up to 100 authorized public HTML pages into clean Markdown for RAG, AI agents, SEO research, and content workflows. Delivered rows include source identity, confidence, data gaps, next action, retry status, and billing. Static HTML only; non-delivery outcomes are free.

Tim Zinin

Bulk WHOIS, DNS & SSL Lookup — Domain Intelligence API

fetchbase/domain-dns-intelligence

Full domain intelligence in one call: all DNS records (A, AAAA, MX, TXT, NS, CNAME, SOA, CAA), registration via RDAP/WHOIS (registrar, creation/expiry dates, status, DNSSEC), and live SSL certificate details. Flags unregistered domains. Charged per domain — no startup fee.

Fetchbase

Skim Clean Web Reader — URL to Markdown for LLMs & RAG

jessiejanie/skim-clean-reader

Feed your LLM ~4x less input for the same content. Skim turns any URL into clean, LLM-ready Markdown plus metadata in about a second — ads, nav, and boilerplate stripped. Flat $4 per 1,000 pages, no compute billing. Built for AI agents, RAG pipelines, and no-code automations.

Karilyn Colegrove

Website to Markdown Crawler for LLM & RAG

logiover/website-text-markdown-crawler

Crawl any website to clean Markdown and plain text for LLM training and RAG. HTML to Markdown, no API or login. Export website text to CSV or JSON.

Logiover

Webpage Text Extractor — URL to Clean Text & Markdown

eliai/webpage-text-extractor

Get the readable text off a web page. Pass article or page URLs and get the clean main text back as Markdown or plain text, one result per URL, with ads, navigation and boilerplate stripped. $0.03 per page. Built for RAG and AI agents.

Broke to Built

News Intelligence Scraper — AI Agent Real-Time News API

logiover/news-intelligence-scraper

Multi-source real-time news aggregator for AI agents: Google News, Bing News and DuckDuckGo News merged, deduplicated, source-ranked and sentiment-scored. One topic or company to clean structured news feed. No API key, no browser.

Logiover

MakeMyTrip & Goibibo Reviews Scraper 🏨 Ratings, Text & Data

factden/makemytrip-scraper

Scrape MakeMyTrip and Goibibo hotel reviews plus full hotel details - ratings, sub-ratings, review text, travel type, owner responses, photos, and LLM-ready markdown. Hotel profiles included free. Structured JSON/CSV for analytics, AI and market research. No API, no login.