Pricing

from $0.43 / 1,000 page fetched (basic tier)s

Smart Page Fetcher

Fetch a batch of URLs adaptively: cheap HTTP for static pages, browser render for JavaScript pages, stealth+residential proxy only for actively defended pages. Pay per URL by the difficulty that actually worked, with browser launches amortized across the batch.

Pricing

from $0.43 / 1,000 page fetched (basic tier)s

Rating

0.0

(0)

Developer

Scott Helvick

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Smart Web Scraper: Adaptive Batch Page Fetcher API through CLI

The Apify CLI is the official tool that allows you to use Smart Page Fetcher locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Smart Page Fetcher API in Python

Smart Page Fetcher API in JavaScript

Smart Page Fetcher OpenAPI definition

Smart Page Fetcher API

Stealth Website Scraper

solutionssmart/stealth-website-scraper

Extract text, links, metadata, HTML, markdown, and structured page data with HTTP-first crawling and stealth-aware browser fallback.

Solutions Smart

Wick Web Fetcher — Browser-Grade Content Extraction

eventful_notoriety/wick-web-fetcher

Fetch web pages using Chrome's real TLS fingerprint. Returns clean markdown for LLMs and RAG pipelines. No headless browser needed — fast and lightweight.

Adam Fisk

Stealth Web Scraper

lentic_clockss/stealth-web-scraper

Get rendered HTML, plain text, and extracted fields from Cloudflare-protected and JavaScript-heavy pages without building your own browser-and-proxy stack.

kane liu

Website Contact Finder

crawlerbros/website-contact-finder

Crawl any website and extract emails, phone numbers, and social media profiles. Smart prioritisation of /contact, /about, /team pages. HTTP-only, no browser.

Crawler Bros

5.0

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

88K

3.7

Website Job Extractor (Browser)

santamaria-automations/website-job-extractor-browser

Extract job listings from JavaScript-rendered career pages (React, Vue, Angular) using AI + Playwright. Companion to the HTTP-only Website Job Extractor. Use it for the ~28% of company sites that need a real browser. Same output format, same quality, same LLM fallback chain.

Ale

Instagram Posts Scraper Lowcost (0.3$/1K 🤑)

sones/instagram-posts-scraper-lowcost

Cost-optimized Instagram scraper for public profiles. Extract posts, captions, engagement metrics, coauthors, and media without authentication. HTTP-only (no browser), 10x cheaper than alternatives. Supports batch scraping with residential proxies and smart rate limiting.

Samy

1.2K

3.4

Stealth Scraper

shvmgrx/stealth-scraper

Shivam Goraksha

Facebook Pages Scraper

automation-lab/facebook-pages-scraper

Scrape public Facebook Pages — extract followers, likes, contact info, website, description, hours, and more. No login required. Powered by residential proxy for reliable access.