Web Scraper avatar
Web Scraper

Pricing

Pay per usage

Try for free
Go to Store
Web Scraper

Web Scraper

Try for free

Developed by

Apify

Apify

Maintained by Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (23)

Pricing

Pay per usage

869

Total users

88K

Monthly users

4.5K

Runs succeeded

>99%

Issues response

12 days

Last modified

a month ago

Developer tools

Open source

All

113

Open

4

Closed

109

Create new issue
Unsure of how to get what I'm looking for

Opened 7 days ago by dej, last comment 7 days ago by dej

Crawler took a long time to complete, way more than average

Opened 13 days ago by remitaffin, last comment 7 days ago by Mustafa99

Error : net::ERR_TUNNEL_CONNECTION_FAILED

Opened 25 days ago by campsider_tools, last comment 19 days ago by campsider_tools

Unable to scrape website

Opened a month ago by Uday-Irasha, last comment a month ago by Jindřich Bär (jindrich.bar)

getting the issues while scrapimg this endpoin

Opened a month ago by capable_santoor, last comment a month ago by capable_santoor

Why is this page erroring out

Opened 2 months ago by burgundy_zebra, last comment a month ago by Jindřich Bär (jindrich.bar)

Can't add a new page through context.enqueueRequest

Opened 3 months ago by oleg522, last comment 3 months ago by oleg522

can't extract emails from websites doing dymanic content rendering

Opened 3 months ago by Uday-Irasha, last comment 2 months ago by Jindřich Bär (jindrich.bar)

dextools hot pairs

Opened 3 months ago by paulbabayakubu04, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Page function keeps loading

Opened 4 months ago by timofeichikm, last comment a month ago by Jindřich Bär (jindrich.bar)

Problem with running Web Scraper

Opened 4 months ago by leoberg, last comment 2 months ago by Jindřich Bär (jindrich.bar)

received 401 status code

Opened 5 months ago by Competent Path (competent_path), last comment 4 months ago by Competent Path (competent_path)

Scraping data from my chrome extension.

Opened 5 months ago by LeonardChin, last comment 5 months ago by Jindřich Bär (jindrich.bar)

Crawling takes much longer

Opened 5 months ago by SallaR, last comment 5 months ago by Jindřich Bär (jindrich.bar)

If I verify in pageFunction that the target website has been redirected by the anti-crawl mechanism, how do I get the latest page content.

Opened 5 months ago by productvidau, last comment 5 months ago by Jindřich Bär (jindrich.bar)

No longer working

Opened 5 months ago by intense_sunshine, last comment 5 months ago by Jindřich Bär (jindrich.bar)

container error.

Opened 5 months ago by caravel, last comment 5 months ago by Jindřich Bär (jindrich.bar)

Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds

Opened 5 months ago by bartos.ondrej, last comment 5 months ago by Jindřich Bär (jindrich.bar)

issue unknown

Opened 5 months ago by caravel, last comment 5 months ago by Jindřich Bär (jindrich.bar)

The parametre "Max result records (optional)" is set to N-1

Opened 5 months ago by RedabenhAKO, last comment a month ago by Jindřich Bär (jindrich.bar)

Cheerio Scraper avatar

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

User avatar

Apify

8.6K

4.7

Web Scraping API avatar

Web Scraping API

zeeb0t/web-scraping-api---scrape-any-website

Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included. It’s just $2 per 1,000 web pages scraped, with no minimum spend.

User avatar

Anthony Ziebell

1.2K

5.0

Puppeteer Scraper avatar

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

User avatar

Apify

7.9K

5.0

Playwright Scraper avatar

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

User avatar

Apify

1.8K

4.3

BS

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

User avatar

Apify

860

4.4

WS

Web Scraper Task

undrtkr984/web-scraper-task

User avatar

Matt

117

Website Content Crawler avatar

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

User avatar

Apify

60K

3.9

RAG Web Browser avatar

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

User avatar

Apify

4K

4.3

FW

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

User avatar

David Deng

1.2K

4.4

HTML Scraper pro avatar

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

User avatar

scrapingxpert

96

Related articles

Blog article image
Web crawling vs. web scraping: what's the difference?
Read more
Blog article image
11 best open-source web crawlers and scrapers in 2025
Read more
Blog article image
What is web scraping?
Read more