Pricing

Pay per usage

Try for free

Go to Store

Web Scraper

Try for free

Developed by

Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (23)

Pricing

Pay per usage

919

Total users

90K

Monthly users

4.9K

Runs succeeded

>99%

Issues response

7.8 days

Last modified

2 months ago

Developer tools

Open source

114

113

isupply web scraper

Opened 17 days ago by faithsekristy, last comment 13 days ago by Nick Lamonov (nick_slam)

Unsure of how to get what I'm looking for

Opened a month ago by dej, last comment 19 days ago by Jindřich Bär (jindrich.bar)

Crawler took a long time to complete, way more than average

Opened a month ago by remitaffin, last comment 19 days ago by Jindřich Bär (jindrich.bar)

Error : net::ERR_TUNNEL_CONNECTION_FAILED

Opened 2 months ago by campsider_tools, last comment a month ago by campsider_tools

Unable to scrape website

Opened 2 months ago by Uday-Irasha, last comment 2 months ago by Jindřich Bär (jindrich.bar)

getting the issues while scrapimg this endpoin

Opened 2 months ago by capable_santoor, last comment 2 months ago by capable_santoor

Why is this page erroring out

Opened 3 months ago by burgundy_zebra, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Can't add a new page through context.enqueueRequest

Opened 3 months ago by oleg522, last comment 3 months ago by oleg522

can't extract emails from websites doing dymanic content rendering

Opened 4 months ago by Uday-Irasha, last comment 3 months ago by Jindřich Bär (jindrich.bar)

dextools hot pairs

Opened 4 months ago, last comment 3 months ago by Jindřich Bär (jindrich.bar)

Page function keeps loading

Opened 4 months ago by timofeichikm, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Problem with running Web Scraper

Opened 5 months ago by leoberg, last comment 3 months ago by Jindřich Bär (jindrich.bar)

received 401 status code

Opened 5 months ago by Competent Path (competent_path), last comment 19 days ago by Jindřich Bär (jindrich.bar)

Scraping data from my chrome extension.

Opened 5 months ago by LeonardChin, last comment 5 months ago by Jindřich Bär (jindrich.bar)

Crawling takes much longer

Opened 5 months ago by SallaR, last comment 5 months ago by Jindřich Bär (jindrich.bar)

If I verify in pageFunction that the target website has been redirected by the anti-crawl mechanism, how do I get the latest page content.

Opened 5 months ago by productvidau, last comment 5 months ago by Jindřich Bär (jindrich.bar)

No longer working

Opened 6 months ago by intense_sunshine, last comment 5 months ago by Jindřich Bär (jindrich.bar)

container error.

Opened 6 months ago by caravel, last comment 6 months ago by Jindřich Bär (jindrich.bar)

Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds

Opened 6 months ago by bartos.ondrej, last comment 6 months ago by Jindřich Bär (jindrich.bar)

issue unknown

Opened 6 months ago by caravel, last comment 6 months ago by Jindřich Bär (jindrich.bar)

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

4.7

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

8.4K

5.0

Web Scraping API

zeeb0t/web-scraping-api---scrape-any-website

Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included. It’s just $2 per 1,000 web pages scraped, with no minimum spend.

Anthony Ziebell

1.2K

5.0

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

3.6

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

870

4.2

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

100

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

4.6K

4.4

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

64K

4.3

Cloudflare Web Scraper

ecomscrape/cloudflare-web-scraper

Advanced web scraper designed to extract data from Cloudflare-protected websites with CAPTCHA bypass, proxy rotation, and JavaScript execution capabilities.

ecomscrape

144

5.0

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!