Pricing

Pay per usage

Try for free

Go to Store

Web Scraper

Try for free

Developed by

Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (23)

Pricing

Pay per usage

920

Total users

90K

Monthly users

4.9K

Runs succeeded

>99%

Issues response

7.8 days

Last modified

2 months ago

Developer tools

Open source

Back to issues Create new issue

Error : net::ERR_TUNNEL_CONNECTION_FAILED

Closed

campsider_tools opened this issue

Hello,

We have recently been observing recurring occurrences of the following error in several of our tasks that rely on the "web-scraper" actor:

net::ERR_TUNNEL_CONNECTION_FAILED

This issue seems to occur intermittently, sometimes multiple times on the same page (each page may be visited up to twice), which in turn leads to incomplete or reduced output in the corresponding runs.

Our task is configurated with :

a proxy that changes with each request.
a retry policy is set to 1.
the maximum concurrency is set to 1.

The problem isn't on our side, as we're running tasks directly from console.apify.com. Tthe targeted website has no updates

We would appreciate any insights into whether this issue is known and currently being addressed on your side, or if there are configuration adjustments we could do to prevent this problem

Thank you in advance for your support.

Best regards,

Jindřich Bär (jindrich.bar)

Hello, and thank you for your interest in this Actor!

net::ERR_TUNNEL_CONNECTION_FAILED is an internal Chrome error that gets fired on a proxy error. Proxies (actually, websites and web scrapers in general) can be unreliable, which is why maxRequestRetries is set to 3 by default. By setting maxRequestRetries to 1, you instruct the crawler to fail after one retry, which may not be enough in some cases.

If you prefer complete results over crawling speed, try reverting the maxRequestRetries option to the default value.

I'll close this issue now, but feel free to ask questions, if you have any. Cheers!

campsider_tools

Thank you your answer i'm going to update the maxRequestRetries to 3

Add comment

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

4.7

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

8.4K

5.0

Web Scraping API

zeeb0t/web-scraping-api---scrape-any-website

Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included. It’s just $2 per 1,000 web pages scraped, with no minimum spend.

Anthony Ziebell

1.2K

5.0

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

3.6

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

870

4.2

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

100

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

4.6K

4.4

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

64K

4.3

Cloudflare Web Scraper

ecomscrape/cloudflare-web-scraper

Advanced web scraper designed to extract data from Cloudflare-protected websites with CAPTCHA bypass, proxy rotation, and JavaScript execution capabilities.

ecomscrape

144

5.0

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!