Pricing

$19.00/month + usage

Go to Store

Similarweb scraper

Try for free

Developed by

Curious Coder

Scrape similarweb to get insights for websites in bulk including website traffic, pages per visit, time spent on website, bounce rate, rank, etc

0.0 (0)

Pricing

$19.00/month + usage

Total users

850

Monthly users

Runs succeeded

>99%

Issue response

51 days

Last modified

4 months ago

Other

Back to issues Create new issue

Crawler keeps failing, even when re-running with different proxies

Closed

Double Your Freelancing (dyf) opened this issue

I noticed it hit a point where all the requests started failing despite re-runs.

Curious Coder (curious_coder)

The issue was due to using urls instead of domain names, I've sent an update to convert the urls into domains automatically

Double Your Freelancing (dyf)

Ahhh okay, gotcha. So you're saying the ideal format would have been "whatever.com" vs "https://whatever.com" ?

Thanks so much for the quick update!

Curious Coder (curious_coder)

Yes!

Add comment

Similarweb Fast Scraper

tri_angle/fast-similarweb-scraper

Scrape Similarweb faster and get data about website traffic, visits, global/country rank and more

Tri⟁angle

107

Similarweb scraper

saswave/similarweb-scraper

Extract similarweb informations from multiple input format. Web crawler for similarweb.com website. Get data like total visits, bounce rate, traffic sources, competitors, top countries, company info .. Do market research, track potential competitors, or for other research and analytics on companies.

SASWAVE

Similarweb Advanced Scraper

curious_coder/similarweb-advanced-scraper

Enrich website details in bulk from Similarweb by scraping all available data at an affordable cost. Get traffic info, Competitors, Audience insights, etc

Curious Coder

449

Similarweb Scraper

radeance/similarweb-scraper

Extract website traffic, global rank, country rank, bounce rate, visit duration, and traffic sources. Get detailed insights on SEO, referrals, and audience demographics. Scrape single or multiple URLs effortlessly. Export data as HTML Table, JSON, JSONL, CSV, Excel, XML, or RSS.

Radeance

150

Similarweb Scraper

tri_angle/similarweb-scraper

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Tri⟁angle

2.9k

Similarweb Scraper

epctex/similarweb-scraper

The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table.

epctex

218

Similar Web Scraper

pintostudio/similar-web-scraper

The SimilarWeb Scraper is a robust tool designed to extract detailed website analytics and traffic insights directly from SimilarWeb.

Pinto Studio

Similarweb Quick Scraper

mscraper/similarweb-quick-scraper

A quick scraper for Similarweb. Get needed data instantly for domains of your choice. Export accumulated data into formats such as HTML, JSON, or Excel.

mscraper

572

Advanced Similarweb Scraper

riccee/advanced-similarweb-scraper

Advanced scraper for Simlarweb. Gets data such as companies' ranks, total visits, competitor analysis, etc. Also offers the option to scrape all top-level employees from all scraped companies.

Joseph Schady

Website Traffic Analysis

mina_safwat/website-traffic-analysis

You want to know more about your website or your competitor's? Get detailed insights on traffic, SEO performance, keyword rankings, and competitor analysis. Optimize your online presence and stay ahead with data-driven strategies!