Similarweb Scraper: Website Traffic & Rank, No Login

The Mine Works: 544 users across 100 public Actors, >99% run success. Pay only for results delivered. Browse all Actors.

Overview

Similarweb Scraper turns any domain into a structured JSON record of what Similarweb's free, public, logged-out website-overview tool actually shows: estimated global rank, category, estimated monthly visits and month-over-month trend, engagement (bounce rate, pages per visit, average visit duration), a traffic-source split (direct / search / social / referrals / paid search / mail / display ads), the top countries by traffic share, and the similar/competitor sites Similarweb lists for that domain.

It is built for people who want a quick, no-account read on a domain's traffic profile: growth marketers sizing up a competitor, SEOs doing a first-pass audit, sales teams qualifying a prospect's web presence, and researchers building a traffic-comparison dataset across many domains. No Similarweb Pro seat, no Data API contract, no manual copy-paste from the browser.

✅ No login required | ✅ No API key | ✅ Fast — no browser required | ✅ MCP-ready for AI agents

Features

Bulk domain lookup — pass up to 50 domains in one run. Global rank, category, category rank, and country rank, when Similarweb shows them. Estimated monthly visits with the month-over-month change shown on the free overview. Engagement metrics: bounce rate, pages per visit, average visit duration. Traffic-source split across the channels Similarweb's free tool breaks out. Top countries by traffic share, and the similar-sites list Similarweb surfaces. Pay per domain actually delivered — blocked or empty lookups are never charged.

How it works

The actor fetches similarweb.com/website/<domain> directly with plain HTTP through Apify's UNBLOCKER proxy group — no browser, no on-page search simulation. UNBLOCKER solves whatever's in front of the page server-side and hands back a real, fully-rendered HTML response; the report itself is embedded in the page as a window.__APP_DATA__ JSON blob, which the actor parses directly for clean, structured fields (rank, category, visits, traffic sources, top countries, similar sites) instead of scraping rendered text off the DOM. A full report typically takes 30-70 seconds to resolve server-side, so the actor retries a domain with a fresh proxy session (maxRetriesPerDomain) when a request comes back mid-solve rather than fully rendered — most domains land on the first or second attempt.

🧾 Input configuration

{
  "domains": ["wikipedia.org"],
  "maxRetriesPerDomain": 3
}

Field	Type	Description
domains	array of strings	Up to 50 bare root domains (no protocol, no path) — e.g. "wikipedia.org". Required.
maxRetriesPerDomain	integer	How many times to retry a domain with a fresh residential IP session if Similarweb blocks the request (default 3, max 6).

📤 Output format

{
  "domain": "wikipedia.org",
  "url": "https://www.similarweb.com/website/wikipedia.org",
  "global_rank": 7,
  "category": "Encyclopedias and Reference",
  "total_visits": "4.2B",
  "visits_change_pct": "-1.3%",
  "bounce_rate_pct": 41.2,
  "pages_per_visit": 2.9,
  "avg_visit_duration": "00:04:12",
  "traffic_sources": { "direct": 55.1, "search": 38.4, "social": 1.2, "referrals": 4.1 },
  "top_countries": [{ "country": "United States", "share_pct": 18.4 }],
  "similar_sites": ["britannica.com", "quora.com"],
  "checked_at": "2026-08-02T15:30:00.000Z"
}

Every field is only ever set when Similarweb's overview page actually showed it — fields it does not display for a given domain are omitted rather than returned as null or a guessed value, so downstream parsing stays clean and honest.

💼 Common use cases

Competitive traffic benchmarking Pull estimated visits, rank, and traffic-source mix for a list of competitors in one run, refreshed on a schedule.

Prospect and lead qualification Check a prospect's web traffic scale and channel mix before a sales call, without a Similarweb seat.

SEO and content audits Start an audit with a domain's category, rank, and top traffic-driving channel before going deeper with dedicated SEO tools.

Market and competitor mapping Feed a list of domains through the actor to build a comparison table of traffic scale and top countries across a whole category.

🚀 Getting started

1. Open the actor and list the domains you want to check under domains (bare domain, e.g. nike.com).
2. Leave maxRetriesPerDomain at the default unless you want more or fewer retries per domain.
3. Click Start. The actor fetches each domain's Similarweb overview page directly and parses the embedded report data.
4. Download results as JSON, CSV, or Excel, or pull them via the Apify API.

FAQ

Do I need a Similarweb account or API key? No. The actor reads the exact same free, public overview a logged-out visitor gets at similarweb.com. You never log in and never buy a Similarweb Pro seat or Data API plan.

How is pricing calculated? Pay per event. You are charged only for each domain where real overview data was actually extracted. Blocked, rate-limited, or empty lookups are never charged. There is no free tier.

Does this need a browser or residential proxy? No. The actor fetches the report page with plain HTTP through Apify's UNBLOCKER proxy group, which solves whatever anti-bot layer sits in front of the page server-side and returns a fully-rendered response — no browser process on the actor's side at all.

Does this get the same data as Similarweb Pro? No, and it never will. This actor is scoped to exactly what the free, logged-out overview tool shows. Similarweb's keyword-level reports, competitor benchmarking suite, and Data API are paid products that sit behind a login; this actor does not attempt to access them.

What formats can I export? Results are stored in an Apify dataset and can be exported as JSON, CSV, Excel, or XML, or pulled programmatically via the Apify API.

Coverage & known limitations (read this before you rely on it)

This actor is scoped, on purpose, to Similarweb's free public overview only — not the paid Pro platform, not the Data API, not keyword-level or competitor-benchmarking reports. Within that scope, be aware of two real constraints we verified directly while building this:

1. A full report takes real time to resolve. UNBLOCKER renders the page server-side, and a genuine domain report was observed taking anywhere from ~30s to ~70s to fully land; a request that comes back truncated or as a transient 202/502 mid-solve is retried with a fresh proxy session rather than treated as a failure. Most domains land within the first two attempts.
2. Some domains genuinely have no Similarweb report. Very low-traffic or unrecognized domains return the tool's generic landing page instead of a report — this is a real, honest "no data" outcome (visible in the dataset as a no_data row and in the run summary's no_data_count), not a block, and it is never charged.

If Similarweb changes the page's markup or embedded-data shape, expect a build update rather than fabricated results — the actor never invents a field it did not actually find in the response.

Use in Claude, ChatGPT & any MCP agent

https://mcp.apify.com/?tools=themineworks/similarweb-scraper

Or call it from code with the Apify client:

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });

const run = await client.actor('themineworks/similarweb-scraper').call({
  domains: ['wikipedia.org', 'nike.com'],
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

🛠️ Complete your competitive-intelligence pipeline

Pair this scraper with the rest of the themineworks competitive-data suite:

• Crunchbase Scraper: company funding, investors, and firmographics.
• Google Trends Scraper: search interest and rising queries alongside traffic data.
• Company Identity Resolver: verify companies via LEI, EU registration, and SEC EDGAR.

Typical flow: similarweb-scraper pulls traffic scale and channel mix, crunchbase-companies layers on funding stage, and google-trends-pro adds search-demand trend on top.

Found a bug or have a feature request? Open an issue on the actor's Apify Console page or reach out through the Apify profile.

Last verified: 2026-08