SimilarWeb Scraper - Website Traffic Checker for Domain Lists

This SimilarWeb scraper is a bulk website traffic checker: give it a list of domains and it returns the SimilarWeb estimates for each one, including monthly visits, global, country and category rank, bounce rate, pages per visit, traffic sources, top ranking keywords with CPC, detected technologies, similar sites and company details. Use it for competitor benchmarking, market sizing and lead qualification without a SimilarWeb subscription or API key. Each domain becomes one dataset row, so results can be compared, exported to CSV or Excel, or joined on domain.

What the SimilarWeb scraper returns

One row per domain with ranking, traffic, engagement, channel, search, technology, competitor and company fields. The existing field names and types of this actor are kept unchanged, so integrations built on earlier runs continue to work.

• Ranking: global_rank, country_rank with country, category_rank with category, each with its change (global_rank_change, country_rank_change, category_rank_change), plus rank_neighbours, the domains directly above and below.
• Traffic: monthly_visits, monthly_visits_estimate, visits_change_percent, traffic_history, traffic_bucket, low_confidence and the monthly snapshot_date.
• Engagement: bounce_rate_percent, pages_per_visit, avg_visit_duration.
• Channels: traffic_sources_percent with direct, organic, paid, ads, social, mail, referrals, AI and affiliate shares where SimilarWeb publishes them.
• Search: organic_search_percent, paid_search_percent, ranking_keywords_count and top_keywords with keyword, volume, cpc and estimated_value.
• Technology: technologies with category, top_technology and count.
• Competitors: similar_sites.
• Company: company_name, company_founded, company_employees_min, company_employees_max, company_hq_country and description.
• Row metadata: url (the public profile), position (order in your input), source (similarweb-scraper), provider (similarweb) and fetched_at (retrieval time in UTC). The retrieval time and the monthly snapshot describe different moments.

monthly_visits keeps the original value. monthly_visits_estimate is null when SimilarWeb reports zero visits without a global rank, indicating that no estimate is available. Published positive estimates appear unchanged in both fields.

How to use the SimilarWeb scraper

1. Open the actor and enter one or more domains in Domains. Full URLs are fine.
2. Optionally raise Limit (up to 500 domains per run) or Retries.
3. Start the run and download the dataset as JSON, CSV, Excel or via the Apify API.

To track websites over time, schedule the same input weekly or monthly and compare rows by domain and snapshot_date.

Input

Field	Type	Default	Range
domains	Array of domain names or URLs	No default; editor prefill github.com and ebay.com	Any supplied list
limit	Integer	50	1–500
retries	Integer	4	1–8

Domains are trimmed, lowercased and deduplicated. Full URLs are reduced to their hostname, paths and query strings are removed, and an initial www. is removed, so https://www.github.com/foo and github.com behave the same. Empty values are skipped. Invalid domain values appear in the errors record and are not requested. The limit applies after validation and deduplication, so duplicates do not consume a position. Results follow the supplied domain order.

This is the input of the default example run:

{
  "domains": [
    "github.com",
    "ebay.com"
  ],
  "limit": 50,
  "retries": 4
}

The editor prefill is an example, not an automatic domain selection for an empty API input. Supply domains explicitly for API runs. A run with no valid domains succeeds with an empty dataset and a bad_input record.

Output

This is a real row from the example run above (retrieved 2 October 2026, UTC). The top_keywords, technologies, rank_neighbours, similar_sites and traffic_history arrays are shortened here; a run returns the full lists.

{
  "domain": "ebay.com",
  "snapshot_date": "2026-08-01T00:00:00+00:00",
  "category": "e-commerce_and_shopping/marketplace",
  "global_rank": 43,
  "global_rank_change": 1,
  "country_rank": 13,
  "country_rank_change": 1,
  "country": "US",
  "category_rank": 2,
  "category_rank_change": 0,
  "monthly_visits": 669968323,
  "visits_change_percent": 0.08,
  "traffic_bucket": "<1B",
  "bounce_rate_percent": 38.84,
  "pages_per_visit": 6.67,
  "avg_visit_duration": "00:06:02",
  "traffic_sources_percent": {
    "direct": 44.84,
    "organic": null,
    "paid": null,
    "ads": null,
    "social_organic": null,
    "mail": null,
    "referrals": null,
    "gen_ai": null,
    "affiliate": null,
    "social_paid": null
  },
  "organic_search_percent": 86.79,
  "paid_search_percent": 13.21,
  "ranking_keywords_count": 4464314,
  "top_keywords": [
    {
      "keyword": "ebay",
      "volume": null,
      "cpc": 1.23,
      "estimated_value": null
    },
    {
      "keyword": "ebay login",
      "volume": null,
      "cpc": 0.92,
      "estimated_value": null
    }
  ],
  "technologies": [
    {
      "category": "advertising",
      "top_technology": "Google Adsense",
      "count": 96
    },
    {
      "category": "conversion_and_analytics",
      "top_technology": "Google Analytics",
      "count": 26
    }
  ],
  "rank_neighbours": [
    {
      "domain": "mail.ru",
      "rank": 41
    },
    {
      "domain": "claude.ai",
      "rank": 42
    }
  ],
  "similar_sites": [
    "amazon.com",
    "aliexpress.com",
    "walmart.com"
  ],
  "traffic_history": [
    {
      "month": "2026-06",
      "share_of_period": 59.24815020500001,
      "change_percent": -1.6452047662125893
    }
  ],
  "company_name": "eBay",
  "company_founded": 1995,
  "company_employees_min": 10001,
  "company_employees_max": null,
  "company_hq_country": "US",
  "description": "Our policies are designed to help create a fair and safe trading experience for all eBay users. As a seller, you&#39;re responsible for regularly reviewing and complying with eBay&#39;s selling policies, and for meeting your obligations as set out in our User Agreement.",
  "url": "https://www.similarweb.com/website/ebay.com/",
  "position": 2,
  "low_confidence": false,
  "source": "similarweb-scraper",
  "provider": "similarweb",
  "fetched_at": "2026-10-02T23:43:17.778Z"
}

Figures from the same run:

Metric	github.com	ebay.com
Global rank	50	43
Monthly visits	649,321,442	669,968,323
Bounce rate	36.66%	38.84%
Pages per visit	5.77	6.67
Average visit duration	00:06:24	00:06:02
Ranking keywords	2,754,220	4,464,314
Organic search share	99.97%	86.79%

Reading missing metrics

SimilarWeb publishes estimates rather than measured website analytics. A metric which the public profile does not provide remains null; it is never replaced with an invented value or a zero. Channel shares often include nulls even for large websites, and keyword volume can be null while CPC is present.

traffic_bucket is a magnitude band, such as <20K or <1B, rather than a confidence score. low_confidence is true when a numeric monthly visit estimate is below 50,000, including a published zero. A missing visit estimate does not make this flag true. Small websites can have a profile without complete traffic or company information; such a profile keeps its row with null fields.

Summary and errors

The default key-value store contains summary, with the number of returned domains, profiles with traffic, profiles with keywords, profiles with technologies, the list of low-confidence domains, explanatory notes, elapsed retrieval time and error count. When an input or source error occurs, errors contains its code and message. A failure for one domain does not discard the other delivered profiles, and temporary source failures finish as a successful empty run when nothing is available.

Use cases

• Competitor benchmarking. Run your domain alongside its rivals and compare visits, engagement and the organic-versus-paid split in one table.
• Market sizing. similar_sites, category and category_rank show who else occupies a niche and how large each player is.
• Lead qualification. Traffic, technology stack and company size in one row tell a sales team whether a prospect is worth the call.
• Keyword research. top_keywords with published CPC per competitor, next to ranking_keywords_count.
• Technology prospecting. Filter on technologies to find every site in a list that runs a particular analytics, advertising or ecommerce platform.
• Trend monitoring. traffic_history and the rank-change fields show direction month over month.

SimilarWeb scraper vs. other ways to get website traffic data

Option	Bulk domain lists	Key or subscription	Output
This actor	Up to 500 domains per run	Apify account only	Dataset rows, JSON/CSV/Excel, API
Official SimilarWeb API	Yes	Paid SimilarWeb plan and API key	API responses
Free website traffic checker pages	One domain at a time	None	A web page to read manually
SimilarWeb website or extension	One domain at a time	Account for deeper data	Browser view

The actor reads the same public profile data a visitor sees and turns it into structured rows. Data that SimilarWeb reserves for its paid plans is not part of the public profile and is therefore not returned.

Pricing

The actor uses pay-per-event pricing: $0.001 per run start and $0.004 per returned domain profile. A run of 100 domains that all return a profile costs $0.401. The start fee applies once, including runs with no returned profiles. No domain event is charged when the dataset is empty, and failed domains do not produce a profile event. A returned profile with unavailable measurements still counts as a delivered profile.

Users without a paid Apify plan receive at most 10 rows per run. The run summary reports the free-plan cap and how many rows were delivered. Paid users can request up to 500 unique valid domains by setting limit; the work is collected in successive pieces automatically. Increasing retries does not add output rows.

FAQ

Are these figures measured website analytics?

No. They are SimilarWeb estimates. Use a website's own analytics for exact visitor counts and treat small-site figures with the caution indicated by low_confidence.

Do I need a SimilarWeb account or API key?

No. The actor works with an Apify account only. You pay per returned domain profile, not for a SimilarWeb subscription.

Can I check website traffic for many domains at once?

Yes. Put up to 500 domains in one run (10 on the free plan). Each unique valid domain returns one row in your input order.

Can I submit full URLs and duplicates?

Yes. The actor normalizes URLs to domains and returns one profile for each unique valid domain, up to the requested limit. The first occurrence determines its order.

Why are fields null or keywords incomplete?

The public profile does not publish every measurement for every website. The actor keeps those missing values null, including nested keyword and channel measurements. It does not estimate additional values to fill the gaps.

How current is the data?

Each row carries snapshot_date, the month SimilarWeb's published estimate refers to, and fetched_at, when the actor retrieved it. SimilarWeb updates public profiles monthly.

Where do the rows and error messages appear?

Profiles are written to the default dataset. The summary and errors records are available in the default key-value store. Successful domains remain in the dataset even when another domain in the same input cannot be retrieved.