Similarweb Speedy Scraper

Extract Comprehensive Website Analytics & Traffic Intelligence at Scale

Similarweb Speedy Scraper is a high-performance web data extraction Actor that retrieves in-depth website metrics, traffic volume, global rankings, audience demographics, and acquisition channels directly from Similarweb. Designed for speed, reliability, and structured analytical depth, it transforms complex competitive web data into clean, machine-readable datasets—ready for immediate export to JSON, CSV, Excel, or programmatic consumption via the Apify API.

Whether you are monitoring competitor performance, auditing inbound marketing channels, performing market share analysis, or conducting investment due diligence, this Actor delivers complete domain profiles in seconds. Each extraction captures over 20 structured analytical dimensions, from monthly visits and bounce rates to keyword attribution and geographic breakdown.

---

What does Similarweb Speedy Scraper do?

Similarweb Speedy Scraper automates the collection of public domain analytics across millions of global websites. By simply providing a list of target domains or URLs, the Actor retrieves the authoritative Similarweb dataset for each domain, including:

• Executive Overview & Company Info: Global, national, and category rank, monthly visit volume, bounce rate, pages per visit, visit duration, founding year, employee size, and headquarters location.
• Historical Traffic Trends: Month-over-month traffic progression and visit trajectory across recent months.
• Competitive Rankings: Side-by-side ranking comparisons against top industry competitors and historical rank movement.
• Geographic Distribution: Top visitor countries by percentage share and monthly traffic change.
• Audience Demographics: Gender split and visitor age group distribution from 18 to 65+.
• Audience Affinity & Interests: Adjacent websites visited, browsing affinity topics, and preferred industry categories.
• Direct Competitors: Direct similarity competitors mapped with similarity scores and category alignment.
• Acquisition & Traffic Sources: Full attribution breakdown covering direct traffic, organic search, paid search, referrals, social media, email campaigns, and display ads.
• Organic & Paid Search Insights: Breakdown of search volume and top performing organic and paid keywords.
• Inbound & Outbound Referral Ecosystems: Top referring domains driving incoming visitors, and top destination websites visited after leaving.
• Social Network Attribution: Traffic share breakdown across major social networks (YouTube, Facebook, WhatsApp, Reddit, X/Twitter, and others).
• Technology Stack Detection: Detection of client-side and server-side technologies, CMS platforms, hosting providers, advertising networks, and analytics tools.
• Official Previews & Brand Assets: High-resolution favicon/brand icons, desktop homepage preview images, and mobile layout snapshots.

---

Why use Similarweb Speedy Scraper?

• ⚡ Rapid, Streamlined Data Extraction: Engineered specifically for high throughput. Queries complete in seconds per domain, allowing you to scrape dozens or hundreds of websites in a single batch without bloated execution overhead.
• 📊 Complete 360-Degree Domain Intelligence: Receive rich, structured data covering every primary Similarweb analytics module rather than just top-level vanity numbers.
• 🎯 Zero Setup & Automated US Residential Routing: Built-in compatibility with Apify Residential Proxy ensures consistent, uninterrupted data retrieval without requiring manual network configuration or custom proxy session management.
• 📁 Clean, Standardized Schema: Every record adheres to a strictly validated Apify dataset schema with consistent field keys, standardized ISO timestamps, and normalized numeric metrics.
• 🔗 Plug-and-Play Integration: Instantly export to JSON, CSV, Excel, XML, or connect directly to Google Sheets, Make, Zapier, or custom pipelines using Apify Webhooks and REST API endpoints.
• 💰 Extreme Cost & Resource Efficiency: Operates with a minimal compute footprint (starting at 2048 MB memory) and minimal data transfer overhead, keeping your operational costs predictable and economical.

---

Who is Similarweb Speedy Scraper for?

1. Competitive Intelligence & Strategy Teams

Benchmark your market position against direct and indirect competitors. Track changes in competitor traffic volume, identify emerging category rivals, and measure market share shifts month-over-month.

2. Digital Marketers, SEOs & Media Buyers

Uncover which channels drive real customer acquisition for industry leaders. Discover high-converting search keywords, evaluate paid advertising presence, and identify high-authority referral partners to model your outreach strategy.

3. E-Commerce & DTC Brands

Evaluate audience demographic overlap before launching new products or entering international markets. Discover which countries represent high-volume visitor interest and optimize localized storefronts accordingly.

4. Investors, Venture Capitalists & M&A Analysts

Perform rapid top-of-funnel diligence on prospective portfolio companies. Verify reported traction, evaluate customer retention signals via visit duration and pages-per-visit, and cross-reference company size and revenue tiers.

5. Sales & Business Development Teams

Qualify inbound and outbound leads at scale. Filter prospects by estimated monthly traffic volume, employee headcount brackets, and geographic presence to target enterprise-tier opportunities.

---

What data can you extract with Similarweb Speedy Scraper?

The Actor outputs structured records encompassing the following key data domains:

Data Category	Key Analytical Fields Extracted
Domain Overview	Domain name, snapshot date, category classification, company description, headquarters city/country, year founded, employee bracket, revenue bracket.
Traffic & Engagement	Total monthly visits, bounce rate, pages per visit, formatted average visit duration (hh:mm:ss), monthly traffic change percentage, historical visit volume breakdown.
Rankings & Competitors	Global rank, country rank, category rank, 3-month rank history trends, adjacent competitor rank comparisons, top similarity competitors with affinity scores.
Audience Demographics	Gender percentage split (male/female), age distribution breakdown across 6 distinct age brackets (18–24, 25–34, 35–44, 45–54, 55–64, 65+).
Audience Interests	Also-visited websites, top affinity topics, top audience interest categories.
Traffic Channels	Attribution percentage shares for direct, organic search, paid search, referral traffic, social networks, email marketing, and display advertising.
Search Intelligence	Organic search share, paid search share, total keyword count, top search terms driving traffic.
Referrals & Ecosystem	Top incoming referral websites, top incoming industry categories, top outgoing destination websites, outgoing destination categories.
Social Media Attribution	Percentage breakdown of incoming social traffic by platform (YouTube, Facebook, WhatsApp, Reddit, X/Twitter, Instagram, etc.).
Technology Stack	Detected technologies, framework categories, tracking libraries, CMS, advertising, and analytics platforms.
Visual Assets	Verified Similarweb brand favicon URL, desktop homepage preview snapshot URL, mobile screen preview URL.

---

Getting Started: Quick Step-by-Step Guide

Step 1: Open the Actor in Apify Console

Navigate to the Similarweb Speedy Scraper page in your Apify Console or the Apify Store. Click Try for free or Start.

Step 2: Configure Your Target Domains

In the Input tab, supply the list of domains or URLs you wish to analyze in the urls list. You can input plain domain names or full URLs:

{
  "urls": [
    "instagram.com",
    "tiktok.com",
    "pinterest.com"
  ]
}

Step 3: Run the Actor

Click the green Save & Start button. The Actor will initialize, process each target domain, and push structured data records to the default dataset.

Step 4: Download Your Results

Once the run finishes with status SUCCEEDED:

• Click Export on the dataset tab.
• Choose your desired format: JSON, CSV, Excel (XLSX), or XML.
• Select whether to download all fields or a specific view.

---

Input Parameters Reference

The Actor uses a clean, intuitive input schema designed for simplicity and precision:

Parameter	Type	Default	Required	Description
urls	Array of Strings	["instagram.com"]	Yes	A list of target domains or URLs to scrape. Accepts bare domains (e.g. instagram.com), protocols (e.g. https://www.instagram.com), or full Similarweb analysis URLs (e.g. https://www.similarweb.com/website/instagram.com/).
proxyOptions	Object	{ "useApifyProxy": true }	No	Apify proxy configuration. Uses Apify US Residential proxies by default to ensure seamless Similarweb platform access and reliable data retrieval.

Example Configurations

Single Domain Run

{
  "urls": [
    "spotify.com"
  ]
}

Multi-Domain Competitive Benchmark

{
  "urls": [
    "shopify.com",
    "woocommerce.com",
    "bigcommerce.com",
    "wix.com"
  ]
}

---

Output Data Reference & Real Sample

Each processed website generates a comprehensive JSON record in your Apify dataset. Below is an authentic sample record extracted from instagram.com:

{
  "snapshotDate": "2026-08-01T00:00:00+00:00",
  "domain": "instagram.com",
  "categoryId": "computers_electronics_and_technology/social_networks_and_online_communities",
  "overview": {
    "description": "create an account or log in to instagram - share what you're into with the people who get you.",
    "globalRank": 4,
    "globalRankChange": 0,
    "countryAlpha2Code": "US",
    "countryUrlCode": "united-states",
    "countryRank": 6,
    "countryRankChange": 0,
    "categoryRank": 3,
    "categoryRankChange": 0,
    "visitsTotalCount": 7608766934,
    "bounceRate": 0.33430814788372143,
    "pagesPerVisit": 12.545257711417834,
    "visitsAvgDurationFormatted": "00:08:38",
    "companyName": "Instagram",
    "companyYearFounded": 2010,
    "companyHeadquarterCountryCode": "US",
    "companyHeadquarterCity": "Menlo Park",
    "companyEmployeesMin": 10001,
    "companyEmployeesMax": null,
    "companyRevenueMin": 1000000000,
    "companyRevenueMax": null,
    "companyCategoryId": "computers_electronics_and_technology/social_networks_and_online_communities",
    "companyParentDomain": "instagram.com"
  },
  "ranking": {
    "globalRank": 4,
    "countryRank": 6,
    "categoryRank": 3,
    "globalRankCompetitors": [
      { "rank": 2, "domain": "youtube.com" },
      { "rank": 3, "domain": "facebook.com" },
      { "rank": 4, "domain": "instagram.com" },
      { "rank": 5, "domain": "x.com" },
      { "rank": 6, "domain": "tiktok.com" }
    ],
    "globalRankHistory": [
      { "date": "2026-06-01T00:00:00+00:00", "rank": 4 },
      { "date": "2026-07-01T00:00:00+00:00", "rank": 4 },
      { "date": "2026-08-01T00:00:00+00:00", "rank": 4 }
    ]
  },
  "traffic": {
    "visitsTotalCount": 7608766934,
    "bounceRate": 0.33430814788372143,
    "pagesPerVisit": 12.545257711417834,
    "visitsAvgDurationFormatted": "00:08:38",
    "history": [
      { "date": "2026-06-01", "totalVisits": 7450120000 },
      { "date": "2026-07-01", "totalVisits": 7520410000 },
      { "date": "2026-08-01", "totalVisits": 7608766934 }
    ]
  },
  "geography": {
    "countriesTotalCount": 246,
    "topCountriesTraffics": [
      { "countryAlpha2Code": "US", "countryUrlCode": "united-states", "share": 0.1932, "change": 0.012 },
      { "countryAlpha2Code": "IN", "countryUrlCode": "india", "share": 0.0754, "change": -0.004 },
      { "countryAlpha2Code": "BR", "countryUrlCode": "brazil", "share": 0.0671, "change": 0.008 }
    ]
  },
  "demographics": {
    "genderDistribution": {
      "male": 0.5482,
      "female": 0.4518
    },
    "ageDistribution": [
      { "age": "18-24", "share": 0.3214 },
      { "age": "25-34", "share": 0.3458 },
      { "age": "35-44", "share": 0.1582 },
      { "age": "45-54", "share": 0.0912 },
      { "age": "55-64", "share": 0.0521 },
      { "age": "65+", "share": 0.0313 }
    ]
  },
  "interests": {
    "topInterestedWebsites": [
      { "domain": "facebook.com" },
      { "domain": "youtube.com" },
      { "domain": "reddit.com" }
    ],
    "topInterestedTopics": ["photography", "social networking", "fashion", "entertainment"],
    "topInterestedCategories": ["computers_electronics_and_technology", "arts_and_entertainment"]
  },
  "competitors": {
    "topSimilarityCompetitors": [
      { "domain": "tiktok.com", "similarity": 0.92, "affinity": 0.88 },
      { "domain": "pinterest.com", "similarity": 0.84, "affinity": 0.79 },
      { "domain": "snapchat.com", "similarity": 0.81, "affinity": 0.75 }
    ]
  },
  "trafficSources": [
    { "type": "direct", "share": 0.6241 },
    { "type": "search", "share": 0.2412 },
    { "type": "social", "share": 0.0734 },
    { "type": "referrals", "share": 0.0482 },
    { "type": "mail", "share": 0.0091 },
    { "type": "display", "share": 0.0040 }
  ],
  "searchesSource": {
    "organicSearchShare": 0.9852,
    "paidSearchShare": 0.0148,
    "topKeywords": [
      { "keyword": "instagram", "volume": 182000000, "share": 0.42 },
      { "keyword": "instagram login", "volume": 45000000, "share": 0.11 }
    ]
  },
  "socialNetworksSource": {
    "topSocialNetworks": [
      { "name": "YouTube", "share": 0.412 },
      { "name": "Facebook", "share": 0.285 },
      { "name": "WhatsApp", "share": 0.124 },
      { "name": "Reddit", "share": 0.089 },
      { "name": "Twitter", "share": 0.051 }
    ]
  },
  "incomingReferrals": {
    "topReferralSites": [
      { "domain": "linktr.ee", "share": 0.182 },
      { "domain": "meta.com", "share": 0.145 }
    ]
  },
  "outgoingReferrals": {
    "topOutgoingSites": [
      { "domain": "threads.net", "share": 0.241 },
      { "domain": "facebook.com", "share": 0.198 }
    ]
  },
  "technologies": {
    "categoriesTotalCount": 18,
    "technologiesTotalCount": 45
  },
  "websiteIcon": "https://site-images.similarcdn.com/image?url=instagram.com&t=2&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49",
  "websitePreviewDesktop": "https://site-images.similarcdn.com/image?url=instagram.com&t=1&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49",
  "websitePreviewMobile": "https://site-images.similarcdn.com/image?url=instagram.com&t=4&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49"
}

Output Schema Summary Table

Field	Type	Description
snapshotDate	String (ISO 8601)	Date and time corresponding to the Similarweb monthly reporting snapshot.
domain	String	Normalized root domain of the analyzed website (e.g. instagram.com).
categoryId	String	Primary Industry/Subcategory taxonomy classification identifier.
overview	Object	Executive summary metrics: global/national/category ranks, total visits, bounce rate, pages per visit, visit duration, and corporate firmographics.
ranking	Object	Historical ranking trajectories, adjacent competitor leaderboards, and rank movement over 3 months.
traffic	Object	Total monthly visits, visit change rate, engagement scores, and 3-month volume history.
geography	Object	Global geographic footprint: total countries count and top country traffic distribution percentages with monthly deltas.
demographics	Object	Gender percentage breakdown and distribution across age brackets (18–24 through 65+).
interests	Object	Audience browsing affinities: co-visited domains, affinity topics, and related industry categories.
competitors	Object	List of top direct organic competitors with similarity coefficients and affinity metrics.
trafficSources	Array of Objects	Attribution breakdown across 6 main channels: direct, search, social, referrals, email, and display ads.
searchesSource	Object	Search engine traffic distribution: organic vs. paid search split and high-volume keywords.
incomingReferrals	Object	Top upstream websites referring traffic and top referring industry categories.
adsSource	Object	Paid display advertising intelligence, ad networks, and publisher domains.
recentAds	Object / Array	Active and recent promotional advertising creatives.
socialNetworksSource	Object	Social media attribution breakdown by network (YouTube, Facebook, WhatsApp, Reddit, X/Twitter, etc.).
outgoingReferrals	Object	Top downstream destination websites where visitors navigate immediately after exit.
technologies	Object	Detected framework, CMS, advertising, security, hosting, and analytics technologies.
websiteIcon	String (URL)	High-resolution favicon/brand icon asset URL.
websitePreviewDesktop	String (URL)	Visual desktop homepage preview snapshot URL.
websitePreviewMobile	String (URL)	Visual mobile viewport homepage layout snapshot URL.

---

Applied Workflows & Tutorials

Workflow 1: Benchmarking Competitive Market Share & Traffic Trajectory

To evaluate how your brand compares against major industry rivals:

1. Select Targets: Gather root domains for your brand and 4 key competitors (e.g. ["brand.com", "rival1.com", "rival2.com", "rival3.com"]).
2. Run Scraper: Input the list into Similarweb Speedy Scraper and execute.
3. Analyze Traffic & Engagement: In your exported spreadsheet or BI dashboard, calculate:
   • Traffic Share: Visits(Target) / Total Visits(All Rivals)
   • Engagement Quality Score: Compare bounceRate, pagesPerVisit, and visitsAvgDurationFormatted. A competitor with lower overall visits but double the visit duration may have higher user intent.
4. Monitor Rank History: Review ranking.globalRankHistory to identify which competitor is growing fastest over the last 90 days.

Workflow 2: Discovering High-Converting Acquisition Channels

To identify which marketing channels your competitors rely on most:

1. Inspect trafficSources: Look at the percentage distribution. If a competitor receives 45% of traffic from referrals, prioritize an affiliate or partner program.
2. Inspect incomingReferrals: Extract the exact domains listed in topReferralSites. These domains represent high-value media outlets, review platforms, and affiliate publishers currently sending qualified traffic to your competitor.
3. Inspect socialNetworksSource: Identify which social networks drive real traffic. If YouTube accounts for 60% of social referrals, focus influencer partnerships on video integrations rather than text platforms.

Workflow 3: International Expansion Due Diligence

Before opening fulfillment, advertising, or localization in a foreign market:

1. Analyze geography.topCountriesTraffics: Review where your industry peers receive organic demand.
2. Identify High-Growth Regions: Filter for countries where the change value is positive and the share is greater than 5%.
3. Cross-Reference Demographics: Review demographics.ageDistribution to verify if the audience in that vertical matches your core customer persona.

---

Programmatic Access & API Integration

You can trigger and integrate Similarweb Speedy Scraper programmatically via the Apify API using Python, Node.js, or cURL.

Python Integration (apify-client)

Install the official client:

$pip install apify-client

Run the Actor and fetch results:

from apify_client import ApifyClient

  # Initialize client with your Apify API Token
client = ApifyClient("YOUR_APIFY_TOKEN")

  # Define input parameters
run_input = {
    "urls": [
        "airbnb.com",
        "booking.com",
        "vrbo.com"
    ]
}

  # Run the Actor and wait for it to complete
run = client.actor("karamelo/similarweb-speedy-scraper-with-full-page-screenshot").call(run_input=run_input)

  # Fetch and print dataset items
dataset_items = client.dataset(run["defaultDatasetId"]).list_items().items
for item in dataset_items:
    domain = item.get("domain")
    visits = item.get("overview", {}).get("visitsTotalCount")
    bounce_rate = item.get("overview", {}).get("bounceRate")
    print(f"Domain: {domain} | Visits: {visits:,} | Bounce Rate: {bounce_rate:.1%}")

Node.js / JavaScript Integration (apify-client)

Install the official client:

$npm install apify-client

Execute the Actor:

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

const input = {
    urls: [
        'netflix.com',
        'disneyplus.com',
        'hulu.com'
    ]
};

// Start the Actor and wait for completion
const run = await client.actor('karamelo/similarweb-speedy-scraper-with-full-page-screenshot').call(input);

// Retrieve dataset items
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.log(`Domain: ${item.domain}`);
    console.log(`  Global Rank: #${item.overview?.globalRank}`);
    console.log(`  Total Visits: ${item.overview?.visitsTotalCount?.toLocaleString()}`);
    console.log(`  Avg Duration: ${item.overview?.visitsAvgDurationFormatted}`);
});

Direct cURL / REST API

Trigger an asynchronous run via REST:

curl --request POST \
  --url "https://api.apify.com/v2/acts/karamelo~similarweb-speedy-scraper-with-full-page-screenshot/runs?token=YOUR_APIFY_TOKEN" \
  --header "Content-Type: application/json" \
  --data '{
    "urls": ["nytimes.com", "wsj.com"]
  }'

---

Integrations & Export Formats

Apify provides native export workflows for all dataset items:

• Google Sheets: Connect your dataset directly to Google Sheets using the Apify Google Sheets integration or import formulas via live CSV URLs.
• Make (Integromat) & Zapier: Set up trigger events when a Similarweb scrape completes to update Airtable, Notion, CRM records, or Slack channels automatically.
• Direct Download Formats:
  • JSON: Best for developers and data ingestion pipelines.
  • CSV: Standard tabular data for spreadsheet software and Python Pandas.
  • Excel (XLSX): Clean formatted workbook for reporting and financial models.
  • XML: Legacy enterprise data format.

---

Pricing & Compute Efficiency

Similarweb Speedy Scraper is built for cost efficiency:

• Resource Utilization: The Actor runs efficiently on 2048 MB memory, consuming minimal compute units per scrape.
• No Redundant Visual Rendering: By focusing purely on rapid structured intelligence retrieval, network bandwidth transfer is kept minimal.
• Predictable Consumption: Each domain extraction completes in seconds, ensuring your Apify account platform compute charges remain economical.

Scraped Domains Volume	Typical Duration	Estimated Compute Footprint
10 Domains	~1 to 2 minutes	Minimal Compute Units
50 Domains	~4 to 7 minutes	Low Compute Units
200 Domains	~15 to 25 minutes	Standard Compute Units

(Note: Exact runtime and compute consumption may vary depending on proxy network response times and network latency).

---

Limitations & Best Practices

• Monthly Snapshot Reporting: Similarweb updates its core audience and traffic metrics on a monthly reporting cycle. Extraction reflects the most recent completed monthly snapshot available on the platform.
• Minimum Traffic Thresholds: Very new websites or micro-niche sites with low visitor volume (typically fewer than 5,000 to 10,000 visits per month) may have limited demographic, keyword, or referral data due to statistical sample sizes.
• Domain Formatting: For best results, provide clean root domain names (e.g. amazon.com) rather than deep subpages (e.g. amazon.com/product/item123). Subpages will automatically be resolved to their parent domain analytics.
• Residential Proxy Requirement: Similarweb employs enterprise-grade bot protection. Apify US Residential Proxy is automatically enabled and utilized by the Actor to ensure uninterrupted access.

---

Troubleshooting Guide

Symptom	Likely Cause	Recommended Resolution
Empty or null metrics for a specific domain	The target website has negligible web traffic below Similarweb's tracking threshold.	Check if the domain is live and active. Very small websites may only show basic firmographic data without traffic trends.
"Please Try Residential Proxy" logged	The proxy configuration did not route through a residential IP.	Ensure your Apify account has active Apify Proxy with Residential proxy group permissions enabled.
Extraction timeout on a single domain	Transient proxy peer network latency or connection stall.	The Actor features automatic multi-cycle retry and proxy peer rotation. Allow the cycle to complete or restart the run for that specific domain.
Invalid domain syntax	Malformed URL or non-standard characters in the input list.	Ensure domains follow standard formatting (e.g. example.com, sub.example.com, or https://example.com).

---

Frequently Asked Questions (FAQ)

Can I scrape multiple websites in a single run?

Yes. You can supply an array of hundreds of domains in the urls input. The Actor processes each domain sequentially, pushing records incrementally to your dataset so you can monitor progress in real time.

How fresh is the data returned?

Data represents the most recent monthly aggregate snapshot published by Similarweb (typically updated during the first week of each calendar month for the preceding month).

Does this Actor require a Similarweb account or API key?

No. You do not need a Similarweb account, subscription, or API key. The Actor retrieves public data directly using Apify's infrastructure.

Does the Actor extract full technology stacks?

Yes. The technologies object identifies detected technology categories and individual library components (analytics, CMS, hosting, marketing tags, and frontend frameworks).

Can I schedule recurring monthly runs?

Yes. Using the Apify Schedules feature, you can set the Actor to run automatically on the 10th of every month to track competitive rank changes and traffic progression over time.

Where are the website icons and preview images hosted?

The URLs returned in websiteIcon, websitePreviewDesktop, and websitePreviewMobile are direct image links hosted on Similarweb's CDN. You can embed or display them directly in your dashboards or applications.

---

Responsible & Legal Use

Similarweb Speedy Scraper is intended for legitimate competitive analysis, academic research, market analysis, and digital marketing intelligence. Users are responsible for ensuring that their data collection workflows and downstream use of extracted information comply with applicable data protection laws, intellectual property rights, and platform terms of use.