Similarweb Scraper

🚀 Similarweb Scraper

Get Similarweb website traffic data for any list of domains. The Similarweb Scraper returns each site's estimated monthly visits with a 3-month history, global, country and category rank, bounce rate, pages per visit and average visit duration, the traffic-source split (direct, search, social, referrals, email, ads and AI chatbots), the top countries, the top search keywords with volume and CPC, and AI chatbot traffic: how many visits come from ChatGPT, Claude, Gemini, Perplexity and others, each chatbot's share with history, and the prompts that lead people to the site. Use it for competitor research, market sizing, lead scoring, investment and M&A screening, affiliate and publisher vetting, or tracking a list of sites month by month. No Similarweb account needed.

✨ Features

• 📈 Monthly visits + history: The latest month's estimated visits and the 3 months before it, to spot growth and decline.
• 🏆 Global, country and category rank: Where the site stands worldwide, in its main country and in its industry category.
• ⏱️ Engagement: Bounce rate, pages per visit and average visit duration.
• 🔀 Traffic sources: Share of direct, organic and paid search, referrals, organic and paid social, email, display ads, affiliates and AI chatbots.
• 🤖 AI chatbot traffic: Visits from AI assistants, the share each chatbot sends (ChatGPT, Claude, Gemini, Perplexity, Grok, DeepSeek, Copilot) with a 3-month history, and the top prompts that send users to the site.
• 🌍 Top countries: The 5 countries that bring the most visits, with their share.
• 🔑 Top keywords: The search keywords that send the most traffic, with search volume, CPC and estimated value.
• 🧹 Paste anything: example.com, www.example.com or a full URL; duplicates are looked up once. Subdomains (docs.example.com) are looked up on their own.

🛠️ How It Works

1. Add domains: one per line, as domains or URLs.
2. Set Max domains: the default is 50.
3. Run the Scraper: one row per domain, downloadable as JSON, CSV or Excel or through the API.

Domains Similarweb has no data for (very small or new sites) are skipped, not charged, and listed in the run's status message.

⚙️ Input

Field	What it does
Domains	Websites to look up: apify.com, www.apify.com or https://apify.com/store.
Max domains	Stop after this many domains. Default 50.
Proxy configuration	Residential proxies by default (recommended).

With an empty input the scraper reports on apify.com and github.com.

{
    "domains": ["zalando.de", "otto.de", "aboutyou.de"],
    "maxItems": 100
}

💰 Pricing

Pay only for the domains you get. No monthly rental.

Event	Price	What you get
Domain	$0.002 per domain ($2.00 per 1,000)	One row with visits and history, ranks, engagement, traffic sources, top countries, top keywords and AI traffic
Actor start	$0.00005 per run	Charged once when the run starts.

Examples: 50 domains = $0.10 · 1,000 domains = $2.00 · 10,000 domains = $20.00. Domains without data are free.

📊 Sample Output Data

{
    "domain": "github.com",
    "url": "https://www.similarweb.com/website/github.com/",
    "title": "GitHub · Change is constant. GitHub keeps you ahead.",
    "description": "Join the world's most widely adopted, AI-powered developer platform where millions of developers, businesses, and the largest open source community build software that advances humanity.",
    "category": "Computers Electronics and Technology/Programming and Developer Software",
    "globalRank": 45,
    "countryRank": { "countryCode": "US", "rank": 77 },
    "categoryRank": 4,
    "globalCategoryRank": null,
    "month": "2026-09",
    "monthlyVisits": 645466516,
    "bounceRatePercent": 36.44,
    "pagesPerVisit": 5.69,
    "avgVisitDurationSeconds": 387,
    "visitsHistory": [
        { "month": "2026-07", "visits": 637885711 },
        { "month": "2026-08", "visits": 649321442 },
        { "month": "2026-09", "visits": 645466516 }
    ],
    "trafficSourcesPercent": {
        "direct": 53.31,
        "organicSearch": 24.34,
        "paidSearch": 0.02,
        "referrals": 9.32,
        "organicSocial": 9.42,
        "paidSocial": 0.12,
        "email": 1.22,
        "displayAds": 0.25,
        "affiliate": 0,
        "aiChatbots": 1.99
    },
    "topCountries": [
        { "countryCode": "US", "sharePercent": 18.73 },
        { "countryCode": "CN", "sharePercent": 11.83 }
    ],
    "topKeywords": [
        { "keyword": "github", "volume": 10089950, "cpc": 1.62, "estimatedValue": 11461050 },
        { "keyword": "github desktop", "volume": 282600, "cpc": 2.25, "estimatedValue": 400930 }
    ],
    "aiTraffic": {
        "monthlyVisits": 12006520,
        "shareOfVisitsPercent": 1.91,
        "chatbots": [
            {
                "name": "chatgpt.com",
                "rank": 1,
                "sharePercent": 61.82,
                "history": [
                    { "month": "2026-07", "sharePercent": 49.06 },
                    { "month": "2026-08", "sharePercent": 71.55 },
                    { "month": "2026-09", "sharePercent": 61.82 }
                ]
            },
            { "name": "claude.ai", "rank": 2, "sharePercent": 12.86, "history": [] },
            { "name": "perplexity.ai", "rank": 4, "sharePercent": null, "history": [] }
        ],
        "topPrompts": [
            "How do I create a new repository, push an existing local project to it, and manage basic access permissions using a web-based Git hosting service?"
        ]
    },
    "isSmallSite": false,
    "screenshotUrl": "https://site-images.similarcdn.com/image?url=github.com&t=1&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b",
    "dataDate": "2026-09-01",
    "scrapedAt": "2026-10-19T11:34:46.379Z"
}

(Lists shortened here; a real row carries up to 5 countries and 5 keywords, every ranked chatbot, and the history for the top 3 chatbots.)

❓ FAQ

How accurate are the numbers? They are Similarweb's estimates, not analytics data. They are best for comparing sites and spotting trends.

Which month is it? month is the latest month Similarweb has published (usually the previous calendar month); visitsHistory covers the 3 months up to it.

Why are some chatbot shares empty? Similarweb ranks every AI chatbot that sends traffic but publishes the share and history only for the top 3. topPrompts is empty for sites where Similarweb does not show prompts.

Do I need a Similarweb account? No.

🔗 More SEO Actors

• Ahrefs Traffic Scraper: organic search traffic, traffic value, top pages and keywords for any domain.
• Ahrefs Domain Rating Scraper: Domain Rating, backlink and referring-domain counts for a list of domains.
• Ahrefs Backlinks Scraper: the top backlinks pointing at any domain, with anchor text and source DR.
• Ahrefs Keyword Difficulty Scraper: Keyword Difficulty plus the top-10 Google results with DR and traffic.
• Google Keyword Volume Scraper: monthly Google search volume, CPC and competition for your keyword list.
• Google Ranked Keywords Scraper: every keyword a domain ranks for on Google, with position and URL.

This actor is not affiliated with or endorsed by Similarweb.