# Similarweb Scraper - Website Traffic, Ranks & Sources (`automly/similarweb-scraper`) Actor Get Similarweb website traffic data for any list of domains: global, country and category rank, monthly visits and trend, bounce rate, traffic sources, top countries, keywords and competitors. - **URL**: https://apify.com/automly/similarweb-scraper.md - **Developed by:** [Automly](https://apify.com/automly) (community) - **Categories:** SEO tools - **Stats:** 5 total users, 4 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.80 / 1,000 websites This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ## Similarweb Scraper - Website Traffic, Ranks & Sources ### What is Similarweb Scraper? **Similarweb Scraper** is a tool that lets you **scrape website traffic data from Similarweb for any list of domains**: global, country and category rank, monthly visits and their trend, bounce rate, pages per visit, visit duration, top countries, traffic sources (direct, search, social, referrals, email, display ads, AI chatbots), organic vs paid search, top keywords, and with one switch **competitors and similar sites, top referring sites, social networks, company facts and audience age and gender**. Add your domains, click **Start**, and download one row per website as Excel, CSV or JSON. - ⚑ **Fast:** 100 websites in about 30 seconds, or about a minute with competitors and referrers (our tests) - πŸ“‹ **Bulk lists:** paste hundreds of domains or full links at once; repeats are read once - πŸ“Š **One row per website:** every metric in its own column, ready for a spreadsheet - πŸ”“ **No login:** no Similarweb account or subscription needed - πŸ’Έ **Free to try:** the $5 of free usage every Apify account gets each month covers about 5,000 websites ### What can Similarweb Scraper do? - **Check website traffic in bulk**: monthly visits for the last three months and the change from the month before - **Get Similarweb rank** for any site: global rank, rank in its top country and rank in its category - **See where traffic comes from**: direct, organic and paid search, organic and paid social, referrals, email, display ads, affiliates and AI chatbots - **Find a website's top countries** with each country's share of visits - **Find a website's competitors and similar sites** for any domain, ranked by similarity - **See the top referring sites and social networks** sending visitors to a website - **Get top keywords** with search volume and cost per click - **Get website engagement metrics**: bounce rate, pages per visit and average visit duration - Export to Excel, CSV, JSON, HTML or XML, or send the data to Google Sheets, Make, Zapier and more ### What data can you extract from Similarweb? | | | | |---|---|---| | πŸ† Global rank | 🌍 Country rank and country | πŸ—‚οΈ Category and category rank | | πŸ‘₯ Monthly visits | πŸ“ˆ Visits by month and change | ⏱️ Average visit duration | | ↩️ Bounce rate | πŸ“„ Pages per visit | πŸ—ΊοΈ Top countries with shares | | 🚦 Traffic sources | πŸ” Organic vs paid search | πŸ”‘ Top keywords, volume, CPC | | πŸ₯Š Competitors and similar sites | πŸ”— Top referring sites | πŸ“£ Top social networks | | 🏒 Company, founded, HQ, size, revenue | πŸ§‘β€πŸ€β€πŸ§‘ Audience gender and age | πŸ“… Data month | ### How to scrape Similarweb 1. [Create a free Apify account](https://console.apify.com/sign-up). 2. Open **Similarweb Scraper**. 3. Enter the websites to analyze, one per line: `github.com`, `https://www.nike.com/` or a Similarweb link all work. 4. Turn on **Include competitors, referrers and audience** if you need similar sites, referring sites, social networks, company facts and audience data. 5. Click **Start**, then download the results as Excel, CSV, JSON or HTML. ### How much does it cost to scrape Similarweb website data? You pay per website saved. A website with traffic and rank data (the default) costs less than a website saved with competitors, referrers and audience (**Include competitors, referrers and audience** on). Each website is charged one price or the other, never both: | Apify plan | Websites per 1,000 | Websites with full details per 1,000 | |---|---|---| | Free | $1.00 | $8.00 | | Starter (Bronze) | $0.95 | $7.50 | | Scale (Silver) | $0.90 | $7.00 | | Business (Gold) and higher | $0.80 | $6.00 | Platform usage is included in these prices, so you pay nothing else for the run. Websites Similarweb has no data for are not charged. Example: traffic and rank for 1,000 websites cost $1.00 on the Free plan and $0.80 on Business. The same 1,000 websites with competitors, referrers and audience cost $8.00 on the Free plan. Every Apify account gets **$5 of free usage each month**, enough for about 5,000 websites with traffic and rank data. See the **Pricing** tab for details. ### ⬇️ Input | Setting | What it does | |---|---| | **Websites** | Domains (`github.com`), links (`https://www.github.com/features`) or Similarweb website links, one per line. `www.` is dropped; other subdomains such as `blog.hubspot.com` are kept | | **Include competitors, referrers and audience** | Adds similar sites, top referring and outgoing sites, top social networks, company facts, audience gender and age, and global rank history. Off by default | | **Connection settings** | The default works for most runs | Traffic and rank for three websites: ```json { "domains": ["github.com", "stackoverflow.com", "https://www.bbc.co.uk/"] } ``` The same with competitors, referrers and audience: ```json { "domains": ["github.com", "stackoverflow.com", "bbc.co.uk"], "includeDetails": true } ``` ### ⬆️ Output Every website is one row. Shares and rates are percentages (0-100), visits and ranks are whole numbers, and durations are in seconds (with an `hh:mm:ss` copy). A row with **Include competitors, referrers and audience** on (lists shortened): ```json { "domain": "github.com", "url": "https://www.similarweb.com/website/github.com/", "title": "GitHub Β· Change is constant. GitHub keeps you ahead.", "description": "Join the world's most widely adopted, AI-powered developer platform where millions of developers, businesses, and the largest open source community build software that advances humanity.", "category": "Computers Electronics and Technology > Programming and Developer Software", "globalRank": 50, "countryRank": 81, "countryRankCountry": "US", "categoryRank": 4, "monthlyVisits": 649321442, "visitsChangePercent": 1.79, "bounceRate": 36.66, "pagesPerVisit": 5.77, "avgVisitDuration": 384, "avgVisitDurationText": "00:06:24", "monthlyVisitsHistory": [ {"month": "2026-06", "visits": 615239605}, {"month": "2026-07", "visits": 637885711}, {"month": "2026-08", "visits": 649321442} ], "topCountries": [ {"countryCode": "US", "country": "United States", "share": 18.608}, {"countryCode": "CN", "country": "China", "share": 11.664}, {"countryCode": "IN", "country": "India", "share": 10.469} ], "trafficSources": { "direct": 52.601, "organicSearch": 24.54, "paidSearch": 0.019, "organicSocial": 9.406, "paidSocial": 0.128, "referrals": 9.564, "mail": 1.15, "displayAds": 0.244, "affiliate": 0.004, "aiChatbots": 2.344, "search": 24.559, "social": 9.534 }, "organicSearchShare": 99.92, "paidSearchShare": 0.08, "topKeywords": [ {"keyword": "github", "volume": 10019460, "cpc": 1.63, "estimatedValue": 11327530} ], "similarSites": [ {"domain": "stackoverflow.com", "similarity": 100.0, "category": "Computers Electronics and Technology > Programming and Developer Software", "categoryRank": 81}, {"domain": "huggingface.co", "similarity": 92.4, "category": "Computers Electronics and Technology > Computers Electronics and Technology", "categoryRank": 52} ], "topReferringSites": [{"domain": "linux.do", "share": 2.078}, {"domain": "zhihu.com", "share": 1.94}], "referringSitesCount": 920, "topOutgoingSites": [{"domain": "raw.githubusercontent.com", "share": 2.122}], "outgoingSitesCount": 797, "topSocialNetworks": [{"network": "Youtube", "share": 43.016}, {"network": "Reddit", "share": 29.173}], "socialNetworksCount": 68, "keywordsCount": 2754220, "countriesCount": 111, "globalRankHistory": [{"month": "2026-06", "rank": 47}, {"month": "2026-07", "rank": 49}, {"month": "2026-08", "rank": 50}], "company": { "name": "GitHub", "foundedYear": 2008, "headquartersCity": "San Francisco", "headquartersCountryCode": "US", "employeesMin": 501, "employeesMax": 1000, "revenueMin": 1000000000, "revenueMax": null, "revenueCurrency": "USD", "parentDomain": "github.com" }, "audience": { "male": 69.81, "female": 30.19, "ageGroups": [{"ages": "18-24", "share": 27.44}, {"ages": "25-34", "share": 34.49}, {"ages": "65+", "share": 3.32}] }, "screenshotUrl": "https://site-images.similarcdn.com/image?url=github.com&t=1&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b", "dataMonth": "2026-08", "detailsIncluded": true, "scrapedAt": "2026-10-02T06:53:06Z" } ``` With the switch off, the same row comes without `similarSites`, `topReferringSites`, `topOutgoingSites`, `topSocialNetworks`, the counts, `globalRankHistory`, `company` and `audience` (they are `null`). The **Overview** tab shows ranks, visits, engagement and the main traffic sources side by side; the **All data** tab shows every field. The run report lists any website Similarweb has no data for. ### How can I use Similarweb data? - **Competitor analysis:** compare traffic, ranks and traffic sources of your competitors in one table - **Market research:** size up every website in a niche by monthly visits and audience countries - **Lead qualification:** sort prospect websites by traffic before sales outreach - **SEO and marketing research:** see which sites rely on search, social or paid traffic, and their top keywords - **Partnerships and link building:** find the referring sites and similar websites around a brand - **Tracking over time:** run it monthly (with a schedule) to follow visits and rank changes ### Which websites have data? Similarweb covers most websites with regular traffic. Very small sites may show visits and engagement with no rank. A domain Similarweb has no data for is skipped and listed in the run report as not found; the run still finishes successfully. Figures are Similarweb's estimates for the month in `dataMonth` (usually the last full month), the same numbers anyone can see on Similarweb without an account. ### Scrape more website and SEO data | Actor | What it gets | |---|---| | [Ahrefs SEO Scraper - DR, Backlinks, Keywords, Traffic](https://apify.com/automly/ahrefs-seo-scraper) | Domain Rating, backlinks, organic traffic and keyword ideas for any domain | | [Website Email Scraper](https://apify.com/automly/website-email-scraper) | Email addresses from any website's start, contact, about, team and legal pages | | [Google Ads Transparency Scraper](https://apify.com/automly/google-ads-transparency-scraper) | A competitor's Google ad creatives, regions and first and last shown dates | | [Facebook Ads Scraper - Meta Ad Library Scraper & API](https://apify.com/automly/facebook-ad-library-scraper) | Facebook and Instagram ads by keyword or Page, with text, media and dates | | [AI Web Scraper - Describe What You Want, Get Structured Data](https://apify.com/automly/ai-web-scraper) | Any fields you describe, from any website, as structured data | ### ❓FAQ #### How much does it cost to scrape Similarweb? $1.00 per 1,000 websites, or $8.00 per 1,000 websites with competitors, referrers and audience, on the Free plan, less on paid plans. See the **How much does it cost to scrape Similarweb website data?** section above. Websites with no data are not charged, and you can set a maximum cost per run. #### How many websites can I check in one run? As many as you like: paste hundreds of domains at once. In our tests 100 websites took about 30 seconds, or about a minute with competitors and referrers. #### Do I need a Similarweb account? No. The scraper collects the figures Similarweb shows to anyone without signing in, so you don't need a Similarweb account or subscription. Data that Similarweb keeps for paying subscribers (for example its very top referring sites, which it hides from visitors) is not included. #### Why are some fields empty? Similarweb does not have every figure for every website: smaller websites often have no country rank, no company facts or no keywords. Competitors, referring sites, social networks, company and audience are filled only when **Include competitors, referrers and audience** is on. #### Are the shares percentages? Yes. Every share and rate (traffic sources, countries, bounce rate, referring sites, social networks, audience) is a percentage from 0 to 100. `organicSearchShare` and `paidSearchShare` split search visits only, so they add up to 100. #### Can I call it as an API? Yes. Run it through the Apify API from any language, or use its real-time API (`/site?domain=github.com`, add `&includeDetails=true` for competitors and referrers), which answers with the row directly without starting a run. #### Can I connect Similarweb Scraper to other tools or AI agents? Yes. Start runs and download results with the Apify API or the Python and JavaScript clients, send results to Make, Zapier, n8n, Google Sheets or Slack with Apify integrations and webhooks, or let AI assistants and agents run it through the Apify MCP server at [mcp.apify.com](https://mcp.apify.com). #### Is it legal to scrape Similarweb? This scraper only collects public data that Similarweb shows to anyone without signing in: traffic estimates and facts about websites and companies, not about private people. Audience figures are anonymous totals. If you combine the data with personal data, laws such as GDPR may apply, so use it for a legitimate reason and ask a lawyer if you are unsure. You can read more in [Is web scraping legal?](https://blog.apify.com/is-web-scraping-legal/) Similarweb Scraper is an independent tool. It is not affiliated with, endorsed by or sponsored by Similarweb. #### Something isn't working? Open an issue in the **Issues** tab with your input and what you expected. We read every one and usually reply within a day. ### ⭐ Your feedback Have an idea or found a problem? Tell us in the **Issues** tab. If Similarweb Scraper saved you time, a short review on the **Reviews** tab helps other people find it. # Actor input Schema ## `domains` (type: `array`): Enter the websites to analyze, one per line: domains like github.com or full links like https://www.github.com/. Each website gives one row. ## `includeDetails` (type: `boolean`): Add similar sites (competitors), top referring and outgoing sites, top social networks, company facts, audience gender and age, and global rank history to every row. Slower: about half as many websites per minute. ## `proxyConfiguration` (type: `object`): Apify Proxy works out of the box. ## Actor input object example ```json { "domains": [ "github.com", "stackoverflow.com" ], "includeDetails": false, "proxyConfiguration": { "useApifyProxy": true } } ``` # Actor output Schema ## `overview` (type: `string`): No description ## `details` (type: `string`): No description ## `results` (type: `string`): No description ## `report` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "domains": [ "github.com", "stackoverflow.com" ], "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("automly/similarweb-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "domains": [ "github.com", "stackoverflow.com", ], "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("automly/similarweb-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "domains": [ "github.com", "stackoverflow.com" ], "proxyConfiguration": { "useApifyProxy": true } }' | apify call automly/similarweb-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,automly/similarweb-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/vXGQZrKHNa2SdsBgo/builds/lM1Kdu6yGezX2MlYh/openapi.json