# Similarweb Scraper (`santamaria-automations/similarweb-scraper`) Actor Scrape website traffic data from Similarweb. Get monthly visits, traffic sources, top keywords, global rankings, and audience insights for any domain. - **URL**: https://apify.com/santamaria-automations/similarweb-scraper.md - **Developed by:** [Alessandro Santamaria](https://apify.com/santamaria-automations) (community) - **Categories:** SEO tools, Lead generation, Marketing - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $4.87 / 1,000 website analyzeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Similarweb Scraper Scrape website traffic analytics from Similarweb. Get monthly visits, traffic sources, top keywords, global rankings, and audience insights for any domain. ### What data do you get? For each domain, the scraper returns: - **Rankings**: Global rank, country rank, category rank - **Traffic**: Total visits, bounce rate, pages per visit, average visit duration - **Monthly visits**: Last 3 months of estimated visit data - **Traffic sources**: Direct, search, social, referrals, mail, paid referrals (percentages) - **Top countries**: Top 5 countries by traffic share - **Top keywords**: Top 5 organic keywords with search volume and CPC - **Competitors**: Similar websites identified by Similarweb - **Metadata**: Site title, description, category, screenshot URL ### Input You can provide domains in two ways: #### Option 1: Domain names ```json { "domains": ["amazon.com", "github.com", "netflix.com"] } ```` #### Option 2: Similarweb URLs ```json { "urls": ["https://www.similarweb.com/website/amazon.com/"] } ``` #### Full input example ```json { "domains": ["amazon.com", "github.com"], "urls": ["https://www.similarweb.com/website/netflix.com/"], "maxResults": 50, "proxyConfiguration": { "useApifyProxy": true } } ``` ### Output example ```json { "domain": "amazon.com", "title": "Amazon Charts Top 20 Books", "description": "See this week's Top 20 Most Read Fiction books...", "global_rank": 9, "country_rank": 4, "country": "United States", "country_code": "US", "category_rank": 1, "category": "E-commerce and Shopping > Marketplace", "total_visits": 2289218737, "bounce_rate": "30.61%", "pages_per_visit": "9.06", "avg_visit_duration": "06:02", "monthly_visits": [ { "date": "2025-12", "visits": 3077818349 }, { "date": "2026-01", "visits": 2719230286 }, { "date": "2026-02", "visits": 2289218737 } ], "traffic_sources": { "direct": 0.6838, "search": 0.2394, "social": 0.0141, "referrals": 0.0552, "mail": 0.0016, "paid_referrals": 0.0058 }, "top_countries": [ { "country_code": "US", "share": 0.8558 }, { "country_code": "IN", "share": 0.012 } ], "top_keywords": [ { "keyword": "amazon", "estimated_value": 79784590, "volume": 71632480, "cpc": 0.25 } ], "competitors": [], "source_url": "https://www.similarweb.com/website/amazon.com/", "source_platform": "similarweb.com", "scraped_at": "2026-04-01T12:00:00Z" } ``` ### Performance - **Memory**: 128 MB (Go binary, no browser needed) - **Speed**: ~1 domain per second (with rate limiting) - **Cost**: Very low compute usage (~0.001 CU per domain) ### Pricing | Event | Price | |-------|-------| | website-result | $0.005 per domain | ### Notes - Data availability depends on the domain's traffic. Very small or new websites may not have data. - Similarweb provides estimated traffic data, not exact numbers. - The free API returns basic analytics. Some fields (like detailed referral sites) require a paid Similarweb subscription. - The scraper includes a 1-second delay between requests to avoid rate limiting. ### Related Actors **Related Scrapers** - [Google News Scraper — News articles](https://apify.com/santamaria-automations/google-news-scraper) - [YouTube Scraper — Video & channel data](https://apify.com/santamaria-automations/youtube-scraper) - [Kununu.de Scraper — Employer reviews](https://apify.com/santamaria-automations/kununu-de-scraper) **European Classifieds** - [Kleinanzeigen.de Scraper — Germany](https://apify.com/santamaria-automations/kleinanzeigen-de-scraper) - [Willhaben.at Scraper — Austria](https://apify.com/santamaria-automations/willhaben-at-scraper) - [Tutti.ch Scraper — Switzerland](https://apify.com/santamaria-automations/tutti-ch-scraper) - [Marktplaats.nl Scraper — Netherlands](https://apify.com/santamaria-automations/marktplaats-nl-scraper) **Enrich your data** - [Website Email & Phone Scraper](https://apify.com/santamaria-automations/website-email-scraper) - [Google Maps Scraper](https://apify.com/santamaria-automations/google-maps-scraper) - [Website Contact Extractor](https://apify.com/santamaria-automations/website-contact-extractor) ### Issues & Feature Requests If something is not working or you're missing a feature or data field, please [open an issue](https://console.apify.com/actors/1254zwvzsmUeahEUs/issues) and we'll look into it. # Actor input Schema ## `urls` (type: `array`): Similarweb website analytics URLs. Example: https://www.similarweb.com/website/amazon.com/ ## `domains` (type: `array`): Domain names to look up on Similarweb. Example: amazon.com, github.com. You can use either URLs or domains (or both). ## `maxResults` (type: `integer`): Maximum number of domains to scrape. ## `proxyConfiguration` (type: `object`): Apify proxy settings. Datacenter proxy works well for Similarweb API. ## Actor input object example ```json { "urls": [ "https://www.similarweb.com/website/amazon.com/", "https://www.similarweb.com/website/github.com/" ], "domains": [ "amazon.com", "github.com" ], "maxResults": 50, "proxyConfiguration": { "useApifyProxy": true } } ``` # Actor output Schema ## `websites` (type: `string`): Dataset containing scraped website analytics data # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.similarweb.com/website/amazon.com/", "https://www.similarweb.com/website/github.com/" ], "domains": [ "amazon.com", "github.com" ], "maxResults": 50 }; // Run the Actor and wait for it to finish const run = await client.actor("santamaria-automations/similarweb-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": [ "https://www.similarweb.com/website/amazon.com/", "https://www.similarweb.com/website/github.com/", ], "domains": [ "amazon.com", "github.com", ], "maxResults": 50, } # Run the Actor and wait for it to finish run = client.actor("santamaria-automations/similarweb-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.similarweb.com/website/amazon.com/", "https://www.similarweb.com/website/github.com/" ], "domains": [ "amazon.com", "github.com" ], "maxResults": 50 }' | apify call santamaria-automations/similarweb-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=santamaria-automations/similarweb-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Similarweb Scraper", "description": "Scrape website traffic data from Similarweb. Get monthly visits, traffic sources, top keywords, global rankings, and audience insights for any domain.", "version": "1.0", "x-build-id": "E2V1SGXFO9oM3NXV8" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/santamaria-automations~similarweb-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-santamaria-automations-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/santamaria-automations~similarweb-scraper/runs": { "post": { "operationId": "runs-sync-santamaria-automations-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/santamaria-automations~similarweb-scraper/run-sync": { "post": { "operationId": "run-sync-santamaria-automations-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "Similarweb URLs", "type": "array", "description": "Similarweb website analytics URLs. Example: https://www.similarweb.com/website/amazon.com/", "items": { "type": "string" } }, "domains": { "title": "Domains", "type": "array", "description": "Domain names to look up on Similarweb. Example: amazon.com, github.com. You can use either URLs or domains (or both).", "items": { "type": "string" } }, "maxResults": { "title": "Maximum Results", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of domains to scrape.", "default": 50 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Apify proxy settings. Datacenter proxy works well for Similarweb API.", "default": { "useApifyProxy": true } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```