# Similarweb Website Traffic & SEO Analytics Scraper (`datascraperes/similarweb-website-scraper`) Actor Analyze public domains with estimated traffic, monthly visits, rankings, audience geography, traffic sources and competitor insights. Get clean structured data for SEO research, market analysis and competitive intelligence. Unofficial and not affiliated with Similarweb. - **URL**: https://apify.com/datascraperes/similarweb-website-scraper.md - **Developed by:** [DataScraperES](https://apify.com/datascraperes) (community) - **Categories:** SEO tools, Automation, Developer tools - **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing $1.00 / 1,000 website profiles This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README Analyze public domains with estimated traffic, engagement, rankings, audience geography, traffic sources, competitors, and other website intelligence. Submit up to 10,000 domains and receive one normalized Dataset item per unique valid domain. This Actor is unofficial and is not affiliated with Similarweb. ### What this Actor does - Accepts bare domains, public website URLs without a path, and Similarweb URLs in the `/website/{domain}/` format. - Normalizes domains, removes leading `www`, converts internationalized names to ASCII, and deduplicates equivalent inputs. - Returns estimated monthly visits, engagement metrics, global and country rankings, geographic traffic shares, traffic sources, competitors, keywords, and other available fields. - Keeps optional source data in stable normalized blocks and preserves additional top-level fields in `extraData`. - Writes one Dataset item for every processed domain, including a structured error item when a domain cannot be retrieved or validated. - Stores run totals and error counts in the `SUMMARY` record of the default Key-Value Store. ### Use cases - Compare website traffic and engagement across competitors. - Enrich domain lists for SEO prospecting and market research. - Analyze country distribution and acquisition channels. - Find competing sites and high-value organic keywords. - Create recurring website-intelligence snapshots with Apify Tasks and Schedules. - Export normalized domain data to spreadsheets, databases, or BI tools. ### How to use 1. Open the Actor's **Input** tab. 2. Add one or more domains under **Domains**. 3. Click **Start**. 4. Open **Dataset** to review or export the website profiles. 5. Open the default Key-Value Store and select `SUMMARY` when you need run-level totals. Equivalent domains are processed once. For example, `example.com`, `https://www.example.com/`, and `https://www.similarweb.com/website/example.com/` resolve to the same domain. ### Input The Actor has one public input field: | Field | Type | Required | Description | | --- | --- | --- | --- | | `domains` | `string[]` | Yes | Domains or accepted URLs to analyze. Minimum 1 and maximum 10,000 unique values. | Accepted examples include `google.com`, `https://apify.com/`, and `https://www.similarweb.com/website/example.com/`. URLs with credentials, custom ports, query strings, fragments, or unrelated paths are rejected. This is the exact input used for the complete output example below: ```json { "domains": [ "google.com", "apify.com" ] } ``` ### Output The default Dataset contains one item per unique valid domain. Successful records use `status: "success"`; unsuccessful domains remain visible with `status: "error"` and a structured `error` object. Key fields include: | Field | Description | | --- | --- | | `domain` | Normalized domain without a leading `www`. | | `sourceUrl` | Source endpoint associated with the record. | | `retrievedAt` | UTC timestamp when the response was retrieved. | | `snapshotDate` | Period represented by the source estimate; different from `retrievedAt`. | | `isPartial` | Whether one or more optional normalized blocks were unavailable. | | `missingBlocks` | Names of unavailable optional blocks. | | `overview` | Site identity, description, category, and related overview fields. | | `traffic` | Monthly visits, engagement, keywords, and AI traffic details when available. | | `ranking` | Global, country, and category ranks. | | `geography` | Country traffic shares and source country metadata. | | `competitors` | Similar sites returned by the source. | | `trafficSources` | Direct, organic, paid, social, referral, mail, display, affiliate, and GenAI shares when available. | | `technologies` | Technology information when available; otherwise `null`. | | `extraData` | Other source fields not promoted to normalized blocks. | | `rawData` | Reserved for compatibility and returned as `null`. | | `http` | Non-sensitive response and attempt metadata. | | `error` | Structured failure information, or `null` after success. | The following is one complete Dataset item returned for `google.com` using the input above. No fields or nested values have been omitted: ```json { "domain": "google.com", "sourceUrl": "https://data.similarweb.com/api/v1/data?domain=google.com", "retrievedAt": "2026-08-21T18:52:40.479023+00:00", "source": "similarweb_data_api", "status": "success", "snapshotDate": "2026-07-01T00:00:00+00:00", "isPartial": true, "missingBlocks": [ "technologies" ], "overview": { "siteName": "google.com", "title": "„Google“ išplėstinė paieška", "description": "Learn about the Certified Publisher Program. Our publishing software experts will help you maximize revenue and grow your business.", "category": "computers_electronics_and_technology/search_engines", "largeScreenshot": "https://site-images.similarcdn.com/image?url=google.com&t=1&s=1&h=eb35e0fbafa3eb290132ffdfe47187d950d68daaa659ec1bd4b4e834b8f16461", "isSmall": false, "isDataFromGa": false }, "traffic": { "estimatedMonthlyVisits": { "2026-05-01": 87502305979, "2026-06-01": 84940150026, "2026-07-01": 86958861491 }, "engagements": { "BounceRate": "0.28492742035110014", "Month": "7", "Year": "2026", "PagePerVisit": "8.676456201759066", "Visits": "86958861491", "TimeOnSite": "598.310339583397" }, "topKeywords": [ { "Name": "gemini", "EstimatedValue": 174568500, "Volume": 119034200, "Cpc": 0.28 }, { "Name": "gmail", "EstimatedValue": 111486750, "Volume": 114891800, "Cpc": 1.64 }, { "Name": "google maps", "EstimatedValue": 103979920, "Volume": 70053910, "Cpc": 0.34 }, { "Name": "maps", "EstimatedValue": 50527180, "Volume": 49578780, "Cpc": 0.18 }, { "Name": "google", "EstimatedValue": 46603260, "Volume": 38387600, "Cpc": 0.95 } ], "aiTrafficDetails": { "Traffic": { "Split": [ { "Name": "chatgpt.com", "Rank": 1, "Icon": "/image?url=chatgpt.com&t=2&s=1&h=a31616ae3cdef12fcfc664127563e6092e7531e7b4c3cde7e0c8c5fd3310dfc0" }, { "Name": "claude.ai", "Rank": 2, "Icon": "/image?url=claude.ai&t=2&s=1&h=a3b3778e02952b653132fb6d019ed0361cff7850429377787fbdc4c86ce1565e" }, { "Name": "chat.deepseek.com", "Rank": 3, "Icon": "/image?url=chat.deepseek.com&t=2&s=1&h=3932bcfb7ad820bd114ee43a2dba828a589d2ff19b6dc54400e0d39b2d65d377" }, { "Name": "perplexity.ai", "Rank": 4, "Icon": "/image?url=perplexity.ai&t=2&s=1&h=f48fa93e79e65eef47bff5b62e7037bccffb0629aecaed2d0c9f2fb25f177362" }, { "Name": "copilot.microsoft.com", "Rank": 5, "Icon": "/image?url=copilot.microsoft.com&t=2&s=1&h=eb2c5d699c15f4d7ff035602d8165b847ac5e2883d42a9d8eae54163cd4b47cb" }, { "Name": "grok.com", "Rank": 6, "Icon": "/image?url=grok.com&t=2&s=1&h=5f2be8fd5c0911d0646a313793511a5a9acc4816f25a1b301774b501e7aa7c94" }, { "Name": "getliner.com", "Rank": 7, "Icon": "/image?url=getliner.com&t=2&s=1&h=85d2c6f88dbf8da9eadc5bd919fc7eaf3753319e773b7fe83912a3e1dd8f384c" } ], "Distribution": { "Boundary": "<500M", "Chart": [ { "Name": "chatgpt.com", "Icon": "/image?url=chatgpt.com&t=2&s=1&h=a31616ae3cdef12fcfc664127563e6092e7531e7b4c3cde7e0c8c5fd3310dfc0", "History": [ { "Date": "2026-07-01", "Value": 46.45737895827754 }, { "Date": "2026-06-01", "Value": 45.103501398975 }, { "Date": "2026-05-01", "Value": 52.20076552239426 } ] }, { "Name": "claude.ai", "Icon": "/image?url=claude.ai&t=2&s=1&h=a3b3778e02952b653132fb6d019ed0361cff7850429377787fbdc4c86ce1565e", "History": [ { "Date": "2026-07-01", "Value": 35.52204045684062 }, { "Date": "2026-06-01", "Value": 33.984424799048455 }, { "Date": "2026-05-01", "Value": 31.63916119491169 } ] }, { "Name": "chat.deepseek.com", "Icon": "/image?url=chat.deepseek.com&t=2&s=1&h=3932bcfb7ad820bd114ee43a2dba828a589d2ff19b6dc54400e0d39b2d65d377", "History": [ { "Date": "2026-07-01", "Value": 13.234232682441787 }, { "Date": "2026-06-01", "Value": 10.651065107337459 }, { "Date": "2026-05-01", "Value": 6.3281031262145 } ] } ], "Chatbots": [ { "Name": "chatgpt.com", "Icon": "/image?url=chatgpt.com&t=2&s=1&h=a31616ae3cdef12fcfc664127563e6092e7531e7b4c3cde7e0c8c5fd3310dfc0", "Value": 46.45737895827754 }, { "Name": "claude.ai", "Icon": "/image?url=claude.ai&t=2&s=1&h=a3b3778e02952b653132fb6d019ed0361cff7850429377787fbdc4c86ce1565e", "Value": 35.52204045684062 }, { "Name": "chat.deepseek.com", "Icon": "/image?url=chat.deepseek.com&t=2&s=1&h=3932bcfb7ad820bd114ee43a2dba828a589d2ff19b6dc54400e0d39b2d65d377", "Value": 13.234232682441787 } ] } }, "TotalVisits": 400761893.18, "ReferralTraffic": 0.004649500655214312, "TopPrompts": { "Status": 0, "ErrorMessage": null, "Prompts": [ "How can I set up and customize a simple homepage search experience on my web browser to quickly find information and launch web searches?", "What are the differences between using a generic web search page versus installing a dedicated search extension for faster query results and privacy controls?", "Can you recommend steps to troubleshoot when a browser's default search page isn't loading correctly and how to restore search functionality without reinstalling the browser?" ] } } }, "ranking": { "globalRank": { "Rank": 1 }, "globalCategoryRank": null, "countryRank": { "Country": 840, "CountryCode": "US", "Rank": 1 }, "categoryRank": { "Rank": "1", "Category": "Computers_Electronics_and_Technology/Search_Engines" } }, "geography": { "topCountryShares": [ { "Country": 840, "CountryCode": "US", "Value": 0.24007551443721573 }, { "Country": 392, "CountryCode": "JP", "Value": 0.06059525517008199 }, { "Country": 356, "CountryCode": "IN", "Value": 0.05765463504121194 }, { "Country": 76, "CountryCode": "BR", "Value": 0.050692779182928374 }, { "Country": 826, "CountryCode": "GB", "Value": 0.035067970064269774 } ], "countries": [ { "Code": "AF", "UrlCode": "afghanistan", "Name": "Afghanistan" }, { "Code": "AX", "UrlCode": "land-islands", "Name": "Åland Islands" }, { "Code": "AL", "UrlCode": "albania", "Name": "Albania" }, { "Code": "DZ", "UrlCode": "algeria", "Name": "Algeria" }, { "Code": "AS", "UrlCode": "american-samoa", "Name": "American Samoa" }, { "Code": "AD", "UrlCode": "andorra", "Name": "Andorra" }, { "Code": "AO", "UrlCode": "angola", "Name": "Angola" }, { "Code": "AI", "UrlCode": "anguilla", "Name": "Anguilla" }, { "Code": "AQ", "UrlCode": "antarctica", "Name": "Antarctica" }, { "Code": "AG", "UrlCode": "antigua-and-barbuda", "Name": "Antigua and Barbuda" }, { "Code": "AR", "UrlCode": "argentina", "Name": "Argentina" }, { "Code": "AM", "UrlCode": "armenia", "Name": "Armenia" }, { "Code": "AW", "UrlCode": "aruba", "Name": "Aruba" }, { "Code": "AU", "UrlCode": "australia", "Name": "Australia" }, { "Code": "AT", "UrlCode": "austria", "Name": "Austria" }, { "Code": "AZ", "UrlCode": "azerbaijan", "Name": "Azerbaijan" }, { "Code": "BS", "UrlCode": "bahamas", "Name": "Bahamas" }, { "Code": "BH", "UrlCode": "bahrain", "Name": "Bahrain" }, { "Code": "BD", "UrlCode": "bangladesh", "Name": "Bangladesh" }, { "Code": "BB", "UrlCode": "barbados", "Name": "Barbados" }, { "Code": "BY", "UrlCode": "belarus", "Name": "Belarus" }, { "Code": "BE", "UrlCode": "belgium", "Name": "Belgium" }, { "Code": "BZ", "UrlCode": "belize", "Name": "Belize" }, { "Code": "BJ", "UrlCode": "benin", "Name": "Benin" }, { "Code": "BM", "UrlCode": "bermuda", "Name": "Bermuda" }, { "Code": "BT", "UrlCode": "bhutan", "Name": "Bhutan" }, { "Code": "BO", "UrlCode": "bolivia-plurinational-state-of", "Name": "Bolivia" }, { "Code": "BQ", "UrlCode": "bonaire-sint-eustatius-and-saba", "Name": "Bonaire, Sint Eustatius and Saba" }, { "Code": "BA", "UrlCode": "bosnia-and-herzegovina", "Name": "Bosnia and Herzegovina" }, { "Code": "BW", "UrlCode": "botswana", "Name": "Botswana" }, { "Code": "BV", "UrlCode": "bouvet-island", "Name": "Bouvet Island" }, { "Code": "BR", "UrlCode": "brazil", "Name": "Brazil" }, { "Code": "IO", "UrlCode": "british-indian-ocean-territory", "Name": "British Indian Ocean Territory" }, { "Code": "BN", "UrlCode": "brunei-darussalam", "Name": "Brunei Darussalam" }, { "Code": "BG", "UrlCode": "bulgaria", "Name": "Bulgaria" }, { "Code": "BF", "UrlCode": "burkina-faso", "Name": "Burkina Faso" }, { "Code": "BI", "UrlCode": "burundi", "Name": "Burundi" }, { "Code": "CV", "UrlCode": "cabo-verde", "Name": "Cabo Verde" }, { "Code": "KH", "UrlCode": "cambodia", "Name": "Cambodia" }, { "Code": "CM", "UrlCode": "cameroon", "Name": "Cameroon" }, { "Code": "CA", "UrlCode": "canada", "Name": "Canada" }, { "Code": "KY", "UrlCode": "cayman-islands", "Name": "Cayman Islands" }, { "Code": "CF", "UrlCode": "central-african-republic", "Name": "Central African Republic" }, { "Code": "TD", "UrlCode": "chad", "Name": "Chad" }, { "Code": "CL", "UrlCode": "chile", "Name": "Chile" }, { "Code": "CN", "UrlCode": "china", "Name": "China" }, { "Code": "CX", "UrlCode": "christmas-island", "Name": "Christmas Island" }, { "Code": "CC", "UrlCode": "cocos-keeling-islands", "Name": "Cocos (Keeling) Islands" }, { "Code": "CO", "UrlCode": "colombia", "Name": "Colombia" }, { "Code": "KM", "UrlCode": "comoros", "Name": "Comoros" }, { "Code": "CG", "UrlCode": "congo", "Name": "Congo" }, { "Code": "CD", "UrlCode": "congo-the-democratic-republic-of-the", "Name": "Congo, the Democratic Republic of the" }, { "Code": "CK", "UrlCode": "cook-islands", "Name": "Cook Islands" }, { "Code": "CR", "UrlCode": "costa-rica", "Name": "Costa Rica" }, { "Code": "CI", "UrlCode": "cte-divoire", "Name": "Côte d'Ivoire" }, { "Code": "HR", "UrlCode": "croatia", "Name": "Croatia" }, { "Code": "CU", "UrlCode": "cuba", "Name": "Cuba" }, { "Code": "CW", "UrlCode": "curaao", "Name": "Curaçao" }, { "Code": "CY", "UrlCode": "cyprus", "Name": "Cyprus" }, { "Code": "CZ", "UrlCode": "czech-republic", "Name": "Czech Republic" }, { "Code": "DK", "UrlCode": "denmark", "Name": "Denmark" }, { "Code": "DJ", "UrlCode": "djibouti", "Name": "Djibouti" }, { "Code": "DM", "UrlCode": "dominica", "Name": "Dominica" }, { "Code": "DO", "UrlCode": "dominican-republic", "Name": "Dominican Republic" }, { "Code": "EC", "UrlCode": "ecuador", "Name": "Ecuador" }, { "Code": "EG", "UrlCode": "egypt", "Name": "Egypt" }, { "Code": "SV", "UrlCode": "el-salvador", "Name": "El Salvador" }, { "Code": "GQ", "UrlCode": "equatorial-guinea", "Name": "Equatorial Guinea" }, { "Code": "ER", "UrlCode": "eritrea", "Name": "Eritrea" }, { "Code": "EE", "UrlCode": "estonia", "Name": "Estonia" }, { "Code": "ET", "UrlCode": "ethiopia", "Name": "Ethiopia" }, { "Code": "FK", "UrlCode": "falkland-islands-malvinas", "Name": "Falkland Islands (Malvinas)" }, { "Code": "FO", "UrlCode": "faroe-islands", "Name": "Faroe Islands" }, { "Code": "FJ", "UrlCode": "fiji", "Name": "Fiji" }, { "Code": "FI", "UrlCode": "finland", "Name": "Finland" }, { "Code": "FR", "UrlCode": "france", "Name": "France" }, { "Code": "GF", "UrlCode": "french-guiana", "Name": "French Guiana" }, { "Code": "PF", "UrlCode": "french-polynesia", "Name": "French Polynesia" }, { "Code": "TF", "UrlCode": "french-southern-territories", "Name": "French Southern Territories" }, { "Code": "GA", "UrlCode": "gabon", "Name": "Gabon" }, { "Code": "GM", "UrlCode": "gambia", "Name": "Gambia" }, { "Code": "GE", "UrlCode": "georgia", "Name": "Georgia" }, { "Code": "DE", "UrlCode": "germany", "Name": "Germany" }, { "Code": "GH", "UrlCode": "ghana", "Name": "Ghana" }, { "Code": "GI", "UrlCode": "gibraltar", "Name": "Gibraltar" }, { "Code": "GR", "UrlCode": "greece", "Name": "Greece" }, { "Code": "GL", "UrlCode": "greenland", "Name": "Greenland" }, { "Code": "GD", "UrlCode": "grenada", "Name": "Grenada" }, { "Code": "GP", "UrlCode": "guadeloupe", "Name": "Guadeloupe" }, { "Code": "GU", "UrlCode": "guam", "Name": "Guam" }, { "Code": "GT", "UrlCode": "guatemala", "Name": "Guatemala" }, { "Code": "GG", "UrlCode": "guernsey", "Name": "Guernsey" }, { "Code": "GN", "UrlCode": "guinea", "Name": "Guinea" }, { "Code": "GW", "UrlCode": "guinea-bissau", "Name": "Guinea-Bissau" }, { "Code": "GY", "UrlCode": "guyana", "Name": "Guyana" }, { "Code": "HT", "UrlCode": "haiti", "Name": "Haiti" }, { "Code": "HM", "UrlCode": "heard-island-and-mcdonald-islands", "Name": "Heard Island and McDonald Islands" }, { "Code": "VA", "UrlCode": "holy-see-vatican-city-state", "Name": "Holy See (Vatican City State)" }, { "Code": "HN", "UrlCode": "honduras", "Name": "Honduras" }, { "Code": "HK", "UrlCode": "hong-kong", "Name": "Hong Kong" }, { "Code": "HU", "UrlCode": "hungary", "Name": "Hungary" }, { "Code": "IS", "UrlCode": "iceland", "Name": "Iceland" }, { "Code": "IN", "UrlCode": "india", "Name": "India" }, { "Code": "ID", "UrlCode": "indonesia", "Name": "Indonesia" }, { "Code": "IR", "UrlCode": "iran-islamic-republic-of", "Name": "Iran" }, { "Code": "IQ", "UrlCode": "iraq", "Name": "Iraq" }, { "Code": "IE", "UrlCode": "ireland", "Name": "Ireland" }, { "Code": "IM", "UrlCode": "isle-of-man", "Name": "Isle of Man" }, { "Code": "IL", "UrlCode": "israel", "Name": "Israel" }, { "Code": "IT", "UrlCode": "italy", "Name": "Italy" }, { "Code": "JM", "UrlCode": "jamaica", "Name": "Jamaica" }, { "Code": "JP", "UrlCode": "japan", "Name": "Japan" }, { "Code": "JE", "UrlCode": "jersey", "Name": "Jersey" }, { "Code": "JO", "UrlCode": "jordan", "Name": "Jordan" }, { "Code": "KZ", "UrlCode": "kazakhstan", "Name": "Kazakhstan" }, { "Code": "KE", "UrlCode": "kenya", "Name": "Kenya" }, { "Code": "KI", "UrlCode": "kiribati", "Name": "Kiribati" }, { "Code": "KP", "UrlCode": "korea-democratic-peoples-republic-of", "Name": "Korea, Democratic People's Republic of" }, { "Code": "KR", "UrlCode": "korea-republic-of", "Name": "Korea, Republic of" }, { "Code": "KW", "UrlCode": "kuwait", "Name": "Kuwait" }, { "Code": "KG", "UrlCode": "kyrgyzstan", "Name": "Kyrgyzstan" }, { "Code": "LA", "UrlCode": "lao-peoples-democratic-republic", "Name": "Lao People's Democratic Republic" }, { "Code": "LV", "UrlCode": "latvia", "Name": "Latvia" }, { "Code": "LB", "UrlCode": "lebanon", "Name": "Lebanon" }, { "Code": "LS", "UrlCode": "lesotho", "Name": "Lesotho" }, { "Code": "LR", "UrlCode": "liberia", "Name": "Liberia" }, { "Code": "LY", "UrlCode": "libya", "Name": "Libya" }, { "Code": "LI", "UrlCode": "liechtenstein", "Name": "Liechtenstein" }, { "Code": "LT", "UrlCode": "lithuania", "Name": "Lithuania" }, { "Code": "LU", "UrlCode": "luxembourg", "Name": "Luxembourg" }, { "Code": "MO", "UrlCode": "macao", "Name": "Macao" }, { "Code": "MK", "UrlCode": "macedonia-the-former-yugoslav-republic-of", "Name": "Macedonia (FYROM)" }, { "Code": "MG", "UrlCode": "madagascar", "Name": "Madagascar" }, { "Code": "MW", "UrlCode": "malawi", "Name": "Malawi" }, { "Code": "MY", "UrlCode": "malaysia", "Name": "Malaysia" }, { "Code": "MV", "UrlCode": "maldives", "Name": "Maldives" }, { "Code": "ML", "UrlCode": "mali", "Name": "Mali" }, { "Code": "MT", "UrlCode": "malta", "Name": "Malta" }, { "Code": "MH", "UrlCode": "marshall-islands", "Name": "Marshall Islands" }, { "Code": "MQ", "UrlCode": "martinique", "Name": "Martinique" }, { "Code": "MR", "UrlCode": "mauritania", "Name": "Mauritania" }, { "Code": "MU", "UrlCode": "mauritius", "Name": "Mauritius" }, { "Code": "YT", "UrlCode": "mayotte", "Name": "Mayotte" }, { "Code": "MX", "UrlCode": "mexico", "Name": "Mexico" }, { "Code": "FM", "UrlCode": "micronesia-federated-states-of", "Name": "Micronesia, Federated States of" }, { "Code": "MD", "UrlCode": "moldova-republic-of", "Name": "Moldova" }, { "Code": "MC", "UrlCode": "monaco", "Name": "Monaco" }, { "Code": "MN", "UrlCode": "mongolia", "Name": "Mongolia" }, { "Code": "ME", "UrlCode": "montenegro", "Name": "Montenegro" }, { "Code": "MS", "UrlCode": "montserrat", "Name": "Montserrat" }, { "Code": "MA", "UrlCode": "morocco", "Name": "Morocco" }, { "Code": "MZ", "UrlCode": "mozambique", "Name": "Mozambique" }, { "Code": "MM", "UrlCode": "myanmar", "Name": "Myanmar" }, { "Code": "NA", "UrlCode": "namibia", "Name": "Namibia" }, { "Code": "NR", "UrlCode": "nauru", "Name": "Nauru" }, { "Code": "NP", "UrlCode": "nepal", "Name": "Nepal" }, { "Code": "NL", "UrlCode": "netherlands", "Name": "Netherlands" }, { "Code": "AN", "UrlCode": "netherlands-antilles", "Name": "Netherlands Antilles" }, { "Code": "NC", "UrlCode": "new-caledonia", "Name": "New Caledonia" }, { "Code": "NZ", "UrlCode": "new-zealand", "Name": "New Zealand" }, { "Code": "NI", "UrlCode": "nicaragua", "Name": "Nicaragua" }, { "Code": "NE", "UrlCode": "niger", "Name": "Niger" }, { "Code": "NG", "UrlCode": "nigeria", "Name": "Nigeria" }, { "Code": "NU", "UrlCode": "niue", "Name": "Niue" }, { "Code": "AP", "UrlCode": "non-spec-asia-pas-location", "Name": "Non-spec Asia Pas Location" }, { "Code": "NF", "UrlCode": "norfolk-island", "Name": "Norfolk Island" }, { "Code": "MP", "UrlCode": "northern-mariana-islands", "Name": "Northern Mariana Islands" }, { "Code": "NO", "UrlCode": "norway", "Name": "Norway" }, { "Code": "OM", "UrlCode": "oman", "Name": "Oman" }, { "Code": "PK", "UrlCode": "pakistan", "Name": "Pakistan" }, { "Code": "PW", "UrlCode": "palau", "Name": "Palau" }, { "Code": "PS", "UrlCode": "palestine-state-of", "Name": "Palestine" }, { "Code": "PA", "UrlCode": "panama", "Name": "Panama" }, { "Code": "PG", "UrlCode": "papua-new-guinea", "Name": "Papua New Guinea" }, { "Code": "PY", "UrlCode": "paraguay", "Name": "Paraguay" }, { "Code": "PE", "UrlCode": "peru", "Name": "Peru" }, { "Code": "PH", "UrlCode": "philippines", "Name": "Philippines" }, { "Code": "PN", "UrlCode": "pitcairn", "Name": "Pitcairn" }, { "Code": "PL", "UrlCode": "poland", "Name": "Poland" }, { "Code": "PT", "UrlCode": "portugal", "Name": "Portugal" }, { "Code": "PR", "UrlCode": "puerto-rico", "Name": "Puerto Rico" }, { "Code": "QA", "UrlCode": "qatar", "Name": "Qatar" }, { "Code": "RE", "UrlCode": "runion", "Name": "Réunion" }, { "Code": "RO", "UrlCode": "romania", "Name": "Romania" }, { "Code": "RU", "UrlCode": "russian-federation", "Name": "Russia" }, { "Code": "RW", "UrlCode": "rwanda", "Name": "Rwanda" }, { "Code": "BL", "UrlCode": "saint-barthlemy", "Name": "Saint Barthélemy" }, { "Code": "SH", "UrlCode": "saint-helena-ascension-and-tristan-da-cunha", "Name": "Saint Helena, Ascension and Tristan da Cunha" }, { "Code": "KN", "UrlCode": "saint-kitts-and-nevis", "Name": "Saint Kitts and Nevis" }, { "Code": "LC", "UrlCode": "saint-lucia", "Name": "Saint Lucia" }, { "Code": "MF", "UrlCode": "saint-martin-french-part", "Name": "Saint Martin (French part)" }, { "Code": "PM", "UrlCode": "saint-pierre-and-miquelon", "Name": "Saint Pierre and Miquelon" }, { "Code": "VC", "UrlCode": "saint-vincent-and-the-grenadines", "Name": "Saint Vincent and the Grenadines" }, { "Code": "WS", "UrlCode": "samoa", "Name": "Samoa" }, { "Code": "SM", "UrlCode": "san-marino", "Name": "San Marino" }, { "Code": "ST", "UrlCode": "sao-tome-and-principe", "Name": "Sao Tome and Principe" }, { "Code": "SA", "UrlCode": "saudi-arabia", "Name": "Saudi Arabia" }, { "Code": "SN", "UrlCode": "senegal", "Name": "Senegal" }, { "Code": "RS", "UrlCode": "serbia", "Name": "Serbia" }, { "Code": "CS", "UrlCode": "serbia-and-montenegro", "Name": "SERBIA AND MONTENEGRO" }, { "Code": "SC", "UrlCode": "seychelles", "Name": "Seychelles" }, { "Code": "SL", "UrlCode": "sierra-leone", "Name": "Sierra Leone" }, { "Code": "SG", "UrlCode": "singapore", "Name": "Singapore" }, { "Code": "SX", "UrlCode": "sint-maarten-dutch-part", "Name": "Sint Maarten (Dutch part)" }, { "Code": "SK", "UrlCode": "slovakia", "Name": "Slovakia" }, { "Code": "SI", "UrlCode": "slovenia", "Name": "Slovenia" }, { "Code": "SB", "UrlCode": "solomon-islands", "Name": "Solomon Islands" }, { "Code": "SO", "UrlCode": "somalia", "Name": "Somalia" }, { "Code": "ZA", "UrlCode": "south-africa", "Name": "South Africa" }, { "Code": "GS", "UrlCode": "south-georgia-and-the-south-sandwich-islands", "Name": "South Georgia and the South Sandwich Islands" }, { "Code": "SS", "UrlCode": "south-sudan", "Name": "South Sudan" }, { "Code": "ES", "UrlCode": "spain", "Name": "Spain" }, { "Code": "LK", "UrlCode": "sri-lanka", "Name": "Sri Lanka" }, { "Code": "SD", "UrlCode": "sudan", "Name": "Sudan" }, { "Code": "SR", "UrlCode": "suriname", "Name": "Suriname" }, { "Code": "SJ", "UrlCode": "svalbard-and-jan-mayen", "Name": "Svalbard and Jan Mayen" }, { "Code": "SZ", "UrlCode": "swaziland", "Name": "Swaziland" }, { "Code": "SE", "UrlCode": "sweden", "Name": "Sweden" }, { "Code": "CH", "UrlCode": "switzerland", "Name": "Switzerland" }, { "Code": "SY", "UrlCode": "syrian-arab-republic", "Name": "Syrian Arab Republic" }, { "Code": "TW", "UrlCode": "taiwan", "Name": "Taiwan" }, { "Code": "TJ", "UrlCode": "tajikistan", "Name": "Tajikistan" }, { "Code": "TZ", "UrlCode": "tanzania-united-republic-of", "Name": "Tanzania, United Republic of" }, { "Code": "TH", "UrlCode": "thailand", "Name": "Thailand" }, { "Code": "TL", "UrlCode": "timor-leste", "Name": "Timor-Leste" }, { "Code": "TG", "UrlCode": "togo", "Name": "Togo" }, { "Code": "TK", "UrlCode": "tokelau", "Name": "Tokelau" }, { "Code": "TO", "UrlCode": "tonga", "Name": "Tonga" }, { "Code": "TT", "UrlCode": "trinidad-and-tobago", "Name": "Trinidad and Tobago" }, { "Code": "TN", "UrlCode": "tunisia", "Name": "Tunisia" }, { "Code": "TR", "UrlCode": "turkey", "Name": "Turkey" }, { "Code": "TM", "UrlCode": "turkmenistan", "Name": "Turkmenistan" }, { "Code": "TC", "UrlCode": "turks-and-caicos-islands", "Name": "Turks and Caicos Islands" }, { "Code": "TV", "UrlCode": "tuvalu", "Name": "Tuvalu" }, { "Code": "UG", "UrlCode": "uganda", "Name": "Uganda" }, { "Code": "UA", "UrlCode": "ukraine", "Name": "Ukraine" }, { "Code": "AE", "UrlCode": "united-arab-emirates", "Name": "United Arab Emirates" }, { "Code": "GB", "UrlCode": "united-kingdom", "Name": "United Kingdom" }, { "Code": "US", "UrlCode": "united-states", "Name": "United States" }, { "Code": "UM", "UrlCode": "united-states-minor-outlying-islands", "Name": "United States Minor Outlying Islands" }, { "Code": "UY", "UrlCode": "uruguay", "Name": "Uruguay" }, { "Code": "UZ", "UrlCode": "uzbekistan", "Name": "Uzbekistan" }, { "Code": "VU", "UrlCode": "vanuatu", "Name": "Vanuatu" }, { "Code": "VE", "UrlCode": "venezuela-bolivarian-republic-of", "Name": "Venezuela" }, { "Code": "VN", "UrlCode": "vietnam", "Name": "Vietnam" }, { "Code": "VG", "UrlCode": "virgin-islands-british", "Name": "Virgin Islands, British" }, { "Code": "VI", "UrlCode": "virgin-islands-us", "Name": "Virgin Islands, U.S." }, { "Code": "WF", "UrlCode": "wallis-and-futuna", "Name": "Wallis and Futuna" }, { "Code": "EH", "UrlCode": "western-sahara", "Name": "Western Sahara" }, { "Code": "YE", "UrlCode": "yemen", "Name": "Yemen" }, { "Code": "ZM", "UrlCode": "zambia", "Name": "Zambia" }, { "Code": "ZW", "UrlCode": "zimbabwe", "Name": "Zimbabwe" } ] }, "competitors": { "TopSimilarityCompetitors": [] }, "trafficSources": { "SocialOrganic": 0.027244762946865973, "SocialPaid": 0.0011685994196042005, "Mail": 0.009260910213337761, "Referrals": 0.01688870616293292, "SearchOrganic": 0.007119242107196337, "SearchPaid": 0.0003651532665743775, "Direct": 0.9257302687131368, "GenAi": 0.0050949761355085854, "Affiliate": 0.00019739906634921837, "DisplayAds": 0.006929981968493789 }, "technologies": null, "extraData": { "Version": 1, "Policy": 0, "Notification": { "Content": null } }, "rawData": null, "http": { "statusCode": 200, "contentType": "application/json; charset=utf-8", "finalUrl": "https://data.similarweb.com/api/v1/data?domain=google.com", "attempts": 1, "wafAction": null }, "error": null } ``` The run summary is available separately at `OUTPUT.summary`. It contains requested, successful, failed, partial-success, and Dataset-item counts plus normalized domains and error totals. ### Pricing This Actor uses pay-per-event pricing: | Event | Price | Charged when | | --- | ---: | --- | | `website-profile` | USD 0.001 per result (USD 1 per 1,000) | A successfully processed website profile is written to the Dataset. | Error items do not trigger the `website-profile` charge. Before a large run, you can set a maximum total charge in Apify. The current Pricing tab on the Actor page is authoritative. ### API and integrations Run the Actor through Apify Console, API, CLI, Tasks, Schedules, or webhooks. The default Dataset can feed spreadsheets, databases, dashboards, and automation platforms. API request: ```bash curl -X POST "https://api.apify.com/v2/acts/datascraperes~similarweb-website-scraper/runs?token=YOUR_APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"domains":["google.com","apify.com"]}' ``` JavaScript client: ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('datascraperes/similarweb-website-scraper').call({ domains: ['google.com', 'apify.com'], }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` Python client: ```python from apify_client import ApifyClient client = ApifyClient("YOUR_APIFY_TOKEN") run = client.actor("datascraperes/similarweb-website-scraper").call( run_input={"domains": ["google.com", "apify.com"]} ) items = client.dataset(run["defaultDatasetId"]).list_items().items print(items) ``` ### Related Actors | Actor | Best for | | --- | --- | | [Bulk Domain Rating Checker](https://apify.com/datascraperes/bulk-domain-rating-checker) | Adding Ahrefs Domain Rating to domain research lists. | | [Website Technology Lookup – CMS, Hosting & Tech Stack Data](https://apify.com/datascraperes/website-technology-lookup) | Identifying published CMS, hosting, and technology data for the same domains. | | [Google Search SERP Scraper - SERP Results](https://apify.com/datascraperes/google-serp-scraper) | Measuring organic search positions by query, country, language, and page. | | [Website Content Style & Brand Terminology Checker](https://apify.com/datascraperes/website-content-style-brand-terminology-checker) | Checking pages and supplied text against editorial and brand terminology rules. | ### Limits and data quality - A run accepts at most 10,000 domain values. - Invalid input stops the run before processing; equivalent valid domains are deduplicated. - Traffic, engagement, ranking, keyword, geography, and competitor values are third-party estimates and may change between snapshots. - Optional blocks can be absent for some domains. Check `isPartial` and `missingBlocks` instead of assuming every section is populated. - A successful result requires a valid JSON response with the minimum source contract, including a non-empty snapshot date. An HTTP 200 response alone is not treated as success. - Domain failures are isolated, so one unavailable domain does not remove other results. - The Actor returns the normalized contract and `extraData`; it does not expose the complete raw source payload. - Large runs depend on source availability, Apify run limits, and the maximum total charge selected by the user. ### Frequently asked questions #### Do I need a Similarweb API key? No. You only need an Apify account that can run the Actor. #### Are duplicate domains processed or charged twice? No. Equivalent inputs are normalized and processed once. #### Are failed domains charged? No. Only a successfully produced Dataset profile triggers the `website-profile` event. #### Why is `isPartial` true? At least one optional data block was absent or null in the source response. Use `missingBlocks` to see which block was unavailable. #### Why do values change between runs? The data represents estimates for source-defined snapshots. The source can revise estimates and publish a newer snapshot. #### Can I schedule recurring checks? Yes. Save the input as an Apify Task and connect it to an Apify Schedule. ### Responsible use Use this Actor only for lawful analysis of public domain intelligence. Follow applicable laws, data-protection requirements, Similarweb's terms, website terms, and third-party rights. Do not use the results for unauthorized access, deception, discrimination, harassment, or other harmful activity. ### Support If a run fails or returns unexpected data, open an issue from the Actor page and include the run URL, a non-sensitive example domain, and the expected behavior. Do not post API tokens or other secrets. # Actor input Schema ## `domains` (type: `array`): Enter domains such as google.com or apify.com. Public HTTPS website URLs without a path are also accepted; Similarweb website URLs are supported. Maximum 10,000 domains per run. ## Actor input object example ```json { "domains": [ "google.com", "apify.com" ] } ``` # Actor output Schema ## `websiteProfiles` (type: `string`): One record per requested domain, including successful, partial and failed domain results. ## `summary` (type: `string`): Execution counters and error breakdown stored in the default key-value store. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "domains": [ "google.com", "apify.com" ] }; // Run the Actor and wait for it to finish const run = await client.actor("datascraperes/similarweb-website-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "domains": [ "google.com", "apify.com", ] } # Run the Actor and wait for it to finish run = client.actor("datascraperes/similarweb-website-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "domains": [ "google.com", "apify.com" ] }' | apify call datascraperes/similarweb-website-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,datascraperes/similarweb-website-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/9cnbAnffX5kWjCK7M/builds/hZP7hubgdHJeIltno/openapi.json