# Similarweb Scraper (`parsebird/similarweb-scraper`) Actor

crape Similarweb website traffic data in bulk: global, country and category rank, monthly visits, bounce rate, traffic sources, AI chatbot traffic, top countries and keywords, similar sites, plus company, audience and competitor data. API, scheduling, JSON/CSV/Excel export.

- **URL**: https://apify.com/parsebird/similarweb-scraper.md
- **Developed by:** [ParseBird](https://apify.com/parsebird) (community)
- **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, 1 bookmarks
- **User rating**: No ratings yet

## Pricing

from $4.59 / 1,000 data

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### Similarweb Scraper

Similarweb Scraper pulls website traffic and ranking data from [Similarweb](https://www.similarweb.com) for any list of domains: global, country and category rank, monthly visits, engagement, traffic sources, AI chatbot traffic, top countries and keywords, plus similar sites from [Similarsites.com](https://www.similarsites.com) and in-depth company, audience and competitor data from similarweb.com.

<table><tr>
<td style="border-left:4px solid #092540;padding:12px 16px;font-weight:600">
Check hundreds of websites in one run and get Similarweb ranks, visits, bounce rate, traffic channel split, AI chatbot referrals, top keywords, 20 similar sites and company, demographics and competitor data as clean JSON rows.
</td>
</tr></table>

<br>

<table>
<tr>
<td colspan="3" style="padding:10px 14px;background:#FFFFFF;border:1px solid #E7E5E4;border-radius:4px 4px 0 0">
<span style="color:#1C1917;font-size:14px;font-weight:700;letter-spacing:0.5px">ParseBird SEO Suite</span>
<span style="color:#78716C;font-size:13px">&nbsp;&nbsp;&bull;&nbsp;&nbsp;Authority, traffic, backlink &amp; keyword data</span>
</td>
</tr>
<tr>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;border-right:none;vertical-align:top;width:33%;background:#FFFFFF">
<a href="https://apify.com/parsebird/ahrefs-scraper" style="color:#1C1917;text-decoration:none;font-weight:700;font-size:13px">Ahrefs Scraper</a><br>
<span style="color:#78716C;font-size:11px">Domain Rating, backlinks, keywords</span>
</td>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;border-right:none;vertical-align:top;width:33%;background:#F5F5F4">
<a href="https://apify.com/parsebird/similarweb-scraper" style="color:#1C1917;text-decoration:none;font-weight:700;font-size:13px">Similarweb Scraper</a><br>
<span style="color:#1C1917;font-size:11px;font-weight:600">You are here</span>
</td>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;vertical-align:top;width:33%;background:#FFFFFF">
<a href="https://apify.com/parsebird/moz-scraper" style="color:#1C1917;text-decoration:none;font-weight:700;font-size:13px">MOZ Scraper</a><br>
<span style="color:#78716C;font-size:11px">Domain Authority, PA, Spam Score</span>
</td>
</tr>
<tr>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;border-right:none;border-radius:0 0 0 4px;vertical-align:top;width:33%;background:#FFFFFF">
<a href="https://apify.com/parsebird/ubersuggest-scraper" style="color:#1C1917;text-decoration:none;font-weight:700;font-size:13px">Ubersuggest Scraper</a><br>
<span style="color:#78716C;font-size:11px">Keyword volume, SERP, backlinks</span>
</td>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;border-right:none;vertical-align:top;width:33%;background:#FFFFFF"></td>
<td style="padding:10px 14px;border:1px solid #E7E5E4;border-top:none;border-radius:0 0 4px 0;vertical-align:top;width:33%;background:#FFFFFF"></td>
</tr>
</table>

##### Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

```text
Similarweb Scraper (Apify actor parsebird/similarweb-scraper) returns Similarweb website traffic data for a list of domains. Call it with the Apify API client: client.actor("parsebird/similarweb-scraper").call(run_input={"urls": ["openai.com", "https://www.indeed.com/"], "include_base_data": true, "include_similar_sites": true, "include_indepth_data": false, "output_mode": "aggregated"}). Inputs: urls (array of strings, required; URLs or domains, any format such as https://google.com, www.google.com or google.com), include_base_data (boolean, default true), include_similar_sites (boolean, default false), include_indepth_data (boolean, default false, extra charge per website), output_mode ("aggregated" one row per website, or "individual" one row per website and data option), proxyConfiguration (optional, residential by default for in-depth data). Output (base data): domain, title, description, rankGlobal, country, countryRank, category, categoryRank, totalVisits, bounceRate, pagesPerVisit, timeOnSite, monthlyVisits, directTraffic, searchTraffic, searchOrganicTraffic, searchPaidTraffic, socialTraffic, referralTraffic, mailTraffic, displayAdsTraffic, affiliateTraffic, genAiTraffic, countryShare, topKeywords, aiTrafficVisits, aiTopChatbots, aiChatbotShare, aiChatbotShareHistory, aiTopPrompts, snapshotDate. Similar sites: similar_sites (url, description, category, totalVisits, similarityScore), related_apps, tags. In-depth: company_name, company_year_founded, company_headquarters, company_employees_min/max, company_revenue_min/max, age_distribution, gender_distribution, rank histories, top_competitors, social_networks_share, top_keywords, referral and outgoing categories, top_technology_providers. Rows without data have an error field and are not charged. API docs: https://apify.com/parsebird/similarweb-scraper/api. Get a token: https://console.apify.com/settings/integrations
```

### What is Similarweb Scraper?

**Similarweb Scraper** turns the free data Similarweb shows about a website into structured rows. Give it domains or URLs and it returns **monthly visits, global rank, country rank, category rank, bounce rate, pages per visit, time on site and the traffic channel split** (direct, search, social, referrals, mail, display ads, affiliate and AI chatbots), plus the top countries and top organic keywords.

Use it as a **Similarweb API alternative** for competitor research, lead scoring and market sizing: no Similarweb account and no browser work on your side. Keep the `openai.com` example, click **Start**, and download the results as JSON, CSV or Excel a few seconds later.

### What can Similarweb Scraper do?

- 📊 **Traffic and engagement**: last 3 months of visits, bounce rate, pages per visit, average time on site and the snapshot month.
- 🏆 **Rankings**: Similarweb global rank, rank in the site's top country and rank in its category.
- 🔀 **Traffic sources**: share of direct, organic search, paid search, organic and paid social, referrals, email, display ads, affiliate and AI chatbot traffic.
- 🤖 **AI traffic**: estimated visits from AI chatbots, the chatbots sending the most traffic (ChatGPT, Gemini, Perplexity, Claude and others), their share over the last months and sample prompts.
- 🌍 **Countries and keywords**: top 5 countries by traffic share and top 5 organic keywords with search volume, estimated value and CPC.
- 🔗 **Similar sites**: up to 20 similar websites from Similarsites.com with visits, category and similarity score, plus related Android and iOS apps.
- 🏢 **In-depth data** (optional): company name, founding year, headquarters, employees and revenue range, audience age and gender, 3-month rank history, top 10 competitors, social networks, referring and outgoing categories, ad networks and technologies.
- 📦 **Bulk and flexible output**: hundreds of domains per run, one row per website or one row per data option.

As an Apify Actor it also gives you [scheduling](https://docs.apify.com/platform/schedules) to track sites monthly, a [REST API](https://docs.apify.com/api/v2), [integrations](https://apify.com/integrations) with Google Sheets, Zapier, Make, Slack and webhooks, and exports to JSON, CSV, Excel, XML and HTML.

### What data can you extract from Similarweb?

| Data option | Main fields |
|-------------|-------------|
| Base data (default) | `rankGlobal`, `country`, `countryRank`, `category`, `categoryRank`, `totalVisits`, `monthlyVisits`, `bounceRate`, `pagesPerVisit`, `timeOnSite`, `directTraffic`, `searchOrganicTraffic`, `searchPaidTraffic`, `socialTraffic`, `referralTraffic`, `mailTraffic`, `displayAdsTraffic`, `affiliateTraffic`, `genAiTraffic`, `countryShare`, `topKeywords`, `aiTrafficVisits`, `aiTopChatbots`, `aiChatbotShare`, `aiChatbotShareHistory`, `aiTopPrompts`, `snapshotDate` |
| Similar sites | `similar_sites` (url, description, category, topCountryRank, totalVisits, similarityRank, similarityScore), `related_apps`, `tags`, `total_visits`, `category`, `categoryRank` |
| In-depth data | `company_name`, `company_parent_domain`, `company_year_founded`, `company_headquarters`, `company_headquarters_city`, `company_employees_min`, `company_employees_max`, `company_revenue_min`, `company_revenue_max`, `age_distribution`, `gender_distribution`, `global_rank_history`, `country_rank_history`, `category_rank_history`, `top_competitors`, `top_countries`, `top_keywords`, `social_networks_share`, `marketing_channel_distribution`, `top_incoming_categories`, `top_outgoing_categories`, `total_ads_sites`, `top_technology_providers` |

Traffic source fields are shares from 0 to 1. AI chatbot shares are percentages from 0 to 100, as Similarweb shows them. Company fields are empty when Similarweb has no company profile for the site.

### How to scrape Similarweb data

1. Open [Similarweb Scraper](https://apify.com/parsebird/similarweb-scraper) in Apify Console.
2. Add websites to **Websites**: `openai.com`, `www.indeed.com` or full URLs all work.
3. Keep **Base data** on, and switch on **Similar sites** and **In-depth data** if you need them.
4. Pick the **Output mode**: one row per website, or one row per website and data option.
5. Click **Start**.
6. Download the results from the **Output** tab as JSON, CSV, Excel, XML or HTML, or read them through the [API](https://apify.com/parsebird/similarweb-scraper/api).

### Input parameters

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `urls` | array of strings | **Yes** | — | Website URLs or domains. Subpaths are reduced to the domain |
| `include_base_data` | boolean | No | `true` | Ranks, visits, engagement, traffic sources, countries, keywords, AI traffic |
| `include_similar_sites` | boolean | No | `false` | Similar websites and related apps from Similarsites.com |
| `include_indepth_data` | boolean | No | `false` | Company, audience, rank history, competitors, referrals, technologies |
| `output_mode` | string | No | `aggregated` | `aggregated` (one row per website) or `individual` (one row per data option) |
| `proxyConfiguration` | object | No | Residential | Used for in-depth data only |

**Supported URL formats**

| Format | Supported |
|--------|-----------|
| `https://google.com` | ✅ |
| `http://google.com` | ✅ |
| `www.google.com` | ✅ |
| `google.com` | ✅ |
| `https://www.indeed.com/jobs?q=data` | ✅ (looked up as `indeed.com`) |

### Output example

An aggregated row with base data (lists shortened):

```json
{
  "data_captured_at": "2026-10-07T12:08:41.059312",
  "type": "aggregated",
  "searchUrl": "https://www.openai.com/",
  "domain": "openai.com",
  "url": "https://openai.com",
  "title": "OpenAI",
  "rankGlobal": 147,
  "country": "US",
  "countryRank": 188,
  "category": "AI_Chatbots_and_Tools",
  "categoryRank": 5,
  "totalVisits": 259461422,
  "bounceRate": 0.5489500282509283,
  "pagesPerVisit": 2.7346833238479773,
  "timeOnSite": 150.37198476841593,
  "monthlyVisits": [
    { "month": "2026-07", "visits": 197235347 },
    { "month": "2026-08", "visits": 204335158 },
    { "month": "2026-09", "visits": 259461422 }
  ],
  "directTraffic": 0.43048912126267247,
  "searchOrganicTraffic": 0.2108072388718704,
  "genAiTraffic": 0.21495599553168698,
  "countryShare": [{ "country": "US", "share": 0.25508688419829506 }],
  "topKeywords": [{ "keyword": "chatgpt", "estimatedValue": 28570350, "searchVolume": 185072310, "cpc": 0.13 }],
  "aiTopChatbots": [{ "chatbot": "chatgpt.com", "rank": 1 }, { "chatbot": "gemini.google.com", "rank": 2 }],
  "aiChatbotShare": [{ "chatbot": "chatgpt.com", "sharePercent": 98.66005118118272 }],
  "snapshotDate": "2026-09-01T00:00:00+00:00"
}
```

An in-depth row in individual mode (lists shortened):

```json
{
  "type": "indepth",
  "searchUrl": "zapier.com",
  "domain": "zapier.com",
  "company_name": "Zapier",
  "global_rank": 6646,
  "total_visits": 5042786,
  "gender_distribution": { "male": 0.5736660110211796, "female": 0.42633398897882036 },
  "top_competitors": [{ "domain": "make.com", "category": "computers_electronics_and_technology/computers_electronics_and_technology", "category_rank": 277, "affinity": 1 }],
  "top_technology_providers": [{ "tech_name": "DoubleClick", "category": "advertising", "total_tech_used_in_category": 30 }]
}
```

Download the dataset in JSON, CSV, Excel, XML or HTML from the Output tab.

### How much does it cost to scrape Similarweb?

Similarweb Scraper uses pay-per-event pricing. Compute and proxy costs are included in the price.

| Event | Free plan | Bronze | Silver | Gold |
|-------|-----------|--------|--------|------|
| `result` (one dataset row with data) | **$6.99** / 1,000 | **$5.99** / 1,000 | **$4.99** / 1,000 | **$4.59** / 1,000 |
| `indepth-search` (added when in-depth data is found for a website) | **$1.99** / 1,000 | **$1.79** / 1,000 | **$1.49** / 1,000 | **$0.99** / 1,000 |

In aggregated mode each website is one row. Checking 1,000 websites with base data and similar sites costs $6.99 on the Free plan, and adding in-depth data for all of them adds $1.99. In individual mode each data option is its own row, so base data plus similar sites for 1,000 websites is 2,000 rows. Websites with no data are saved with an `error` field and not charged. You can set a maximum cost per run in the run options.

### FAQ

**Do I need a Similarweb account or API key?**
No. The actor reads the free data Similarweb shows publicly, the same numbers you see on similarweb.com without logging in.

**Why are some fields empty for my website?**
Similarweb only estimates traffic for websites with enough visitors. Small sites get few or no metrics, and company fields stay empty when Similarweb has no company profile. A website with no Similarweb data at all is saved with an `error` field and not charged.

**How fresh is the data?**
Similarweb updates its free data monthly. `snapshotDate` tells you which month the numbers belong to.

**What is the difference between base data and in-depth data?**
Base data covers ranks, visits, engagement, traffic sources, countries, keywords and AI traffic. In-depth data adds company details, demographics, rank history, competitors, social networks, referral and outgoing categories, ad networks and technologies from the similarweb.com website page. In-depth data takes longer to collect and is charged as an extra event.

**Why don't the visit counts in similar sites match base data?**
Similar sites come from Similarsites.com, which uses its own visit estimate. Use base data for Similarweb's monthly visits.

**Can I monitor websites over time?**
Yes. Use [Apify schedules](https://docs.apify.com/platform/schedules) to run the actor monthly and send the results to Google Sheets, Slack or a webhook.

**How do I use the Similarweb Scraper API in Python?**

```python
from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("parsebird/similarweb-scraper").call(run_input={
    "urls": ["openai.com", "anthropic.com"],
    "include_similar_sites": True,
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["domain"], item.get("rankGlobal"), item.get("totalVisits"))
```

**How do I use it in JavaScript?**

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const run = await client.actor('parsebird/similarweb-scraper').call({
    urls: ['https://www.indeed.com/'],
    include_indepth_data: true,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);
```

**Something is missing or broken. What should I do?**
Open an issue on the [Issues tab](https://apify.com/parsebird/similarweb-scraper/issues). Feedback and feature requests are welcome.

### Is it legal to scrape Similarweb?

Similarweb Scraper only collects data that Similarweb and Similarsites show publicly without logging in, and it doesn't collect personal data. You are responsible for how you use the data, including following Similarweb's terms and the laws that apply to you. If you're unsure, ask a lawyer. Read more in Apify's post on [whether web scraping is legal](https://blog.apify.com/is-web-scraping-legal/).

### Other ParseBird SEO scrapers

| Actor | What it does |
|-------|-------------|
| [Ahrefs Scraper](https://apify.com/parsebird/ahrefs-scraper) | Domain Rating, backlinks, organic traffic, keyword difficulty, SERP and AI visibility from Ahrefs' free tools |
| [Google Ads Transparency Center Scraper](https://apify.com/parsebird/google-ads-transparency-scraper) | Ads that any advertiser runs on Google |
| [Website Contact Finder](https://apify.com/parsebird/website-contact-finder) | Emails, phones and social links from websites |
| [SocialBlade Scraper](https://apify.com/parsebird/socialblade-scraper) | Creator stats and growth for YouTube, TikTok, Instagram, Twitch and Facebook |

# Changelog

This Actor's version history is a separate document: https://apify.com/parsebird/similarweb-scraper/changelog.md

# Actor input Schema

## `urls` (type: `array`):

Add website URLs or domains, e.g. <code>openai.com</code>, <code>https://www.indeed.com/</code>. Pages and subpaths are reduced to their domain.

## `include_base_data` (type: `boolean`):

Ranks, monthly visits, engagement, traffic sources, top countries, top keywords and AI chatbot traffic from Similarweb.

## `include_similar_sites` (type: `boolean`):

Up to 20 similar websites with visits, category and similarity score, plus related mobile apps, from Similarsites.com.

## `include_indepth_data` (type: `boolean`):

Company info, audience age and gender, rank history, top competitors, social networks, referring sites and categories, ad networks and technologies from similarweb.com. Charged as an extra event. Best for websites with significant traffic.

## `output_mode` (type: `string`):

<b>Aggregated</b> saves one row per website with all data. <b>Individual</b> saves one row per website and data option.

## `proxyConfiguration` (type: `object`):

Used for in-depth data, which similarweb.com only serves to residential IPs. Keep the default unless you know you need something else.

## Actor input object example

```json
{
  "urls": [
    "openai.com"
  ],
  "include_base_data": true,
  "include_similar_sites": false,
  "include_indepth_data": false,
  "output_mode": "aggregated",
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "openai.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("parsebird/similarweb-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "urls": ["openai.com"] }

# Run the Actor and wait for it to finish
run = client.actor("parsebird/similarweb-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "openai.com"
  ]
}' |
apify call parsebird/similarweb-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parsebird/similarweb-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/gSJZANjfCNFpsbugG/builds/G9DcsYmMCXCmOOxJ6/openapi.json
