# Similarweb Scraper - Website Traffic, Rank & Keywords (`yuri_silva/similarweb-scraper`) Actor

Get Similarweb data for any list of websites: monthly visits, global/country/category rank, bounce rate, traffic sources, top countries, top keywords and AI referrers (ChatGPT, Claude, Gemini). Flat, CSV-ready output. Only pay for domains with data.

- **URL**: https://apify.com/yuri_silva/similarweb-scraper.md
- **Developed by:** [Yuri S.](https://apify.com/yuri_silva) (community)
- **Stats:** 2 total users, 2 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 website results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Similarweb Scraper - Website Traffic, Rank & Keywords

**Check Similarweb traffic for 1 or 1,000 websites in one run.** Paste a list of domains and get one clean row per site: monthly visits, global, country and category rank, bounce rate, pages per visit, visit duration, traffic sources, top countries, top keywords, and how much traffic comes from AI assistants (ChatGPT, Claude, Gemini, Perplexity).

- 💸 **$2 per 1,000 websites.** Sites Similarweb has no data for are free, and so are failed lookups.
- 🤖 **AI traffic included.** See the share of visits from AI assistants, and which ones send them.
- 📋 **Flat, CSV-ready output.** One row per site, so it opens straight in Excel or Google Sheets.
- 🔓 **No login, no Similarweb account, no API key.**

### Try it in 30 seconds

1. Click **Start**. The form is already filled in with `github.com` and `nike.com`.
2. Open the **Output** tab to see the table.
3. Replace the examples with your own list. Plain domains (`github.com`) and full URLs (`https://www.nike.com/shoes`) both work. To paste a long list, use **Bulk edit** on the Websites field.

Export the results as CSV, Excel or JSON, or get them through the API.

### What people use it for

- **Competitor research.** Compare traffic, channels and top keywords for every competitor in one table.
- **Lead qualification.** Sort a list of prospect websites by traffic before your sales team reaches out.
- **Investing and M\&A.** Track 3-month visit trends for a list of companies or acquisition targets.
- **SEO and content.** See which keywords bring a site its search traffic, with volume and CPC.
- **AI search tracking.** Check whether ChatGPT, Claude or Gemini already send visitors to a site, and how many.
- **AI agents.** Clean, flat JSON that works well as a tool for Claude, ChatGPT, Cursor or any MCP client.

Pair it with the [Google Ads Transparency Scraper](https://apify.com/yuri_silva/google-ads-transparency-scraper) to see the ads your competitors run next to the traffic those ads bring in.

### Input

| Field | Description |
|---|---|
| `domains` | Domains or URLs to look up. Duplicates and `www.` are removed. |
| `maxConcurrency` | How many domains to look up at the same time (default 5). |
| `proxyConfiguration` | Residential Apify Proxy, on by default (Similarweb blocks datacenter IPs). You don't pay extra for it. |

```json
{
    "domains": ["github.com", "nike.com", "https://www.apify.com/store"]
}
```

### Output

One row per domain:

```json
{
    "domain": "github.com",
    "hasData": true,
    "title": "GitHub · Change is constant. GitHub keeps you ahead.",
    "category": "Computers Electronics and Technology",
    "subCategory": "Programming and Developer Software",
    "globalRank": 45,
    "countryRank": 77,
    "countryRankCountry": "US",
    "categoryRank": 4,
    "monthlyVisits": 645466516,
    "visitsByMonth": { "2026-07": 637885711, "2026-08": 649321442, "2026-09": 645466516 },
    "bounceRate": 0.3644,
    "pagesPerVisit": 5.69,
    "avgVisitDurationSec": 387,
    "trafficDirect": 0.5331,
    "trafficSearchOrganic": 0.2434,
    "trafficSearchPaid": 0.0002,
    "trafficReferrals": 0.0932,
    "trafficSocial": 0.0954,
    "trafficMail": 0.0122,
    "trafficDisplayAds": 0.0025,
    "trafficGenAi": 0.0199,
    "topCountries": [{ "country": "US", "share": 0.1873 }, { "country": "CN", "share": 0.1183 }],
    "topKeywords": [{ "keyword": "github", "volume": 10089950, "cpc": 1.62, "estimatedValue": 11461050 }],
    "topAiReferrers": ["chatgpt.com", "claude.ai", "gemini.google.com", "perplexity.ai"],
    "screenshotUrl": "https://site-images.similarcdn.com/image?url=github.com&...",
    "snapshotDate": "2026-09-01T00:00:00+00:00",
    "scrapedAt": "2026-10-11T12:00:00.000Z"
}
```

- Traffic source and bounce rate values are shares from 0 to 1 (`0.2434` = 24.34%).
- `hasData: false` means Similarweb has no estimate for that site (usually small sites). These rows are free.
- If a domain still fails after several retries, the row gets an `error` field. Failed rows are free too.

### Use it from code or an AI agent

Run it and get the results in one API call:

```bash
curl -X POST "https://api.apify.com/v2/acts/yuri_silva~similarweb-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains": ["github.com", "nike.com"]}'
```

It also works through the [Apify MCP server](https://mcp.apify.com), so Claude, ChatGPT or Cursor can call it directly, for example: *"Compare monthly traffic and top keywords for these 5 competitors."*

### Pricing

**$2.00 per 1,000 websites with data.** Websites Similarweb doesn't track, and websites that fail, cost nothing. Set a maximum cost per run in the run options and the scraper stops cleanly when it reaches it.

| Websites | Cost |
|---|---|
| 10 | $0.02 |
| 100 | $0.20 |
| 1,000 | $2.00 |
| 10,000 | $20.00 |

### FAQ

**Where does the data come from?** From Similarweb's free public website estimates, the same numbers its free browser extension shows. Paid Similarweb features (full keyword lists, competitor lists, history beyond 3 months) are not included.

**Why is a small site empty?** Similarweb only estimates sites with enough traffic. Those rows come back with `hasData: false` and are free.

**How many websites can I check in one run?** There is no fixed limit. For big lists, set a maximum cost per run so you always know the most you'll pay.

**Can I run it on a schedule?** Yes. Use Apify Schedules to track the same list every month and watch the trends.

**Is this legal?** It reads public, aggregated website statistics and collects no personal data. You are responsible for how you use the data.

### Feedback

Missing a field you need, or something not working? Open an issue on the **Issues** tab and I'll take a look. If the scraper saved you time, a quick ⭐ review helps other people find it.

# Actor input Schema

## `domains` (type: `array`):

Domains or URLs to look up, e.g. "github.com" or "https://www.nike.com/shoes". Only the domain is used.

## `maxConcurrency` (type: `integer`):

How many domains to look up at the same time.

## `proxyConfiguration` (type: `object`):

Residential proxy is on by default because Similarweb blocks datacenter IPs. You don't pay extra for it.

## Actor input object example

```json
{
  "domains": [
    "github.com",
    "nike.com"
  ],
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `websites` (type: `string`):

One row per domain: rank, monthly visits, engagement and traffic sources.

## `websitesFull` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "github.com",
        "nike.com"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": [
            "RESIDENTIAL"
        ]
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("yuri_silva/similarweb-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "domains": [
        "github.com",
        "nike.com",
    ],
    "proxyConfiguration": {
        "useApifyProxy": True,
        "apifyProxyGroups": ["RESIDENTIAL"],
    },
}

# Run the Actor and wait for it to finish
run = client.actor("yuri_silva/similarweb-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "github.com",
    "nike.com"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}' |
apify call yuri_silva/similarweb-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,yuri_silva/similarweb-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/wKAmTaPUc4uFnQjiO/builds/zlHi7onZ4mWFmczha/openapi.json