Similarweb Scraper - Website Traffic, Rank & Keywords

Check Similarweb traffic for 1 or 1,000 websites in one run. Paste a list of domains and get one clean row per site: monthly visits, global, country and category rank, bounce rate, pages per visit, visit duration, traffic sources, top countries, top keywords, and how much traffic comes from AI assistants (ChatGPT, Claude, Gemini, Perplexity).

• 💸 $2 per 1,000 websites. Sites Similarweb has no data for are free, and so are failed lookups.
• 🤖 AI traffic included. See the share of visits from AI assistants, and which ones send them.
• 📋 Flat, CSV-ready output. One row per site, so it opens straight in Excel or Google Sheets.
• 🔓 No login, no Similarweb account, no API key.

Try it in 30 seconds

1. Click Start. The form is already filled in with github.com and nike.com.
2. Open the Output tab to see the table.
3. Replace the examples with your own list. Plain domains (github.com) and full URLs (https://www.nike.com/shoes) both work. To paste a long list, use Bulk edit on the Websites field.

Export the results as CSV, Excel or JSON, or get them through the API.

What people use it for

• Competitor research. Compare traffic, channels and top keywords for every competitor in one table.
• Lead qualification. Sort a list of prospect websites by traffic before your sales team reaches out.
• Investing and M&A. Track 3-month visit trends for a list of companies or acquisition targets.
• SEO and content. See which keywords bring a site its search traffic, with volume and CPC.
• AI search tracking. Check whether ChatGPT, Claude or Gemini already send visitors to a site, and how many.
• AI agents. Clean, flat JSON that works well as a tool for Claude, ChatGPT, Cursor or any MCP client.

Pair it with the Google Ads Transparency Scraper to see the ads your competitors run next to the traffic those ads bring in.

Input

Field	Description
domains	Domains or URLs to look up. Duplicates and www. are removed.
maxConcurrency	How many domains to look up at the same time (default 5).
proxyConfiguration	Residential Apify Proxy, on by default (Similarweb blocks datacenter IPs). You don't pay extra for it.

{
    "domains": ["github.com", "nike.com", "https://www.apify.com/store"]
}

Output

One row per domain:

{
    "domain": "github.com",
    "hasData": true,
    "title": "GitHub · Change is constant. GitHub keeps you ahead.",
    "category": "Computers Electronics and Technology",
    "subCategory": "Programming and Developer Software",
    "globalRank": 45,
    "countryRank": 77,
    "countryRankCountry": "US",
    "categoryRank": 4,
    "monthlyVisits": 645466516,
    "visitsByMonth": { "2026-07": 637885711, "2026-08": 649321442, "2026-09": 645466516 },
    "bounceRate": 0.3644,
    "pagesPerVisit": 5.69,
    "avgVisitDurationSec": 387,
    "trafficDirect": 0.5331,
    "trafficSearchOrganic": 0.2434,
    "trafficSearchPaid": 0.0002,
    "trafficReferrals": 0.0932,
    "trafficSocial": 0.0954,
    "trafficMail": 0.0122,
    "trafficDisplayAds": 0.0025,
    "trafficGenAi": 0.0199,
    "topCountries": [{ "country": "US", "share": 0.1873 }, { "country": "CN", "share": 0.1183 }],
    "topKeywords": [{ "keyword": "github", "volume": 10089950, "cpc": 1.62, "estimatedValue": 11461050 }],
    "topAiReferrers": ["chatgpt.com", "claude.ai", "gemini.google.com", "perplexity.ai"],
    "screenshotUrl": "https://site-images.similarcdn.com/image?url=github.com&...",
    "snapshotDate": "2026-09-01T00:00:00+00:00",
    "scrapedAt": "2026-10-11T12:00:00.000Z"
}

• Traffic source and bounce rate values are shares from 0 to 1 (0.2434 = 24.34%).
• hasData: false means Similarweb has no estimate for that site (usually small sites). These rows are free.
• If a domain still fails after several retries, the row gets an error field. Failed rows are free too.

Use it from code or an AI agent

Run it and get the results in one API call:

curl -X POST "https://api.apify.com/v2/acts/yuri_silva~similarweb-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains": ["github.com", "nike.com"]}'

It also works through the Apify MCP server, so Claude, ChatGPT or Cursor can call it directly, for example: "Compare monthly traffic and top keywords for these 5 competitors."

Pricing

$2.00 per 1,000 websites with data. Websites Similarweb doesn't track, and websites that fail, cost nothing. Set a maximum cost per run in the run options and the scraper stops cleanly when it reaches it.

Websites	Cost
10	$0.02
100	$0.20
1,000	$2.00
10,000	$20.00

FAQ

Where does the data come from? From Similarweb's free public website estimates, the same numbers its free browser extension shows. Paid Similarweb features (full keyword lists, competitor lists, history beyond 3 months) are not included.

Why is a small site empty? Similarweb only estimates sites with enough traffic. Those rows come back with hasData: false and are free.

How many websites can I check in one run? There is no fixed limit. For big lists, set a maximum cost per run so you always know the most you'll pay.

Can I run it on a schedule? Yes. Use Apify Schedules to track the same list every month and watch the trends.

Is this legal? It reads public, aggregated website statistics and collects no personal data. You are responsible for how you use the data.

Feedback

Missing a field you need, or something not working? Open an issue on the Issues tab and I'll take a look. If the scraper saved you time, a quick ⭐ review helps other people find it.