Similarweb Scraper

Similarweb Scraper

Similarweb Scraper pulls website traffic and ranking data from Similarweb for any list of domains: global, country and category rank, monthly visits, engagement, traffic sources, AI chatbot traffic, top countries and keywords, plus similar sites from Similarsites.com and in-depth company, audience and competitor data from similarweb.com.

Check hundreds of websites in one run and get Similarweb ranks, visits, bounce rate, traffic channel split, AI chatbot referrals, top keywords, 20 similar sites and company, demographics and competitor data as clean JSON rows.

ParseBird SEO Suite   •  Authority, traffic, backlink & keyword data
Ahrefs Scraper Domain Rating, backlinks, keywords	Similarweb Scraper You are here	MOZ Scraper Domain Authority, PA, Spam Score
Ubersuggest Scraper Keyword volume, SERP, backlinks

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

Similarweb Scraper (Apify actor parsebird/similarweb-scraper) returns Similarweb website traffic data for a list of domains. Call it with the Apify API client: client.actor("parsebird/similarweb-scraper").call(run_input={"urls": ["openai.com", "https://www.indeed.com/"], "include_base_data": true, "include_similar_sites": true, "include_indepth_data": false, "output_mode": "aggregated"}). Inputs: urls (array of strings, required; URLs or domains, any format such as https://google.com, www.google.com or google.com), include_base_data (boolean, default true), include_similar_sites (boolean, default false), include_indepth_data (boolean, default false, extra charge per website), output_mode ("aggregated" one row per website, or "individual" one row per website and data option), proxyConfiguration (optional, residential by default for in-depth data). Output (base data): domain, title, description, rankGlobal, country, countryRank, category, categoryRank, totalVisits, bounceRate, pagesPerVisit, timeOnSite, monthlyVisits, directTraffic, searchTraffic, searchOrganicTraffic, searchPaidTraffic, socialTraffic, referralTraffic, mailTraffic, displayAdsTraffic, affiliateTraffic, genAiTraffic, countryShare, topKeywords, aiTrafficVisits, aiTopChatbots, aiChatbotShare, aiChatbotShareHistory, aiTopPrompts, snapshotDate. Similar sites: similar_sites (url, description, category, totalVisits, similarityScore), related_apps, tags. In-depth: company_name, company_year_founded, company_headquarters, company_employees_min/max, company_revenue_min/max, age_distribution, gender_distribution, rank histories, top_competitors, social_networks_share, top_keywords, referral and outgoing categories, top_technology_providers. Rows without data have an error field and are not charged. API docs: https://apify.com/parsebird/similarweb-scraper/api. Get a token: https://console.apify.com/settings/integrations

What is Similarweb Scraper?

Similarweb Scraper turns the free data Similarweb shows about a website into structured rows. Give it domains or URLs and it returns monthly visits, global rank, country rank, category rank, bounce rate, pages per visit, time on site and the traffic channel split (direct, search, social, referrals, mail, display ads, affiliate and AI chatbots), plus the top countries and top organic keywords.

Use it as a Similarweb API alternative for competitor research, lead scoring and market sizing: no Similarweb account and no browser work on your side. Keep the openai.com example, click Start, and download the results as JSON, CSV or Excel a few seconds later.

What can Similarweb Scraper do?

• 📊 Traffic and engagement: last 3 months of visits, bounce rate, pages per visit, average time on site and the snapshot month.
• 🏆 Rankings: Similarweb global rank, rank in the site's top country and rank in its category.
• 🔀 Traffic sources: share of direct, organic search, paid search, organic and paid social, referrals, email, display ads, affiliate and AI chatbot traffic.
• 🤖 AI traffic: estimated visits from AI chatbots, the chatbots sending the most traffic (ChatGPT, Gemini, Perplexity, Claude and others), their share over the last months and sample prompts.
• 🌍 Countries and keywords: top 5 countries by traffic share and top 5 organic keywords with search volume, estimated value and CPC.
• 🔗 Similar sites: up to 20 similar websites from Similarsites.com with visits, category and similarity score, plus related Android and iOS apps.
• 🏢 In-depth data (optional): company name, founding year, headquarters, employees and revenue range, audience age and gender, 3-month rank history, top 10 competitors, social networks, referring and outgoing categories, ad networks and technologies.
• 📦 Bulk and flexible output: hundreds of domains per run, one row per website or one row per data option.

As an Apify Actor it also gives you scheduling to track sites monthly, a REST API, integrations with Google Sheets, Zapier, Make, Slack and webhooks, and exports to JSON, CSV, Excel, XML and HTML.

What data can you extract from Similarweb?

Data option	Main fields
Base data (default)	rankGlobal, country, countryRank, category, categoryRank, totalVisits, monthlyVisits, bounceRate, pagesPerVisit, timeOnSite, directTraffic, searchOrganicTraffic, searchPaidTraffic, socialTraffic, referralTraffic, mailTraffic, displayAdsTraffic, affiliateTraffic, genAiTraffic, countryShare, topKeywords, aiTrafficVisits, aiTopChatbots, aiChatbotShare, aiChatbotShareHistory, aiTopPrompts, snapshotDate
Similar sites	similar_sites (url, description, category, topCountryRank, totalVisits, similarityRank, similarityScore), related_apps, tags, total_visits, category, categoryRank
In-depth data	company_name, company_parent_domain, company_year_founded, company_headquarters, company_headquarters_city, company_employees_min, company_employees_max, company_revenue_min, company_revenue_max, age_distribution, gender_distribution, global_rank_history, country_rank_history, category_rank_history, top_competitors, top_countries, top_keywords, social_networks_share, marketing_channel_distribution, top_incoming_categories, top_outgoing_categories, total_ads_sites, top_technology_providers

Traffic source fields are shares from 0 to 1. AI chatbot shares are percentages from 0 to 100, as Similarweb shows them. Company fields are empty when Similarweb has no company profile for the site.

How to scrape Similarweb data

1. Open Similarweb Scraper in Apify Console.
2. Add websites to Websites: openai.com, www.indeed.com or full URLs all work.
3. Keep Base data on, and switch on Similar sites and In-depth data if you need them.
4. Pick the Output mode: one row per website, or one row per website and data option.
5. Click Start.
6. Download the results from the Output tab as JSON, CSV, Excel, XML or HTML, or read them through the API.

Input parameters

Parameter	Type	Required	Default	Description
urls	array of strings	Yes	—	Website URLs or domains. Subpaths are reduced to the domain
include_base_data	boolean	No	true	Ranks, visits, engagement, traffic sources, countries, keywords, AI traffic
include_similar_sites	boolean	No	false	Similar websites and related apps from Similarsites.com
include_indepth_data	boolean	No	false	Company, audience, rank history, competitors, referrals, technologies
output_mode	string	No	aggregated	aggregated (one row per website) or individual (one row per data option)
proxyConfiguration	object	No	Residential	Used for in-depth data only

Supported URL formats

Format	Supported
https://google.com	✅
http://google.com	✅
www.google.com	✅
google.com	✅
https://www.indeed.com/jobs?q=data	✅ (looked up as indeed.com)

Output example

An aggregated row with base data (lists shortened):

{
  "data_captured_at": "2026-10-07T12:08:41.059312",
  "type": "aggregated",
  "searchUrl": "https://www.openai.com/",
  "domain": "openai.com",
  "url": "https://openai.com",
  "title": "OpenAI",
  "rankGlobal": 147,
  "country": "US",
  "countryRank": 188,
  "category": "AI_Chatbots_and_Tools",
  "categoryRank": 5,
  "totalVisits": 259461422,
  "bounceRate": 0.5489500282509283,
  "pagesPerVisit": 2.7346833238479773,
  "timeOnSite": 150.37198476841593,
  "monthlyVisits": [
    { "month": "2026-07", "visits": 197235347 },
    { "month": "2026-08", "visits": 204335158 },
    { "month": "2026-09", "visits": 259461422 }
  ],
  "directTraffic": 0.43048912126267247,
  "searchOrganicTraffic": 0.2108072388718704,
  "genAiTraffic": 0.21495599553168698,
  "countryShare": [{ "country": "US", "share": 0.25508688419829506 }],
  "topKeywords": [{ "keyword": "chatgpt", "estimatedValue": 28570350, "searchVolume": 185072310, "cpc": 0.13 }],
  "aiTopChatbots": [{ "chatbot": "chatgpt.com", "rank": 1 }, { "chatbot": "gemini.google.com", "rank": 2 }],
  "aiChatbotShare": [{ "chatbot": "chatgpt.com", "sharePercent": 98.66005118118272 }],
  "snapshotDate": "2026-09-01T00:00:00+00:00"
}

An in-depth row in individual mode (lists shortened):

{
  "type": "indepth",
  "searchUrl": "zapier.com",
  "domain": "zapier.com",
  "company_name": "Zapier",
  "global_rank": 6646,
  "total_visits": 5042786,
  "gender_distribution": { "male": 0.5736660110211796, "female": 0.42633398897882036 },
  "top_competitors": [{ "domain": "make.com", "category": "computers_electronics_and_technology/computers_electronics_and_technology", "category_rank": 277, "affinity": 1 }],
  "top_technology_providers": [{ "tech_name": "DoubleClick", "category": "advertising", "total_tech_used_in_category": 30 }]
}

Download the dataset in JSON, CSV, Excel, XML or HTML from the Output tab.

How much does it cost to scrape Similarweb?

Similarweb Scraper uses pay-per-event pricing. Compute and proxy costs are included in the price.

Event	Free plan	Bronze	Silver	Gold
result (one dataset row with data)	$6.99 / 1,000	$5.99 / 1,000	$4.99 / 1,000	$4.59 / 1,000
indepth-search (added when in-depth data is found for a website)	$1.99 / 1,000	$1.79 / 1,000	$1.49 / 1,000	$0.99 / 1,000

In aggregated mode each website is one row. Checking 1,000 websites with base data and similar sites costs $6.99 on the Free plan, and adding in-depth data for all of them adds $1.99. In individual mode each data option is its own row, so base data plus similar sites for 1,000 websites is 2,000 rows. Websites with no data are saved with an error field and not charged. You can set a maximum cost per run in the run options.

FAQ

Do I need a Similarweb account or API key? No. The actor reads the free data Similarweb shows publicly, the same numbers you see on similarweb.com without logging in.

Why are some fields empty for my website? Similarweb only estimates traffic for websites with enough visitors. Small sites get few or no metrics, and company fields stay empty when Similarweb has no company profile. A website with no Similarweb data at all is saved with an error field and not charged.

How fresh is the data? Similarweb updates its free data monthly. snapshotDate tells you which month the numbers belong to.

What is the difference between base data and in-depth data? Base data covers ranks, visits, engagement, traffic sources, countries, keywords and AI traffic. In-depth data adds company details, demographics, rank history, competitors, social networks, referral and outgoing categories, ad networks and technologies from the similarweb.com website page. In-depth data takes longer to collect and is charged as an extra event.

Why don't the visit counts in similar sites match base data? Similar sites come from Similarsites.com, which uses its own visit estimate. Use base data for Similarweb's monthly visits.

Can I monitor websites over time? Yes. Use Apify schedules to run the actor monthly and send the results to Google Sheets, Slack or a webhook.

How do I use the Similarweb Scraper API in Python?

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("parsebird/similarweb-scraper").call(run_input={
    "urls": ["openai.com", "anthropic.com"],
    "include_similar_sites": True,
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["domain"], item.get("rankGlobal"), item.get("totalVisits"))

How do I use it in JavaScript?

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const run = await client.actor('parsebird/similarweb-scraper').call({
    urls: ['https://www.indeed.com/'],
    include_indepth_data: true,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Something is missing or broken. What should I do? Open an issue on the Issues tab. Feedback and feature requests are welcome.

Is it legal to scrape Similarweb?

Similarweb Scraper only collects data that Similarweb and Similarsites show publicly without logging in, and it doesn't collect personal data. You are responsible for how you use the data, including following Similarweb's terms and the laws that apply to you. If you're unsure, ask a lawyer. Read more in Apify's post on whether web scraping is legal.

Other ParseBird SEO scrapers

Actor	What it does
Ahrefs Scraper	Domain Rating, backlinks, organic traffic, keyword difficulty, SERP and AI visibility from Ahrefs' free tools
Google Ads Transparency Center Scraper	Ads that any advertiser runs on Google
Website Contact Finder	Emails, phones and social links from websites
SocialBlade Scraper	Creator stats and growth for YouTube, TikTok, Instagram, Twitch and Facebook