Similarweb Scraper

Similarweb Scraper is a powerful Apify Actor designed to extract comprehensive website analytics and market intelligence from Similarweb. Easily retrieve global/country/category rankings, monthly traffic volumes, engagement metrics (bounce rate, pages per visit, average visit duration), traffic acquisition sources, geographic demographics, competitors, and top search keywords.

---

🚀 Features

• Comprehensive Traffic Analytics: Extract total monthly visits, bounce rates, pages per visit, and average visit duration.
• Global & Regional Rankings: Scrape global rank, country rank, and category rank.
• Company & Domain Profile: Extract company name, founding year, employee size range, headquarters location, annual revenue bracket, and industry category.
• Traffic Acquisition Channels: Direct, referrals, search, social, email, and display ad traffic distribution.
• Geographic Breakdown: Top country traffic shares with ISO country codes.
• Competitors & Keywords: Discover top competitors, similar websites, and organic/paid keywords.
• Zero Null Guarantee: Multi-layer extraction strategy (Next.js server state + DOM fallbacks + smart defaults) ensuring clean, comprehensive output datasets without empty null fields.

---

📥 Input Parameters

The Actor accepts input via Apify Console or JSON API.

Parameter	Type	Required	Default	Description
domains	Array of strings	No	["google.com", "github.com", "wikipedia.org"]	List of target domain names to scrape.
startUrls	Array of objects	No	[]	List of Similarweb URLs (https://www.similarweb.com/website/google.com/).
maxItems	Integer	No	100	Maximum number of domains to process.
maxConcurrency	Integer	No	2	Number of parallel browser instances.
proxyConfiguration	Object	No	auto	Apify Proxy settings for anti-bot protection.

Example Input JSON

{
  "domains": [
    "google.com",
    "github.com",
    "wikipedia.org"
  ],
  "maxItems": 10,
  "maxConcurrency": 2
}

---

📤 Output Dataset Format

The extracted data is pushed directly to the default Apify Dataset in JSON, CSV, Excel, or XML formats.

Sample Output Item

{
  "domain": "github.com",
  "url": "https://www.similarweb.com/website/github.com/",
  "title": "GitHub",
  "description": "GitHub is where over 100 million developers shape the future of software, together.",
  "companyName": "GITHUB",
  "yearFounded": 2008,
  "employeeRange": "1000 - 5000",
  "headquarters": "San Francisco, California, United States",
  "annualRevenue": "$500.0M - $1.0B",
  "mainCategory": "Computers Electronics and Technology > Software",
  "globalRank": 74,
  "countryRank": 53,
  "categoryRank": 6,
  "totalVisits": "485.4M",
  "bounceRate": "38.2%",
  "pagesPerVisit": "5.8",
  "avgVisitDuration": "00:06:45",
  "topCountryShares": [
    {
      "country": "United States",
      "countryCode": "US",
      "share": "24.2%"
    },
    {
      "country": "China",
      "countryCode": "CN",
      "share": "8.5%"
    }
  ],
  "trafficSources": {
    "direct": "65.4%",
    "referrals": "4.2%",
    "search": "24.8%",
    "social": "3.1%",
    "mail": "1.8%",
    "display": "0.7%"
  },
  "competitors": [
    "gitlab.com",
    "bitbucket.org",
    "sourceforge.net"
  ],
  "topKeywords": [
    "github",
    "github copilot",
    "git"
  ],
  "scrapedAt": "2026-08-05T10:40:00.000Z"
}

---

💼 Use Cases

1. Competitor Intelligence & Benchmarking: Compare your website traffic and engagement against industry leaders.
2. Market Research: Analyze audience demographics, regional distribution, and top traffic channels.
3. SEO & Content Strategy: Discover high-performing search keywords and referral domains.
4. Lead Generation & Sales Intelligence: Identify fast-growing web platforms and assess company size and revenue tier.

---

⚙️ How to Run Locally

# Install dependencies
npm install

# Run locally
npm start
# or
apify run

---

🛡️ License

ISC License