Semrush Website Traffic Scraper

Get Semrush's public website data for any number of domains as clean JSON, without a Semrush account: Authority Score, global, country and category rank, monthly visits with history and the desktop / mobile split, pages per visit, time on site, bounce rate, organic and paid search traffic with history, backlinks and referring domains with Google penalty risk, top organic keywords (position, volume, CPC, intent), top countries, competitors, incoming and outgoing traffic sources and visits from AI assistants. Or switch to the competitors report for each site's competitor list with their ranks, visits and engagement.

Features

• Bulk domains - one per line, domains or URLs, looked up in parallel.
• Traffic and engagement - visits, visit change, history, pages per visit, time on site, bounce rate.
• Search - organic and paid search traffic with history, top keywords with position, volume, CPC and intent.
• Authority and links - Authority Score, backlinks, referring domains, penalty risk, history.
• Audience and sources - top countries, traffic sources in and out, AI-assistant referrals.
• Competitors report - every competitor with Authority Score, ranks, visits and engagement.

Use cases

• Market sizing - traffic and engagement of every site in a niche.
• Competitor benchmarking - compare ranks, visits and search traffic across rivals.
• Lead qualification - prioritise prospects by traffic and Authority Score.
• SEO research - top keywords and backlink profiles of competing domains.

Input

Field	Type	Default	Description
domains	array	github.com	Domains or URLs, one per line.
report	string	overview	overview (website data) or competitors (competitor list).
concurrency	integer	3	Domains looked up at the same time (1-5).

Example input

{
  "domains": ["stripe.com", "shopify.com", "https://www.notion.so"],
  "report": "overview"
}

Output

One dataset item per domain:

{
  "input": "github.com",
  "domain": "github.com",
  "found": true,
  "report": "overview",
  "source": "https://www.semrush.com/website/github.com/overview/",
  "dataDate": "2026-09-15",
  "brandName": "GitHub",
  "authorityScore": 100,
  "globalRank": 24,
  "countryRank": {
    "rank": 9,
    "country": "BD",
    "countryName": "Bangladesh",
    "rankChange": 0
  },
  "categoryRank": {
    "rank": 1,
    "category": "Computer Software and Development",
    "rankChange": 0
  },
  "visits": 1436619552,
  "pagesPerVisit": 6.075,
  "timeOnSiteSeconds": 719,
  "bounceRate": 0.4011,
  "visitsHistory": [
    {
      "date": "2026-09-01",
      "visits": 1436619552,
      "desktopVisits": 1166423897,
      "mobileVisits": 270195655
    }
  ],
  "searchTraffic": {
    "date": "2026-09-15",
    "organic": 72449659,
    "organicChangePercent": 2.49,
    "paid": 21088,
    "paidChangePercent": -13.47,
    "history": [
      {
        "date": "2026-09-15",
        "organic": 72449659,
        "paid": 21088,
        "total": 72470747
      }
    ]
  },
  "backlinks": {
    "date": "2026-09-01",
    "backlinks": 5088322474,
    "referringDomains": 4217125,
    "googlePenaltyRisk": "Low"
  },
  "topKeywords": {
    "date": "2026-09-15",
    "country": "BD",
    "keywords": [
      {
        "keyword": "github",
        "position": 1,
        "searchVolume": 135000,
        "cpc": 0.62,
        "trafficShare": 0.2785,
        "intents": [
          "navigational"
        ]
      }
    ]
  },
  "topCountries": [
    {
      "country": "BD",
      "countryName": "Bangladesh",
      "visits": 350209633,
      "trafficShare": 0.2438,
      "desktopShare": 0.9886,
      "mobileShare": 0.0114
    }
  ],
  "competitors": [
    {
      "domain": "stackoverflow.com",
      "relevance": 0.23,
      "visits": 25915762
    }
  ],
  "aiTraffic": [
    {
      "source": "chatgpt.com",
      "name": "ChatGPT",
      "visits": 11744546,
      "share": 0.00873,
      "history": [
        {
          "date": "2026-09-01",
          "visits": 11744546
        }
      ]
    }
  ],
  "trafficSources": {
    "date": "2026-09-01",
    "incoming": [],
    "outgoing": []
  }
}

(Lists shortened to one entry: visitsHistory has 6 months, topKeywords, topCountries, competitors, trafficSources and aiTraffic several entries each.) The competitors report returns the same header (ranks, visits) and a competitors list, each competitor with its Authority Score, ranks, visits and engagement.

The key-value store also holds ERRORS - domains Semrush has no public page for, or that failed, with the reason. These are not billed.

Pricing

$1.20 per 1000 domains. You pay only for domains that returned data.

Notes

• Semrush publishes these public pages for about 200,000 of the most visited sites. A smaller site has no page and is reported in ERRORS (not charged).
• The figures are Semrush's monthly estimates (dataDate is the month they describe).
• This actor is not affiliated with Semrush.