Semrush Domain Overview

Semrush Domain Overview gets Semrush traffic and authority metrics for thousands of domains at once, without a Semrush account or subscription. For each domain you get:

• Authority Score, backlinks and referring domains, with the monthly change and Google penalty risk;
• organic and paid search traffic, with the monthly change;
• visits, pages per visit, average visit duration and bounce rate, plus the desktop and mobile split;
• traffic by country (top 5), top competitors, top organic keywords and traffic sources (Google, direct, referrals);
• AI traffic: visits from ChatGPT, Gemini, Perplexity, Claude and other AI assistants, with 6 months of history;
• 6-month history of organic and paid traffic, visits and backlinks;
• the global, country and category rank, and the month the numbers refer to.

Optional, per domain: a change monitor for scheduled runs (what moved since the previous run), a competitor landscape (the full overview of up to 7 competitors plus a ranking row), and Moz metrics (Domain Authority, spam score, linking domains) in the same row.

US$ 9.00 per 1,000 domains. No monthly fee, no start fee. Domains Semrush has not published, invalid input and failed domains are free.

Why this Semrush scraper

Built around the problems people report with Semrush scrapers on the store:

• Every domain you send comes back as a row. Either the full overview, or a free error row that names the domain and says why (NOT_IN_PUBLIC_DATABASE, BLOCKED, INVALID_DOMAIN). Never a "succeeded" run of empty, anonymous rows, and never a charge for a row without metrics.
• No caps. No 3-URL limit, no free-tier clamp, no paying-users-only toggles: thousands of domains in one run, about 400 in 2 minutes.
• One stable report, not a menu of modes. Traffic, engagement, Authority Score, backlinks, organic and paid traffic, countries, competitors and AI traffic all come from the same public overview page, so there is no search type that disappears "under maintenance".
• Retries before it gives up. New IP and new browser fingerprint on every retry, residential IPs if Semrush starts refusing, then a second pass at the end of the queue. Only then does a domain become a free BLOCKED row.
• A clear score at the end. The run's status message says how many domains were delivered and how many were not in Semrush's public database, blocked or invalid, all free.
• No Semrush account, no shared logins. It reads the free public pages, so nothing breaks when an account pool gets banned.

Switching from another Semrush scraper? Your existing input works

Paste the input you already use. These field names are read as they are:

Your field	What this Actor does with it
domains, urls, websites, startUrls, url, domain	The domains to check
q, queries, target, targets	The domains to check (domain, backlinks or competitors mode)
mode: "domain", "backlinks"	Domain overview, which includes backlinks and referring domains totals
mode: "competitors", includeCompetitors	Overview plus up to 7 competitors with their metrics (includeCompetitorDetails)
include_overview, include_traffic, include_authority	Always on: every row has overview, traffic and Authority Score
concurrency, maxConcurrency	Domains read at the same time (1 to 16, default 8)
include_moz	Adds Moz Domain Authority, spam score and linking domains to each row (includeMozMetrics)
database, db, country	Accepted and ignored: the public overview is worldwide with the top countries
mode: "keyword", keywords	Not available (keyword research is not on the public pages): one free UNSUPPORTED_MODE row explains it

Semrush scraper at a glance

• Price per 1,000 domains: US$ 9.00, no run start fee
• Semrush account: Not needed
• Per domain: Authority Score, backlinks, referring domains, organic and paid traffic, visits, engagement, countries, competitors, keywords, traffic sources, AI traffic, 6-month history
• Optional: Up to 7 competitors with their own traffic and engagement metrics, same price
• Competitor landscape: Full overview of up to 7 competitors (charged as domains) plus a free ranking row
• Moz metrics: Domain Authority, spam score, linking domains and 60-day link history in the same row, no extra charge
• Change monitor: What changed since the previous run; unchanged domains can be skipped and not charged
• Speed: About 400 domains in 2 minutes
• Error rows: Free, with the domain and an errorCode
• Subdomains: Optional fallback to the root domain (useRootDomain)

One real row

backlinko.com, collected on 2026-09-30 in the Apify cloud (lists shortened to one item):

{
  "type": "domain",
  "domain": "backlinko.com",
  "month": "2026-08",
  "mainCountry": "BD",
  "categories": ["Advertising and Marketing", "Computer Software and Development", "Online Services"],
  "globalRank": 83260,
  "authorityScore": 54,
  "backlinks": 2954511,
  "referringDomains": 75263,
  "googlePenaltyRisk": "Low",
  "organicTraffic": 223378,
  "organicTrafficChange": 0.4212,
  "paidTraffic": 0,
  "visits": 532050,
  "visitsChange": 0.1749,
  "pagesPerVisit": 1.87,
  "avgVisitDurationSeconds": 325,
  "bounceRate": 0.6971,
  "desktopShare": 0.8723,
  "trafficByCountry": [{ "country": "BD", "countryName": "Bangladesh", "visits": 245400, "share": 0.4612 }],
  "topCompetitors": [{ "domain": "seoreviewtools.com", "relevance": 0.34, "visits": 1050240 }],
  "topOrganicKeywords": [{ "keyword": "best seo tools", "position": 9, "searchVolume": 90500, "cpc": 0.29, "intents": ["informational"] }],
  "trafficSources": [{ "source": "Google organic", "domain": "google.com", "share": 0.384, "visits": 178241 }],
  "aiTrafficShare": 0.0176,
  "aiTrafficSources": [{ "source": "chatgpt.com", "name": "ChatGPT", "visits": 7287, "history": [{ "month": "2026-07", "visits": 9123 }] }],
  "searchTrafficHistory": [{ "month": "2026-08", "organic": 223378, "paid": 0 }],
  "visitsHistory": [{ "month": "2026-08", "visits": 532050, "desktopVisits": 464115, "mobileVisits": 67935 }],
  "backlinksHistory": [{ "month": "2026-08", "backlinks": 2954511, "referringDomains": 75263 }],
  "competitorDetails": [{ "domain": "seoreviewtools.com", "authorityScore": 52, "visits": 1050240, "bounceRate": 0.393 }],
  "semrushUrl": "https://www.semrush.com/website/backlinko.com/overview/"
}

In a cloud run of 400 popular domains, 329 came back with full data in 119 seconds, for example github.com Authority Score 100 with 1.21 billion visits, and notion.so Authority Score 59 with 32.2 million visits.

Website traffic checker in bulk

Check the monthly visits, bounce rate, pages per visit and visit duration of any list of websites, with the country and device split. Useful as a lighter alternative to Similarweb-style traffic data.

Authority Score and backlink checker

Get the Semrush Authority Score, total backlinks, referring domains and 6 months of backlink history for link building prospects, domain purchases or client reports.

Competitor analysis and AI traffic

See who competes with each domain, where its traffic comes from, which keywords bring the most visits, and how much traffic it gets from ChatGPT, Gemini, Perplexity and other AI assistants.

Monitor Semrush domain metrics on a schedule

Turn on monitorChanges and run the same Task every week or month. The Actor keeps the last state of every domain in a key-value store on your own account and adds to each row changes (what moved: month, authorityScore, globalRank, visits, traffic, backlinks, competitors, topKeywords, or new), authorityScoreChange, globalRankChange (positive = moved up), visitsChangeSinceLastRun and the same for organic, paid, backlinks and referring domains (fractions), aiTrafficShareChange, newCompetitors, lostCompetitors, newTopKeywords, lostTopKeywords and previousMonth.

With onlyChanged, domains that did not change are neither saved nor charged, so a daily schedule costs almost nothing until Semrush publishes a new month. A run where nothing changed returns one free NO_CHANGES row. The same domain list always compares with itself; set snapshotName to keep one history while the list changes.

{ "domains": ["client-one.com", "competitor.com"], "monitorChanges": true, "onlyChanged": true }

Video guides from Apify: how to schedule an Actor and how to connect it to other apps.

Competitor landscape

Turn on competitorLandscape to answer "who competes with this domain and how big are they". For each domain the Actor reads the competitors page, then the full overview of each competitor (up to maxLandscapeCompetitors, default 7), and adds:

• one row per competitor, a full domain overview with competitorOf (read once per run even if several of your domains share it);
• one summary row with type: "landscape": rankByVisits, rankByAuthorityScore, rankByOrganicTraffic, rankByAiTrafficShare, leaderByVisits, shareOfGroupVisits, shareOfGroupOrganicTraffic, and ranking (every domain of the group with its visits, Authority Score, organic and paid traffic, AI share, backlinks and position).

{ "domains": ["backlinko.com"], "competitorLandscape": true, "maxLandscapeCompetitors": 5 }

Moz metrics in the same row

Turn on includeMozMetrics (or send include_moz: true) to add Moz's free domain analysis: mozDomainAuthority, mozSpamScore, mozLinkingRootDomains, and in moz the ranking keywords, top pages by Page Authority, top linking domains and 60 days of linking domains gained and lost. Each domain uses a new residential IP (included). If Moz has no data, the Semrush row still comes back, with mozErrorCode.

Semrush scraper input

Field	What it does
domains	Domains or website links, one per line. https://www.backlinko.com/blog is read as backlinko.com
includeCompetitorDetails	Also read the competitors page: up to 7 competitors with Authority Score, ranks, visits and engagement, plus the site description. Same price
useRootDomain	Off by default. If a subdomain has no public page, read the root domain instead (docs.github.com -> github.com); the row keeps requestedDomain
competitorLandscape, maxLandscapeCompetitors	Full overview of up to 7 competitors per domain plus a summary row with the group ranking
includeMozMetrics	Add Moz Domain Authority, spam score, linking domains and link history
monitorChanges, onlyChanged, snapshotName	Compare with the previous run; optionally deliver only new and changed domains
proxyConfiguration	Apify Proxy by default; the Actor moves to residential IPs by itself if needed

{ "domains": ["amazon.com", "backlinko.com", "https://www.notion.so/pricing"], "includeCompetitorDetails": true }

Semrush domain data fields

domain, input, month (the month of the traffic data), searchDataDate, brandName, mainCountry, categories, globalRank, countryRank and countryRankCountry, categoryRank and categoryRankCategory, authorityScore, backlinks, backlinksChange, referringDomains, referringDomainsChange, googlePenaltyRisk, organicTraffic, organicTrafficChange, paidTraffic, paidTrafficChange, visits, visitsChange, pagesPerVisit, avgVisitDurationSeconds, bounceRate, desktopShare, mobileShare, trafficByCountry, topCompetitors, topOrganicKeywords, topKeywordsDatabase, trafficSources, outgoingTraffic, aiTrafficShare, aiTrafficSources, searchTrafficHistory, visitsHistory, backlinksHistory, semrushUrl, scrapedAt. With includeCompetitorDetails: description and competitorDetails. With useRootDomain, rows answered by the root domain also have requestedDomain. The Moz, monitor and landscape fields are listed in their sections above.

Shares, changes and rates are fractions: 0.4212 means 42.12%.

Error codes (never charged)

errorCode	Meaning
NOT_IN_PUBLIC_DATABASE	Semrush has no public overview page for this exact domain. Subdomains and many smaller or government sites are missing
INVALID_DOMAIN	Not a domain or website link
BLOCKED	Semrush did not answer after retries on new IPs; run again
NO_DATA	Semrush has a page for the domain but it shows no metrics
UNSUPPORTED_MODE	You asked for keyword research, which is not on Semrush's public pages
NO_CHANGES	onlyChanged is on and no domain changed since the previous run
NO_COMPETITORS	competitorLandscape is on but Semrush lists no competitors for the domain (its own row is still delivered)
NOT_REACHED, UNEXPECTED	The run timeout arrived, or something unforeseen broke; only that domain is lost

Semrush scraper pricing

Event	Per 1,000
Domain overview delivered	US$ 9.00

1,000 domains cost US$ 9.00. Duplicates in the input are checked once, error rows are free, and there is no Apify compute bill on top.

Options: competitor details, Moz metrics and the landscape summary row have no extra charge. In the competitor landscape, each competitor's own overview row is a domain row and is charged like any domain. With onlyChanged, unchanged domains are not charged.

Semrush scraper FAQ

Why not the official Semrush API? The Semrush API needs a paid Business plan plus API units bought separately. This Actor reads the free public domain overview pages, so you pay only per domain delivered.

Are there rate limits? Can I schedule it every hour? There is no per-user quota. Large batches are fine: the Actor reads 8 domains at a time, retries with new IPs on its own and gives each blocked domain a second pass before it becomes a free BLOCKED row. Hourly schedules of a few hundred domains work; for tens of thousands, one bigger run is faster than many small ones.

Do I get Moz DA or spam score? Yes, with includeMozMetrics (or include_moz). They come from Moz's free domain analysis page, read with a new residential IP per domain; no Moz account needed. Every row also has Semrush's own Authority Score, backlinks and referring domains.

Can I track a domain month over month? Yes. Save the input as a Task with monitorChanges on and schedule it. Each run compares with the previous one and says what changed; with onlyChanged you pay only for domains that moved.

Do I get the top paid keywords? No. The public page shows paid traffic and its 6-month history, not the paid keyword list.

Why is my domain missing? Semrush publishes free overview pages for a large set of popular domains, not for every site. In our tests about 8 in 10 popular domains had a page. Missing ones come back as a free NOT_IN_PUBLIC_DATABASE row with the domain name, so you always know which ones to check elsewhere. For subdomains, turn on useRootDomain.

Do I get the organic keyword count or unique visitors? No. Those numbers are not on the public pages; only the top 5 organic keywords and total visits are.

How fresh is the data? It is what Semrush shows that day; the month field says which month the numbers refer to (usually the previous month).

Are these the same numbers as a paid Semrush account? They are the numbers Semrush publishes on its free public domain overview page (semrush.com/website/<domain>/overview/), read exactly as any visitor sees them in a browser. No Semrush account is involved and nothing is logged in. A paid account shows deeper reports (full keyword and backlink lists, more competitors, filters by date and country) that are not on the public page; this Actor delivers what the public page shows, no more.

Semrush scraper limitations

• Only root domains that Semrush has published; subdomains like blog.example.com are not covered.
• Lists are as long as Semrush shows them: 5 countries, 3 competitors (7 with includeCompetitorDetails), 5 keywords, 5 traffic sources, 5 AI sources, 6 months of history.
• This Actor reads public pages only. Semrush and Authority Score are trademarks of Semrush; this Actor is not affiliated with Semrush.

Related scrapers

• Similarweb Scraper: website traffic, rank and competitors from Similarweb.
• Moz Domain Authority Checker: bulk Domain Authority, links and spam score.
• Keyword Search Volume: Google Ads search volume, CPC and competition.
• SEO Site Audit: site crawler with broken links, sitemap and score.
• Tech Stack Detector: the technologies a website runs on.

Changelog

• 2026-10-18: Change monitor (monitorChanges, onlyChanged, snapshotName), competitor landscape (competitorLandscape: full overview of up to 7 competitors plus a ranking row) and Moz metrics (includeMozMetrics, include_moz). Runs with the old input deliver the same rows.

• 2026-10-08: Field names from other Semrush actors are accepted (urls, q, queries, target, mode, concurrency...). Blocked domains get a second pass at the end of the queue before the free BLOCKED row. Pages without any metric become a free NO_DATA row instead of a charged empty row. Keyword modes return a free UNSUPPORTED_MODE row instead of an empty run. Optional useRootDomain for subdomains. The status message shows delivered, missing and blocked counts. Runs with the old input deliver the same rows.

• 2026-09-30, 0.1: first release. Bulk Authority Score, backlinks, organic and paid traffic, visits and engagement, countries, competitors, keywords, traffic sources, AI traffic and 6-month history; optional competitor details; free error rows.