# Semrush Scraper: Authority Score, Traffic & Backlinks (`tablewise/semrush-domain-metrics-scraper`) Actor

Get Semrush Authority Score, backlinks, referring domains, monthly visits, bounce rate and penalty risk for hundreds of domains in one run. No Semrush subscription or API key. USD 5 per 1,000 domains with data; domains without data are free. Export to JSON, CSV or Excel, or use the API.

- **URL**: https://apify.com/tablewise/semrush-domain-metrics-scraper.md
- **Developed by:** [table wise](https://apify.com/tablewise) (community)
- **Categories:** SEO tools, Marketing
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 domain metrics

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### What is Semrush Scraper?

Semrush Scraper gets the Semrush Authority Score, backlinks, referring domains
and monthly traffic of hundreds of domains in one run — no Semrush
subscription, no API key, no login. Paste a list of domains, get a
spreadsheet. **USD 5 per 1,000 domains with data**; domains Semrush has no
data for are free.

### What you can do with it

- Check the Authority Score of 500 prospect sites for link building without
  pasting them into Semrush one by one: a bulk domain authority checker.
- Rank a list of competitors or acquisition targets by backlinks and traffic:
  a website traffic checker for a whole list.
- Track your clients' domains every week on a schedule and export to a sheet.
- Let an AI agent look up domain authority through Apify's MCP server.

### Use cases

Ready-to-run examples, with the input already filled in:

- [Check Semrush Authority Score for a list of domains](https://apify.com/tablewise/semrush-domain-metrics-scraper/examples/bulk-semrush-authority-score-checker):
  Authority Score, backlinks, referring domains and monthly visits for five
  well-known sites.
- [Compare competitors' website traffic and backlinks](https://apify.com/tablewise/semrush-domain-metrics-scraper/examples/compare-competitor-website-traffic):
  four CRM vendors side by side (HubSpot, Salesforce, Zoho and monday.com).

### Example output

One row per domain you enter. This is a real run (2026-11-20) with
`https://www.github.com/features` and a domain Semrush has no data for:

```json
[
  {
    "domain": "github.com",
    "authority_score": 100,
    "backlinks": 5391798656,
    "referring_domains": 4384519,
    "monthly_visits": 1074908407,
    "pages_per_visit": 5.8732,
    "bounce_rate": 0.3963,
    "google_penalty_risk": "Low",
    "data_date": "2026-10-01",
    "source_url": "https://www.semrush.com/website/github.com/overview/",
    "input": "https://www.github.com/features",
    "status": "ok",
    "status_message": null,
    "scraped_at": "2026-11-20T21:46:36Z"
  },
  {
    "domain": "zzqx-no-data-example-18273.com",
    "authority_score": null,
    "backlinks": null,
    "referring_domains": null,
    "monthly_visits": null,
    "pages_per_visit": null,
    "bounce_rate": null,
    "google_penalty_risk": null,
    "data_date": null,
    "source_url": "https://www.semrush.com/website/zzqx-no-data-example-18273.com/overview/",
    "input": "zzqx-no-data-example-18273.com",
    "status": "no_data",
    "status_message": "Semrush has no public data for this domain (common for small, new or technical domains). Not charged.",
    "scraped_at": "2026-11-20T21:46:38Z"
  }
]
```

| Field | What it is |
| --- | --- |
| `domain` | The domain you entered, normalized (no `https://`, no `www.`, no path) |
| `authority_score` | Semrush Authority Score, 0–100 |
| `backlinks` | Total backlinks Semrush reports for the domain |
| `referring_domains` | Number of unique domains linking to it |
| `monthly_visits` | Estimated monthly visits |
| `pages_per_visit` | Average pages per visit |
| `bounce_rate` | Bounce rate as a fraction (0.32 = 32 %) |
| `google_penalty_risk` | Semrush's penalty-risk label |
| `data_date` | Date of the Semrush snapshot the numbers come from |
| `source_url` | The public Semrush page the data was read from |
| `input` | The line exactly as you entered it |
| `status` | `ok`, or why there are no metrics (table below) |
| `status_message` | The reason in plain words; empty for `ok` rows |
| `scraped_at` | When the row was produced (UTC) |

| `status` | What it means | Charged? |
| --- | --- | --- |
| `ok` | The domain has Semrush data | Yes |
| `no_data` | Semrush has no public data for the domain | No |
| `invalid_input` | The line is not a domain or a URL | No |
| `blocked` | Semrush blocked the request; try again later | No |
| `error` | Semrush answered with an unexpected page | No |

### What it costs

| Event | Price |
| --- | --- |
| Actor start | USD 0.0005 per run |
| Domain result | USD 0.005 per domain |

**Example:** 1,000 domains with data = USD 5.00, plus USD 0.0005 per run.

You only pay for rows with `status` `ok`. Domains without data, lines that
are not domains, blocked pages and unexpected pages are not charged.
Repeated domains are skipped, even when written differently
(`github.com` and `https://www.github.com/`), so they are never charged
twice.

#### How many domains can I check with the free plan?

Apify's free plan includes USD 5 of credit every month. Used only for
this Actor, that is about 995 domains with data: for example, 5 runs of 199
domains = 5 × (0.0005 + 199 × 0.005) = USD 4.98. Domains without data cost
nothing.

### How to use it

1. Paste your domains into the **Domains** field, one per line. Full URLs
   work too.
2. Click **Start** and download the results as JSON, CSV or Excel.

With an empty input it checks two sample domains (`github.com` and
`stackoverflow.com`), so you can see the output first.

#### Input

| Field | Type | Default | What it does |
| --- | --- | --- | --- |
| `domains` | array | `["github.com", "stackoverflow.com"]` | Domains or URLs, one per item |
| `maxResults` | integer | 1000 | Processes only the first N domains, so you never pay for more than N results |
| `delayBetweenRequests` | integer | 1 | Seconds between requests |
| `proxyConfiguration` | object | `{"useApifyProxy": true}` | Apify Proxy settings (on by default) |

### Use it from the API, n8n or an AI agent

**API.** This call runs the Actor and returns the rows when it finishes (it
waits up to 5 minutes; for longer runs, start the run and read its dataset
when it ends):

```bash
curl -X POST "https://api.apify.com/v2/acts/tablewise~semrush-domain-metrics-scraper/run-sync-get-dataset-items" \
  -H "Authorization: Bearer <YOUR_APIFY_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"domains": ["github.com", "stackoverflow.com"]}'
```

**Python**, with the official client (`pip install "apify-client>=3"`):

```python
from apify_client import ApifyClient

client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("tablewise/semrush-domain-metrics-scraper").call(
    run_input={"domains": ["github.com", "stackoverflow.com"]}
)
for row in client.dataset(run.default_dataset_id).iterate_items():
    print(row["domain"], row["status"], row["authority_score"])
```

**n8n, Make or Zapier.** With the Apify node or app, run the Actor
`tablewise/semrush-domain-metrics-scraper` with `{"domains": [...]}` as the
input, then read the items of its dataset.

**For AI agents (MCP).** Add Apify's MCP server (`https://mcp.apify.com`)
and call the Actor `tablewise/semrush-domain-metrics-scraper`:

- Input: `{"domains": ["example.com"]}`. Every other field has a default.
  `{}` checks two sample domains.
- Output: exactly one row per distinct domain, with `status`. Only `ok`
  rows have metrics and only they are charged (USD 0.005 each, plus USD
  0.0005 per run).
- Rows that are not `ok` are free and say why in `status_message`:
  `no_data`, `invalid_input`, `blocked` or `error`.
- A run takes about 1 to 5 seconds per domain (one request at a time).

### Limits and known issues

- It reads Semrush's **public domain overview page** only. It does not return
  keyword lists, the backlink list itself, or anything that needs a Semrush
  account.
- Small, new or non-public sites (CDNs, API hosts, parked domains) usually
  have no data and come back as `no_data`: in a test with 600 domains from a
  public top-sites list, 245 had data.
- Numbers are Semrush's estimates, as of the `data_date` shown in each row.
- Speed: in our tests, 13 to 30 domains with data per minute, depending on
  how fast Semrush answers. Domains without data go faster. It sends one request
  at a time with a pause in between, so 1,000 domains can take about an
  hour.
- Data comes from publicly available pages. No personal data is collected.

### FAQ

#### Do I need a Semrush account or API key?

No. It reads the public domain overview page that Semrush shows to any
visitor: no subscription, no API key and no API units.

#### Is this a Semrush API alternative?

For domain-level metrics, yes: Authority Score, backlinks, referring domains
and traffic for any list of domains, by API, without Semrush API units. It
does not cover keyword research or full backlink lists.

#### How do I check domain authority in bulk?

Paste all your domains into **Domains** (or send them in `domains` through
the API) and run it once. Each domain comes back with its Authority Score,
and the whole list exports to CSV or Excel.

#### Does it give me the list of backlinks?

No. It gives the totals Semrush shows on the overview page: the number of
backlinks and of referring domains, not the links themselves.

#### Why do some domains come back as `no_data`?

Semrush has no public data for many small, new or technical domains, such as
CDNs, API hosts and parked domains. Those rows say `no_data` and are not
charged.

#### How current are the numbers?

They are Semrush's own estimates. Each row includes `data_date`, the date of
the Semrush snapshot the numbers come from.

#### Is it legal to scrape Semrush?

This Actor only reads pages that anyone can open without logging in, and it
does not collect personal data. Whether scraping is allowed depends on your
country and on how you use the data, and Semrush's terms of use may
restrict automated access. If you are not sure, ask a lawyer.

#### Can I schedule it or send the results to other tools?

Yes. You can run it on a schedule, export each run as JSON, CSV or Excel, get
a webhook when it finishes, and connect it to Make, Zapier, n8n, Google
Drive, Slack and other tools through Apify integrations.

### Support

Found a problem? Open an issue on the Actor's **Issues** tab with the run ID
and we'll look into it. If the Actor is useful to you, a rating on its Store
page helps other people find it.

### More Actors from the same developer

- [Website Email & Contact Scraper](https://apify.com/tablewise/website-email-contact-scraper): emails, phones and social profiles from any list of websites.
- [LinkedIn Company Scraper](https://apify.com/tablewise/linkedin-company-scraper): size, industry, employees, website and offices of any LinkedIn company page.
- [Google Trends Scraper](https://apify.com/tablewise/google-trends-scraper): interest over time, interest by region and related queries for any keyword.
- [YouTube Transcript & Subtitles Scraper](https://apify.com/tablewise/youtube-transcript-scraper): the transcript of any YouTube video, Short or channel as text or SRT, with the video details.
- [LinkedIn Jobs Scraper](https://apify.com/tablewise/linkedin-jobs-scraper): LinkedIn job postings with full description, salary, seniority and applicants, without login.
- [Company Jobs Scraper: Workday, Greenhouse, Lever & Ashby](https://apify.com/tablewise/workday-greenhouse-lever-jobs-scraper): every open job from company careers sites on those four platforms.
- [Google Hotels Scraper](https://apify.com/tablewise/google-hotels-scraper): hotel prices for your dates, ratings and prices by booking site.
- [AliExpress Search Scraper](https://apify.com/tablewise/aliexpress-search-scraper): prices, discounts, ratings and units sold from any AliExpress search.
- [Amazon Best Sellers Scraper](https://apify.com/tablewise/amazon-bestsellers-scraper): the top 100 of any Amazon.com Best Sellers or Hot New Releases list.
- [Amazon Product Details Scraper](https://apify.com/tablewise/amazon-product-details-scraper): price, Best Sellers Rank, specs and images for any list of ASINs.
- [Tennis Results & Odds Scraper](https://apify.com/tablewise/tennis-results-scraper): ATP, WTA, Challenger and ITF results and fixtures with set scores and betting odds.

# Actor input Schema

## `domains` (type: `array`):

Enter one domain per line, for example github.com. Full URLs work too; repeated domains are skipped.

## `maxResults` (type: `integer`):

Process only the first N domains of your list, so you never pay for more than N.

## `delayBetweenRequests` (type: `integer`):

Wait this long between pages. Lower is faster but more likely to be blocked.

## `proxyConfiguration` (type: `object`):

Apify Proxy is on by default and recommended for this site.

## Actor input object example

```json
{
  "domains": [
    "github.com",
    "stackoverflow.com"
  ],
  "maxResults": 1000,
  "delayBetweenRequests": 1,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `results` (type: `string`):

One row per domain: Authority Score, backlinks, referring domains, monthly visits, pages per visit, bounce rate and Google penalty risk from Semrush's public overview page. Domains without data come as free rows with status no_data.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "github.com",
        "stackoverflow.com"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("tablewise/semrush-domain-metrics-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "domains": [
        "github.com",
        "stackoverflow.com",
    ],
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("tablewise/semrush-domain-metrics-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "github.com",
    "stackoverflow.com"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call tablewise/semrush-domain-metrics-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,tablewise/semrush-domain-metrics-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/ga6fThnXN1pClsGDI/builds/9TPityxbz99jJo8eQ/openapi.json
