# Semrush Scraper — Traffic, Authority, Backlinks & Top Websites (`memo23/semrush-scraper`) Actor Turn any domain into structured Semrush SEO data — Authority Score, traffic, global/country/category ranks, backlinks, referring domains, top keywords and AI-search traffic. Or pull the top websites by country + industry. Bulk domains or URLs in, one row each. No Semrush seat or API key. - **URL**: https://apify.com/memo23/semrush-scraper.md - **Developed by:** [Muhamed Didovic](https://apify.com/memo23) (community) - **Categories:** SEO tools, AI, Agents - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $5.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Semrush Scraper Turn any domain into structured **Semrush website-overview data** — Authority Score, traffic estimates, global/country/category ranks, backlinks, referring domains, top competitors, top organic keywords, and even AI/LLM traffic. Paste one domain or a thousand; each returns a single clean, export-ready row. Two modes in one Actor: **Domain overview** (look up any list of domains) and **Top websites** (the ranked leaders for a country + industry, with traffic and month/year growth). No Semrush seat, no API key, no login. This Actor reads Semrush's own public website-overview pages and hands you the numbers as JSON, CSV, or Excel. #### How it works ![How Semrush Scraper works](https://raw.githubusercontent.com/muhamed-didovic/muhamed-didovic.github.io/main/assets/how-it-works-semrush.png) #### ✨ Why use this scraper? - **Full domain overview in one row** — Authority Score, traffic, ranks, backlinks, engagement, competitors, keywords and AI traffic, flattened into table-friendly columns plus nested detail. - **Bulk by design** — feed 1 or 1,000 domains in a single run; results stream in parallel, one row per domain. - **No Semrush account needed** — reads only public website-overview data, so there is no seat cost, API quota, or login to manage. - **AI-search visibility included** — see how much traffic ChatGPT, Gemini, Grok and other LLMs send to a domain. - **Flexible input** — bare domains, full site URLs, or Semrush overview URLs all work; `www.` and paths are stripped automatically. - **Export anywhere** — JSON, CSV, Excel, XML or the Apify API, straight out of the dataset. #### 🎯 Use cases | Audience | What they get | |---|---| | **SEO specialists & agencies** | Bulk Authority Score, traffic and backlink profiles for a whole client roster without buying extra Semrush seats. | | **Competitive analysts** | Top organic + paid competitors per domain, with estimated visits and relevance, to map a market. | | **Content & keyword teams** | Top organic keywords with search volume, CPC, position and decoded intent for any domain. | | **AI / LLM researchers** | Per-LLM traffic share (ChatGPT, Gemini, Grok…) to track which brands AI assistants send traffic to. | | **Growth & BD teams** | Traffic, rank and engagement signals to qualify prospects, partners or acquisition targets at scale. | | **Data teams & dashboards** | Monthly history arrays and per-country/per-device splits to feed BI tools and trend charts. | #### 📥 Supported inputs **Mode 1 — Domain overview** (`mode: "domains"`): supply a list of domains. | Input form | Example | Result | |---|---|---| | Bare domain | `stripe.com` | Overview for stripe.com | | Full site URL | `https://stripe.com/pricing` | Host extracted → stripe.com | | Subdomain / path | `blog.hubspot.com/marketing` | Host extracted → blog.hubspot.com | | Semrush overview URL | `https://www.semrush.com/website/stripe.com/overview/` | Domain parsed out → stripe.com | **Mode 2 — Top websites** (`mode: "top_websites"`): supply a country + industry and get the ranked leaders. | Field | Example | Result | |---|---|---| | Country | `us` or `united-states` | Ranking scoped to that country | | Industry | `finance`, `retail`, `all` | Ranking scoped to that industry | | Limit | `100` | Top N domains (max 100) | | Enrich | `true` | Each ranked domain also gets a full overview scrape | **Not supported:** keyword-only research (volume/CPC for a bare keyword with no domain), position-tracking projects, or any data that Semrush gates behind a logged-in seat. Domains with no Semrush coverage return no row (they are logged and skipped, never billed). #### 🔄 How it works 1. **Normalise** each input into a clean registrable domain (strip scheme, `www.`, path, query; dedupe). 2. **Fetch** the domain's public Semrush overview page — a single HTTP request per domain, run in parallel with a global sliding window. 3. **Decode** the metrics embedded in the page's rendered state. 4. **Flatten** the headline KPIs into table columns and keep the rich sections (history, per-country, per-device, journey, competitors, keywords, AI traffic) as nested fields. 5. **Push** exactly one row per domain to the dataset. A domain Semrush has no data for is skipped with a clear log line. #### ⚙️ Input parameters | Field | Type | Default | Description | |---|---|---|---| | `mode` | string | `domains` | `domains` (look up domains) or `top_websites` (ranking by country + industry). | | `domains` | array | `["stripe.com", …]` | *(domains mode)* Domains or URLs to analyse. One row per unique domain. | | `topWebsitesCountry` | string | `us` | *(top websites)* 2-letter code (`us`, `gb`) or full slug (`united-states`). | | `topWebsitesIndustry` | string | `all` | *(top websites)* Industry slug (`all`, `finance`, `retail`, `news`…). | | `topWebsitesLimit` | integer | `100` | *(top websites)* How many ranked domains to return (1–100). | | `enrichTopWebsites` | boolean | `false` | *(top websites)* Also run a full overview scrape per ranked domain. | | `includeHistory` | boolean | `true` | Month-by-month history for visits, organic/paid, backlinks, referring domains. | | `includeTrafficByCountry` | boolean | `true` | Per-country traffic with device split and share. | | `includeTrafficByDevice` | boolean | `true` | Desktop vs mobile visit history. | | `includeTrafficJourney` | boolean | `true` | Inbound / outbound referral hosts. | | `includeCompetitors` | boolean | `true` | Top organic + paid competitor domains. | | `includeKeywords` | boolean | `true` | Top organic keywords (volume, CPC, position, intent). | | `includeAiTraffic` | boolean | `true` | AI / LLM traffic sources and share. | | `includeSiteAudit` | boolean | `false` | On-page SEO audit block (usually empty unless already crawled). | | `maxItems` | integer | `1000` | Hard cap on domains processed per run. | | `maxConcurrency` | integer | `10` | Domains fetched in parallel. | | `proxy` | object | Apify Residential | Proxy used to reach Semrush. Residential recommended. | > The `include*` toggles trim the **output** only — every section arrives in the same single request, so turning them off does not change the price. Use them to keep rows lean when you only need headline KPIs. #### 📊 Output overview Each dataset row is one domain. The top of the row is a flat block of headline KPIs (Authority Score, ranks, visits, organic/paid traffic, engagement, backlinks, device split, top competitor, AI traffic share) that render as plain columns in the Apify table view. Below that sit the nested detail sections — monthly history, per-country and per-device breakdowns, the traffic journey, the full competitor list, top keywords, and AI-traffic sources — each gated by its `include*` toggle. #### 📦 Output sample ```json { "type": "domain_overview", "domain": "stripe.com", "url": "https://www.semrush.com/website/stripe.com/overview/", "dataMonth": "2026-05-15", "dateModified": "2026-06-12", "country": "US", "categories": ["Computer Software and Development", "Finance", "Information Technology", "Online Services"], "authorityScore": 79, "googlePenaltyRisk": "Low", "globalRank": 167, "countryRank": 165, "categoryRank": 6, "categoryRankName": "Finance", "visits": 190046716, "visitsChange": 0.1381, "organicTraffic": 5485936, "paidTraffic": 311438, "bounceRate": 0.6053, "pagesPerVisit": 2.8708, "avgVisitDurationSec": 508, "backlinks": 181169732, "referringDomains": 609490, "desktopShare": 0.4972, "mobileShare": 0.5028, "topCountry": "United States", "topCountryTraffic": 53060565, "competitorsCount": 3, "topCompetitor": "gocardless.com", "aiTrafficShare": 0.0608, "competitors": [ { "name": "gocardless.com", "relevance": 0.16, "visits": 2688810 } ], "topKeywords": [ { "keyword": "stripe", "position": 1, "searchVolume": 550000, "cpc": 5.18, "traffic": 0.2294 } ], "trafficByCountry": [ { "countryName": "United States", "traffic": 53060565, "trafficShare": 0.2792, "desktopShare": 0.4296, "mobileShare": 0.5704 } ], "trafficAi": [ { "id": "grok.com", "name": null, "traffic": { "value": 5518189, "share": 0.03663 } } ], "scrapedAt": "2026-07-10T22:44:21.115Z" } ```` #### 🗂 Key output fields | Field | Type | Description | |---|---|---| | **Identity** | | | | `domain` | string | Registrable domain the row describes. | | `country` | string | Primary country for the traffic data. | | `categories` | string\[] | Semrush business categories for the domain. | | `dataMonth` / `dateModified` | string | Reference month of the data / date Semrush last updated it. | | **Authority & rank** | | | | `authorityScore` | number | Semrush Authority Score (0–100). | | `googlePenaltyRisk` | string | Backlink penalty-risk label (e.g. `Low`). | | `globalRank` / `countryRank` / `categoryRank` | number | Semrush traffic ranks. | | `categoryRankName` | string | The category the `categoryRank` applies to. | | **Traffic & engagement** | | | | `visits` / `visitsChange` | number | Monthly visits and month-over-month change. | | `organicTraffic` / `paidTraffic` | number | Estimated organic and paid search traffic. | | `bounceRate` / `pagesPerVisit` / `avgVisitDurationSec` | number | Engagement metrics. | | `desktopShare` / `mobileShare` | number | Device split of visits. | | `topCountry` / `topCountryTraffic` | string / number | Largest traffic country and its volume. | | **Backlinks** | | | | `backlinks` / `referringDomains` | number | Total backlinks and unique referring domains. | | **Competition & keywords** | | | | `competitorsCount` / `topCompetitor` | number / string | Competitor count and the closest one. | | `competitors[]` | object\[] | Competitor domains with relevance + estimated visits. | | `topKeywords[]` | object\[] | Top organic keywords: volume, CPC, position, intent, traffic share. | | **AI traffic** | | | | `aiTrafficShare` | number | Combined share of traffic from AI/LLM sources. | | `trafficAi[]` | object\[] | Per-LLM traffic (ChatGPT, Gemini, Grok…) with share and history. | | **History & breakdowns** | | | | `visitsHistory` / `searchTrafficHistory` / `backlinksHistory` / `referringDomainsHistory` | object\[] | Monthly time series. | | `trafficByCountry[]` | object\[] | Per-country traffic with device split. | | `trafficByDeviceHistory[]` | object\[] | Desktop vs mobile visits over time. | | `trafficJourney` | object | Inbound and outbound referral hosts. | | `scrapedAt` | string | ISO timestamp of the scrape. | #### 🏆 Top Websites output In `top_websites` mode each row is one ranked domain. With `enrichTopWebsites` off (default), rows are lightweight ranking records; with it on, each row is a full domain-overview (as above) plus `rank`, `industry` and `rankingCountry`. ```json { "type": "top_website", "rank": 1, "domain": "yahoo.com", "country": "us", "industry": "finance", "dataMonth": "2026-05-01", "totalTraffic": 1108419488, "desktopTraffic": 458469356, "desktopShare": 0.4136, "mobileTraffic": 649950132, "mobileShare": 0.5864, "momChange": 0.0654, "yoyChange": -0.1345, "topSource": "direct" } ``` | Field | Type | Description | |---|---|---| | `rank` | number | Position in the country × industry ranking (1 = highest traffic). | | `domain` | string | The ranked domain. | | `totalTraffic` | number | Estimated monthly visits. | | `desktopTraffic` / `mobileTraffic` | number | Device-split visit estimates. | | `desktopShare` / `mobileShare` | number | Device split as a 0–1 fraction. | | `momChange` / `yoyChange` | number | Month-over-month and year-over-year change (0–1 fraction, can be negative). | | `topSource` | string | Largest traffic source (e.g. `direct`, `search`). | #### ❓ FAQ **Do I need a Semrush subscription or API key?** No. This Actor reads Semrush's public website-overview pages, so there is nothing to log into and no API quota to manage. **How accurate are the numbers?** They are Semrush's own publicly published estimates for each domain — the same figures shown on the public overview page. They are modelled traffic estimates, not server-side analytics, and update roughly monthly (`dataMonth` tells you the reference period). **What happens for a domain Semrush doesn't cover?** Semrush returns a 404 for domains it has no data on. The Actor detects this immediately, logs it as "not found — no coverage", and moves on. No row is pushed and you are not billed for it. **Can I get keyword volume for a keyword that isn't tied to a domain?** Not in this Actor — standalone keyword research is gated behind a Semrush login. You do get each domain's top organic keywords (with volume, CPC, position and intent) as part of its overview row. **Why is `competitors` sometimes empty?** Semrush controls whether the competitors block is exposed on the public overview page, and it toggles this per data snapshot — some months it's fully populated, some months it's withheld (the page returns it hidden). When Semrush exposes it you get the full competitor list; when it doesn't, `competitors` is an empty array. Every other section (traffic, ranks, backlinks, keywords, AI traffic, per-country/device) is unaffected. **How do I get the top websites in my industry?** Set `mode` to `top_websites`, pick a `topWebsitesCountry` (e.g. `us`) and `topWebsitesIndustry` (e.g. `finance`, or `all`). You get up to 100 ranked domains with traffic, device split and month/year growth in a single request. Turn on `enrichTopWebsites` to also pull a full overview for each ranked domain. **Why is `siteAudit` empty?** The on-page SEO audit only has data when Semrush has already crawled the domain for a project. It is off by default; enable `includeSiteAudit` if you specifically want that block. #### 💬 Support Found a domain that parses oddly or a field you'd like added? Open an issue on the Actor's **Issues** tab in the Apify Console and include the exact input you ran. Feature requests for extra fields are welcome. #### 🛠 Additional services Need this wired into a pipeline, scheduled, or combined with other data sources? The same team builds custom scrapers and enrichment flows across job boards, marketplaces, real-estate, and SEO/analytics platforms — reach out via the Apify Store profile. #### 🔎 Explore more scrapers Looking at the wider SEO/analytics stack? Compare domains across tools by pairing this with Similarweb, Ahrefs, Moz and Ubersuggest scrapers for a triangulated view of authority and traffic. *** ### ⚠️ Disclaimer This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Semrush Inc. or any of its subsidiaries or affiliates. "Semrush" and all related trademarks are the property of their respective owners. The scraper accesses only publicly available Semrush website-overview pages — no authenticated endpoints, no paid-seat features, and no content behind a Semrush login. All metrics are Semrush's own publicly published estimates. Users are responsible for ensuring their use complies with Semrush's Terms of Service, applicable data-protection law (GDPR, CCPA, etc.), and any contractual obligations of their own organisation. *** ### SEO Keywords semrush scraper, scrape semrush, semrush api, semrush data export, apify semrush, website traffic scraper, domain authority score scraper, seo data scraper, backlink data scraper, referring domains scraper, competitor analysis scraper, organic keywords scraper, keyword volume cpc scraper, traffic analytics scraper, ai traffic scraper, chatgpt traffic scraper, domain overview api, bulk domain seo data, seo rank tracker data, top websites ranking scraper, trending websites scraper, top sites by industry, semrush alternative scraper, similarweb alternative scraper, marketing intelligence data # Actor input Schema ## `mode` (type: `string`): Choose 'Domain overview' to look up specific domains, or 'Top websites' to list the top-ranked sites for a country and industry. ## `domains` (type: `array`): List of websites to look up on Semrush. Accepts bare domains (e.g. stripe.com), full site URLs (e.g. https://stripe.com/pricing), or Semrush overview URLs (e.g. https://www.semrush.com/website/stripe.com/overview/). www. and paths are stripped automatically. Add in bulk via the Bulk edit tab. ## `topWebsitesCountry` (type: `string`): Country for the ranking. Use a 2-letter code (us, gb, de, in, br…) or the full Semrush slug (united-states). Defaults to the United States. ## `topWebsitesIndustry` (type: `string`): Industry to rank within. Use 'all' for every industry, or a Semrush industry slug such as finance, retail, news, travel-and-tourism, real-estate, healthcare, education, computer-software-and-development, online-services, advertising-and-marketing. ## `topWebsitesLimit` (type: `integer`): How many ranked domains to return (1-100). ## `enrichTopWebsites` (type: `boolean`): When on, each ranked domain is also run through the full domain-overview scrape (Authority Score, backlinks, competitors, keywords, etc.). Adds one request and one richer row per domain. Off by default — the ranking alone is a single request for up to 100 rows. ## `includeHistory` (type: `boolean`): Month-by-month history arrays for visits, organic/paid traffic, backlinks and referring domains. ## `includeTrafficByCountry` (type: `boolean`): Per-country traffic breakdown with desktop/mobile split and traffic share. ## `includeTrafficByDevice` (type: `boolean`): Desktop vs mobile visit history. ## `includeTrafficJourney` (type: `boolean`): Inbound and outbound referral hosts (where visitors come from and go next). ## `includeCompetitors` (type: `boolean`): Top organic + paid competitor domains with relevance and estimated visits. ## `includeKeywords` (type: `boolean`): Top organic keywords with search volume, CPC, position, decoded intent and traffic share. ## `includeAiTraffic` (type: `boolean`): AI / LLM traffic sources (ChatGPT, Gemini, Grok, etc.) with share of total AI traffic. ## `includeSiteAudit` (type: `boolean`): On-page SEO audit block (health score, crawled/broken pages). Usually empty unless Semrush has already crawled the domain, so it is off by default. ## `maxItems` (type: `integer`): Hard cap on the number of domains processed in one run. ## `maxConcurrency` (type: `integer`): Maximum number of domains fetched in parallel. ## `proxy` (type: `object`): Proxy used to reach Semrush. Residential proxies are recommended — datacenter IPs can be throttled by Semrush. ## Actor input object example ```json { "mode": "domains", "domains": [ "stripe.com", "notion.so", "figma.com" ], "topWebsitesCountry": "us", "topWebsitesIndustry": "all", "topWebsitesLimit": 100, "enrichTopWebsites": false, "includeHistory": true, "includeTrafficByCountry": true, "includeTrafficByDevice": true, "includeTrafficJourney": true, "includeCompetitors": true, "includeKeywords": true, "includeAiTraffic": true, "includeSiteAudit": false, "maxItems": 1000, "maxConcurrency": 10, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "domains": [ "stripe.com", "notion.so", "figma.com" ], "topWebsitesCountry": "us", "topWebsitesIndustry": "all", "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("memo23/semrush-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "domains": [ "stripe.com", "notion.so", "figma.com", ], "topWebsitesCountry": "us", "topWebsitesIndustry": "all", "proxy": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("memo23/semrush-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "domains": [ "stripe.com", "notion.so", "figma.com" ], "topWebsitesCountry": "us", "topWebsitesIndustry": "all", "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call memo23/semrush-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=memo23/semrush-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Semrush Scraper — Traffic, Authority, Backlinks & Top Websites", "description": "Turn any domain into structured Semrush SEO data — Authority Score, traffic, global/country/category ranks, backlinks, referring domains, top keywords and AI-search traffic. Or pull the top websites by country + industry. Bulk domains or URLs in, one row each. No Semrush seat or API key.", "version": "0.0", "x-build-id": "BAFFXXjjZeEtxgbdp" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/memo23~semrush-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-memo23-semrush-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/memo23~semrush-scraper/runs": { "post": { "operationId": "runs-sync-memo23-semrush-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/memo23~semrush-scraper/run-sync": { "post": { "operationId": "run-sync-memo23-semrush-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Mode", "enum": [ "domains", "top_websites" ], "type": "string", "description": "Choose 'Domain overview' to look up specific domains, or 'Top websites' to list the top-ranked sites for a country and industry.", "default": "domains" }, "domains": { "title": "Domains or URLs", "type": "array", "description": "List of websites to look up on Semrush. Accepts bare domains (e.g. stripe.com), full site URLs (e.g. https://stripe.com/pricing), or Semrush overview URLs (e.g. https://www.semrush.com/website/stripe.com/overview/). www. and paths are stripped automatically. Add in bulk via the Bulk edit tab.", "items": { "type": "string" } }, "topWebsitesCountry": { "title": "Country", "type": "string", "description": "Country for the ranking. Use a 2-letter code (us, gb, de, in, br…) or the full Semrush slug (united-states). Defaults to the United States.", "default": "us" }, "topWebsitesIndustry": { "title": "Industry", "type": "string", "description": "Industry to rank within. Use 'all' for every industry, or a Semrush industry slug such as finance, retail, news, travel-and-tourism, real-estate, healthcare, education, computer-software-and-development, online-services, advertising-and-marketing.", "default": "all" }, "topWebsitesLimit": { "title": "Number of top websites", "minimum": 1, "maximum": 100, "type": "integer", "description": "How many ranked domains to return (1-100).", "default": 100 }, "enrichTopWebsites": { "title": "Enrich each ranked domain with full overview", "type": "boolean", "description": "When on, each ranked domain is also run through the full domain-overview scrape (Authority Score, backlinks, competitors, keywords, etc.). Adds one request and one richer row per domain. Off by default — the ranking alone is a single request for up to 100 rows.", "default": false }, "includeHistory": { "title": "Include monthly history", "type": "boolean", "description": "Month-by-month history arrays for visits, organic/paid traffic, backlinks and referring domains.", "default": true }, "includeTrafficByCountry": { "title": "Include traffic by country", "type": "boolean", "description": "Per-country traffic breakdown with desktop/mobile split and traffic share.", "default": true }, "includeTrafficByDevice": { "title": "Include traffic by device", "type": "boolean", "description": "Desktop vs mobile visit history.", "default": true }, "includeTrafficJourney": { "title": "Include traffic journey", "type": "boolean", "description": "Inbound and outbound referral hosts (where visitors come from and go next).", "default": true }, "includeCompetitors": { "title": "Include competitors", "type": "boolean", "description": "Top organic + paid competitor domains with relevance and estimated visits.", "default": true }, "includeKeywords": { "title": "Include top keywords", "type": "boolean", "description": "Top organic keywords with search volume, CPC, position, decoded intent and traffic share.", "default": true }, "includeAiTraffic": { "title": "Include AI traffic", "type": "boolean", "description": "AI / LLM traffic sources (ChatGPT, Gemini, Grok, etc.) with share of total AI traffic.", "default": true }, "includeSiteAudit": { "title": "Include SEO site audit", "type": "boolean", "description": "On-page SEO audit block (health score, crawled/broken pages). Usually empty unless Semrush has already crawled the domain, so it is off by default.", "default": false }, "maxItems": { "title": "Maximum domains to scrape", "minimum": 1, "type": "integer", "description": "Hard cap on the number of domains processed in one run.", "default": 1000 }, "maxConcurrency": { "title": "Max concurrency", "minimum": 1, "type": "integer", "description": "Maximum number of domains fetched in parallel.", "default": 10 }, "proxy": { "title": "Proxy configuration", "type": "object", "description": "Proxy used to reach Semrush. Residential proxies are recommended — datacenter IPs can be throttled by Semrush.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```