# SEO Domain & Keyword Scraper (Semrush Alternative) (`khadinakbar/seo-domain-keyword-scraper`) Actor SEMrush-alternative SEO data: domain overview, ranked keywords, keyword research, competitors & backlinks via the DataForSEO API. - **URL**: https://apify.com/khadinakbar/seo-domain-keyword-scraper.md - **Developed by:** [Khadin Akbar](https://apify.com/khadinakbar) (community) - **Categories:** SEO tools, MCP servers, AI - **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $5.00 / 1,000 result rows This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## SEO Domain & Keyword Scraper — SEMrush-Alternative Data via DataForSEO Pull **SEMrush / Ahrefs-grade SEO data** — domain traffic, ranked keywords, keyword research, organic competitors and backlink profiles — as clean, structured JSON. Powered by the official **DataForSEO API** (you bring your own DataForSEO credentials), so there is **no scraping, no anti-bot fight, and effectively 100% reliability**. MCP-ready for AI agents. ### What you get | Mode | What it returns | SEMrush equivalent | |---|---|---| | `domain_overview` | Organic & paid keyword counts, estimated traffic (ETV), traffic value, ranking distribution by position | Domain Overview | | `ranked_keywords` | Every keyword a domain ranks for + position, volume, CPC, difficulty, ranked URL, traffic | Organic Research | | `keyword_overview` | Volume, CPC, competition, difficulty and search intent for keywords you supply | Keyword Overview | | `keyword_ideas` | Related keyword suggestions from seed terms, with full metrics | Keyword Magic | | `competitors` | Organic competitor domains, shared keywords, their traffic | Competitors | | `backlinks_summary` | Backlinks, referring domains, rank, broken links, spam score | Backlink Analytics | > **Note:** `backlinks_summary` uses DataForSEO's **Backlinks API**, a separate subscription from DataForSEO Labs. If your plan doesn't include it, this mode returns a clear "activate your Backlinks subscription" message instead of data. The other five modes use DataForSEO Labs. ### When to use it - SEO agencies and consultants building client audits and reports. - Growth/content teams doing keyword research and gap analysis at scale. - AI agents (via Apify MCP) that need structured SEO metrics on demand. - Anyone with a DataForSEO account who wants this data piped into Apify, Make, Zapier, or Google Sheets without writing API plumbing. **Not** a SEMrush login scraper — it never touches SEMrush. It returns comparable third-party data from DataForSEO's own datasets. ### Pricing (Apify side) This actor uses **pay-per-event**: | Event | Price | |---|---| | Actor start | $0.00005 | | Result row (keyword / competitor / ranked keyword) | $0.005 | | Domain or backlinks report | $0.02 | > **DataForSEO is billed separately on your own DataForSEO account** (typically ~$0.01–0.02 per API call). This actor never charges you for DataForSEO usage — that stays on your key. ### Credentials You need a DataForSEO account. Get your **API login (email)** and **API password** from https://app.dataforseo.com/api-access (the API password is auto-generated and is **not** your dashboard password). Paste both into the `dataforSeoLogin` and `dataforSeoPassword` secret fields. ### Input ```json { "mode": "ranked_keywords", "target": "nike.com", "locationCode": 2840, "languageCode": "en", "maxResults": 100, "dataforSeoLogin": "you@example.com", "dataforSeoPassword": "your-api-password" } ```` Keyword research example: ```json { "mode": "keyword_ideas", "keywords": ["running shoes", "marathon training"], "locationCode": 2840, "languageCode": "en", "maxResults": 200 } ``` #### Fields - **mode** — one of `domain_overview`, `ranked_keywords`, `keyword_overview`, `keyword_ideas`, `competitors`, `backlinks_summary`. - **target** — domain for domain/competitor/backlink/ranked modes (e.g. `apple.com`). - **keywords** — array of phrases for `keyword_overview` / `keyword_ideas`. - **locationCode** — DataForSEO location code (2840 = US, 2826 = UK, 2124 = CA, 2036 = AU, 2356 = IN). - **languageCode** — e.g. `en`, `es`, `de`, `fr`. - **maxResults** — 1–1000 for list modes. - **includeSerpInfo** — add SERP feature data to keyword modes (raises DataForSEO cost). ### Output One flat JSON record per result. Example (ranked\_keywords): ```json { "mode": "ranked_keywords", "target": "nike.com", "keyword": "nike air force 1", "searchVolume": 823000, "cpc": 0.74, "competition": 0.42, "keywordDifficulty": 91, "position": 1, "serpType": "organic", "rankedUrl": "https://www.nike.com/...", "etv": 248300.5, "locationCode": 2840, "languageCode": "en" } ``` A run summary is written to the key-value store under `OUTPUT` (mode, results pushed, Apify charge, DataForSEO cost). ### Use with AI agents (MCP) Exposed via Apify MCP as `apify--seo-domain-keyword-scraper`. Give an agent a domain or keyword set and it returns structured SEO metrics in one tool call. Costs are predictable per the table above. ### FAQ **Do I need a SEMrush account?** No. You need a DataForSEO account. **Is this scraping SEMrush?** No. It calls the DataForSEO API, a licensed third-party SEO data provider. **Why are some fields missing?** Null/empty values are stripped from records. A domain or keyword with no data returns a record with a `_note` explaining why. **How accurate is the data?** It is DataForSEO's estimated/modeled SEO data (volumes, traffic, difficulty), comparable in nature to SEMrush/Ahrefs estimates — not Google-Search-Console ground truth. **What about rate limits / blocks?** None — this is a first-party API, not a scraper. Reliability is limited only by your DataForSEO balance and the API's uptime. ### Legal This actor accesses the **DataForSEO API** using credentials you supply, under your own DataForSEO agreement. You are responsible for complying with DataForSEO's terms of service and for all usage billed to your DataForSEO account. This tool is provided for legitimate SEO research and analytics. It is not affiliated with, endorsed by, or connected to SEMrush, Ahrefs, or DataForSEO. "SEMrush" and "Ahrefs" are trademarks of their respective owners and are referenced only to describe comparable data categories. # Actor input Schema ## `mode` (type: `string`): Which SEO dataset to pull. 'domain\_overview' = traffic/keyword totals for a domain. 'ranked\_keywords' = every keyword a domain ranks for. 'keyword\_overview' = metrics for keywords you supply. 'keyword\_ideas' = related keyword suggestions from seeds. 'competitors' = organic competitor domains. 'backlinks\_summary' = backlink profile totals. Defaults to 'domain\_overview'. ## `target` (type: `string`): Domain to analyze, e.g. 'apple.com'. Used by domain\_overview, ranked\_keywords, competitors and backlinks\_summary. Strip https:// and www — both are handled if present. NOT a keyword; for keyword modes use the 'keywords' field instead. ## `keywords` (type: `array`): Keyword phrases for 'keyword\_overview' (metrics for these exact terms) or 'keyword\_ideas' (suggestions seeded from these). Example: \["seo tools", "keyword research"]. Ignored by domain/competitor/backlink modes. Max 700 for overview, 200 for ideas. ## `dataforSeoLogin` (type: `string`): Your DataForSEO API login — the email you registered with at https://app.dataforseo.com/api-access. DataForSEO API usage is billed on YOUR DataForSEO account, separate from Apify charges. Stored as a secret. NOT your Apify token. ## `dataforSeoPassword` (type: `string`): Your DataForSEO API password from https://app.dataforseo.com/api-access (the auto-generated API password, NOT your dashboard login password). Stored as a secret and never logged. ## `locationCode` (type: `integer`): DataForSEO numeric location code for the market. 2840 = United States, 2826 = United Kingdom, 2124 = Canada, 2036 = Australia, 2356 = India. Defaults to 2840 (US). See DataForSEO locations endpoint for the full list. ## `languageCode` (type: `string`): Two-letter language code matching the location, e.g. 'en' (English), 'es' (Spanish), 'de' (German), 'fr' (French). Defaults to 'en'. Must be a language DataForSEO supports for the chosen location. ## `maxResults` (type: `integer`): Maximum rows to return for list modes (ranked\_keywords, keyword\_ideas, competitors, keyword\_overview). 1-1000. Ignored by report modes (domain\_overview, backlinks\_summary), which always return one record. Defaults to 100. ## `includeSerpInfo` (type: `boolean`): When true, keyword\_overview and keyword\_ideas also request SERP feature data from DataForSEO (raises DataForSEO cost on your key). Defaults to false. No effect on other modes. ## Actor input object example ```json { "mode": "domain_overview", "target": "nike.com", "keywords": [ "running shoes", "marathon training" ], "locationCode": 2840, "languageCode": "en", "maxResults": 100, "includeSerpInfo": false } ``` # Actor output Schema ## `results` (type: `string`): All SEO data rows returned by this run. ## `keywordData` (type: `string`): Keyword overview, keyword ideas, and ranked keyword rows using the dataset keyword view. ## `domainOverview` (type: `string`): Domain-level organic and paid SEO totals using the dataset domain view. ## `competitors` (type: `string`): Organic competitor domains using the dataset competitors view. ## `backlinks` (type: `string`): Backlink profile totals using the dataset backlinks view. ## `summary` (type: `string`): Mode, result count, Apify charge and DataForSEO cost. ## `run` (type: `string`): Apify Console run details, logs, storage links, and billing information. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "domain_overview", "target": "apple.com", "keywords": [ "seo tools", "keyword research" ], "locationCode": 2840, "languageCode": "en", "maxResults": 100 }; // Run the Actor and wait for it to finish const run = await client.actor("khadinakbar/seo-domain-keyword-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "domain_overview", "target": "apple.com", "keywords": [ "seo tools", "keyword research", ], "locationCode": 2840, "languageCode": "en", "maxResults": 100, } # Run the Actor and wait for it to finish run = client.actor("khadinakbar/seo-domain-keyword-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "domain_overview", "target": "apple.com", "keywords": [ "seo tools", "keyword research" ], "locationCode": 2840, "languageCode": "en", "maxResults": 100 }' | apify call khadinakbar/seo-domain-keyword-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=khadinakbar/seo-domain-keyword-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "SEO Domain & Keyword Scraper (Semrush Alternative)", "description": "SEMrush-alternative SEO data: domain overview, ranked keywords, keyword research, competitors & backlinks via the DataForSEO API.", "version": "1.0", "x-build-id": "zZeK6l1RNS0WufF3b" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/khadinakbar~seo-domain-keyword-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-khadinakbar-seo-domain-keyword-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/khadinakbar~seo-domain-keyword-scraper/runs": { "post": { "operationId": "runs-sync-khadinakbar-seo-domain-keyword-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/khadinakbar~seo-domain-keyword-scraper/run-sync": { "post": { "operationId": "run-sync-khadinakbar-seo-domain-keyword-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Mode", "enum": [ "domain_overview", "ranked_keywords", "keyword_overview", "keyword_ideas", "competitors", "backlinks_summary" ], "type": "string", "description": "Which SEO dataset to pull. 'domain_overview' = traffic/keyword totals for a domain. 'ranked_keywords' = every keyword a domain ranks for. 'keyword_overview' = metrics for keywords you supply. 'keyword_ideas' = related keyword suggestions from seeds. 'competitors' = organic competitor domains. 'backlinks_summary' = backlink profile totals. Defaults to 'domain_overview'.", "default": "domain_overview" }, "target": { "title": "Target domain", "type": "string", "description": "Domain to analyze, e.g. 'apple.com'. Used by domain_overview, ranked_keywords, competitors and backlinks_summary. Strip https:// and www — both are handled if present. NOT a keyword; for keyword modes use the 'keywords' field instead." }, "keywords": { "title": "Keywords", "type": "array", "description": "Keyword phrases for 'keyword_overview' (metrics for these exact terms) or 'keyword_ideas' (suggestions seeded from these). Example: [\"seo tools\", \"keyword research\"]. Ignored by domain/competitor/backlink modes. Max 700 for overview, 200 for ideas.", "items": { "type": "string" } }, "dataforSeoLogin": { "title": "DataForSEO API login (email)", "type": "string", "description": "Your DataForSEO API login — the email you registered with at https://app.dataforseo.com/api-access. DataForSEO API usage is billed on YOUR DataForSEO account, separate from Apify charges. Stored as a secret. NOT your Apify token." }, "dataforSeoPassword": { "title": "DataForSEO API password", "type": "string", "description": "Your DataForSEO API password from https://app.dataforseo.com/api-access (the auto-generated API password, NOT your dashboard login password). Stored as a secret and never logged." }, "locationCode": { "title": "Location code", "type": "integer", "description": "DataForSEO numeric location code for the market. 2840 = United States, 2826 = United Kingdom, 2124 = Canada, 2036 = Australia, 2356 = India. Defaults to 2840 (US). See DataForSEO locations endpoint for the full list.", "default": 2840 }, "languageCode": { "title": "Language code", "type": "string", "description": "Two-letter language code matching the location, e.g. 'en' (English), 'es' (Spanish), 'de' (German), 'fr' (French). Defaults to 'en'. Must be a language DataForSEO supports for the chosen location.", "default": "en" }, "maxResults": { "title": "Max results", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum rows to return for list modes (ranked_keywords, keyword_ideas, competitors, keyword_overview). 1-1000. Ignored by report modes (domain_overview, backlinks_summary), which always return one record. Defaults to 100.", "default": 100 }, "includeSerpInfo": { "title": "Include SERP info", "type": "boolean", "description": "When true, keyword_overview and keyword_ideas also request SERP feature data from DataForSEO (raises DataForSEO cost on your key). Defaults to false. No effect on other modes.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```