# SEO Competitor Gap Analyzer - AI Content Gap Finder (`fetchcraft/seo-competitor-gap`) Actor

Find SEO content gaps versus competitors using AI. Crawls your sitemap and up to 5 competitor sitemaps, diffs topic coverage, returns target keywords with search-volume bands, word counts, and rationale per gap. Bring your own LLM key. Pay per competitor analyzed.

- **URL**: https://apify.com/fetchcraft/seo-competitor-gap.md
- **Developed by:** [Emily Ward](https://apify.com/fetchcraft) (community)
- **Categories:** SEO tools, AI, Marketing
- **Stats:** 2 total users, 1 monthly users, 78.6% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet

## Pricing

$500.00 / 1,000 competitor analyseds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## SEO Competitor Content Gap (AI)

**Drop in your site URL + up to 5 competitor URLs. Get back the exact topical gaps with suggested post titles, target keywords, and word counts. Powered by Claude Sonnet 4.6.**

### Why this exists

Ahrefs charges $99 to $999 per month to do this. SEMrush charges $129 to $499. You use the feature once a quarter.

This actor charges $0.50 per competitor analysed. No subscription. No annual contract.

### What you get back per competitor

| Field | Description |
| --- | --- |
| `competitor_url` | URL analysed |
| `your_topic_count` | Topic slugs found on your site (from sitemap) |
| `competitor_topic_count` | Topic slugs found on competitor (from sitemap) |
| `overlap_count` | Slugs you both cover |
| `gaps_count` | Slugs only the competitor covers, after AI filtering |
| `top_gap_title` | The single highest-priority post title to write |
| `gaps[]` | Full ranked list of gaps |

Each gap object includes:
- `source_slug` (the exact competitor URL slug)
- `suggested_post_title` (sharper than the competitor's, often as a question or contrarian angle)
- `target_keyword`
- `estimated_search_volume_band` (low / medium / high)
- `recommended_word_count` (800 to 3000)
- `primary_intent` (informational / transactional / navigational / commercial)
- `rationale` (one sentence on why this gap matters)

### Pricing

**$0.50 USD per competitor analysed.** You only pay for successful analyses. Failed sites (no sitemap, blocked, error) are not charged.

| Use case | Competitors | Cost |
| --- | --- | --- |
| Single competitor check | 1 | $0.50 |
| Quarterly competitive review | 5 | $2.50 |
| Annual industry scan | 20 | $10.00 |

Compare to Ahrefs Standard at $179/mo or SEMrush Guru at $229/mo.

### How it works

1. Sitemap-first extraction: fetches `/sitemap.xml`, follows nested sitemap indexes, falls back to homepage link crawl if no sitemap.
2. Slug-based topic comparison: extracts the meaningful slug from each URL (last path segment, cleaned).
3. Set diff: identifies slugs unique to the competitor.
4. AI ranking: Claude Sonnet 4.6 filters out low-value slugs (login, terms, tags), prioritises matches with your target audience, and suggests sharper post titles than the competitor uses.

### Inputs

- **your_url**: your homepage URL
- **competitor_urls**: array of up to 5 competitor homepage URLs
- **your_target_audience**: one paragraph describing who you write for. The AI uses this to prioritise gaps that matter for your audience.
- **max_pages_per_site**: default 60. Higher = more coverage but slower and more compute.
- **max_concurrency**: default 2. Number of competitors processed in parallel.

### Use cases

- Quarterly content strategy: pick your top 5 competitors, get a 50-gap ranked backlog.
- New-site launch: see what the category leader covers that you do not.
- Agency client onboarding: ship the gap report as a $500 deliverable, spend $2.50 to make it.
- Programmatic SEO planning: pull 100s of competitor slugs and prioritise which to write first.

### What this actor does NOT do

- It does not check search volume against Google. Use Ahrefs or Keyword Planner for hard volume numbers. The `estimated_search_volume_band` is an AI estimate, not a measured value.
- It does not write the posts. Pair this with your existing AI writing workflow.
- It does not crawl behind authentication. Public sitemaps only.
- It does not check current rankings. Use a rank tracker for that.

### Tags

`seo` `content-marketing` `competitor-analysis` `ai` `claude` `keyword-research` `content-strategy` `b2b` `saas`

### Companion actors

- **[AI Sales Personalizer](https://apify.com/fetchcraft/ai-sales-personalizer)** ($0.15/result). Use the gaps surfaced here to drive personalized outbound to the prospect's competitive set.
- **[Cold Email Rewriter](https://apify.com/fetchcraft/cold-email-rewriter)** ($0.10/rewrite). Reference a gap-filled blog post in the cold-email outreach.
- **[LinkedIn Post Personalizer](https://apify.com/fetchcraft/linkedin-post-personalizer)** ($0.10/opener). Use the gap insights as a hook in LinkedIn DMs to the competitor's customer base.

---

Made with Claude Sonnet 4.6 by Emily Ward, Cancel Costs.


### Integrations

This actor works out of the box with every Apify-supported integration:

- **API**: call via Apify API or any official SDK (Python, JavaScript, PHP, .NET). Returns a clean dataset URL.
- **Schedule**: set a daily, weekly, or custom cron cadence in Apify Console. Combine with `notification` for fresh feeds.
- **Webhooks**: wire `ACTOR.RUN.SUCCEEDED` to Slack, Discord, Zapier, Make, n8n, Pipedream, or any HTTPS endpoint.
- **MCP**: this actor is discoverable through Apify's hosted MCP server at `mcp.apify.com` for Claude, Cursor, Cline, Windsurf, and other MCP clients.
- **n8n / Make / Zapier**: native HTTP-Request integration. Trigger the actor on schedule, pipe results to Google Sheets, Airtable, your CRM, or any database.

### Try it free

Every Apify user gets **$5/month in free platform credits** (around 250 events at this actor's per-event price). Run preview mode first to confirm output shape before scaling.

New to Apify? [Sign up here](https://apify.com/sign-up?fpr=fetchcraft) to get free credits on signup.

### What's New

- 2026-06-03: Metadata, categories, and SEO refreshed. Latest version live on Apify Store.

### Last Updated

2026-06-03

# Actor input Schema

## `your_url` (type: `string`):

Your homepage URL. We crawl its sitemap to extract your topic coverage.
## `competitor_urls` (type: `array`):

Up to 5 competitor homepage URLs. We crawl each one's sitemap and diff against yours.
## `your_target_audience` (type: `string`):

Who do you write content for? Role, company size, what they search for. The AI prioritises gaps relevant to this audience.
## `max_pages_per_site` (type: `integer`):

Maximum sitemap URLs to ingest per site. Higher = more coverage but slower.
## `max_concurrency` (type: `integer`):

How many competitors to analyse in parallel.
## `llm_provider` (type: `string`):

Pick which LLM you want. Gemini is recommended (1500 free requests/day at https://aistudio.google.com/apikey). Groq also good (14400 free/day at https://console.groq.com/keys). Leave blank to use the actor owner's configured key (if any).
## `llm_api_key` (type: `string`):

Paste the API key for the provider you selected. Never leaves the Apify run, never logged. Free tier providers (Gemini, Groq) give thousands of free results per day.

## Actor input object example

```json
{
  "your_url": "https://www.cancelcosts.com",
  "competitor_urls": [
    "https://www.smartlead.ai",
    "https://www.lemlist.com"
  ],
  "your_target_audience": "B2B SaaS founders and SDR teams looking to cut cold-outreach tooling spend.",
  "max_pages_per_site": 60,
  "max_concurrency": 2,
  "llm_provider": ""
}
````

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "your_url": "https://www.cancelcosts.com",
    "competitor_urls": [
        "https://www.smartlead.ai",
        "https://www.lemlist.com"
    ],
    "your_target_audience": "B2B SaaS founders and SDR teams looking to cut cold-outreach tooling spend."
};

// Run the Actor and wait for it to finish
const run = await client.actor("fetchcraft/seo-competitor-gap").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "your_url": "https://www.cancelcosts.com",
    "competitor_urls": [
        "https://www.smartlead.ai",
        "https://www.lemlist.com",
    ],
    "your_target_audience": "B2B SaaS founders and SDR teams looking to cut cold-outreach tooling spend.",
}

# Run the Actor and wait for it to finish
run = client.actor("fetchcraft/seo-competitor-gap").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "your_url": "https://www.cancelcosts.com",
  "competitor_urls": [
    "https://www.smartlead.ai",
    "https://www.lemlist.com"
  ],
  "your_target_audience": "B2B SaaS founders and SDR teams looking to cut cold-outreach tooling spend."
}' |
apify call fetchcraft/seo-competitor-gap --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=fetchcraft/seo-competitor-gap",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "SEO Competitor Gap Analyzer - AI Content Gap Finder",
        "description": "Find SEO content gaps versus competitors using AI. Crawls your sitemap and up to 5 competitor sitemaps, diffs topic coverage, returns target keywords with search-volume bands, word counts, and rationale per gap. Bring your own LLM key. Pay per competitor analyzed.",
        "version": "0.1",
        "x-build-id": "mfNXRMNLoh4qbUGNC"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/fetchcraft~seo-competitor-gap/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-fetchcraft-seo-competitor-gap",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/fetchcraft~seo-competitor-gap/runs": {
            "post": {
                "operationId": "runs-sync-fetchcraft-seo-competitor-gap",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/fetchcraft~seo-competitor-gap/run-sync": {
            "post": {
                "operationId": "run-sync-fetchcraft-seo-competitor-gap",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "your_url",
                    "competitor_urls",
                    "your_target_audience"
                ],
                "properties": {
                    "your_url": {
                        "title": "Your site URL",
                        "type": "string",
                        "description": "Your homepage URL. We crawl its sitemap to extract your topic coverage."
                    },
                    "competitor_urls": {
                        "title": "Competitor URLs",
                        "type": "array",
                        "description": "Up to 5 competitor homepage URLs. We crawl each one's sitemap and diff against yours.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "your_target_audience": {
                        "title": "Your target audience (one paragraph)",
                        "minLength": 20,
                        "maxLength": 1500,
                        "type": "string",
                        "description": "Who do you write content for? Role, company size, what they search for. The AI prioritises gaps relevant to this audience."
                    },
                    "max_pages_per_site": {
                        "title": "Max pages per site",
                        "minimum": 10,
                        "maximum": 300,
                        "type": "integer",
                        "description": "Maximum sitemap URLs to ingest per site. Higher = more coverage but slower.",
                        "default": 60
                    },
                    "max_concurrency": {
                        "title": "Max parallel competitors",
                        "minimum": 1,
                        "maximum": 5,
                        "type": "integer",
                        "description": "How many competitors to analyse in parallel.",
                        "default": 2
                    },
                    "llm_provider": {
                        "title": "LLM provider (bring your own key)",
                        "enum": [
                            "",
                            "gemini",
                            "groq",
                            "cerebras",
                            "openrouter",
                            "huggingface",
                            "anthropic"
                        ],
                        "type": "string",
                        "description": "Pick which LLM you want. Gemini is recommended (1500 free requests/day at https://aistudio.google.com/apikey). Groq also good (14400 free/day at https://console.groq.com/keys). Leave blank to use the actor owner's configured key (if any).",
                        "default": ""
                    },
                    "llm_api_key": {
                        "title": "Your LLM API key (paired with llm_provider above)",
                        "type": "string",
                        "description": "Paste the API key for the provider you selected. Never leaves the Apify run, never logged. Free tier providers (Gemini, Groq) give thousands of free results per day."
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```
