# SpyFu Domain Intelligence Scraper (`clearpath/spyfu-scraper`) Actor
Extract SpyFu domain intelligence — competitors, ad history, backlinks, top pages, and monthly SEO/PPC metrics. Just add domains, get structured JSON with all six sections and time-series data included.
- **URL**: https://apify.com/clearpath/spyfu-scraper.md
- **Developed by:** [ClearPath](https://apify.com/clearpath) (community)
- **Categories:** SEO tools, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet
## Pricing
from $6.99 / 1,000 domains
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## SpyFu Intelligence | Domain Competitive Intelligence from SpyFu (2026)
16 fields per domain stat, 5 sections per run — monthly SEO/PPC metrics, organic and paid competitors, ad history, backlinks, and top pages in a single structured output.
#### Copy to your AI assistant
````
clearpath/spyfu-scraper on Apify. Scrapes SpyFu domain intelligence — competitors, ad history, backlinks, top pages, and domain stats. Call ApifyClient("TOKEN").actor("clearpath/spyfu-scraper").call(run\_input={...}), then client.dataset(run\["defaultDatasetId"]).list\_items().items. Full spec: GET https://api.apify.com/v2/acts/clearpath~spyfu-scraper/builds/default (Bearer TOKEN) → inputSchema, actorDefinition.storages.dataset, readme. Token: https://console.apify.com/account/integrations
````
### What Data Can You Extract from SpyFu?
Every result covers one domain with up to five nested sections:
- **domainStats** — monthly SEO and PPC metrics going back years (average rank, monthly clicks, organic value, ad spend)
- **competitors** — organic and paid competitors with overlap scores and rank data
- **adHistory** — ad creatives with titles, body text, positions, and visibility percentages
- **backlinks** — backlink source records with domain strength, traffic metrics, and ranked keywords
- **topPages** — top pages by estimated monthly organic clicks with keyword-level breakdown
#### Quick Start
```json
{
"queries": ["apify.com"]
}
````
#### Multiple Domains + Country
```json
{
"queries": ["apify.com", "scrapingbee.com"],
"countryCode": "US"
}
```
### Input Parameters
| Parameter | Type | Default | Description |
|-----------|------|---------|-------------|
| `queries` | array | *required* | Domains to scrape. Full URLs are accepted and normalized automatically. |
| `countryCode` | string | `US` | SpyFu country dataset. Defaults to United States. |
### Output Example
```json
{
"query": "apify.com",
"normalizedQuery": "apify.com",
"countryCode": "US",
"scrapedAt": "2026-04-25T08:18:17Z",
"domainStats": [
{
"searchDate": "201710",
"averageOrganicRank": 20.7,
"monthlyPaidClicks": 0,
"averageAdRank": 0,
"totalOrganicResults": 279,
"monthlyBudget": 0,
"monthlyOrganicValue": 454.84,
"totalAdsPurchased": 0,
"monthlyOrganicClicks": 85006.17,
"strength": 0,
"totalInverseRank": 1120,
"hasData": true,
"domain": "apify.com",
"totalResults": 106,
"year": 2017,
"month": 10
}
// more...
],
"competitors": [
{
"domain": "scrapingbee.com",
"commonTerms": 2177,
"rank": 0.0048394115,
"competitorType": "organic"
}
],
"competitorHistory": [
{
"type": "organic",
"competitors": [
{
"domain": "scrapingbee.com",
"domainId": 123456,
"commonTerms": 2177,
"rank": 0.0048394115,
"graphCoordinates": [
{
"keywords": 279,
"monthlyClicks": 85006.17,
"monthlyValue": 454.84,
"searchDate": { "dateString": "201710", "month": 10, "year": 2017 }
}
// more...
]
}
// more competitors...
]
},
{
"type": "paid",
"competitors": [
{
"domain": "scrapingbee.com",
"domainId": 123456,
"commonTerms": 1820,
"rank": 0.00391234,
"graphCoordinates": [
{
"keywords": 44,
"monthlyClicks": 1205.5,
"monthlyValue": 892.3,
"searchDate": { "dateString": "201710", "month": 10, "year": 2017 }
}
// more...
]
}
// more competitors...
]
}
],
"adHistory": [
{
"adId": 740964057,
"averagePosition": 3.67,
"averageAdCount": 5.44,
"body": "Find hundreds of ready-made Actors for your web scraping or automation project. Crawl any website, collect structured large datasets, and...",
"title": "Apify - Extract data from any website",
"fullUrl": "https://apify.com/",
"leaderboardCount": 7,
"percentageLeaderboard": 0.78,
"percentageAdsServed": 0.11
}
// more...
],
"backlinks": [
{
"url": "https://crawlee.dev/api/puppeteer-crawler",
"backlinkDomain": "crawlee.dev",
"numOutboundLinks": 130,
"domainStrength": 27,
"domainMonthlyOrganicClicks": 15000,
"pageMonthlyOrganicClicks": 3,
"rankedKeywords": 2
}
// more...
],
"topPages": [
{
"title": "Pornhub Video (Downloader) API in Python",
"url": "https://apify.com/pintxuki/pornhub-video-downloader/api/python",
"estMonthlySeoClicks": 5378,
"keywordCount": 20,
"topKeyword": "pornhub downloader"
}
// more...
]
}
```
### Pricing — Pay Per Event (PPE)
**$7.99 per 1,000 domains** (base price). Volume discounts available.
| Tier | Price per 1,000 |
|------|-----------------|
| Free / Bronze | $7.99 |
| Silver | $7.49 |
| Gold | $6.99 |
Free tier: 5 lifetime runs, 5 domains per run.
### FAQ
**How many results does each domain return?**
Each domain produces one dataset row containing six sections. Section sizes vary — domainStats returns monthly records going back years (50–100+ entries), competitorHistory returns time-series for each competitor, competitors and backlinks typically return 5–50 records, adHistory returns 20–100 ads, and topPages returns up to 50 pages.
**What country data is available?**
SpyFu supports 32 country datasets. Select the desired country from the dropdown in the input schema. Default is US.
**Does this work on the free tier?**
Yes. Free tier allows 5 lifetime runs with up to 5 domains per run. Each subsequent run after the free limit requires credits.
**Is the data fresh?**
Data reflects SpyFu's latest available crawl. Historical metrics (domainStats) go back several years where SpyFu has coverage.
**What happens if a section fails?**
Failed sections are recorded in the `errors` field of the output row. The actor continues processing remaining sections and other domains.
### Support
- **Bugs**: Issues tab
- **Features**: Email or issues
- **Email**: max@mapa.slmail.me
### Legal Compliance
Extracts publicly available data from SpyFu. Users must comply with SpyFu terms of service and applicable data protection regulations (GDPR, CCPA).
***
*Structured domain intelligence from SpyFu — competitors, ad history, backlinks, and stats in one actor.*
# Actor input Schema
## `queries` (type: `array`):
Add domains to scrape. Full URLs are accepted and normalized to domains.
## `countryCode` (type: `string`):
SpyFu country dataset to use. Default is US — supported countries are listed in the dropdown.
## Actor input object example
```json
{
"queries": [
"apify.com",
"scrapingbee.com",
"semrush.com"
],
"countryCode": "US"
}
```
# Actor output Schema
## `results` (type: `string`):
No description
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"queries": [
"apify.com",
"scrapingbee.com",
"semrush.com"
],
"countryCode": "US"
};
// Run the Actor and wait for it to finish
const run = await client.actor("clearpath/spyfu-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"queries": [
"apify.com",
"scrapingbee.com",
"semrush.com",
],
"countryCode": "US",
}
# Run the Actor and wait for it to finish
run = client.actor("clearpath/spyfu-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"queries": [
"apify.com",
"scrapingbee.com",
"semrush.com"
],
"countryCode": "US"
}' |
apify call clearpath/spyfu-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=clearpath/spyfu-scraper",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "SpyFu Domain Intelligence Scraper",
"description": "Extract SpyFu domain intelligence — competitors, ad history, backlinks, top pages, and monthly SEO/PPC metrics. Just add domains, get structured JSON with all six sections and time-series data included.",
"version": "0.0",
"x-build-id": "qGShuaovqrlo9idQ0"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/clearpath~spyfu-scraper/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-clearpath-spyfu-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/clearpath~spyfu-scraper/runs": {
"post": {
"operationId": "runs-sync-clearpath-spyfu-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/clearpath~spyfu-scraper/run-sync": {
"post": {
"operationId": "run-sync-clearpath-spyfu-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"required": [
"queries"
],
"properties": {
"queries": {
"title": "Domains",
"minItems": 1,
"type": "array",
"description": "Add domains to scrape. Full URLs are accepted and normalized to domains.",
"items": {
"type": "string"
}
},
"countryCode": {
"title": "Country",
"enum": [
"US",
"GB",
"DE",
"FR",
"AR",
"AT",
"AU",
"BE",
"BR",
"CA",
"CL",
"CZ",
"DK",
"FI",
"IN",
"IE",
"IT",
"JP",
"MX",
"NL",
"NZ",
"NO",
"PL",
"PT",
"SG",
"ZA",
"ES",
"SE",
"CH",
"TR",
"UA",
"VE"
],
"type": "string",
"description": "SpyFu country dataset to use. Default is US — supported countries are listed in the dropdown.",
"default": "US"
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```