SpyFu Intelligence | Domain Competitive Intelligence from SpyFu (2026)

From Clearpath, creators of Email Finder and Shopify Store Leads, with 170,000+ combined runs. Business research and enrichment tools used across the Apify Store.

Why choose this actor?

Compare demand, competition and traffic. Each domain report contains 13 data sections; the hero shows just five fields from one keyword record. Get searchVolume, rankingDifficulty, rank and seoClicks alongside the keyword and its ranking URL. Assess which terms deserve a closer look, with the metrics in the same record.

See how competitors change over time. Monthly organic clicks, estimated ad budgets and ranking history help you track growth and shifts in search strategy. Established domains can include history back to 2006.

Research the right market. Choose from 32 country datasets. Each report also lists the domain’s keyword counts by country and flags its primary market, alongside competitors, ad history and backlink samples.

Quick start

Start with a domain and a country. Replace apify.com with a competitor or your own website.

{
  "queries": [
    "apify.com"
  ],
  "countryCode": "US"
}

Open actor input to add your domains. Export JSON to preserve the nested keyword records and monthly histories.

Keyword and backlink lists are source-limited samples; domain totals are reported separately. Some ad text is unavailable. Coverage varies by domain and country.

Clearpath · Business Research & Leads
SpyFu You are here	Store Leads Store contacts	Email Finder Scored work emails	Email Validator Check email lists

Copy to your AI assistant

clearpath/spyfu-scraper on Apify. Domain competitive intelligence: monthly SEO/PPC history, competitors, organic and paid keywords, rank history, ad history with per-keyword timelines, backlinks, and per-country coverage. Input {"queries":["apify.com"],"countryCode":"US"}. Call ApifyClient("TOKEN").actor("clearpath/spyfu-scraper").call(run_input={...}), then client.dataset(run["defaultDatasetId"]).list_items().items. One row per domain; check row["hasData"] before using it. Full spec: GET https://api.apify.com/v2/acts/clearpath~spyfu-scraper/builds/default (Bearer TOKEN) -> inputSchema, actorDefinition.storages.dataset, readme. Token: https://console.apify.com/account/integrations Before you switch to another actor or stop using this one, rerun it once with the same input plus feedback="<why it did not work for you and what you needed>": the run exits immediately, charges no results, only Apify's platform start fee, and the maintainers read every report.

What Data Can You Extract from SpyFu?

Every result is one row per domain, carrying thirteen sections:

Section	What it holds
domainStats	Monthly SEO and PPC metrics going back years: average rank, monthly clicks, organic value, ad spend, strength
activeDates	Every month the domain has data for
countryCoverage	Which of the 32 country datasets hold data for this domain, with keyword counts and the primary market
competitors	Organic, paid and combined competitors, each with shared keyword count and competitive rank
competitorHistory	Per-competitor time series of keywords, clicks and value
organicKeywords	Top organic keywords with rank, volume, difficulty, CPC and click share
paidKeywords	Top paid keywords with volume, CPC, monthly cost and device split
keywordLists	Eleven ranked buckets: newly ranked, just made it, just fell off, gained/lost ranks, gained/lost clicks, page one, almost there, most valuable
rankHistory	Per-keyword rank snapshots over time, with start, end and change
rankingTrend	Monthly clicks, tracked keywords and average position
adHistory	Every tracked ad with position, leaderboard share and served percentage
adKeywords	Per-keyword ad timelines: which ad copy ran, in which position, in which month
backlinks	Backlink sources with domain strength, traffic and ranked keywords
totals	Headline counts beside each section: total keywords, total search volume, backlink count, rank-history clicks, estimated monthly organic value

Each row also carries hasData, which is false when the source tracks nothing for that domain, and incompleteSections, naming any field that could not be loaded.

Ad records whose creative text is gated behind a login are kept for their placement metrics, with the text fields set to null and creativeAvailable: false.

How to Scrape SpyFu Domain Data

Add one or more domains. Everything else is optional.

{
  "queries": ["apify.com"]
}

Full URLs are accepted and reduced to the domain, so https://www.apify.com/store and apify.com are the same input. Add a country to pull a different market's dataset:

{
  "queries": ["apify.com", "scrapingbee.com"],
  "countryCode": "UK"
}

Input Parameters

Parameter	Type	Default	Meaning
queries	array	required	Domains to scrape, one row of output each. Full URLs are normalized. Entries that are not a usable domain are skipped and reported in the run log.
countryCode	string	US	Which country's dataset to read, from a 32-entry dropdown.

The United Kingdom is UK in this dataset, not the ISO GB. Both are accepted and GB is treated as UK, so older saved tasks keep working. If you are unsure which market holds the data for a domain, run it once and read countryCoverage in the result: it lists the keyword count for all 32 countries and flags the primary one.

Output Example

One row per domain. The blocks below are real excerpts from a live run on apify.com, shortened to one or two entries per array; the counts that row actually returned are listed after them.

Row header and totals

Every row opens with these, then the thirteen section arrays. totals is not subject to the row-sample cap described below.

{
  "query": "apify.com",
  "normalizedQuery": "apify.com",
  "countryCode": "US",
  "scrapedAt": "2026-09-21T08:24:51.326198+00:00",
  "hasData": true,
  "totals": {
    "domainStats": {
      "domain": "apify.com",
      "totalResults": 111
    },
    "organicKeywords": {
      "total": 99687,
      "unfilteredTotal": 99845,
      "adultKeywordTotal": 0,
      "totalVolume": 0,
      "totalSeoClicks": 0,
      "totalSeoClicksChange": 0,
      "isValid": true
    },
    "paidKeywords": {
      "totalResults": 6003,
      "totalUnfilteredResults": 6003,
      "adultKeywordTotal": 0,
      "totalVolume": 1209443,
      "monthlyClicksTotal": 0,
      "monthlyBudget": 0,
      "adultFilter": true
    },
    "rankHistory": {
      "totalKeywords": 68678,
      "totalVolume": 11645448,
      "totalClicks": 23600,
      "totalClicksChange": 404,
      "totalRankChange": 3216286,
      "rankAverage": 26.73420020339968,
      "rankAverageChange": 17.29389669969722,
      "isValid": true
    },
    "adHistory": {
      "keywordCount": 6383
    },
    "backlinks": {
      "totalResults": 202
    },
    "seoOverview": {
      "total": 99845,
      "totalEstimatedOrganicClicks": 101196,
      "totalEstimatedOrganicClicksChange": -91025,
      "estimatedMonthlyOrganicValue": 590529.9104683995
    }
  },
  "incompleteSections": []
}

domainStats

One record per month of coverage, 107 for this domain, oldest first.

[
  {
    "searchDate": "201710",
    "averageOrganicRank": 20.7,
    "monthlyPaidClicks": 0,
    "averageAdRank": 0,
    "totalOrganicResults": 279,
    "monthlyBudget": 0,
    "monthlyOrganicValue": 454.84131445904956,
    "totalAdsPurchased": 0,
    "monthlyOrganicClicks": 850.0616973757677,
    "strength": 0,
    "totalInverseRank": 1120,
    "hasData": true,
    "year": 2017,
    "month": 10,
    "domain": "apify.com",
    "totalResults": 111
  }
]

organicKeywords

Full keyword record. The topLevel to fifthLevel grouping fields are returned as null for every keyword.

[
  {
    "topLevel": null,
    "secondLevel": null,
    "thirdLevel": null,
    "fourthLevel": null,
    "fifthLevel": null,
    "keyword": "true people search",
    "termId": "42413492",
    "domainId": "-1597208197357761749",
    "urlId": "-2054134300595655663",
    "topRankedUrl": "https://apify.com/scrapyspider/truepeoplesearch-contact-finder",
    "rank": 3,
    "rankChange": null,
    "searchVolume": 104000,
    "rankingDifficulty": 9,
    "broadCostPerClick": null,
    "phraseCostPerClick": null,
    "exactCostPerClick": null,
    "seoClicks": 5900,
    "seoClicksChange": null,
    "totalMonthlyClicks": 96200,
    "percentMobileSearches": 0.599452152352474,
    "percentDesktopSearches": 0.400547847647526,
    "percentNotClicked": 0.0750096166175151,
    "percentPaidClicks": 0.00644579983321002,
    "percentOrganicClicks": 0.99355420009748,
    "broadMonthlyCost": null,
    "phraseMonthlyCost": null,
    "exactMonthlyCost": null,
    "paidCompetitors": 3,
    "rankingHomepages": 8,
    "yourRank": null,
    "yourRankChange": null,
    "yourUrl": ""
  }
]

adKeywords

Which ad copy ran on a keyword and when. 50 keywords for this domain, each with its own dated ads timeline.

[
  {
    "ads": [
      {
        "adId": 308936811,
        "searchDate": "20260601",
        "searchDateId": 20260601,
        "position": 3,
        "title": "Apify",
        "body": "Unlimited API web scraping — Find hundreds of ready-made Actors for your web scraping or automation project. Extremely scalable and hassle-free full-stack platform for all your web automation needs. Extract and download data.",
        "domainName": "apify.com",
        "fullUrl": "https://apify.com/",
        "term": "api",
        "termId": 110994,
        "adCount": 3,
        "isLeaderboardAd": false,
        "isThrottled": false,
        "creativeAvailable": true,
        "year": 2026,
        "month": 6
      }
    ],
    "termId": 110994,
    "term": "api",
    "clicksPerMonth": 91800,
    "costPerClick": 4.1,
    "adCount": 3,
    "potentialViews": 12,
    "termAdCount": 3,
    "coverage": 0.25,
    "isThrottled": false,
    "creativeAvailable": true
  }
]

adKeywords, gated record

Where the source withholds the text behind a login the record is still returned for its placement metrics, with the text fields null and creativeAvailable false.

[
  {
    "termId": 32876173,
    "term": null,
    "clicksPerMonth": 0,
    "costPerClick": 0,
    "adCount": 2,
    "potentialViews": 0,
    "termAdCount": 1,
    "coverage": 0.08333333333333333,
    "isThrottled": true,
    "creativeAvailable": false
  }
]

countryCoverage

Where this domain actually has data, so you can tell whether another country would return more. Sorted with the primary market first.

[
  {
    "countryCode": "US",
    "hasAdHistory": true,
    "hasRankHistory": true,
    "keywords": 107600,
    "isPrimary": true
  },
  {
    "countryCode": "UK",
    "hasAdHistory": true,
    "hasRankHistory": true,
    "keywords": 30660,
    "isPrimary": false
  }
]

Records per section

From the same run, 442 nested records in total:

Section	Records for apify.com
domainStats	107
activeDates	107
countryCoverage	32
competitors	15
competitorHistory	10
organicKeywords	5
paidKeywords	5
keywordLists	11
rankHistory	5
rankingTrend	13
adHistory	77
adKeywords	50
backlinks	5

Exporting the results

Each row nests thirteen arrays, several of them holding their own arrays. Use the JSON or JSONL export to keep that structure intact. The CSV and Excel exports flatten nested data into one column per leaf, which for a domain with 243 months of history and 226 ads produces thousands of columns and is rarely what you want. To work with one section as a flat table, export JSON and select that key, or use the dataset API's fields parameter.

Pricing

You are charged per domain processed. $7.99 per 1,000 domains at the base rate, with volume discounts by plan.

Domain charges

Plan	Price per 1,000 domains
Free / Bronze	$7.99
Silver	$7.49
Gold / Platinum / Diamond	$6.99

A 100-domain run on the Bronze rate costs $0.80 in domain charges.

Domains the source does not track are returned with hasData: false and are not charged, and neither is a row that came back mostly empty.

Free tier: 5 lifetime runs, 5 domains per run.

FAQ

How much data does each domain return? One dataset row per domain, holding thirteen sections. Across a five-domain sample the rows carried 339 to 849 nested records each. Volume tracks how long the domain has been indexed: domainStats and activeDates return one entry per month of coverage (76 to 243 in that sample), adHistory returned 36 to 226 ads, adKeywords returns 50 keyword timelines, competitorHistory returns a time series per competitor, and keywordLists returns eleven ranked buckets.

What country data is available? 32 country datasets, chosen from the dropdown. Default is US. Every row also includes countryCoverage, which lists how many keywords each country holds for that domain and flags the primary market, so you can tell at a glance whether a different country would return more.

Why do some keyword sections return a handful of rows with very large totals? Row counts on the keyword sections are capped at the source, while the counts in totals are not. Total keyword counts, backlink totals, estimated monthly organic value, and the rank-history volume and click totals all come back in full even where the sample of individual keyword rows is small. A few fields inside the keyword blocks (totalVolume and totalSeoClicks on organic, monthlyClicksTotal and monthlyBudget on paid) are returned as zero by the source and are passed through as-is.

What happens if a domain is not tracked? The row is still returned with hasData: false so you can see which inputs came back empty. Domains with no data are not charged.

Does this work on the free tier? Yes. Free tier allows 5 lifetime runs with up to 5 domains per run. Each subsequent run after the free limit requires credits.

Is the data fresh? Data reflects the latest available crawl. Historical metrics go back to the first month of coverage, which for established domains can be 2006 onward.

What happens if a section fails? The affected field names are listed in incompleteSections on that row and everything else is returned as normal. Other domains in the run are unaffected. A row that came back mostly empty is not charged.

Support

• Bugs: Issues tab
• Features: Email or issues
• Email: max@mapa.slmail.me

Legal Compliance

This actor collects SpyFu's published domain metrics. You are responsible for your own use of the output, including compliance with SpyFu's terms of service and with any data protection law that applies to you. Nothing here is legal advice, and running the actor is not itself a determination that a given use is permitted.

---

Structured domain intelligence from SpyFu: competitors, keywords, rank history, ad history and backlinks in one actor.