SpyFu Domain Scraper: Bulk SEO & PPC Competitor Reports

SpyFu Domain Scraper builds an SEO and PPC competitor report for any website from SpyFu data. For each domain you get organic keyword count, estimated monthly SEO clicks and their dollar value, average ranking, paid keyword count, monthly Google Ads clicks and estimated ad budget. Each report also includes top organic and paid keywords, top SEO and PPC competitors, the countries where the site ranks, and month-by-month history. You can analyze hundreds of domains in one run and export to CSV, Excel or JSON, with no SpyFu subscription and no per-seat fees.

What does SpyFu Domain Scraper do?

SpyFu estimates how much search traffic every website gets from Google and how much it spends on Google Ads. This scraper pulls that competitive intelligence for a whole list of domains at once:

• 📈 SEO metrics: organic keywords, monthly organic clicks, organic traffic value in USD, average organic rank and an SEO strength score.
• 💰 PPC metrics: paid keywords, monthly paid clicks, estimated monthly Google Ads budget and average ad position.
• 🔑 Top keywords: the most valuable organic keywords, newly ranked keywords and the most successful paid keywords, with search volume, keyword difficulty, CPC and ranking URL.
• 🥊 Competitors: top organic (SEO) and paid (PPC) competitors with the number of shared keywords.
• 🌍 Top countries: where the domain ranks and how many keywords it has in each country.
• 🗓️ History: monthly SEO and PPC metrics going back as far as you need.

What data can you get?

Metric	Description
seoStrength	Overall SEO strength score (0–100).
organicKeywords	Number of keywords the domain ranks for.
monthlyOrganicClicks	Estimated organic clicks per month.
monthlyOrganicValueUsd	What those clicks would cost in Google Ads.
averageOrganicRank	Average organic position.
paidKeywords	Number of keywords the domain buys ads on.
monthlyPaidClicks	Estimated paid clicks per month.
monthlyAdBudgetUsd	Estimated monthly Google Ads spend.
averageAdRank	Average ad position.
topOrganicKeywords	Most valuable organic keywords with volume, difficulty, CPC, rank and URL.
newlyRankedKeywords	Keywords the domain started ranking for recently.
topPaidKeywords	Most successful paid keywords.
organicCompetitors / paidCompetitors	Top competing domains with shared keywords.
topCountries	Keyword counts by country.
history	Month-by-month SEO and PPC metrics.

Use cases

• SEO and PPC agencies: run quick audits and pitch decks for prospects in bulk.
• Competitor research: see how much traffic and ad spend your competitors have, and which keywords drive it.
• Lead generation: qualify prospects by ad budget. Companies spending on Google Ads are buying marketing services.
• Market sizing and due diligence: compare online visibility across a list of companies or acquisition targets.
• Content strategy: find a competitor's most valuable and newly ranked keywords.
• Tracking: schedule monthly runs to follow competitors' SEO and PPC trends.

How to get SEO and PPC data for a list of domains

1. Click Try for free to open SpyFu Domain Scraper in Apify Console.
2. Paste your domains, one per line (bare domains or full URLs).
3. Pick the country (Google market).
4. Choose whether to include top keywords, competitors and monthly history.
5. Click Start and download one report per domain as CSV, Excel or JSON.

Input

Example input

{
  "domains": ["hubspot.com", "shopify.com", "apify.com"],
  "country": "US",
  "includeKeywords": true,
  "includeCompetitors": true,
  "includeHistory": true,
  "historyMonths": 12
}

Field	Description
Domains	Websites to analyze. One report per domain.
Country	Google market: US, UK, CA, AU, DE, FR, ES, IT, NL, BR, MX, IN and more.
Include top keywords	Most valuable, newly ranked and top paid keywords.
Include competitors	Top SEO and PPC competitors.
Include monthly history	Month-by-month metrics.
History months	How many recent months to include.

Output

Domain report example

{
  "domain": "shopify.com",
  "country": "US",
  "month": "2026-09",
  "seoStrength": 72,
  "organicKeywords": 1102000,
  "monthlyOrganicClicks": 1503000,
  "monthlyOrganicValueUsd": 15490000,
  "averageOrganicRank": 38.2,
  "paidKeywords": 344700,
  "monthlyPaidClicks": 10230000,
  "monthlyAdBudgetUsd": 10090000,
  "averageAdRank": 2.2,
  "topCountries": [{ "country": "US", "organicKeywords": 1102000, "isPrimary": true }, { "country": "UK", "organicKeywords": 712500, "isPrimary": false }],
  "topOrganicKeywords": [{ "keyword": "shopify", "rank": 1, "url": "https://www.shopify.com/", "searchVolume": 870000, "keywordDifficulty": 9, "costPerClick": 5.16, "estimatedMonthlyClicks": 143000 }],
  "organicCompetitors": [{ "domain": "wix.com", "commonKeywords": 61000 }, { "domain": "hubspot.com", "commonKeywords": 53067 }],
  "paidCompetitors": [{ "domain": "wix.com", "commonKeywords": 9800 }],
  "history": [{ "month": "2026-08", "organicKeywords": 1090000, "monthlyOrganicClicks": 1480000, "monthlyAdBudgetUsd": 9800000 }]
}

Domains without enough search data in the chosen country get a row with hasData: false and an error message, and are not charged.

How much does it cost?

SpyFu Domain Scraper uses pay-per-report pricing: one fixed price per domain report, and domains without data are free. Higher Apify plans get an automatic discount. See the Pricing tab for the exact price per domain.

More marketing and SEO tools

• Tech Stack Detector: find the CMS, analytics, ad pixels and hosting behind any website.
• Google Search Scraper: Google search results for any query.
• Website Content Crawler Pro: turn whole websites into clean Markdown.

FAQ

Do I need a SpyFu account? No. Just add domains and click Start.

How accurate are the traffic and budget numbers? They are SpyFu's estimates based on keyword rankings, search volumes and CPCs. Use them to compare sites and spot trends, not as exact analytics.

How many keywords and competitors are included? Each report includes the top keywords in three lists (most valuable, newly ranked and top paid) and the top SEO and PPC competitors.

Which countries are supported? US, UK, Canada, Australia, Germany, France, Spain, Italy, the Netherlands, Brazil, Mexico, India and more. Pick one per run.

Can I analyze hundreds of domains? Yes. Paste a long list; domains are processed in parallel.

What formats can I export? CSV, Excel, JSON, XML, HTML and RSS, or read the results through the Apify API.

Can I integrate SpyFu Domain Scraper with other apps? SpyFu Domain Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. It works with Make, Zapier, Slack, Airbyte, GitHub, Google Drive and many more, plus the Apify API, JS/Python clients and MCP. Or use webhooks to trigger an action whenever a run finishes.

Related Actors

• Tech Stack Detector
• Google Search Scraper

Notes

Original clean-room implementation. Returns only publicly available data; you are responsible for compliance with SpyFu's terms. Not affiliated with SpyFu.