SEO Content Orchestrator - Keyword Research, SERP Analysis & Competitor Content Crawler

Automated SEO content research pipeline that chains multiple Apify actors to deliver keyword volume data, SERP analysis, competitor page crawling, and actionable content briefs — all in a single run.

What does SEO Content Orchestrator do?

This actor replaces manual SEO research workflows (and expensive tools like AirOps, Surfer SEO, or Clearscope) by orchestrating three Apify Store actors into one automated pipeline:

1. Keyword Volume & Metrics — Fetches search volume, CPC, competition level, competition index, and 12-month trend data for every keyword
2. SERP Analysis — Scrapes Google search results to extract organic rankings, People Also Ask questions, and related searches
3. Competitor Content Crawl — Crawls the top-ranking pages for each keyword and extracts word counts, headings, and content structure
4. Content Brief Generation — Aggregates all data into a ready-to-use content brief with target word count, suggested topics, and questions to answer

Use cases

• Content marketing teams — Research keywords and generate data-driven content briefs without switching between 5 different SEO tools
• SEO agencies — Batch-analyze keywords for multiple clients in a single run, export structured reports
• AI content workflows — Feed the output into Claude, GPT, or any LLM to generate optimized drafts with real SERP data
• Programmatic SEO — Automate content research at scale for hundreds of keywords
• Competitive analysis — See exactly what top-ranking pages cover, how long they are, and what questions they answer

Input

Field	Type	Default	Description
keywords	array of strings	required	Keywords to research
maxKeywords	integer	10	Limit analysis to top N keywords by search volume
competitorPagesPerKeyword	integer	3	How many top-ranking pages to crawl per keyword
country	string	us	Country code for search results (us, uk, de, etc.)
language	string	en	Language code (en, de, fr, etc.)

Example input

{
  "keywords": ["web scraping tools", "data extraction API", "browser automation"],
  "maxKeywords": 5,
  "competitorPagesPerKeyword": 3,
  "country": "us",
  "language": "en"
}

Output

Each run produces a single structured report with all pipeline data combined:

{
  "generatedAt": "2026-04-03T11:41:47.937Z",
  "pipeline": {
    "keywordVolume": "success",
    "serpAnalysis": "success",
    "competitorCrawl": "success"
  },
  "keywords": [
    {
      "keyword": "web scraping tools",
      "searchVolume": 14800,
      "cpc": 2.19,
      "competition": "LOW",
      "competitionIndex": 16,
      "monthlySearches": [{"year": 2026, "month": 2, "search_volume": 22200}, ...],
      "serp": {
        "organic": [
          {"title": "...", "url": "...", "snippet": "...", "position": 1}
        ],
        "paa": [{"question": "...", "answer": "..."}],
        "relatedSearches": ["related term 1", "related term 2"]
      }
    }
  ],
  "competitorContent": [
    {"url": "https://example.com/page", "title": "...", "wordCount": 2500, "headings": ["..."]}
  ],
  "contentBrief": {
    "targetWordCount": 2400,
    "competitorAvgWordCount": 2100,
    "paaToAnswer": ["What is web scraping?", "Is web scraping legal?"],
    "suggestedTopics": ["Getting started", "Best practices", "Tools comparison"]
  }
}

How it works

The actor chains three Apify Store actors using Actor.call():

1. Google Keyword Data Extractor — Returns search volume, CPC, competition data from Google Ads API
2. Google Search Scraper — Scrapes Google SERPs for organic results, PAA, related searches
3. Website Content Crawler — Crawls competitor pages to extract content structure

Each step has retry logic with exponential backoff. If any step fails, the pipeline continues with the remaining data — you always get a report.

Integrations

• MCP Server — Expose this actor to Claude, GPT, or any AI assistant via @apify/actors-mcp-server
• Webhooks — Trigger downstream workflows when the run completes
• API — Call via Apify API for programmatic access
• Zapier / Make — Connect to 5,000+ apps

Related actors

• AI Brand Monitor — Monitor your brand visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. Pairs with this actor: research keywords here, then track how your brand ranks in AI answers for those same keywords.
• Company Intelligence Enricher — Enrich company data with Google Knowledge Graph, news, locations, and social links.
• SERP Feature Tracker — Track featured snippets, PAA, and other SERP features over time.

Pricing

This actor calls other Apify Store actors, so costs depend on usage:

• Keyword volume: ~$0.005 per keyword
• SERP scraping: ~$0.01 per keyword
• Content crawling: ~$0.01 per page

Typical run for 10 keywords with 3 competitors each: ~$0.50