Firecrawl Competitive Intelligence - Auto-Discover Pricing, Features & Key Pages

Discover and extract competitor pricing, features, and key pages using Firecrawl's Map + Scrape APIs. Automatically finds relevant pages (pricing, features, about, contact) and extracts structured data including prices, plan names, and feature lists. Analyze multiple competitors in a single run with optional screenshot capture.

Features

• Smart Page Discovery - Auto-finds pricing, features, about, and contact pages using Firecrawl Map API
• Multi-Competitor Analysis - Analyze multiple competitors in one run
• Page Classification - Auto-categorizes discovered pages by type
• Pricing Extraction - Extracts prices, plan names, and billing intervals
• Feature Extraction - Pulls feature lists and comparison tables
• Screenshot Capture - Optional visual snapshots of competitor pages
• Custom Search Terms - Find specific page types beyond defaults
• Webhook Support - Async delivery for automation pipelines
• Demo Mode - Test with sample data before going live

Who Should Use This Actor?

Product Marketing Managers

Monitor competitor pricing and positioning changes. Track feature additions, pricing tier changes, and messaging updates across your competitive landscape.

Sales Enablement Teams

Build competitive battle cards with up-to-date pricing and feature comparisons. Know exactly how your product stacks up before every sales call.

Competitive Intelligence Analysts

Systematically track multiple competitors without manual research. Get structured data for competitive databases and executive reporting.

Strategy Consultants

Research market positioning and pricing strategies across industries. Deliver data-driven competitive analyses to clients.

Pricing Analysts

Track competitor pricing changes over time. Identify pricing patterns, discount strategies, and plan structure evolution.

Product Managers

Identify feature gaps and opportunities by analyzing what competitors offer. Inform roadmap decisions with competitive feature data.

Quick Start

Demo Mode (Free Test)

{
  "demoMode": true
}

Single Competitor Analysis

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": ["https://competitor.com"],
  "extractPricing": true,
  "extractFeatures": true,
  "demoMode": false
}

Multi-Competitor Analysis

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": [
    "https://competitor1.com",
    "https://competitor2.com",
    "https://competitor3.com"
  ],
  "pageTypes": ["pricing", "features", "about"],
  "extractPricing": true,
  "extractFeatures": true,
  "includeScreenshots": true,
  "demoMode": false
}

Custom Page Discovery

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": ["https://saas-competitor.com"],
  "pageTypes": ["pricing", "features", "integrations", "api"],
  "customSearchTerms": ["enterprise", "security", "compliance"],
  "maxPagesPerCompetitor": 15,
  "demoMode": false
}

Input Parameters

Parameter	Type	Default	Description
competitorUrls	array	-	List of competitor website URLs (required unless demoMode)
pageTypes	array	["pricing", "features", "about", "contact", "plans"]	Page types to discover
customSearchTerms	array	-	Additional search terms for page discovery
maxPagesPerCompetitor	number	10	Maximum pages to extract per competitor
extractPricing	boolean	true	Extract pricing data from pages
extractFeatures	boolean	true	Extract feature lists from pages
includeScreenshots	boolean	false	Capture page screenshots
firecrawlApiKey	string	-	Your Firecrawl API key (BYOK)
demoMode	boolean	true	Return sample data for testing
webhookUrl	string	-	Webhook URL for results delivery

Get Your Firecrawl API Key

1. Go to firecrawl.dev (or firecrawl.link/john-rippy for 10% off)
2. Sign up for free tier (500 credits/month) or paid plans
3. Go to Dashboard → API Keys
4. Copy your API key

Output Format

{
  "competitorUrl": "https://competitor.com",
  "competitorName": "Competitor Inc",
  "pagesAnalyzed": 8,
  "pages": [
    {
      "pageType": "pricing",
      "url": "https://competitor.com/pricing",
      "title": "Pricing Plans - Competitor",
      "description": "Flexible pricing for all business sizes",
      "markdown": "# Pricing Plans\n\n## Starter - $29/mo...",
      "extractedData": {
        "pricing": {
          "plans": [
            {
              "name": "Starter",
              "monthlyPrice": "$29",
              "annualPrice": "$290",
              "features": ["5 users", "10GB storage"]
            },
            {
              "name": "Pro",
              "monthlyPrice": "$99",
              "annualPrice": "$990",
              "features": ["Unlimited users", "100GB storage", "Priority support"]
            }
          ]
        }
      },
      "screenshotUrl": "https://...",
      "scrapedAt": "2026-01-28T10:30:00.000Z"
    }
  ],
  "summary": {
    "pricingPageFound": true,
    "featuresPageFound": true,
    "lowestPrice": "$29/mo",
    "highestPrice": "Custom",
    "planCount": 3
  },
  "analyzedAt": "2026-01-28T10:30:00.000Z"
}

Pricing (Pay-Per-Event)

Event	Description	Price
competitor_analyzed	Per competitor site analyzed	$0.05
pages_extracted	Per 5 pages scraped and extracted	$0.01

Example costs:

• 1 competitor, 10 pages: $0.05 + (2 x $0.01) = $0.07
• 5 competitors, 10 pages each: (5 x $0.05) + (10 x $0.01) = $0.35
• 10 competitors with screenshots: (10 x $0.05) + (20 x $0.01) = $0.70
• Demo mode: $0.00

Note: Firecrawl API usage is billed separately through your Firecrawl account (BYOK).

Common Scenarios

Scenario 1: Monthly Competitive Pricing Audit

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": [
    "https://competitor1.com",
    "https://competitor2.com",
    "https://competitor3.com"
  ],
  "pageTypes": ["pricing", "plans"],
  "extractPricing": true,
  "includeScreenshots": true,
  "webhookUrl": "https://hooks.zapier.com/...",
  "demoMode": false
}

Schedule monthly to track pricing changes and build historical competitive pricing database.

Scenario 2: Feature Gap Analysis

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": ["https://main-competitor.com"],
  "pageTypes": ["features", "integrations", "api", "security"],
  "extractFeatures": true,
  "maxPagesPerCompetitor": 20,
  "demoMode": false
}

Discover all competitor features and integrations for product roadmap planning.

Scenario 3: Sales Battle Card Data

{
  "firecrawlApiKey": "fc-XXXXXXXXXXXXXXXX",
  "competitorUrls": ["https://competitor.com"],
  "pageTypes": ["pricing", "features", "about", "customers", "case-studies"],
  "extractPricing": true,
  "extractFeatures": true,
  "includeScreenshots": true,
  "demoMode": false
}

Gather comprehensive competitor data for sales enablement materials.

Webhook & Automation Integration

Zapier / Make.com / n8n

1. Create a webhook trigger in your automation platform
2. Copy the webhook URL to webhookUrl
3. Route competitive intelligence to dashboards and databases

Popular automations:

• Pricing data -> Google Sheets (competitive pricing tracker)
• Feature lists -> Notion (competitive intelligence database)
• Screenshots -> Slack (competitor update alerts)
• Price changes -> Email (executive notifications)

Apify Scheduled Runs

Schedule weekly or monthly competitive intelligence gathering.

FAQ

Q: How does page discovery work?

A: The actor uses Firecrawl's Map API to scan the competitor site and identify pages matching your pageTypes (pricing, features, etc.). It then scrapes those pages for structured data.

Q: Can I track competitors over time?

A: Yes. Schedule regular runs and use webhooks to send data to Google Sheets or a database. Compare results over time to track pricing and feature changes.

Q: What if a competitor has non-standard page names?

A: Use customSearchTerms to find pages with custom names (e.g., "enterprise" for enterprise pricing, "solutions" for feature pages).

Q: Are screenshots full-page?

A: Yes, screenshots capture the entire page for visual documentation and archiving.

Q: How do I handle gated/login-required pages?

A: This actor only extracts publicly accessible pages. Gated content requires authentication, which is not supported.

Common Problems & Solutions

"Invalid API key" error

• Get your API key from firecrawl.dev dashboard
• Copy it exactly without extra spaces

Fewer pages found than expected

• Some sites have unusual page structures
• Add customSearchTerms for non-standard page names
• Increase maxPagesPerCompetitor for larger sites

Missing pricing data

• Some sites hide pricing behind sales forms
• Pricing may be in images (not extractable as text)
• Try adding "plans" or "packages" to pageTypes

"Demo data showing"

• Set demoMode: false and provide your firecrawlApiKey

---

📞 Support

• Actor Arsenal: Full Actor Catalog
• Developer: John Rippy

---

Built by John Rippy | Actor Arsenal