Competitor Intelligence Scraper – Funnel, Pricing & Conversion Analyser

Scrape any competitor's public website and extract full conversion intelligence — sales funnel structure, lead magnets, CTAs at every stage, pricing model, upsells, cross-sells, social proof signals, and conversion tactics — all in one structured JSON report per competitor.

No API keys required. 100% free to run.

---

Why competitor funnel analysis matters

Most teams copy competitor UI. The best teams copy competitor business logic.

Knowing what a competitor shows is easy — you can just visit their site. Knowing how their funnel is structured, what they use to convert visitors at each stage, and what monetization model they rely on is the insight that drives better product and marketing decisions.

This actor gives you that intelligence systematically and at scale.

---

What does Competitor Intelligence Scraper do?

For each competitor URL you provide, the actor:

1. Crawls the website — discovers and visits high-value pages (pricing, demo, blog, case studies, sign-up, integrations, etc.) up to a configurable depth
2. Detects funnel stage — classifies each page into top, mid, or bottom of funnel
3. Extracts all CTAs — captures button and link copy with destination, classified by funnel stage
4. Identifies lead magnets — ebooks, newsletters, free trials, webinars, quizzes, checklists
5. Detects monetization model — subscription, freemium, one-time, usage-based, or enterprise
6. Analyses pricing page — number of plans, free tier, trial, highlighted plan, annual discount
7. Maps social proof — customer logos, testimonials, ratings, stats, awards
8. Flags conversion tactics — live chat, exit-intent popups, countdown timers, sticky nav CTAs
9. Surfaces upsell & cross-sell signals — copy patterns that indicate upgrade pressure or bundling
10. Outputs one structured report per competitor — ready to export, compare, or feed into your product/marketing workflow

---

What data does Competitor Intelligence Scraper return?

Funnel intelligence	Monetization	Conversion signals
🔺 Top/mid/bottom-of-funnel page types	💰 Pricing model detected	💬 Live chat vendor
📣 CTA copy + destination per page	💳 Plan names and prices	🚪 Exit-intent popup
🧲 Lead magnet types	🆓 Free tier / trial flag	⏱️ Countdown timer
📊 Pages crawled and analysed	📈 Annual discount offered	📌 Sticky nav CTA
🏆 Social proof signals	⭐ Plan highlighted	🔼 Upsell copy patterns

---

What can I do with competitor funnel data?

Growth teams and performance marketers

Audit multiple competitors' full funnel in minutes. Identify which CTAs they use at each stage, what lead magnets they offer, and which conversion tactics are in play. Use it to inform A/B tests and landing page strategy.

Founders and product managers

Understand how competitors monetize before you set your own pricing. Detect whether they use freemium, trials, or direct sales-assisted conversion. Map their upgrade pressure tactics and upsell copy to inform your own product decisions.

SEO and content strategists

Discover what top-of-funnel content competitors create to drive organic traffic. Identify content gaps and lead magnet formats you're missing (ebooks, webinars, checklists, courses).

SaaS and e-commerce managers

Compare the funnel structure of 5–10 competitors side by side. Identify industry-standard conversion patterns vs. differentiation opportunities.

Agencies and consultants

Deliver competitive funnel audits as part of client onboarding or strategy engagements. Run the actor on a client's top 5 competitors and output a structured JSON report in minutes.

---

Why use Competitor Intelligence Scraper instead of alternatives?

Feature	SpyFu / SimilarWeb (paid)	Competitor Intelligence Scraper
Funnel structure mapping	Traffic/keyword data only	CTA mapping by funnel stage
Pricing model detection	Not available	Freemium / subscription / usage-based
Lead magnet identification	Not available	Ebooks, trials, webinars, checklists
Conversion tactic detection	Not available	Chat, popups, countdown timers
Cost	$79–$449/month	Free (no API keys)
API key required	Yes	No
Export formats	Web UI only	JSON, CSV, Excel

---

Output example

{
    "competitor": "notion.so",
    "scraped_at": "2024-03-01T10:00:00.000Z",
    "pages_analysed": 18,
    "monetization_model": "freemium",
    "funnel": {
        "top_of_funnel": {
            "page_types": ["blog", "features"],
            "lead_magnets": ["free plan", "newsletter", "template"],
            "ctas": [
                { "copy": "Get Notion free", "destination": "/signup" }
            ]
        },
        "bottom_funnel": {
            "page_types": ["pricing", "signup"],
            "ctas": [
                { "copy": "Get started", "destination": "/signup" }
            ]
        }
    },
    "pricing": {
        "plans": [
            { "name": "Free", "price": "$0" },
            { "name": "Plus", "price": "$10/mo" }
        ],
        "has_free_tier": true,
        "has_trial": false,
        "annual_discount": "20% off annual",
        "highlighted_plan": "Plus"
    },
    "social_proof": {
        "signals": ["customer_logos", "stats", "testimonials"],
        "customer_count_mentioned": "30 million+ users"
    },
    "conversion_tactics": ["live_chat_widget", "sticky_nav_cta"]
}

---

How to use Competitor Intelligence Scraper

1. Enter competitor URLs

• Add one or more competitor URLs in the Competitor URLs field
• The actor crawls each site independently and produces one report per competitor
• Works best on public-facing marketing sites (SaaS, e-commerce, agencies, marketplaces)

2. Set crawl depth

• Max Pages Per Competitor controls how deeply the actor crawls each site
• 15–20 pages is enough for most SaaS sites
• Increase to 30–50 for large sites with many product pages

3. Run and export

• Click Start and results appear in the Dataset tab
• Export to JSON or CSV, or connect via the Apify API to your own pipeline

---

How much will it cost?

Competitor Intelligence Scraper uses CheerioCrawler for fast HTML scraping — no browser overhead.

Typical costs:

• 3 competitors at 20 pages each: < $0.10
• 10 competitors at 30 pages each: < $0.50

Cost tips:

• Start with 15–20 pages per competitor for most marketing sites — increasing beyond 50 rarely adds new funnel signals
• Avoid proxy for initial research; only enable if specific competitors block datacenter IPs

See the Apify pricing page for full pricing details.

---

How Competitor Intelligence Scraper works

1. The actor automatically discovers and prioritises high-value pages from each competitor site
2. Each page is fetched with CheerioCrawler and classified into a funnel stage based on URL patterns and page content
3. CTAs, lead magnets, pricing signals, and social proof are extracted using a multi-layer rule engine
4. Results are aggregated into one structured report per competitor

Page type	Funnel stage	What it reveals
Blog / Resources	Top	Content-led acquisition strategy
Ebooks / Guides / Webinars	Top	Lead magnet types
Features / How it works	Top–Mid	Value proposition structure
Case studies / Customers	Mid	Social proof strategy
Integrations	Mid	Ecosystem positioning
Demo / Book a call	Mid–Bottom	Sales-assisted conversion
Pricing / Plans	Bottom	Monetization model, plan structure
Free trial / Sign-up	Bottom	Self-serve conversion path

---

What is detected

Monetization models

subscription · freemium · one_time · usage_based · enterprise · unknown

Lead magnets

ebook · newsletter · free trial · free plan · webinar · checklist · template · quiz · course · whitepaper · email opt-in form

Conversion tactics

live_chat_widget · exit_intent_popup · countdown_timer · sticky_nav_cta

Social proof signals

customer_logos · testimonials · stats · awards

---

Input parameters

Parameter	Required	Default	Description
Competitor URLs	Yes	—	One or more competitor website URLs
Max Pages Per Competitor	No	20	How many pages to crawl per site (5–100)
Browser Language	No	English	Language header sent with requests

---

Limitations

This actor analyses publicly accessible pages only. It cannot access:

• Post-login content (onboarding flows, in-app upsells, email sequences)
• Retargeting ads (requires ad account access)
• Dynamic content loaded by JavaScript requiring a real browser

For best results, use on marketing sites and landing pages rather than web apps.

---

Integrations

Connect your funnel reports to any tool via Apify integrations:

• Google Sheets — Compare competitors' funnels in a spreadsheet
• Airtable — Build a live competitor intelligence database
• Make (Integromat) / Zapier — Trigger reports on a schedule or pipeline event
• Slack — Send competitor updates to your team automatically
• REST API — Pull data into your own product or BI tool

---

Frequently asked questions

What types of competitor sites does this work best on? Public-facing marketing and landing pages for SaaS, e-commerce, agencies, and marketplace businesses. It does not work on gated or login-required content.

How many pages should I crawl per competitor? 15–20 pages is sufficient for most SaaS sites to capture all funnel stages. Increase to 30–50 for large e-commerce or media sites with many distinct page types.

Can I track changes in competitor funnels over time? Yes. Schedule the actor on a monthly cadence and compare output datasets to detect changes in pricing plans, CTA copy, or lead magnet strategy.

What if the actor misses a pricing page? The actor prioritises URLs matching pricing-related patterns (/pricing, /plans, /subscription, etc.). If a competitor uses unusual URL structures, try increasing the max pages setting.

Can I use Competitor Intelligence Scraper via the Apify API? Yes. Use the Run Actor endpoint with your actor ID and input JSON. Combine with webhooks to trigger competitor monitoring on a schedule.

Can I use Competitor Intelligence Scraper through an MCP Server? Yes. Via the Apify MCP server, you can call this actor from any MCP-compatible AI assistant (Claude, ChatGPT, etc.) to analyse competitor funnels directly from a conversation.

Is scraping competitor websites legal? This actor accesses only publicly visible marketing pages — the same content any visitor sees. Scraping public websites is generally permitted under major jurisdictions. Always review a site's terms of service before large-scale or automated use.

---

Related actors

Actor	Description
E-Commerce Tech Stack Detector	Identify the platform and installed apps (Klaviyo, Gorgias, Klarna, etc.) for any store URL
Product Listing SEO Auditor	Audit product listings for SEO quality, structured data, and image completeness
AI SERP Intent Extractor	Classify search intent from Google results to understand what your audience is researching
Shopify Products Scraper	Scrape every product from any Shopify store using just the domain

---

Changelog

v0.1.3

• Latest stable release

---

Your feedback

Found a bug or have a feature request? Open an issue or contact us through the Apify platform. Your feedback helps improve this actor for everyone.