Firecrawl Pro

"Advanced Web Scraping with Full Firecrawl Features" by John Rippy | johnrippy.link

2025 Zapier Automation Hero of the Year - Project Phoenix: A 95-step AI sales pipeline cutting development time by 50%. Read more

---

Professional web scraping using Firecrawl's complete feature set. This actor exposes all advanced Firecrawl capabilities not available in basic scrapers.

Features

Basic Scraping

• Markdown/HTML Extraction - Clean content in multiple formats
• Main Content Filtering - Remove headers, footers, navigation
• Include/Exclude Tags - Fine-grained content selection

Advanced Features

• Actions - Click buttons, type text, scroll, wait before scraping
• Screenshots - Full-page or element screenshots in PNG/JPEG
• Stealth Mode - Anti-detection for protected sites
• Fast Mode - Accelerated scraping for simple pages
• Caching - Reduce costs with 2-day cache (configurable)
• Location Proxies - Geo-targeted content (US, UK, DE, FR, JP, AU, BR, IN)

Extraction

• JSON Schema Extraction - Define fields to extract as structured data
• Prompt-Based Extraction - Natural language extraction instructions
• Branding Profile - Extract colors, fonts, logos, typography
• Links Extraction - All links with metadata
• Images Extraction - All images with alt text

Agent Mode

• Autonomous Navigation - AI navigates multiple pages to find data
• Multi-Page Discovery - About, Pricing, Contact, etc.
• Credit Limits - Control agent spend per session

Use Cases

• Competitor Analysis - Scrape pricing pages with cookie dismissal
• Lead Enrichment - Extract company info across multiple pages
• E-commerce Monitoring - Product data with screenshots
• Brand Analysis - Extract visual identity (colors, fonts, logos)
• Content Archiving - Full-page screenshots with markdown backup

Input

Basic Scrape

{
  "urls": ["https://example.com"],
  "formats": ["markdown", "screenshot"],
  "stealthMode": true,
  "extractionSchema": {
    "type": "object",
    "properties": {
      "title": {"type": "string"},
      "price": {"type": "string"},
      "features": {"type": "array", "items": {"type": "string"}}
    }
  },
  "firecrawlApiKey": "fc-xxxxx"
}

With Actions (Dismiss Cookie Banner)

{
  "urls": ["https://example.com"],
  "formats": ["markdown"],
  "actions": [
    {"type": "wait", "milliseconds": 2000},
    {"type": "click", "selector": "#cookie-accept"},
    {"type": "wait", "milliseconds": 500}
  ],
  "firecrawlApiKey": "fc-xxxxx"
}

Agent Mode (Multi-Page Discovery)

{
  "urls": ["https://stripe.com"],
  "mode": "agent",
  "agentPrompt": "Navigate to find pricing information, company about page, and contact details.",
  "agentMaxCredits": 50,
  "extractionSchema": {
    "type": "object",
    "properties": {
      "companyName": {"type": "string"},
      "pricing": {"type": "string"},
      "contactEmail": {"type": "string"}
    }
  },
  "firecrawlApiKey": "fc-xxxxx"
}

Input Parameters

Parameter	Type	Default	Description
urls	array	-	URLs to scrape
mode	string	"basic"	"basic" or "agent"
formats	array	["markdown"]	markdown, html, rawHtml, links, screenshot, extract
onlyMainContent	boolean	true	Filter to main content only
actions	array	[]	Page actions before scraping
extractionSchema	object	-	JSON schema for extraction
extractionPrompt	string	-	Natural language extraction
screenshotOptions	object	{fullPage: true}	Screenshot settings
enableCaching	boolean	false	Use cached results
cacheMaxAge	number	172800	Cache age in seconds (2 days)
fastMode	boolean	false	Faster but less accurate
stealthMode	boolean	false	Anti-detection mode
proxyLocation	string	-	US, UK, DE, FR, JP, AU, BR, IN
extractBranding	boolean	false	Extract brand colors/fonts
agentPrompt	string	-	Instructions for agent mode
agentMaxCredits	number	50	Max Firecrawl credits per agent
firecrawlApiKey	string	-	Your Firecrawl API key
webhookUrl	string	-	Webhook for results
demoMode	boolean	true	Run with sample data

Output

{
  "url": "https://example.com",
  "success": true,
  "title": "Example Domain",
  "markdown": "# Example Domain\n\nThis domain is for use...",
  "screenshotBase64": "data:image/png;base64,...",
  "extractedData": {
    "title": "Example Domain",
    "price": "$99.00",
    "features": ["Feature 1", "Feature 2"]
  },
  "extractedDataCount": 3,
  "branding": {
    "primaryColor": "#0066cc",
    "secondaryColors": ["#ffffff"],
    "fonts": ["Arial", "Helvetica"],
    "logo": "https://example.com/logo.png"
  },
  "links": [{"url": "https://...", "text": "Link text"}],
  "images": [{"src": "https://...", "alt": "Image alt"}],
  "actionsExecuted": 2,
  "cachedResult": false,
  "scrapedAt": "2025-01-15T10:30:00.000Z",
  "mode": "basic",
  "featuresUsed": ["markdown", "screenshot", "schemaExtraction", "actions"]
}

Pricing

This actor uses pay-per-event pricing:

Event	Description	Price
page_scraped	Per webpage scraped with content	$0.02
screenshot_captured	Per full-page screenshot	$0.01
schema_extracted	Per structured data extraction	$0.03
actions_executed	Per action sequence (click, type, scroll)	$0.015
agent_navigation	Per autonomous agent session	$0.08
branding_extracted	Per branding profile extraction	$0.025

Example costs:

• Scrape 100 pages with markdown: 100 x $0.02 = $2.00
• Scrape 50 pages with screenshots: 50 x $0.02 + 50 x $0.01 = $1.50
• Agent navigation with extraction: $0.08 + $0.03 = $0.11

Actions Reference

Action	Parameters	Description
click	selector	Click an element
type	selector, text	Type into an input field
scroll	direction, amount	Scroll page
wait	milliseconds	Wait for time
screenshot	-	Take screenshot at this point
press	key	Press keyboard key

Webhook Integration

Results can be sent directly to Zapier, Make, n8n, or any webhook:

{
  "actorId": "firecrawl-pro",
  "status": "success",
  "resultCount": 5,
  "successCount": 5,
  "timestamp": "2025-01-15T10:30:00.000Z",
  "data": [/* array of results */]
}

Notes

• API Key Required - Get your Firecrawl API key at https://firecrawl.dev
• Stealth Mode - Use for sites with anti-bot protection
• Caching - Enable for repeated scrapes to reduce API costs
• Agent Mode - Best for multi-page discovery, uses more credits
• Demo Mode - Test with sample data before using API credits

---

Built by John Rippy | johnrippy.link

---

Keywords

firecrawl, web scraping, screenshot, stealth mode, data extraction, actions, automation, structured extraction, branding profile