Firecrawl Agent - AI Autonomous Web Data Extraction

AI-powered autonomous web agent that navigates websites, handles complex interactions, and extracts structured data using natural language goals. Powered by Firecrawl's Agent API. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).

BYOK (Bring Your Own Key) -- you provide your own API credentials.

---

Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Firecrawl API key (get it at firecrawl.dev)

You can test with Demo Mode first (free, no key needed) to see the output format before committing.

---

Quick Start

Test with Demo Mode (free, no API key needed)

{
  "demoMode": true,
  "url": "https://example.com",
  "objective": "Find the pricing information and list all available plans with their features and costs"
}

Run with real data

{
  "demoMode": false,
  "url": "https://example.com",
  "objective": "Find the pricing information and list all available plans with their features and costs",
  "maxSteps": 10,
  "allowBacktracking": true,
  "firecrawlApiKey": "YOUR_API_KEY_HERE",
  "webhookPlatform": "custom"
}

---

Input Parameters

Parameter	Type	Default	Required	Description
url	string	-	No	The URL where the agent should start its extraction
objective	string	-	No	Describe in natural language what data you want to extract. The AI will autonomously navigate and find it.
schema	object	-	No	JSON schema defining the structure of extracted data. Leave empty for automatic extraction.
maxSteps	integer	10	No	Maximum number of pages/actions the agent can take
allowBacktracking	boolean	true	No	Allow the agent to go back and try different paths if stuck
firecrawlApiKey	string	-	Yes*	Your Firecrawl API key (get it at firecrawl.dev)
demoMode	boolean	true	No	Run with sample data (no API key required). Disable and provide a Firecrawl API key for real extraction.
webhookUrl	string	-	No	URL to send extraction results via POST request. Supports Zapier, Make, n8n, and custom webhooks.
webhookPlatform	string	"custom"	No	Select your webhook platform for optimized payload formatting
webhookHeaders	object	-	No	Additional HTTP headers to include in webhook requests (e.g., authorization tokens)

*Required when Demo Mode is off.

---

Pricing

This actor uses pay-per-event billing:

Event	Description	Price
Extraction Completed	Each autonomous extraction completed	$0.05

Demo mode is free -- no charges for sample data.

---

Troubleshooting

"API key is required"

You have Demo Mode turned off but didn't provide an API key. Either:

• Turn Demo Mode on to test with sample data
• Add your API key in the input

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

• Invalid input format (check the examples above)
• API key without proper permissions
• The target data doesn't exist or is too small to track

How do I test without an API key?

Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.

---

Built by John Rippy | Actor Arsenal