Firecrawl Website Crawler

Fixed in version 1.3.1 (October 5, 2026). In the weeks before October 5, 2026, most runs of this Actor failed at "Failed to start crawl". Firecrawl's crawl API started rejecting three request options this Actor still sent, so every real crawl was refused before it began. Version 1.3.1 sends only the options Firecrawl accepts now, and crawls complete normally again. Your existing input works as it is; the one change is that waitForSelector now takes a wait time in milliseconds (for example 2000), because Firecrawl no longer accepts a CSS selector there. If your scheduled runs stopped because of these failures, they can be turned back on. If anything still fails, open an issue on the Issues tab with the run link and I will look at it.

Enhanced website crawler using Firecrawl's Crawl API for superior JS rendering, smart rate limiting, anti-bot bypass, and clean markdown extraction.

BYOK (Bring Your Own Key): you provide your own API credentials.

---

Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Firecrawl API key. Get one at firecrawl.dev

---

Quick Start

Run with real data

{
  "url": "https://example.com",
  "maxPages": 100,
  "maxDepth": 5,
  "includeSubdomains": false,
  "outputFormat": "markdown",
  "includeScreenshots": false,
  "firecrawlApiKey": "YOUR_API_KEY_HERE"
}

---

Input Parameters

Parameter	Type	Default	Required	Description
url	string	-	Yes*	The website URL to crawl (e.g., https://example.com)
maxPages	integer	100	No	Maximum number of pages to crawl
maxDepth	integer	5	No	Maximum crawl depth from the starting URL
includeSubdomains	boolean	false	No	Crawl subdomains of the main domain
excludePatterns	array	-	No	URL patterns to exclude from crawling (regex supported)
includePatterns	array	-	No	Only crawl URLs matching these patterns (regex supported)
outputFormat	string	"markdown"	No	Format for extracted content
includeScreenshots	boolean	false	No	Capture screenshots of each page
waitForSelector	string	-	No	CSS selector to wait for before extracting content (for JS-heavy sites)
country	string	-	No	Country code for geo-targeted crawling (e.g., 'US', 'GB')
firecrawlApiKey	string	-	Yes*	Your Firecrawl API key. Get one at firecrawl.dev
webhookUrl	string	-	No	URL to receive results via webhook when complete

---

Troubleshooting

"API key is required"

• Add your API key in the input

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

• Invalid input format (check the examples above)
• API key without proper permissions
• The target data doesn't exist or is too small to track

How do I test without an API key?

Run the actor without a firecrawlApiKey, or set "demoMode": true. It returns realistic sample results labeled with demo: true and a _notice field so you can inspect the exact output shape before connecting your own key. Demo runs make no external API calls and charge no task events.

---

Built by John Rippy | Actor Arsenal