Firecrawl Agent - Web Crawler
Pricing
from $0.01 / 1,000 results
Firecrawl Agent - Web Crawler
Advanced web crawling with Firecrawl. Extract clean markdown, handle JavaScript sites & manage large-scale crawls with built-in rate limiting & error handling.
Pricing
from $0.01 / 1,000 results
Rating
0.0
(0)
Developer
The Howlers
Maintained by CommunityActor stats
5
Bookmarked
120
Total users
1
Monthly active users
7 days ago
Last modified
Categories
Features
Share
Firecrawl Agent - AI Web Data Extraction
Reads one web page with Firecrawl (JavaScript rendered, always fresh) and returns its content. Give a JSON schema and your plain-English objective guides Firecrawl's AI extraction of structured data from that page. It does not follow links or navigate to other pages. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).
BYOK (Bring Your Own Key): you provide your own API credentials.
What it does
- Scrapes the
urlonce with Firecrawl (markdown + HTML, JavaScript rendered, never from cache). - If you give a
schema, runs one Firecrawl JSON extraction on the same page, with yourobjectiveas the prompt, and returns the structured data. - Without a schema, returns the page title, description and the first 5,000 characters of its markdown.
It reads that single page only: it does not click, follow links, or visit other pages, so stepsUsed is 1 and pagesVisited is just the url. For multi-page crawling use a Firecrawl crawl actor.
Before You Start
This actor requires your own API credentials to fetch real data.
Where to get your key: Your Firecrawl API key (get it at firecrawl.dev)
The Firecrawl API key is required. Demo Mode is off by default; turn it on to get labeled sample output (no Firecrawl call, no task charges) that shows the output format.
Quick Start
See the output format with Demo Mode (no Firecrawl call)
{"demoMode": true,"firecrawlApiKey": "YOUR_API_KEY_HERE","url": "https://example.com","objective": "Find the pricing information and list all available plans with their features and costs"}
Run with real data
{"demoMode": false,"url": "https://example.com","objective": "Find the pricing information and list all available plans with their features and costs","firecrawlApiKey": "YOUR_API_KEY_HERE","webhookPlatform": "custom"}
Input Parameters
| Parameter | Type | Default | Required | Description |
|---|---|---|---|---|
url | string | - | No | The page to read. Only this page is scraped; links on it are not followed. |
objective | string | - | No | Describe in plain English what data you want from the page. With a schema, it is the prompt for Firecrawl's AI extraction of that one page. Without a schema, the page title, description and first 5,000 characters of content are returned and the objective is recorded with them. The actor does not navigate to other pages. |
schema | object | - | No | JSON schema defining the structure of extracted data. When given, Firecrawl's AI extracts data in this shape from the page (one extra Firecrawl request). Leave empty to get the page content instead. |
maxSteps | integer | 10 | No | Currently has no effect. The actor reads the start page (plus one structured extraction when a schema is given), and Firecrawl's API has no step limit. Kept so existing inputs still work. |
allowBacktracking | boolean | true | No | Currently has no effect: Firecrawl's API has no backtracking option. Kept so existing inputs still work. |
firecrawlApiKey | string | - | Yes | Your Firecrawl API key (get it at firecrawl.dev) |
demoMode | boolean | false | No | Return labeled sample output instead of calling Firecrawl. |
webhookUrl | string | - | No | URL to send extraction results via POST request. Supports Zapier, Make, n8n, and custom webhooks. |
webhookPlatform | string | "custom" | No | Select your webhook platform for optimized payload formatting |
webhookHeaders | object | - | No | Additional HTTP headers to include in webhook requests (e.g., authorization tokens) |
Pricing
This actor uses pay-per-event billing:
| Event | Description | Price |
|---|---|---|
| Actor Start | Apify's start charge, per GB of run memory (minimum one), on every run | $0.10 |
| Page Crawled | Each page scraped and returned in real mode | $0.02 |
Demo mode returns labeled sample data and charges none of the events above; Apify's Actor Start charge still applies to every run.
Troubleshooting
"Field input.firecrawlApiKey is required"
The run did not start because the Firecrawl API key is missing. Add your key in the input; nothing is charged for a run that does not start.
"API error 403" or "Unauthorized"
Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.
"API error 429" or "Rate limit"
Too many requests. Wait a minute and try again, or reduce the number of items per run.
No results or empty dataset
Check the run log for error messages. Common causes:
- Invalid input format (check the examples above)
- API key without proper permissions
- The target data doesn't exist or is too small to track
Can I see the output without using Firecrawl credits?
Enable Demo Mode in the input (the API key field is still required). The run makes no Firecrawl call and returns sample data labeled demo: true, so you can check the output format for your workflow.
Built by John Rippy | Actor Arsenal


