Firecrawl Agent - Web Crawler avatar

Firecrawl Agent - Web Crawler

Pricing

from $0.01 / 1,000 results

Go to Apify Store
Firecrawl Agent - Web Crawler

Firecrawl Agent - Web Crawler

Advanced web crawling with Firecrawl. Extract clean markdown, handle JavaScript sites & manage large-scale crawls with built-in rate limiting & error handling.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

The Howlers

The Howlers

Maintained by Community

Actor stats

5

Bookmarked

120

Total users

1

Monthly active users

7 days ago

Last modified

Features

Limited permissions

Share

Firecrawl Agent - AI Web Data Extraction

Reads one web page with Firecrawl (JavaScript rendered, always fresh) and returns its content. Give a JSON schema and your plain-English objective guides Firecrawl's AI extraction of structured data from that page. It does not follow links or navigate to other pages. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).

BYOK (Bring Your Own Key): you provide your own API credentials.


What it does

  1. Scrapes the url once with Firecrawl (markdown + HTML, JavaScript rendered, never from cache).
  2. If you give a schema, runs one Firecrawl JSON extraction on the same page, with your objective as the prompt, and returns the structured data.
  3. Without a schema, returns the page title, description and the first 5,000 characters of its markdown.

It reads that single page only: it does not click, follow links, or visit other pages, so stepsUsed is 1 and pagesVisited is just the url. For multi-page crawling use a Firecrawl crawl actor.


Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Firecrawl API key (get it at firecrawl.dev)

The Firecrawl API key is required. Demo Mode is off by default; turn it on to get labeled sample output (no Firecrawl call, no task charges) that shows the output format.


Quick Start

See the output format with Demo Mode (no Firecrawl call)

{
"demoMode": true,
"firecrawlApiKey": "YOUR_API_KEY_HERE",
"url": "https://example.com",
"objective": "Find the pricing information and list all available plans with their features and costs"
}

Run with real data

{
"demoMode": false,
"url": "https://example.com",
"objective": "Find the pricing information and list all available plans with their features and costs",
"firecrawlApiKey": "YOUR_API_KEY_HERE",
"webhookPlatform": "custom"
}

Input Parameters

ParameterTypeDefaultRequiredDescription
urlstring-NoThe page to read. Only this page is scraped; links on it are not followed.
objectivestring-NoDescribe in plain English what data you want from the page. With a schema, it is the prompt for Firecrawl's AI extraction of that one page. Without a schema, the page title, description and first 5,000 characters of content are returned and the objective is recorded with them. The actor does not navigate to other pages.
schemaobject-NoJSON schema defining the structure of extracted data. When given, Firecrawl's AI extracts data in this shape from the page (one extra Firecrawl request). Leave empty to get the page content instead.
maxStepsinteger10NoCurrently has no effect. The actor reads the start page (plus one structured extraction when a schema is given), and Firecrawl's API has no step limit. Kept so existing inputs still work.
allowBacktrackingbooleantrueNoCurrently has no effect: Firecrawl's API has no backtracking option. Kept so existing inputs still work.
firecrawlApiKeystring-YesYour Firecrawl API key (get it at firecrawl.dev)
demoModebooleanfalseNoReturn labeled sample output instead of calling Firecrawl.
webhookUrlstring-NoURL to send extraction results via POST request. Supports Zapier, Make, n8n, and custom webhooks.
webhookPlatformstring"custom"NoSelect your webhook platform for optimized payload formatting
webhookHeadersobject-NoAdditional HTTP headers to include in webhook requests (e.g., authorization tokens)

Pricing

This actor uses pay-per-event billing:

EventDescriptionPrice
Actor StartApify's start charge, per GB of run memory (minimum one), on every run$0.10
Page CrawledEach page scraped and returned in real mode$0.02

Demo mode returns labeled sample data and charges none of the events above; Apify's Actor Start charge still applies to every run.


Troubleshooting

"Field input.firecrawlApiKey is required"

The run did not start because the Firecrawl API key is missing. Add your key in the input; nothing is charged for a run that does not start.

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

  • Invalid input format (check the examples above)
  • API key without proper permissions
  • The target data doesn't exist or is too small to track

Can I see the output without using Firecrawl credits?

Enable Demo Mode in the input (the API key field is still required). The run makes no Firecrawl call and returns sample data labeled demo: true, so you can check the output format for your workflow.


Built by John Rippy | Actor Arsenal