Pricing

from $0.01 / 1,000 results

Firecrawl Agent - Web Crawler

Advanced web crawling with Firecrawl. Extract clean markdown, handle JavaScript sites & manage large-scale crawls with built-in rate limiting & error handling.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

The Howlers

Actor stats

Bookmarked

Total users

Monthly active users

14 hours ago

Last modified

Categories

Developer tools

Automation

Agents

Starting URL

url

Optional

The URL where the agent should start its extraction

Type:string

Extraction Objective

objective

Optional

Describe in natural language what data you want to extract. The AI will autonomously navigate and find it.

Type:string

Output Schema (Optional)

schema

Optional

JSON schema defining the structure of extracted data. Leave empty for automatic extraction.

Type:object

Max Navigation Steps

maxSteps

Optional

Maximum number of pages/actions the agent can take

Type:integer

Minimum:1

Maximum:50

Default:10

Allow Backtracking

allowBacktracking

Optional

Allow the agent to go back and try different paths if stuck

Type:boolean

Default:true

Firecrawl API Key

firecrawlApiKey

Optional

Your Firecrawl API key (get it at firecrawl.dev)

Type:string

Demo Mode

demoMode

Optional

Run with sample data (no API key required). Disable and provide a Firecrawl API key for real extraction.

Type:boolean

Default:true

Webhook URL

webhookUrl

Optional

URL to send extraction results via POST request. Supports Zapier, Make, n8n, and custom webhooks.

Type:string

Webhook Platform

webhookPlatform

Optional

Select your webhook platform for optimized payload formatting

Type:string

Default:custom

Options:

zapiermaken8ncustom

Custom Webhook Headers

webhookHeaders

Optional

Additional HTTP headers to include in webhook requests (e.g., authorization tokens)

Type:object

Firecrawl AI-Powered Web Search & Scrape

alizarin_refrigerator-owner/firecrawl-ai-powered-web-search-scrape

Search the web and get clean, LLM-ready content in one API call. Powered by Firecrawl's /v1/search endpoint. Returns markdown, HTML, or extracted data. Perfect for SEO research, competitor analysis, and AI training data collection.

The Howlers

Python Example

apify/python-example

Example Actor written in Python, showing how to read the Actor input and push to the Actor's default dataset.

Apify

139

Agentic Crawler

hpix/agentic-crawler

An intelligent AI web scraper that navigates websites like a human. Just describe the data you need in plain English. Adapts to layout changes, handles dynamic JavaScript sites, and gets smarter with every run.

Hpix

Local Business Website Enricher - Contact Details

express_kingfisher/gmaps-place-enricher

Extract emails, phone numbers, and social media links (Instagram, LinkedIn, etc.) from any business website. Ideal for enriching leads from Google Maps.

Prince Raj

Google Maps Scraper & Tech Stack Audit

practicaltools/SMB-Tech-Stack-Audit

The only Google Maps Scraper that checks the website FOR you. Detects WordPress, Shopify, Pixels, and Chat Widgets to help you send better cold emails.

Practical Tools

5.0

Firecrawl Website Crawler

alizarin_refrigerator-owner/firecrawl-website-crawler

Enhanced Website Crawling with Superior JS Rendering Enhanced website crawler using Firecrawl's Crawl API for superior JavaScript rendering, smart rate limiting, anti-bot bypass, and clean markdown extraction.

The Howlers

Firecrawl Pro Advanced Web Scraping Full Firecrawl Features

alizarin_refrigerator-owner/firecrawl-pro-advanced-web-scraping-full-firecrawl-features

Professional scraping using Firecrawl's complete feature set / exposes all Firecrawl capabilities Markdown/HTML Content Filtering Include/Exclude Screenshots Stealth Mode Fast Mode Caching Location Proxies JSON Prompt-Based Branding Link Extraction Image Extraction Autonomous Multi-Page Discovery

The Howlers

Browser Use Apify

lexis-solutions/browser-use-apify

Open-source AI-powered browser automation based on Browser Use and hosted on Apify. Run any task using Apify's platform and LLMs like ChatGPT, Claude, etc. Easy, scalable, resilient, and hosted solution for web-enabled AI agents.

Lexis Solutions

331

5.0

Clean Web Scraper - Markdown for AI 🔥 Firecrawl API

clearpath/web-to-markdown

Convert any website to clean, LLM-optimized markdown using Firecrawl. Perfect for RAG pipelines, AI training data, and knowledge bases. No login required, 25% cheaper than Firecrawl direct. Batch process hundreds of URLs. Supports PDF/DOCX. Pay only $0.004 per page - no monthly fees.

ClearPath

Generate leads from google map - extract email and contacts

scraplib/google-maps-lead-generation

Extracts detailed business information including company details, ratings, hours of operation, contact info, email addresses, social media links, and more. This tool is perfect for creating comprehensive contact lists for lead generation, business development, and market research.