AI Extraction Agent - Autonomous Web Data Extraction

AI-powered web agent that autonomously extracts data from websites using natural language objectives. Uses Claude AI for intelligent extraction - NO Firecrawl dependency required. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).

BYOK (Bring Your Own Key): you provide your own API credentials.

---

Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Anthropic API key for Claude AI extraction. Get one at https://console.anthropic.com

---

Quick Start

Run with real data

{
  "url": "https://example.com",
  "objective": "Find the pricing information and list all available plans with their features",
  "maxPages": 5,
  "followLinks": true,
  "anthropicApiKey": "YOUR_API_KEY_HERE",
  "webhookPlatform": "custom"
}

---

Input Parameters

Parameter	Type	Default	Required	Description
url	string	-	No	The starting URL to begin extraction from
objective	string	-	No	Natural language description of what data to extract (e.g., 'Find all pricing plans and their features')
schema	object	-	No	Optional JSON schema to structure the extracted data. If provided, the AI will conform output to this schema.
maxPages	integer	5	No	Maximum number of pages to crawl and analyze
followLinks	boolean	true	No	Whether to follow links on the page to discover more content
anthropicApiKey	string	-	Yes*	Your Anthropic API key for Claude AI extraction. Get one at https://console.anthropic.com
webhookUrl	string	-	No	URL to send extraction results via POST request. Supports Zapier, Make, n8n, and custom webhooks.
webhookPlatform	string	"custom"	No	Select your webhook platform for optimized payload formatting
webhookHeaders	object	-	No	Additional HTTP headers to include in webhook requests (e.g., authorization tokens)

---

Pricing

This actor uses pay-per-event billing:

Event	Description	Price
Extraction Completed	Each AI-powered web data extraction completed	$0.05

---

Troubleshooting

"API key is required"

• Add your API key in the input

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

• Invalid input format (check the examples above)
• API key without proper permissions
• The target data doesn't exist or is too small to track

How do I test without an API key?

Run the actor without an anthropicApiKey, or set "demoMode": true. It returns realistic sample results labeled with demo: true and a _notice field so you can inspect the exact output shape before connecting your own key. Demo runs make no external API calls and charge no task events.

---

Built by John Rippy | Actor Arsenal