Pricing

Pay per usage

Go to Apify Store

ScraperCodeGenerator

Try for free

An intelligent web scraping tool that automatically generates custom scraping code for any website.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Ondřej Hlava

Actor stats

Bookmarked

Total users

Monthly active users

a year ago

Last modified

Categories

Automation

Other

Open source

Target URL

targetUrl

Required

The URL of the website you want to scrape

Type:string

Scraping Goal

userGoal

Required

Describe what data you want to extract from the website

Type:string

Claude API Key

claudeApiKey

Required

Your Anthropic Claude API key for AI-powered code generation

Type:string

Max Retries

maxRetries

Optional

Maximum number of retry attempts for scraping

Type:integer

Minimum:1

Maximum:10

Default:3

Timeout (seconds)

timeout

Optional

Timeout for each scraping attempt in seconds

Type:integer

Minimum:10

Maximum:300

Default:60

Test Generated Script

testScript

Optional

Whether to test the generated scraping script before saving it

Type:boolean

Default:true

Claude Model

claudeModel

Optional

Choose which Claude model to use for AI analysis

Type:string

Default:claude-sonnet-4-20250514

Options:

claude-sonnet-4-20250514claude-opus-4-20250514claude-3-7-sonnet-20250219claude-3-5-sonnet-20241022claude-3-5-haiku-20241022claude-3-sonnet-20240229claude-3-haiku-20240307

Enable HTML Pruning

htmlPruningEnabled

Optional

Enable HTML content processing before analysis

Type:boolean

Default:true

Max List Items

htmlMaxListItems

Optional

Maximum number of items to keep in lists when pruning HTML

Type:integer

Minimum:1

Maximum:20

Default:3

Max Text Length

htmlMaxTextLength

Optional

Maximum length of text content to keep when pruning HTML

Type:integer

Minimum:50

Maximum:2000

Default:200

Prune Before Evaluation

htmlPruneBeforeEvaluation

Optional

Apply HTML pruning before quality evaluation

Type:boolean

Default:true

Prune Percentage

htmlPrunePercentage

Optional

Percentage of HTML content to prune (0-100)

Type:integer

Minimum:0

Maximum:100

Default:80

Scraping Actors Configuration

actors

Optional

Select and configure which Apify actors to use for scraping

Type:array

Concurrent Actors

concurrentActors

Optional

Run multiple actors simultaneously for faster results

Type:boolean

Default:true

Generate for Apify Actor

forActor

Optional

Choose the output format for the generated script

Type:boolean

Default:true

Scraping Page

flavorful_quintuplet/scraping-page

Scraping Page Based on Your Website

Nomeri Sadulak

AI Newsletter Agent

louisdeconinck/ai-newsletter-agent

An intelligent agent that automatically generates curated newsletters on any topic by collecting and aggregating content from multiple sources.

Louis Deconinck

5.0

Universal AI GPT Scraper

louisdeconinck/ai-gpt-scraper

Transform any website into structured data with AI-powered extraction. This versatile tool combines advanced web scraping with intelligent content analysis to deliver clean, customized JSON output - perfect for automating data collection from any web source.

Louis Deconinck

173

5.0

Universal Web Scraper & Data Extractor – Fast No-Code Tool

motivational_nickel/my-actor

Universal web scraper that extracts structured data from almost any website. Detect and scrape webpage content into clean datasets (CSV, Excel, JSON) without coding. Ideal for web scraping, research, lead generation, automation pipelines, and large-scale data extraction.

Leoncio Jr Coronado

5.0

Smart Url Extractor

diao-bah-timbi/smart-url-extractor

Intelligent web scraping Actor that automatically detects content types (products, jobs, articles, profiles) and extracts structured data with 15+ fields. Perfect for e-commerce monitoring, job aggregation, and content curation.

Mamadou Diao Bah

Website Content Crawler Fast

timelody/website-content-crawler-fast

Scraping data from every single web page.

timelody

5.0

📧✨ Extract Emails, Socials and Contacts from Any Website

logical_scrapers/extract-email-from-any-website

(fastest) An advanced Actor for extracting email addresses, social links and contact details from websites. This tool is perfect for web scraping, contact collection, and lead generation.

Goldmine

2.3K

5.0

AI Web Extractor

uxinfra/uxinfra-web-extractor

Intelligent web content extraction with AI-powered structuring. Extracts articles, products, reviews, and structured data from any website.

UXINFRA

Intelligent Website Scrapper

happitap/intelligent-website-scrapper

An intelligent website scraper that uses LangChain and LLM to extract and process content based on high-level goals like summarization, product extraction, service extraction, and FAQ extraction.

HappiTap

266

5.0

Universal Website to API – Any Site → JSON

inquisitive_zeppelin/universal-website-to-api---any-site---json

Multi-URL Web Scraper is a fast, reliable, and highly flexible scraping tool designed to extract structured data from multiple web pages in a single run.