ScraperCodeGenerator

Pricing

Pay per usage

Try for free

Go to Apify Store

ScraperCodeGenerator

Try for free

Developed by

Ondřej Hlava

Maintained by Community

An intelligent web scraping tool that automatically generates custom scraping code for any website.

0.0 (0)

Pricing

Pay per usage

Last modified

3 months ago

Automation

Other

Open source

Target URL

targetUrlstringRequired

The URL of the website you want to scrape

Scraping Goal

userGoalstringRequired

Describe what data you want to extract from the website

Claude API Key

claudeApiKeystringRequired

Your Anthropic Claude API key for AI-powered code generation

Max Retries

maxRetriesintegerOptional

Maximum number of retry attempts for scraping

Default value of this property is 3

Timeout (seconds)

timeoutintegerOptional

Timeout for each scraping attempt in seconds

Default value of this property is 60

Test Generated Script

testScriptbooleanOptional

Whether to test the generated scraping script before saving it

Default value of this property is true

Claude Model

claudeModelEnumOptional

Choose which Claude model to use for AI analysis

Value options:

"claude-sonnet-4-20250514": string"claude-opus-4-20250514": string"claude-3-7-sonnet-20250219": string"claude-3-5-sonnet-20241022": string"claude-3-5-haiku-20241022": string"claude-3-sonnet-20240229": string"claude-3-haiku-20240307": string

Default value of this property is "claude-sonnet-4-20250514"

Enable HTML Pruning

htmlPruningEnabledbooleanOptional

Enable HTML content processing before analysis

Default value of this property is true

Max List Items

htmlMaxListItemsintegerOptional

Maximum number of items to keep in lists when pruning HTML

Default value of this property is 3

Max Text Length

htmlMaxTextLengthintegerOptional

Maximum length of text content to keep when pruning HTML

Default value of this property is 200

Prune Before Evaluation

htmlPruneBeforeEvaluationbooleanOptional

Apply HTML pruning before quality evaluation

Default value of this property is true

Prune Percentage

htmlPrunePercentageintegerOptional

Percentage of HTML content to prune (0-100)

Default value of this property is 80

Scraping Actors Configuration

actorsarrayOptional

Select and configure which Apify actors to use for scraping

Concurrent Actors

concurrentActorsbooleanOptional

Run multiple actors simultaneously for faster results

Default value of this property is true

Generate for Apify Actor

forActorbooleanOptional

Choose the output format for the generated script

Default value of this property is true

Scraping Page

flavorful_quintuplet/scraping-page

Scraping Page Based on Your Website

Nomeri Sadulak

AI Newsletter Agent

louisdeconinck/ai-newsletter-agent

An intelligent agent that automatically generates curated newsletters on any topic by collecting and aggregating content from multiple sources.

Louis Deconinck

5.0

website content crawler

akash9078/website-content-crawler

Powerful website content crawler tool to extract, analyze, and index web pages automatically. Streamline data collection with fast, accurate web scraping technology.

Akash Kumar Naik

Universal AI GPT Scraper

louisdeconinck/ai-gpt-scraper

Transform any website into structured data with AI-powered extraction. This versatile tool combines advanced web scraping with intelligent content analysis to deliver clean, customized JSON output - perfect for automating data collection from any web source.

Louis Deconinck

127

5.0

Custom Web Scraping Service

delicious_zebu/custom-web-scraping-service

Discover professional, tailored web scraping solutions. Input anything to learn about our services, pricing, and process!

ВAH

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

170

5.0

Website Content Crawler Fast

timelody/website-content-crawler-fast

Scraping data from every single web page.

timelody

5.0

📧✨ Extract Emails, Socials and Contacts from Any Website

logical_scrapers/extract-email-from-any-website

(fastest) An advanced Actor for extracting email addresses, social links and contact details from websites. This tool is perfect for web scraping, contact collection, and lead generation.

Goldmine

866

5.0

Intelligent Website Scrapper

happitap/intelligent-website-scrapper

An intelligent website scraper that uses LangChain and LLM to extract and process content based on high-level goals like summarization, product extraction, service extraction, and FAQ extraction.

HappiTap

Ultimate Walmart Scraper

eneiromatos/ultimate-walmart-scraper

This is the ultimate web scraping tool for extracting the most relevant data points from products on Walmart.com! Developed by an expert software developer, this powerful scraper is a fast and reliable tool for all your web scraping needs.