Pricing

from $5.00 / 1,000 results

AI-Powered Smart Web Scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

Pricing

from $5.00 / 1,000 results

Rating

0.0

(0)

Developer

cloud9

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Categories

Automation

URLs

urls

Required

List of URLs to scrape. Each URL will be processed and its content extracted.

Type:array

Max Pages

maxPages

Optional

Maximum number of pages to crawl. Applies when maxDepth > 0 for multi-page crawling.

Type:integer

Minimum:1

Maximum:1000

Default:10

Output Format

outputFormat

Optional

Format of the extracted content.

Type:string

Default:markdown

Options:

markdowntexthtml

Chunk Size (tokens)

chunkSize

Optional

Target size for each text chunk in estimated tokens. Ideal for embedding models (OpenAI: 8191, Cohere: 512).

Type:integer

Minimum:100

Maximum:16000

Default:1000

Chunk Overlap (tokens)

chunkOverlap

Optional

Number of overlapping tokens between consecutive chunks. Helps maintain context across chunk boundaries.

Type:integer

Minimum:0

Maximum:2000

Default:100

Exclude CSS Selectors

excludeSelectors

Optional

Additional CSS selectors to remove from the page before extraction. Nav, footer, ads are already excluded by default.

Type:array

Default:

[]

Include Links

includeLinks

Optional

Extract all links from the page and include them in metadata.

Type:boolean

Default:true

Include Images

includeImages

Optional

Extract all images from the page and include them in metadata.

Type:boolean

Default:true

Max Crawl Depth

maxDepth

Optional

Maximum crawl depth. 0 = only the provided URLs, 1 = follow links one level deep, etc.

Type:integer

Minimum:0

Maximum:10

Default:0

Respect robots.txt

respectRobotsTxt

Optional

Whether to respect robots.txt rules. Recommended to keep enabled.

Type:boolean

Default:true

AI Web Extractor

uxinfra/uxinfra-web-extractor

Intelligent web content extraction with AI-powered structuring. Extracts articles, products, reviews, and structured data from any website.

UXINFRA

Agentic Crawler

hpix/agentic-crawler

An intelligent AI web scraper that navigates websites like a human. Just describe the data you need in plain English. Adapts to layout changes, handles dynamic JavaScript sites, and gets smarter with every run.

Hpix

AI Smart Scraper — Extract Data from Any Website

flreey/ai-smart-scraper

AI web scraper: describe the data you want in plain English, get clean JSON from any webpage. No CSS selectors needed. For lead gen, price monitoring, RAG, and AI agents. Powered by Gemini AI.

亲晖林

Universal AI Web Scraper

stanvanrooy6/universal-ai-web-scraper

Turn any website into an API. Extract structured data using plain English. Features anti-bot bypass, dynamic rendering, and web search. No coding needed.

Stan Van Rooy

5.0

AI Lead Extractor

dz_omar/ai-lead-extractor

Extract any information from websites using intelligent AI - from contact details to custom data fields, summaries, and creative content. Free tier: basic contact extraction. Paid tier: AI-powered dynamic extraction with natural language instructions.

FlowExtract API

4.3

Crawlee HTML Scraper

ellustar/my-actor-28

Crawlee HTML Scraper is a fast, lightweight web scraping actor built with JavaScript, Crawlee, and Cheerio. It efficiently extracts structured data from static HTML pages, supports custom selectors, pagination, and scalable crawling for reliable web data collection.

Ellustar

Crawlee Scraper

ellustar/my-actor-62

Crawlee Scraper** is a lightweight JavaScript actor for fast and reliable web scraping using Crawlee and Cheerio. It efficiently crawls pages, extracts structured data, and supports scalable, customizable scraping workflows.

Ellustar

Smart Url Extractor

diao-bah-timbi/smart-url-extractor

Intelligent web scraping Actor that automatically detects content types (products, jobs, articles, profiles) and extracts structured data with 15+ fields. Perfect for e-commerce monitoring, job aggregation, and content curation.

Mamadou Diao Bah

Universal AI GPT Scraper

louisdeconinck/ai-gpt-scraper

Transform any website into structured data with AI-powered extraction. This versatile tool combines advanced web scraping with intelligent content analysis to deliver clean, customized JSON output - perfect for automating data collection from any web source.