Under maintenance

Pricing

from $0.00005 / actor start

Try for free

Go to Apify Store

AI Web Crawler

Under maintenance

Try for free

Extract structured data from any website using AI. No custom selectors needed.

Pricing

from $0.00005 / actor start

Rating

0.0

(0)

Developer

Angel Rojo

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

AI Web Scraper — Extract Data from Any Website with GPT API through CLI

The Apify CLI is the official tool that allows you to use AI Web Crawler locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

AI Web Crawler API in Python

AI Web Crawler API in JavaScript

AI Web Crawler OpenAPI definition

AI Web Crawler API

AI Smart Scraper — Extract Data from Any Website

flreey/ai-smart-scraper

AI web scraper: describe the data you want in plain English, get clean JSON from any webpage. No CSS selectors needed. For lead gen, price monitoring, RAG, and AI agents. Powered by Gemini AI.

亲晖林

5.0

AI Website Content Crawler

ilborso/ai-website-content-crawler

A super fast website crawler for AI training

Fabio Borsotti

5.0

AI Web Scraper

crawlworks/ai-web-scraper

Scrape any webpage with a URL and a plain-English prompt. Get structured JSON output powered by AI — no coding, no selectors, no configuration.

Crawlworks

🤖 AI Web Scraper — LLM Data Extraction

nexgendata/ai-web-scraper

Extract structured data from any web page using AI. Describe what you want — the LLM understands the page and returns clean JSON. No selectors, no code, no maintenance. The future of scraping. Pay per page.

Stephan Corbeil

Smartcontext AI Web Crawler

bluelightco/smartcontext-ai-crawler

Scrape any website and extract structured data using AI-powered instructions. Provide URLs and a natural language prompt to get tailored JSON outputs.

Bluelight

192

5.0

AI Web Extractor

uxinfra/uxinfra-web-extractor

Intelligent web content extraction with AI-powered structuring. Extracts articles, products, reviews, and structured data from any website.

UXINFRA

Universal AI Web Scraper

stanvanrooy6/universal-ai-web-scraper

Turn any website into an API. Extract structured data using plain English. Features anti-bot bypass, dynamic rendering, and web search. No coding needed.

Stan Van Rooy

1.5

AI-Powered Smart Web Scraper

cloud9_ai/ai-web-scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

cloud9

AI Web Scraper with Playwright Browser (No-Code, MCP)

data_rig/ai-web-scraper

Run a real Playwright browser as an AI web scraper. Extract structured data from any site using natural language—no selectors or scripts. Handles JS-heavy pages, pagination, and interactions. Built for MCP agents like OpenCode and Claude Code.

Data Rig

AI Web Scraper

apify/ai-web-scraper

AI-first web scraper that extracts structured data from any website using natural-language prompts. No programming knowledge required. No hard-coded logic that breaks when a website changes.