Pricing

from $1.00 / 1,000 results

Try for free

Go to Apify Store

LLM Scraping Agent - Describe Any Page, Get Structured JSON

Try for free

LLM web scraper that turns any URL into clean, structured JSON. List the fields you want or describe them in plain English, bring your own OpenAI (GPT) or Anthropic (Claude) key, and the model reads the page like a human - no CSS selectors, no per-site code. JSON, CSV or Excel.

Pricing

from $1.00 / 1,000 results

Rating

5.0

(1)

Developer

Flash Scrape

Actor stats

Bookmarked

Total users

Monthly active users

2 hours ago

Last modified

Categories

Developer tools

Automation

You can access the LLM Scraping Agent - Describe Any Page, Get Structured JSON programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrls": ["https://news.ycombinator.com"],
10    "fields": [
11        "title",
12        "summary",
13        "author",
14    ],
15}
16
17# Run the Actor and wait for it to finish
18run = client.actor("flash_scraper/ai-universal-scraper").call(run_input=run_input)
19
20# Fetch and print Actor results from the run's dataset (if there are any)
21print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
22for item in client.dataset(run.default_dataset_id).iterate_items():
23    print(item)
24
25# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

LLM Web Scraper - Any Site to JSON with GPT or Claude API in Python

The Apify API client for Python is the official library that allows you to use LLM Scraping Agent - Describe Any Page, Get Structured JSON API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

LLM Scraping Agent - Describe Any Page, Get Structured JSON API in JavaScript

LLM Scraping Agent - Describe Any Page, Get Structured JSON API through CLI

LLM Scraping Agent - Describe Any Page, Get Structured JSON OpenAPI definition

LLM Scraping Agent - Describe Any Page, Get Structured JSON API

AI Web Data Extractor — URL + Prompt → JSON

hichemdev/ai-web-extractor

Extract structured data from any web page with a plain-English prompt, using your own OpenAI or Anthropic API key. Turn messy pages into clean JSON.

Hichem Ben Moussa

Claude AI Web Automation

dtrungtin/claude-ai-web-automation

A real browser with Anthropic's Claude models to navigate any website and extract structured data — no CSS selectors or page-specific scraping code required.

Tin

AI Web Scraper: Extract Structured Data With Plain English

lanky_quantifier/ai-web-scraper

Extract structured data from any website using plain English. Describe what you need, AI scraper does the rest. No CSS selectors needed. Export JSON/CSV. Bundle: 30 scrapers at vhubster3.gumroad.com/l/fjmtqn

Vhub Systems

LLM Web Scraper

incredible_moment/llm-scraper

Turn any website into structured JSON using AI. Supports OpenAI GPT-4 and Anthropic Claude. Built in Rust to minimize compute costs while waiting for LLM responses. Extract data without selectors.

Daniel Rosen

Best AI Web Scraper

hgservices/Best-AI-Web-Scraper

Extract any data from any website by simply describing what you want in plain English. AI-powered web scraping with no code, no selectors, and no per-site setup.

Harish Garg

OpenAI Web Automation

dtrungtin/openai-web-automation

Controls a real browser with an OpenAI model to interact with web pages and extract structured data — no CSS selectors or page-specific scraping code required.

Tin

No-Code Web Scraper: Extract Any Website by Example

flash_scraper/smart-scraper-by-example

A no-code web scraper that extracts any website by example - no CSS selectors, no API key. Paste a URL plus values you can see on the page; it learns the HTML pattern and pulls every matching item into structured rows with a confidence score. Follows pagination. CSV, JSON, Excel.

Flash Scrape

AI Web Scraper

crawlworks/ai-web-scraper

Scrape any webpage with a URL and a plain-English prompt. Get structured JSON output powered by AI — no coding, no selectors, no configuration.

Crawlworks

Web Structured Data Extractor (Claude, JSON Schema)

gochujang/web-structured-extractor

Pass a URL + JSON schema (or natural-language goal). Claude reads the page and returns a strict JSON object matching your schema. Product / news / hotel / real-estate / job-board extraction. BYO Anthropic API key. $0.01 per page.

Hojun Lee

Page to API / Sitemap to JSON for RAG & LLM Ingestion

timely_quarterstaff/page-to-api-extractor

Turn any page URL or sitemap into embedding-ready JSON for RAG and LLM pipelines - drop-in for LlamaIndex & LangChain. Clean main_text per page, no HTML noise. Also a plain page to api / sitemap to json extractor. Deterministic code, no AI required.