Pricing

Pay per usage

Structured Web Scraper

Extract articles, products, headings, images and links from any website in clean structured JSON format. Supports multiple URLs per run.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Huy Tran

Actor stats

Bookmarked

Total users

Monthly active users

17 hours ago

Last modified

Categories

Other

Automation

URLs to scrape

urls

Required

List of URLs to scrape. Supports any website.

Type:string[]

Content type to extract

contentType

Optional

Type of content to prioritize during extraction.

Type:string

Default:article

Options:

articleproductsearch-resultsall

Extract images

extractImages

Optional

Include image URLs and alt text in the output.

Type:boolean

Default:true

Extract outbound links

extractLinks

Optional

Include all outbound links found on the page.

Type:boolean

Default:false

Max items per page

maxItems

Optional

Maximum number of items to extract per page before filtering.

Type:integer

Default:30

Use AI filter

useAiFilter

Optional

Enable AI-powered content filtering. Each article is validated before inclusion.

Type:boolean

Default:false

AI provider

aiProvider

Optional

Which LLM to use for filtering.

Type:string

Default:openai

Options:

openaiollama

OpenAI API key

openaiApiKey

Optional

Your OpenAI API key. Get one at platform.openai.com

Type:string

Ollama server URL

ollamaUrl

Optional

URL of your Ollama server (e.g. http://your-server:11434). Must be reachable from Apify cloud.

Type:string

Default:http://localhost:11434

AI model

aiModel

Optional

Model to use. OpenAI: gpt-4o-mini, gpt-4o. Ollama: llama3, mistral, etc.

Type:string

Default:gpt-4o-mini

Filter goal

filterGoal

Optional

Instruction to the AI for what to keep. E.g. 'only tech/programming articles', 'no political content', 'prioritize in-depth technical posts'.

Type:string

Default:Only keep high-quality, substantive articles. Reject clickbait, ads, and low-effort content.

universal-structured-web-extractor-base

pierremrd29/universal-structured-web-extractor-base

Autonomous web change detection Actor for AI agents. Monitors URLs, detects meaningful content changes, computes diffs, and outputs structured signals for automation, alerts, and decision-making workflows.

Pierre Morandeau

Web Structured Data Extractor (Claude, JSON Schema)

gochujang/web-structured-extractor

Pass a URL + JSON schema (or natural-language goal). Claude reads the page and returns a strict JSON object matching your schema. Product / news / hotel / real-estate / job-board extraction. BYO Anthropic API key. $0.01 per page.

Hojun Lee

LLM Token Counter & Cost Estimator (Claude/GPT/Gemini/Llama)

gochujang/llm-token-counter

Count tokens for any text across 16+ models (Claude Opus/Sonnet/Haiku, GPT-4o, o3, Gemini 1.5, Llama, Mistral) and estimate per-million-token cost. Claude via Anthropic API (BYO key), GPT via tiktoken, others via heuristic. $0.001 per text counted.

Hojun Lee

MCP Config Generator (Apify Actor → Claude / Cursor)

gochujang/mcp-config-generator

Given any Apify actor ID, generates ready-to-paste Model Context Protocol (MCP) server configs for Claude Desktop, Claude Code, and Cursor. Wraps the actor as a tool Claude can call directly. $0.005 per config.

Hojun Lee

Tweet / X Thread → Article (Claude, Markdown)

gochujang/tweet-thread-to-article

Convert a Twitter / X thread (URL or pasted text) into a clean Markdown article. Removes '1/N' noise, smooths transitions, adds optional H2 headings, preserves facts and quotes. BYO Anthropic API key. $0.01 per thread.

Hojun Lee

Article Summarizer (Claude — TL;DR + Bullets + Topics)

gochujang/article-summarizer

Pass any URL or text — get back a tight summary in your chosen style (TL;DR / bullets / executive / tweet) plus topic tags + sentiment. Article body auto-extracted via trafilatura. BYO Anthropic API key. $0.005 per summary, Claude tokens billed by Anthropic.

Hojun Lee

AI Web Scraper — Structured Data Extraction from Any Website

oneary/ai-powered-data-extractor

Extract structured data from any webpage using AI. Define your schema and the AI identifies relevant content — no selectors or coding needed. Handles products, reviews, contacts, and custom fields.

Luan M.

AI-Ready Content Extractor — Structured Web Data for LLM & MCP

yuchiaoniu/ai-content-extractor

Extract structured JSON from any URL for LLM, RAG, and MCP integration. Outputs title, sections, contact info, links, structured data, and clean plain text.

Niu Yuchiao

AI Web Scraper — Structured Data From Any URL

muhammadafzal/ai-web-extractor

Extract structured data from any website using an LLM and your own field schema — no CSS selectors. Give it URLs and the fields you want; get clean JSON rows back. Works on blogs, job boards, product pages, listings, and more.

Muhammad Afzal

Faire Wholesale Product Scraper

parseforge/faire-scraper

Browse Faire by keyword and pull every matching wholesale product with its name, brand, retail price, minimum order quantity, and brand rating. Each item includes the image, review count, and origin country. Handy for retail sourcing, assortment research, and price benchmarking.