Pricing

$30.00 / 1,000 results

Go to Apify Store

AI Web Scraper

Try for free

Crawl web pages and extract structured information using AI

Pricing

$30.00 / 1,000 results

Rating

0.0

(0)

Developer

Tin

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

AI Web Scraper

AI Web Scraper is an Apify actor designed to crawl web pages and extract structured information using AI. The actor loads web pages, collects their content, and sends the extracted data to an AI model for intelligent processing. The AI then analyzes the page and returns structured information such as title, price, condition and other relevant data. It is build on top of Apify SDK and you can run it both on Apify platform and locally.

Input
Output
Compute units consumption
Epilogue

Input

Input is a JSON object with the following properties:

{
    "startUrls": START_URLS,
    "question": QUESTION,
    "outputSchema": OUTPUT_SCHEMA
}

Example:

{
    "question": "Extract the title, price and condition of the ebay item.",
    "startUrls": [
        {
            "url": "https://www.ebay.com/p/3072579174?iid=186372216016&var=694422418597"
        }
    ],
    "outputSchema": "(z) => { return z.object({ title: z.string(), price: z.string(), condition: z.string() }); }"
}

Output

Output is stored in a dataset. Example:

{
  "url": "https://www.ebay.com/p/3072579174?iid=186372216016&var=694422418597",
  "title": "Samsung Galaxy S22 - 128 GB - Phantom Black (Unlocked)",
  "price": "$156.99",
  "condition": "Very Good - Refurbished"
}

Compute units consumption

Keep in mind that it is much more efficient to run one longer scrape (at least one minute) than more shorter ones because of the startup time.

The average consumption is 1 Compute unit for 1000 actor pages scraped

Epilogue

Thank you for trying my actor. I will be very glad for a feedback that you can send to my email dtrungtin@gmail.com.

Smartcontext AI Web Crawler

bluelightco/smartcontext-ai-crawler

Scrape any website and extract structured data using AI-powered instructions. Provide URLs and a natural language prompt to get tailored JSON outputs.

Bluelight

136

5.0

(2)

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

Paco

3.9

(3)

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Raizen Technology

314

1.0

(1)

Universal AI Web Scraper

stanvanrooy6/universal-ai-web-scraper

Turn any website into an API. Extract structured data using plain English. Features anti-bot bypass, dynamic rendering, and web search. No coding needed.

Stan Van Rooy

5.0

(1)

Scrape GPT - Universal AI Web Scraper Agent

paradox-analytics/scrape-gpt---universal-ai-web-scraper-agent

AI-powered universal web scraper that works on ANY website without configuration. Extract data from e-commerce, news sites, social media, and more using intelligent LLM-based field mapping. Features JSON-first extraction, automatic pagination, anti-bot bypass, and cost-effective caching.

Paradox Analytics

5.0

(1)

AI Web Scraper - Webscraper with AI based Summery or answer

sidjain/apify-webscrap

Web Page Scraper + AI Summary/Answer: Scrapes any URL, extracts content (text, links, images, tables, lists,raw html,tech stack), auto-falls back to headless browser for JS sites, and optionally generates an AI summary/answer from your prompt. Try with frontend at-https://aiscraperweb.netlify.app/

Siddharth Jain

AI Web Extractor

uxinfra/uxinfra-web-extractor

Intelligent web content extraction with AI-powered structuring. Extracts articles, products, reviews, and structured data from any website.

UXINFRA

Quick Website Content Scraper ( Extract Text for RAG & LLMs )

automateitplease/ai-web-content-scraper-extract-text-for-rag-llms

Extract clean text from any website for AI/LLM applications. Supports both static and JavaScript-rendered sites (React, Vue, Angular). Perfect for RAG systems, chatbot training, and content analysis.

AutomateItPlease Workflow And Automaton Ops

AI-Powered Smart Web Scraper

cloud9_ai/ai-web-scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

cloud9

Agentic Crawler

hpix/agentic-crawler

An intelligent AI web scraper that navigates websites like a human. Just describe the data you need in plain English. Adapts to layout changes, handles dynamic JavaScript sites, and gets smarter with every run.