Pricing

Pay per event

Go to Store

Universal AI GPT Scraper

Try for free

Developed by

Louis Deconinck

Transform any website into structured data with AI-powered extraction. This versatile tool combines advanced web scraping with intelligent content analysis to deliver clean, customized JSON output - perfect for automating data collection from any web source.

5.0 (1)

Pricing

Pay per event

Monthly users

Runs succeeded

>99%

Last modified

2 months ago

Automation

Developer tools

You can access the Universal AI GPT Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1# Start Server-Sent Events (SSE) session and keep it running
2curl "https://actors-mcp-server.apify.actor/sse?token=<YOUR_API_TOKEN>&actors=louisdeconinck/ai-gpt-scraper"
3
4# Session id example output:
5# event: endpoint
6# data: /message?sessionId=9d820491-38d4-4c7d-bb6a-3b7dc542f1fa

Using Universal AI GPT Scraper via Model Context Protocol (MCP) server

MCP server lets you use Universal AI GPT Scraper within your AI workflows. Send API requests to trigger actions and receive real-time results. Take the received sessionId and use it to communicate with the MCP server. The message starts the Universal AI GPT Scraper Actor with the provided input.

1curl -X POST "https://actors-mcp-server.apify.actor/message?token=<YOUR_API_TOKEN>&session_id=<SESSION_ID>" -H "Content-Type: application/json" -d '{
2  "jsonrpc": "2.0",
3  "id": 1,
4  "method": "tools/call",
5  "params": {
6    "arguments": {
7      "urls": [
8            "https://apify.com/louisdeconinck/ai-gpt-scraper"
9      ],
10      "fields": [
11            {
12                  "name": "name",
13                  "description": "The name/title of the scraper tool",
14                  "type": "string"
15            },
16            {
17                  "name": "price",
18                  "description": "The price per 1000 results, only the number",
19                  "type": "number"
20            },
21            {
22                  "name": "author",
23                  "description": "The author or maintainer of the scraper",
24                  "type": "string"
25            }
26      ],
27      "cssSelector": "main",
28      "predefinedModel": "google/gemini-2.0-flash-001",
29      "proxyConfiguration": {
30            "useApifyProxy": true
31      }
32},
33    "name": "louisdeconinck/ai-gpt-scraper"
34  }
35}'

The response should be: Accepted. You should received response via SSE (JSON) as:

1event: message
2data: {
3  "result": {
4    "content": [
5      {
6        "type": "text",
7        "text": "ACTOR_RESPONSE"
8      }
9    ]
10  }
11}

Configure local MCP Server via standard input/output for Universal AI GPT Scraper

You can connect to the MCP Server using clients like ClaudeDesktop and LibreChat or build your own. The server can run both locally and remotely, giving you full flexibility. Set up the server in the client configuration as follows:

1{
2  "mcpServers": {
3    "actors-mcp-server": {
4      "command": "npx",
5      "args": [
6        "-y",
7        "@apify/actors-mcp-server",
8        "--actors",
9        "louisdeconinck/ai-gpt-scraper"
10      ],
11      "env": {
12        "APIFY_TOKEN": "<YOUR_API_TOKEN>"
13      }
14    }
15  }
16}

You can further access the MCP client through the Tester MCP Client, a chat user interface to interact with the server.

To get started, check out the documentation and example clients. If you are interested in learning more about our MCP server, check out our blog post.

Pricing

Pricing model

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Actor start

$0.050

One-time charge for initializing the servers.

Page processed

$0.001

Cost per web page processed and converted to structured data.

1,000 Gemini Flash 1.5 tokens

$0.001

Cost for processing a 1,000 tokens with the Google Gemini Flash 1.5 model.

1,000 Gemini Flash 2 tokens

$0.001

Cost for processing a 1,000 tokens with the Google Gemini Flash 2.0 model.

1,000 GPT-4o Mini tokens

$0.001

Cost for processing a 1,000 tokens with the Open AI GPT-4o Mini model.

1,000 Gemini Pro 1.5 tokens

$0.020

Cost for processing a 1,000 tokens with the Google Gemini Pro 1.5 model.

1,000 GPT-4o tokens

$0.040

Cost for processing a 1,000 tokens with the Open AI GPT-4o model.

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

Paco

232

AI-Powered Web Content & Link Extractor

scrapercoder/ai-powered-web-content-link-extractor

Crawls websites to extract clean, structured content for AI/LLM use, ideal for training datasets, knowledge bases, and RAG systems. Json output includes: * text: Normalized page content * links: Extracted sub-URLs

wallnut.ai

GPT Scraper

drobnikj/gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

5.7k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.4k

AI Markdown Web Scraper

jordanchalupka/ai-markdown-web-scraper

Turn any webpage into a clean markdown format. Perfect to use as input to your LLM.

Jordan

AI-powered Search

easyapi/ai-powered-search

Transform your search queries into structured, AI-powered summaries with references and optimization tips. Get comprehensive three-paragraph summaries enhanced with emojis, source citations, and Google search comparisons - all in one powerful Actor! 🔍✨

EasyApi

🔥 FireScrape AI Website Content Markdown Scraper

mohamedgb00714/fireScraper-AI-Website-Content-Markdown-Scraper

Advanced web scraper powered by Crawlee and Puppeteer — extracts website content, converts it to Markdown, and structures it for LLM training datasets.

mohamed el hadi msaid

GPT-4 Instant Response Actor

scraping_samurai/gpt-4-instant-response-actor

The Chat GPT-4 AI Actor enables you to interact with GPT-4 models to generate text-based responses. Customize the model selection, system-level instructions, and output formatting to suit your needs. Enjoy flexibility with minimal effort and easily generate high-quality, formatted text.

Samurai

🔍 GPT Search [Private API]

openapi/gpt-search-private-api

Use OpenAI's GPT4o Search mode via API! No cookie or proxy is required. Fast, cheap and reliable.

Open API

Website Closers Scraper

louisdeconinck/website-closers-scraper

Unlock the potential of digital business acquisitions with our powerful scraper for WebsiteClosers.com. Effortlessly gather key metrics like asking price, cash flow, and more. Ideal for market research, lead generation, and building a comprehensive database of online businesses for sale.