# AI Web Scraper - Verified Structured Data from Any Page (`tracefetch/ai-web-scraper-verified`) Actor

Extract structured data from any web page with AI: name the fields you need and get clean JSON. Every value is checked against the page text, so values the page does not contain are never returned. $0.01 per page; pages that cannot be fetched are free.

- **URL**: https://apify.com/tracefetch/ai-web-scraper-verified.md
- **Developed by:** [서준 박](https://apify.com/tracefetch) (community)
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $10.00 / 1,000 page extracteds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## AI Web Scraper - Verified Structured Data from Any Page

Extract structured data from any web page with AI. Name the fields you need, paste the URLs, and get clean JSON.
Every returned value is checked against the page text, so the scraper does not hand you values that are not on
the page. No selectors, no code, no prompt engineering.

### Why "verified"?

AI scrapers sometimes return values that look plausible but are not on the page: a guessed brand, a rounded price,
a placeholder like "Your product's name". This Actor runs a check after extraction: a text or number value is kept
only if it actually appears on the page. Anything else is removed from `data` and listed in `removedValues`, so you
can see exactly what was dropped and why.

Measured on 224 real product and job pages from 224 different websites (October 2026):

| Pipeline | Exact-match accuracy | Returned values not found on the page |
|---|---|---|
| This Actor | 87.8% | 0.8% |
| ScrapeGraphAI (gpt-4o-mini, default pipeline) | 85.0% | 5.0% |
| Crawl4AI LLM extraction (gpt-4o-mini, default pipeline) | 78.9% | 4.3% |

Ground truth came from each page's own schema.org data, kept only where the value is visible on the page; all three
pipelines were scored with the same independent check. Verification did not cost accuracy: the same model without
verification scored 87.4%. Results on your pages will vary.

### What you can extract

Anything a person can read on the page: product name, price, currency, SKU, brand, ratings, job title, company,
salary, location, event date, contact details, article author, specifications and more. You define the fields:

```json
[
  {"name": "name", "type": "string", "description": "Product name as shown on the page"},
  {"name": "price", "type": "number", "description": "Current selling price as a plain number"},
  {"name": "currency", "type": "string", "description": "ISO 4217 currency code, e.g. USD"},
  {"name": "in_stock", "type": "boolean"},
  {"name": "condition", "enum": ["new", "used", "refurbished"]}
]
```

Supported types: `string`, `number`, `integer`, `boolean`, and fixed choices with `enum`. A plain list of names such as
`["title", "company", "salary"]` also works. Descriptions are optional but improve accuracy.

### How to use it

1. Paste one or more page URLs.
2. Define the fields to extract (or keep the product example).
3. Optional: add extra instructions, for example "Salaries are monthly" or "Use the first listed location".
4. Click Start. Results appear in the dataset as each page finishes, ready to export as JSON, CSV or Excel.

### Output example

```json
{
  "url": "https://shop.example.com/products/trail-shoe-x",
  "status": "extracted",
  "pageTitle": "Trail Shoe X - Example Shop",
  "data": {"name": "Trail Shoe X", "price": 89.95, "currency": "USD", "in_stock": true, "condition": null},
  "verification": {"name": "verified", "price": "verified", "currency": "verified", "in_stock": "not_checked", "condition": "empty"},
  "removedValues": null,
  "charged": true
}
```

`verification` shows, per field, whether the value was `verified` on the page, `removed`, `empty`, or `not_checked`
(yes/no and fixed-choice fields are interpretations, so they are not checked). Turn verification off with
Verify values against the page if you prefer raw AI output.

### Pricing

Pay per event, no subscription:

| Event | Price |
|---|---|
| Page extracted | $0.01 |

1,000 pages cost $10. A page is billed when it was downloaded and processed, even if none of your fields were on it.
Not charged: invalid URLs, pages that return errors, pages that block access, and pages with no readable text.

Set a maximum charge for the run and the Actor never exceeds it: once the budget is reached, remaining pages are
returned as `skipped` without being processed.

### Use it from the API, integrations and AI agents

```python
from apify_client import ApifyClient

client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("<username>/ai-web-scraper-verified").call(run_input={
    "urls": ["https://shop.example.com/products/trail-shoe-x"],
    "fields": ["name", {"name": "price", "type": "number"}, "currency"],
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["status"], item["data"])
```

Works with schedules, webhooks, Make, Zapier and n8n. AI agents connected to the Apify MCP server can find and call it.

### Limits

- Pages are fetched over plain HTTP. Sites that render their content only with JavaScript return `EMPTY_PAGE`
  and are not charged.
- One page at a time per URL: it extracts the main item of each page, not lists of many items.
- Login-only content is not supported.
- Sites that block automated access may fail even through the proxy; failed pages are not charged.

### FAQ

#### Do I need an OpenAI or other AI account?

No. AI usage is included in the price.

#### What languages work?

Pages in most languages; values are returned as written on the page.

#### Why is a value null?

Either the page does not contain it, or the AI returned something that was not on the page
and verification removed it. Check `removedValues` to tell the two apart.

#### Is it legal to scrape these pages?

The Actor only reads publicly accessible pages. You are responsible for
complying with each site's terms and the laws that apply to you.

# Changelog

This Actor's version history is a separate document: https://apify.com/tracefetch/ai-web-scraper-verified/changelog.md

# Actor input Schema

## `urls` (type: `array`):

Web pages to extract data from, one per line. Each page is fetched and processed once.

## `fields` (type: `array`):

What to extract. Each field has a name, an optional description that tells the AI what you mean, and a type: string, number, integer, boolean, or a list of allowed values via "enum". Plain names like "price" also work.

## `instructions` (type: `string`):

Anything else the AI should know, e.g. "Prices are per month" or "Use the first listed location".

## `verifyValues` (type: `boolean`):

Remove any returned value that does not appear on the page (recommended). Removed values are listed in removedValues. Yes/no and fixed-choice fields are not checked.

## `maxConcurrency` (type: `integer`):

How many pages are processed at the same time.

## `proxyConfiguration` (type: `object`):

Used only when a site blocks the direct request. Residential proxies recover most blocked pages (18 of 20 vs 10 of 20 without, measured on Apify).

## Actor input object example

```json
{
  "urls": [
    "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"
  ],
  "fields": [
    {
      "name": "name",
      "type": "string",
      "description": "Product name as shown on the page"
    },
    {
      "name": "price",
      "type": "number",
      "description": "Current selling price as a plain number"
    },
    {
      "name": "currency",
      "type": "string",
      "description": "ISO 4217 currency code of the price, e.g. USD"
    },
    {
      "name": "in_stock",
      "type": "boolean",
      "description": "Whether the product can be ordered now"
    },
    {
      "name": "stock",
      "type": "integer",
      "description": "Number of items available"
    },
    {
      "name": "upc",
      "type": "string",
      "description": "UPC or article number exactly as shown"
    },
    {
      "name": "category",
      "type": "string",
      "description": "Product category"
    }
  ],
  "verifyValues": true,
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `results` (type: `string`):

All items of this run, including failed ones with an errorCode. Only items with charged=true were billed.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"
    ],
    "fields": [
        {
            "name": "name",
            "type": "string",
            "description": "Product name as shown on the page"
        },
        {
            "name": "price",
            "type": "number",
            "description": "Current selling price as a plain number"
        },
        {
            "name": "currency",
            "type": "string",
            "description": "ISO 4217 currency code of the price, e.g. USD"
        },
        {
            "name": "in_stock",
            "type": "boolean",
            "description": "Whether the product can be ordered now"
        },
        {
            "name": "stock",
            "type": "integer",
            "description": "Number of items available"
        },
        {
            "name": "upc",
            "type": "string",
            "description": "UPC or article number exactly as shown"
        },
        {
            "name": "category",
            "type": "string",
            "description": "Product category"
        }
    ],
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": [
            "RESIDENTIAL"
        ]
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("tracefetch/ai-web-scraper-verified").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "urls": ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"],
    "fields": [
        {
            "name": "name",
            "type": "string",
            "description": "Product name as shown on the page",
        },
        {
            "name": "price",
            "type": "number",
            "description": "Current selling price as a plain number",
        },
        {
            "name": "currency",
            "type": "string",
            "description": "ISO 4217 currency code of the price, e.g. USD",
        },
        {
            "name": "in_stock",
            "type": "boolean",
            "description": "Whether the product can be ordered now",
        },
        {
            "name": "stock",
            "type": "integer",
            "description": "Number of items available",
        },
        {
            "name": "upc",
            "type": "string",
            "description": "UPC or article number exactly as shown",
        },
        {
            "name": "category",
            "type": "string",
            "description": "Product category",
        },
    ],
    "proxyConfiguration": {
        "useApifyProxy": True,
        "apifyProxyGroups": ["RESIDENTIAL"],
    },
}

# Run the Actor and wait for it to finish
run = client.actor("tracefetch/ai-web-scraper-verified").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"
  ],
  "fields": [
    {
      "name": "name",
      "type": "string",
      "description": "Product name as shown on the page"
    },
    {
      "name": "price",
      "type": "number",
      "description": "Current selling price as a plain number"
    },
    {
      "name": "currency",
      "type": "string",
      "description": "ISO 4217 currency code of the price, e.g. USD"
    },
    {
      "name": "in_stock",
      "type": "boolean",
      "description": "Whether the product can be ordered now"
    },
    {
      "name": "stock",
      "type": "integer",
      "description": "Number of items available"
    },
    {
      "name": "upc",
      "type": "string",
      "description": "UPC or article number exactly as shown"
    },
    {
      "name": "category",
      "type": "string",
      "description": "Product category"
    }
  ],
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}' |
apify call tracefetch/ai-web-scraper-verified --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,tracefetch/ai-web-scraper-verified"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/IcE5eDLKPr5NoV6sf/builds/svG1lwOmBEkRqFCO8/openapi.json