Web Data Extractor and Change Monitor
Pricing
from $1.75 / 1,000 results
Web Data Extractor and Change Monitor
Extract structured data from public website URLs and optionally compare repeat runs to detect content, field and structured-data changes. Export normalized results for monitoring, databases and AI workflows.
Pricing
from $1.75 / 1,000 results
Rating
0.0
(0)
Developer
Rafael Barreto Haddad
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
10 days ago
Last modified
Categories
Features
Share
Extract structured data from public website URLs and optionally compare repeat runs to detect content, field and structured-data changes. Export normalized results for monitoring, databases and AI workflows.
Why use this Actor
General web scrapers are flexible but often require code or prompts, while recurring workflows need stable structured outputs and explicit change decisions.
Key features
- Buyer-native inputs aligned to web data extractor.
- Predictable structured output in the default Apify Dataset.
- Pay Per Event pricing tied to measurable result rows or reports.
- Optional MCP connector delivery for downstream automation and AI agents.
Quick start
Start with this working example and replace the target values with your own:
{"urls": ["https://www.python.org/about/"],"maxResults": 8,"directFetch": true}
The Actor writes structured results to the default Apify Dataset and can be used from the Store, API, schedules, Tasks, automations and MCP-compatible AI workflows.
Input
currentItems— Current source records: Advanced: optional user-supplied source data; not independently verified by this Actor.currentDatasetId— Current Apify Dataset ID: Optional current Dataset from an upstream extraction workflow.previousDatasetId— Previous Apify Dataset ID: Optional prior Dataset for recurring comparisons.queries— Queries: Direct-source queries for Google Maps or Google Search modes.urls— URLs: Direct public URLs for web or social best-effort modes.directFetch— Use direct-source mode when no Dataset/rows are supplied: Enable direct-source retrieval only when inline rows and Dataset input are not supplied.
All integration and advanced analysis fields are optional. The default example is intentionally runnable without configuring MCP or a previous-run baseline.
Output
The Dataset exposes predictable machine-readable output. Representative fields include results, report.
Pricing
This Actor uses Pay Per Event. The current factory base price is $0.002500 per result event. The Apify Store remains the source of truth for the price and plan/tier details shown to the buyer.
Use cases
- Run the buyer-ready workflows exposed as Apify Tasks without preparing a custom integration first.
- Use the Actor from API or schedules for recurring collection, comparison or monitoring.
- Feed the structured Dataset output into spreadsheets, databases, automations or AI agents.
- Compare repeat runs when the product supports snapshots or previous-run inputs.
Automation and AI
Use the same Actor through Apify API, schedules, public Tasks and the Apify MCP server. Outputs are structured for downstream workflows and AI agents rather than requiring manual copy/paste.
Limitations
- Public websites and upstream APIs can change markup, access rules, rate limits or field availability without notice.
- Fields that are not publicly available are returned as unavailable or omitted rather than fabricated.
- Analytical outputs depend on the quality and coverage of the supplied or collected source data.
- Treat marketplace, reputation, workforce, safety or commercial signals as decision support and validate material decisions against the underlying source evidence.
Detailed documentation
What the buyer gets
public website data and previously collected page snapshots. Output is a structured Apify Dataset; unavailable source fields are not invented.
First-run example
This is a small example. Replace supplied sample records with authorized data or replace example IDs/searches with real targets.
{"currentItems": [{"id": "w1","url": "https://example.com/pricing","title": "Pricing","description": "Plans for teams","text": "Starter $19 Pro $49 Enterprise contact sales","emails": ["sales@example.com"],"headings": ["Pricing","Plans"]},{"id": "w2","url": "https://example.com/features","title": "Features","description": "Automation features","text": "Workflows integrations agents","headings": ["Features"]}],"previousItems": [{"id": "w1","url": "https://example.com/pricing","title": "Pricing","description": "Plans for teams","text": "Starter $15 Pro $39 Enterprise contact sales","emails": ["sales@example.com"],"headings": ["Pricing","Plans"]}],"maxItems": 5}
Verified test and limitations
Run O1N6ldesoj9Vmg97y (status SUCCEEDED, sample dataset rows 2). The run processed demonstration or supplied records; it does not prove independent live collection or paying-customer demand.
Input mode: supplied data, with optional supported public lookup.
Extract structured data from public web URLs for automation and AI workflows, with optional repeat-run comparison to detect field, content and structured-data changes.
Give public URLs. Extract structured page data, links, metadata, JSON-LD and content fingerprints, with optional field-level change detection.
Why use this Actor
General web scrapers are flexible but often require code or prompts, while recurring workflows need stable structured outputs and explicit change decisions. This Actor converts structured source data into a decision-ready result so recurring workflows do not need a separate manual analysis step. It supports repeatable monitoring, scheduled execution, dashboards, and agent workflows. Scores are deterministic and traceable to observable input fields.
Key features
- No-code URL input with HTTP-first structured metadata and text extraction.
- Stable content fingerprints and previous-snapshot field diffs.
- JSON-LD, headings, links, email and social-link extraction in one schema.
- Automatic MONITOR/REVIEW_CHANGE actions for recurring workflows.
- Dataset input mode for normalization of upstream crawls and 256 MB operation.
- Structured Dataset output for API, Task, schedule, and agent use.
- Current-versus-previous snapshot analysis when prior records are supplied.
- Limited-permission, data-first execution design.
Input
The JSON input schema includes explicit fields and prefilled examples. Important fields include currentItems, currentDatasetId, previousItems, previousDatasetId, queries, urls, directFetch, language, countryCode, maxResults, maxItems. Inline records are convenient for small tests. Dataset identifiers are better for recurring pipelines because one Actor can consume the structured output of another without copying rows manually. Stable entity identifiers improve snapshot comparison.
Output
Results are written to the default Apify Dataset as structured JSON. Output fields include ok, sourceType, analysisKind, entityId, signalScore, changeScore, agentAction, agentReason, metrics, changes, observedAt, source. These fields are designed for dashboards, databases, automation tools, and downstream Actors. Decision fields summarize observable evidence instead of returning only a large unranked export.
Example
Run the prefilled example once in the Apify Console. For a recurring workflow, save the current Dataset or upstream Dataset ID and provide a later snapshot on the next run. Compare the emitted scores, changes, and action fields. Through API or public Tasks, keep the same field mapping between runs so time-series comparisons remain meaningful.
Use cases
- recurring competitive monitoring.
- AI-agent and automation workflows.
- market research and prospect prioritization.
- period-over-period change detection.
- Scheduled daily or weekly monitoring with repeatable decision logic.
- Agent workflows that need compact actions rather than raw rows.
- Research pipelines that need stable JSON and traceable signals.
Pricing
The Actor uses pay-per-event pricing with one primary measurable result. The base design price is USD 0.0025 per primary result before Apify tier discounts. There is no mandatory external AI subscription in the deterministic scoring path. Platform usage varies with run duration, memory, and data volume. The release gate checks margin from real validation costs before publication.
Limitations
- Only public or appropriately licensed data should be supplied or fetched.
- Instagram and TikTok direct public-URL mode is best-effort; Dataset input is the stable mode when those sites block anonymous requests.
- Signals are deterministic decision support, not guarantees.
- Public-source availability and upstream schemas can change over time.
- Missing source fields can reduce the strength of a score or comparison.
- Decision scores are prioritization signals, not promises of commercial or operational outcomes.
- Users remain responsible for source access rules and platform terms.
Operational notes
For production use, prefer scheduled runs with stable input definitions. Review the Dataset after the first production run before connecting downstream systems. Preserve raw snapshots when a source changes schema so transformations remain auditable. Market evidence and competitor capabilities are rechecked before publication because Store conditions can change.
Agent execution and AI discovery (October 2026)
Use this Actor when: Extract structured data from public website URLs and optionally compare repeat runs to detect content, field and structured-data changes. Export normalized results for monitoring, databases and AI workflows.
For AI agents and automations:
- Find this Actor in Apify Store by its use case and verify its actual input and pricing through Apify MCP (
search-actorsandfetch-actor-details). Availability and ranking in Apify AI are controlled by Apify; Apify controls discovery and ranking; independent verification is necessary. - Read the Input tab or input schema. Recognized fields include
currentItems,currentDatasetId,previousItems,previousDatasetId,queries,urls,directFetch,language. Required fields: See the Input tab for valid example values. Do not invent records or credentials. - Supply a small representative input first. Use Apify API, Tasks, or MCP to run and retrieve the structured dataset; inspect the output schema rather than assuming all inputs produce the same rows.
- For programmatic calls, set timeouts and
maxTotalChargeUsdin run options to limit exposure. Check the Apify Pricing tab for billable events and discounts. - Payment compatibility: this Actor is published with limited permissions and pay-per-event pricing. Apify AGI prepaid x402 tokens can execute limited-permission Actors. Direct per-request payment is a separate, conditional feature that may require additional eligibility checks and creator verification. Do not interpret this paragraph as proof of approved KYC or verified payment acceptance.
- This Actor does not independently guarantee real-time access to a third-party source. Verify input provenance and important conclusions, and do not supply confidential personal data unnecessarily.
Buyer-first quick start (November 2026)
This workflow is designed for one practical buyer question, with a small, reproducible first run and auditable Dataset output.
Example input
{"urls": ["https://www.python.org/about/"],"maxResults": 8,"directFetch": true}
Source and limitations
The first run uses a public-source request or user-provided authorized URLs/documents. Upstream websites can block or throttle requests; not every result is assured to be available. Verify source URLs and timestamps before acting. If the source is inaccessible, a failed or limited result is not evidence of zero market demand.
This actor already supports directFetch. The example favors live queries or URLs over synthetic currentItems. Custom Dataset import remains available as an advanced option.
Repeatable workflow
Use the default test to understand the output, verify record identifiers and field coverage, then schedule a Task with a bounded input. Compare real earlier snapshots only when available. Check the current Apify Store Pay Per Event rate and set Apify run charge limits for recurring use. Source evidence does not establish paying customers, successful outbound sales, or revenue.