# AI Training Policy Drift Monitor (`defenestrator/ai-training-policy-drift-monitor`) Actor Monitor public vendor terms, privacy, and AI policy pages for AI-training, customer-content, opt-out, and data-use clause drift. - **URL**: https://apify.com/defenestrator/ai-training-policy-drift-monitor.md - **Developed by:** [Defenestrator](https://apify.com/defenestrator) (community) - **Categories:** Developer tools, Automation - **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 monitor rows This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## AI Training Policy Drift Monitor Unofficial Apify Actor for monitoring public vendor terms, privacy, data-use, and AI policy pages for AI-training and customer-content clause drift. It is designed for legal, procurement, security, AI governance, and vendor-risk teams that need a scheduled early-warning feed when a vendor quietly changes language about customer content, model training, service improvement, opt-outs, third-party sharing, scraping, or AI-related data use. This Actor is not legal advice. It reads only public HTTP(S) pages you provide. It does not log in, bypass access controls, use private/internal URLs, or render JavaScript-only pages. ### What it does For each public policy URL, the Actor: - Fetches the public page with redirect safety checks. - Blocks localhost, private IP, link-local, internal, and reserved destinations before each request and redirect. - Extracts readable text from HTML, Markdown, or plain text. - Computes a stable `textHash` and `clauseHash` without storing the full page text. - Detects deterministic signals for AI/model training, customer-content use, service improvement, opt-out language, no-training commitments, third-party sharing, and scraping/crawler restrictions. - Emits a risk score, explicit policy signal IDs, short snippets, changes versus optional previous rows, and a recommended action. - Writes a run-level `OUTPUT` summary for dashboards or scheduled monitoring. ### Why it is useful repeatedly AI vendor terms and privacy policies are moving quickly. A clause that was acceptable during procurement can change before the next renewal, security review, or model-governance audit. Run this Actor on a schedule with the previous run's dataset rows in `previousSnapshots` to detect clause hash changes, risk-score increases, or new AI-training/data-use signals. ### Example input ```json { "policyUrls": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms" }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation" } ], "previousSnapshots": [], "includeAllRows": true, "alertRiskThreshold": 45 } ```` ### Output fields Each dataset row includes: - `label`, `url`, `finalUrl`, `policyType` - `ok`, `statusCode`, `contentType`, `responseMs`, `byteLength`, `textCharsScanned` - `textHash`, `clauseHash`, `pageTitle` - `riskLevel`, `riskScore`, `riskReasons`, `policySignalIds`, `matchedTerms` - `clauseSnippets` with short public-policy excerpts around detected terms - `changedSincePrevious`, `changes`, `previousRiskScore`, `riskDelta` when previous snapshots are supplied - `alert`, `recommendedAction`, and `fetchError` if applicable The key-value store `OUTPUT` record summarizes checked pages, alert counts, drift counts, fetch errors, warnings, and source stats. ### Safety and limitations - Public HTTP(S) pages only. Private, local, internal, link-local, and reserved IP destinations are blocked, including redirects. - No login, cookies, browser rendering, CAPTCHA solving, or proxy bypass. - JavaScript-rendered pages may have incomplete extracted text; verify important findings manually. - Clause detection is deterministic keyword/context scoring. It can miss nuanced legal language or flag benign clauses. - This is a triage and monitoring aid, not legal advice. Have counsel or a qualified reviewer verify source policy language before taking action. - Do not submit confidential, private, intranet, or customer-only contract URLs. ### Pricing This Actor uses Apify Pay Per Event (PPE) pricing: - `apify-actor-start`: `$0.00005` per run start. - `apify-default-dataset-item`: `$0.002` per dataset row (`Monitor row`). - Platform usage is included in the event price; users do not pay a separate platform-usage pass-through. - A dataset row is one monitored result, source, or drift-check row emitted by the Actor. Run cost scales with the number of rows produced and the limits you choose. Use Apify's max total charge setting before starting a run if you want a hard spend cap. # Actor input Schema ## `policyUrls` (type: `array`): Public HTTP(S) terms, privacy, data-use, or AI policy pages to monitor. You may enter strings or objects with url, label, and policyType. Private/internal/localhost URLs are blocked. ## `previousSnapshots` (type: `array`): Optional rows from a previous run. The Actor compares text hashes, clause hashes, signal sets, risk levels, and scores to flag policy drift. ## `includeAllRows` (type: `boolean`): When false, only alert/drift/error rows are pushed to the dataset. The run-level OUTPUT summary still includes totals. ## `alertRiskThreshold` (type: `integer`): Rows at or above this score are marked alert=true. Material drift can also force an alert. ## `riskIncreaseThreshold` (type: `integer`): When previousSnapshots are supplied, flag an alert if the risk score increases by at least this many points. ## `maxPages` (type: `integer`): Upper bound to keep scheduled runs cheap and predictable. ## `maxBytes` (type: `integer`): Hard cap on bytes read from each public URL before text extraction. ## `maxTextChars` (type: `integer`): Safety cap for clause scanning after HTML-to-text extraction. ## `maxRedirects` (type: `integer`): Each redirect destination is rechecked for public HTTP(S) safety before fetching. ## `timeoutMs` (type: `integer`): Per-request timeout for public policy pages. ## Actor input object example ```json { "policyUrls": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms" }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation" } ], "previousSnapshots": [], "includeAllRows": true, "alertRiskThreshold": 45, "riskIncreaseThreshold": 15, "maxPages": 25, "maxBytes": 750000, "maxTextChars": 120000, "maxRedirects": 5, "timeoutMs": 30000 } ``` # Actor output Schema ## `results` (type: `string`): Dataset rows: one checked public policy page per result unless includeAllRows=false. ## `summary` (type: `string`): Run-level summary including checked pages, alerts, warnings, errors, and source stats. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "policyUrls": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms" }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("defenestrator/ai-training-policy-drift-monitor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "policyUrls": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms", }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation", }, ] } # Run the Actor and wait for it to finish run = client.actor("defenestrator/ai-training-policy-drift-monitor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "policyUrls": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms" }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation" } ] }' | apify call defenestrator/ai-training-policy-drift-monitor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=defenestrator/ai-training-policy-drift-monitor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "AI Training Policy Drift Monitor", "description": "Monitor public vendor terms, privacy, and AI policy pages for AI-training, customer-content, opt-out, and data-use clause drift.", "version": "0.0", "x-build-id": "oZssGFQinquO9gygp" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/defenestrator~ai-training-policy-drift-monitor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-defenestrator-ai-training-policy-drift-monitor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/defenestrator~ai-training-policy-drift-monitor/runs": { "post": { "operationId": "runs-sync-defenestrator-ai-training-policy-drift-monitor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/defenestrator~ai-training-policy-drift-monitor/run-sync": { "post": { "operationId": "run-sync-defenestrator-ai-training-policy-drift-monitor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "policyUrls" ], "properties": { "policyUrls": { "title": "Public policy page URLs", "type": "array", "description": "Public HTTP(S) terms, privacy, data-use, or AI policy pages to monitor. You may enter strings or objects with url, label, and policyType. Private/internal/localhost URLs are blocked.", "items": { "type": "object", "properties": { "url": { "type": "string", "title": "Public policy URL", "description": "Public HTTP(S) terms/privacy/AI policy URL to fetch." }, "label": { "type": "string", "title": "Label", "description": "Human-readable vendor or policy name for output rows." }, "policyType": { "type": "string", "title": "Policy type", "description": "Optional policy category such as terms, privacy, AI policy, or data use." } }, "required": [ "url" ] }, "default": [ { "label": "Anthropic Commercial Terms", "url": "https://www.anthropic.com/legal/commercial-terms", "policyType": "terms" }, { "label": "AWS AI Services Opt-Out Policy", "url": "https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html", "policyType": "AI opt-out documentation" } ] }, "previousSnapshots": { "title": "Previous dataset rows for drift detection", "type": "array", "description": "Optional rows from a previous run. The Actor compares text hashes, clause hashes, signal sets, risk levels, and scores to flag policy drift.", "items": { "type": "object" }, "default": [] }, "includeAllRows": { "title": "Include non-alert rows", "type": "boolean", "description": "When false, only alert/drift/error rows are pushed to the dataset. The run-level OUTPUT summary still includes totals.", "default": true }, "alertRiskThreshold": { "title": "Risk score alert threshold", "minimum": 1, "maximum": 100, "type": "integer", "description": "Rows at or above this score are marked alert=true. Material drift can also force an alert.", "default": 45 }, "riskIncreaseThreshold": { "title": "Risk increase alert threshold", "minimum": 0, "maximum": 100, "type": "integer", "description": "When previousSnapshots are supplied, flag an alert if the risk score increases by at least this many points.", "default": 15 }, "maxPages": { "title": "Maximum pages per run", "minimum": 1, "maximum": 100, "type": "integer", "description": "Upper bound to keep scheduled runs cheap and predictable.", "default": 25 }, "maxBytes": { "title": "Maximum bytes fetched per page", "minimum": 50000, "maximum": 3000000, "type": "integer", "description": "Hard cap on bytes read from each public URL before text extraction.", "default": 750000 }, "maxTextChars": { "title": "Maximum extracted text characters scanned", "minimum": 5000, "maximum": 500000, "type": "integer", "description": "Safety cap for clause scanning after HTML-to-text extraction.", "default": 120000 }, "maxRedirects": { "title": "Maximum redirects per URL", "minimum": 0, "maximum": 10, "type": "integer", "description": "Each redirect destination is rechecked for public HTTP(S) safety before fetching.", "default": 5 }, "timeoutMs": { "title": "Fetch timeout milliseconds", "minimum": 5000, "maximum": 60000, "type": "integer", "description": "Per-request timeout for public policy pages.", "default": 30000 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```