Source Rights Indicator Extractor

Extract visible and machine-readable rights indicators from explicit URLs—metadata indicators only, not legal advice.

What this does not do

This Actor does not give legal advice, declare reuse permitted or prohibited, interpret terms of service, crawl a site, treat robots directives as a license, or bypass access controls. It reads only explicit public or user-authorized URLs.

Sources and authorization

Version 0.1 uses bounded HTTPS GET requests to each supplied URL. It examines safe response headers and HTML for rel=license, schema.org or Dublin Core rights metadata, copyright and attribution text, terms/privacy/API-policy links, robots metadata, and X-Robots-Tag. Optional policy retrieval is limited to five same-origin links identified by the source page.

Input

Supply 1–1,000 explicit URLs. The controlled public default is:

{
  "urls": ["https://flintglade-tools.github.io/apify-fixtures/rights/open-license.html"],
  "includeHeaders": true,
  "includeLinkedPolicies": false,
  "concurrency": 1
}

maxHtmlBytes is bounded between 1 KB and 5 MB. Version 0.1 supports HTTP retrieval only; browser rendering is intentionally excluded.

Output

One result row is written per input URL, followed by an uncharged run-summary row. Each result contains:

• explicit status and substatus;
• response provenance and raw hash;
• indicators separated into license, copyright, attribution, robots, and policy categories;
• source values and evidence locators, with URL query values redacted;
• unresolved conflicts between license indicators;
• optional linked-policy evidence;
• legalConclusion: null and a fixed non-legal disclaimer.

Example finding:

{
  "status": "ok",
  "data": {
    "substatus": "examined",
    "indicatorCounts": {"license": 1, "copyright": 1},
    "legalConclusion": null,
    "disclaimer": "Metadata indicators only—not legal advice or a conclusion that reuse is permitted or prohibited."
  }
}

Pricing

The primary Apify pay-per-event event is rights-indicator-check at $0.01 per input URL. A successful examination, a page with no indicators, a conflicting-indicator result, or a definitive 404/410 is chargeable. Unsafe URLs, transient failures, rate-limit exhaustion, oversized pages, and parser invariant failures are uncharged. Linked policy pages are included in the input URL event and are never charged separately.

One URL check costs up to $0.01 in Actor events. Ten URL checks cost up to $0.10. One thousand URL checks cost up to $10.00, plus platform usage displayed by Apify. The Actor stops scheduling new URL checks when the run charge limit is reached.

State

AP-029 is stateless. It does not create a baseline or silently retain monitoring history.

Partial failures and negative results

Every URL receives its own deterministic status. One source failure does not convert another URL's evidence into a success. Duplicate URLs are emitted as uncharged rejected rows. A 404/410 is a chargeable terminal result because it is a definitive page examination; a 429, timeout, or 5xx is not.

Resource limits

Launch settings are 256 MB minimum, 512 MB default, 1,024 MB maximum, and a 300-second timeout. Concurrency is bounded to 16, redirects are revalidated, and HTML is capped before parsing.

Data handling and privacy

The Actor sends only the requested HTTPS reads to supplied origins and same-origin policy links when explicitly enabled. It has no external telemetry or database. Dataset and run-storage retention follow the customer's Apify account settings. URLs containing userinfo are rejected, URL query values are replaced with REDACTED in output, safe logs omit page bodies, and results never include cookies or authorization headers.

Source rights and attribution

Outputs report source-provided indicators and their locations. An indicator may be incomplete, stale, conflicting, or legally insufficient. Customers remain responsible for authorization and legal review. The controlled Flintglade fixture is CC0 test infrastructure.

Limitations

Version 0.1 does not execute JavaScript, resolve legal meaning, search external rights databases, or infer permission from robots rules. It may not observe indicators generated only after client-side rendering.

Support and changelog

Support: support@flintglade.com. See CHANGELOG.md for release changes and SOURCE_POLICY.md for the source contract.