Pricing

from $0.50 / 1,000 results

Try for free

Go to Apify Store

Content Quality & Provenance

Try for free

Normalize, deduplicate and quality-check rights-confirmed structured records with deterministic provenance.

Pricing

from $0.50 / 1,000 results

Rating

0.0

(0)

Developer

Oddly Clever

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

What it does

selects a declared set of output fields;
deduplicates records using your chosen keys;
reports missing required values;
preserves a declared source URL;
creates a machine-readable run summary;
returns clean records in the default dataset.

Input

Provide:

items: an array of JSON objects;
fields: fields to retain;
dedupe_keys: fields used to identify duplicates;
required_fields: fields that must be populated;
source_url: the authorized source;
rights_confirmed: must be true.

The Actor fails closed when processing rights are not confirmed.

Output

Cleaned records: default dataset.
Run summary: RUN_SUMMARY in the default key-value store.

The summary includes input/output counts, duplicate count, missing-field statistics, and provenance metadata.

Example

Input:

{
  "items": [
    {"url": "https://example.org/a", "title": "Alpha"},
    {"url": "https://example.org/a", "title": "Duplicate"}
  ],
  "fields": ["url", "title"],
  "dedupe_keys": ["url"],
  "required_fields": ["url", "title"],
  "source_url": "https://example.org/authorized-source",
  "rights_confirmed": true
}

This produces one deduplicated record and a reproducible quality summary.

Responsible use

Only process data you are legally authorized to access, transform, and redistribute. The Actor does not bypass authentication, access controls, robots restrictions, or platform terms.

AI Agent Readiness Score

bmiller1009/ai-agent-readiness

Score how easy a domain is for AI agents to discover, understand, access, cite, and interact with, across six weighted, evidence-backed categories.

Sentinel Signal

RAG-Ready Website Research & Knowledge Crawler

quanmatrix/rag-ready-web-research-crawler

Use this Actor to extract rag-ready website research and knowledge crawler into clean structured results for automation and AI workflows. Turn public web pages into clean research records with text quality, provenance, fingerprints, chunk-ready content and change signals for RAG and AI-agent pipelin

Rafael Barreto Haddad

RAG Dataset Builder

zinin/sitemap-to-knowledge

Turn buyer-authorized public website sitemaps into bounded, source-linked text chunks for RAG, search, migration, and review. Each delivered chunk includes provenance, hashes, crawl-gap flags, confidence, and billing metadata. Partial and homepage-fallback chunks are explicitly labeled.

Tim Zinin

Quote Source Verifier

automation-lab/source-quote-verifier

Verify quotations against public source pages and export matched passages, similarity, context, provenance URLs, HTTP status, and checked timestamps.

Automation Lab

Vimeo Public Video Downloader

automation-lab/vimeo-public-video-downloader

Download authorized public Vimeo videos as stored MP4 files and export provenance, quality, size, and retrieval metadata.

Automation Lab

Twitch Public Video Downloader

automation-lab/twitch-public-video-downloader

Download authorized public Twitch videos and clips as stored files with creator, timestamps, duration, quality, provenance, and retrieval status.

Automation Lab

EU Ecological Status Grouping Provenance Records — WISE

nexgensignal/eu-ecological-status-grouping-provenance-records

Keyless pay-per-record EEA WISE WFD ecological-status grouping provenance — quality element, grouping code, status value and change context per surface water body, as filed. Water-body grain, no person data. Gold $0.0335/record.

NexGen Signal

Kleinanzeigen.de Scraper with Contacts & Descriptions

fatihtahta/ebay-kleinanzeigen-scraper

Scrape Kleinanzeigen.de at scale with clean, structured listings. Capture titles, prices, descriptions, photos, locations and seller details for local offers and services. Ideal for price tracking, lead gen, resale sourcing and market research.

Fatih Tahta

5.0

(1)

Google Maps Scraper API — Local Business Leads & Emails

tugelbay/google-maps-leads

Google Maps scraper API for leads: export names, phones, websites, emails, ratings, and coordinates by keyword and location. Guide: https://konabayev.com/tools/google-maps-leads-extractor/?utm_source=apify_readme&utm_medium=referral&utm_campaign=google-maps-leads

Tugelbay Konabayev

EU Tenders API — TED Procurement Deadlines

ikoles/eu-ted-tender-deadline-radar

Search active EU public procurement notices from the official TED API. Filter tenders by keyword, buyer country, CPV code, publication date, submission deadline, and minimum value. Export clean JSON/CSV rows for bid pipelines, sales teams, alerts, dashboards, and AI agents.

Ilya Kalesnichenka

Chinese AI Training Corpus Engine

zhorex/chinese-corpus-engine

Turn China's public web into AI-training-ready text. Pulls Weibo, Bilibili, Xueqiu, Douban & RedNote, then deduplicates, quality-scores, PII-scrubs and provenance-stamps every document. From $0.025/doc, pay-as-you-go. For LLM training-data teams, data vendors & academic NLP researchers.