URL Hygiene & Dedup API

Dataset Cleaner & Deduplicator — Quality Engine

egeusta/dataset-quality-deduplication-engine

Clean datasets, remove duplicate rows, detect missing values, normalize emails and phones, and validate schemas before exporting to CRM or databases.

Clean, deduplicate, normalize, and schema-check JSON datasets with a simple structured input.

Return only never-before-seen rows from repeated Apify datasets and stop duplicate alerts, CRM records, and downstream automation actions.

Ai Training Data Enricher

fiery_dream/ai-training-data-enricher

Production-grade data enrichment and validation for LLM training datasets. Automatically clean, enrich, deduplicate, and validate your AI training data before fine-tuning.

Clean, normalize and deduplicate any dataset: field names, whitespace, empty values, numbers, plus exact and fuzzy duplicate removal.

Apify Dataset QA Gate

zentrafoundry/apify-dataset-quality-auditor

Score Apify datasets and emit actionable quality issues before downstream use.

CSV Deduper Normalizer

junipr/csv-deduper-normalizer

Deduplicate and normalize CSV-style rows. Clean whitespace, casing, domains, URLs, and emails, then output kept and duplicate rows plus clean CSV/JSON files.

Clean and normalize JSON/CSV data: trim whitespace, lowercase emails, normalize phone numbers and dates, drop empty values/rows, and deduplicate by a field.

ai-data-cleaner-classifier

keratogenous_surgeon/dataset-ai-cleaner

Clean, normalize, deduplicate, and classify JSON, CSV, or Apify datasets using rules or OpenAI models. Built for automation pipelines, data preparation, and AI workflows. Supports dataset chaining, cost controls, and safe fallbacks.

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.