JSON Catalog Deduplicator v2

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

Dataset Deduplicator & Cleaner

eszetael_lab/dataset-deduplicator-cleaner

Returns your records with duplicates removed and values normalized — same fields as the input, nothing added or renamed. Exact, normalized or fuzzy matching on keys you choose. A data quality report lands under QUALITY_REPORT. Takes a dataset ID or inline JSON, so it chains after any scraper.

Diffs two public JSON catalogs. Try is Allbirds vs ColourPop products.json. Distinct pair from v1. $2 / 1,000.

Typed rows from a public JSON catalog. Try is ColourPop — distinct from v1 Allbirds. $0.002 / row.

Field-level audit of a public JSON array. Try is Allbirds products.json. Not an Apify platform scanner. $2 / 1,000.

Public OWASP LLM Top 10 2025 headings (LLM01 Prompt Injection). Not a model red-team. $0.01 / heading.

Tesla CIK 0001318605 filings from data.sec.gov. v1 Try is Apple. Not a risk rating. $0.01 / filing.

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

TED France Travaux/Entretien titles as-published. Same engine as the DE snapshot — pick one. $0.01.

CourtListener v4 opinions for “patent infringement”. v1 Try is antitrust. Not a docket dump. $0.01.