Merge JSON Datasets — Deduplicate Rows, Export JSON and CSV avatar

Merge JSON Datasets — Deduplicate Rows, Export JSON and CSV

Pricing

from $0.96 / 1,000 batch cleaneds

Go to Apify Store
Merge JSON Datasets — Deduplicate Rows, Export JSON and CSV

Merge JSON Datasets — Deduplicate Rows, Export JSON and CSV

Merge JSON datasets: Deduplicate object rows and export stable-order JSON and CSV. $0.0012 per batch of up to 1,000 rows; start extra; usage included; failed results uncharged.

Pricing

from $0.96 / 1,000 batch cleaneds

Rating

0.0

(0)

Developer

Logan Parker

Logan Parker

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Features

Limited permissions

Share

Merge JSON datasets supplied as batches of row arrays, deduplicate by chosen key fields or full row equality, and export stable-order JSON and CSV. AI agents can call and pay through Apify MCP. List event rates are $0.0012 per batch of up to 1,000 rows; start is extra, usage is included and failed results are uncharged.

Example result

Example record for the minimal input under How to use it, as this Actor returned it on 2026-10-28 in a run of its production image; the record is kept unchanged with the release.

{
"batch": "[[{\"sku\": \"a\", \"qty\": 2}, {\"sku\": \"b\", \"qty\": 1}], [{\"sku\": \"a\", \"qty\": 2}]]",
"ok": true,
"rows": [
{
"sku": "a",
"qty": 2
},
{
"sku": "b",
"qty": 1
}
],
"inputRows": 3,
"outputRows": 2,
"duplicatesRemoved": 1,
"csv": "sku,qty\r\na,2\r\nb,1\r\n"
}

How to use it

Start a run in Apify Console, by API or from an agent with an input like this one — it is the input Apify runs every day to test this Actor:

{"batches": ["[[{\"sku\": \"a\", \"qty\": 2}, {\"sku\": \"b\", \"qty\": 1}], [{\"sku\": \"a\", \"qty\": 2}]]"]}

Start with the minimal JSON example above, then adjust the fields in the table below. Read the Example result and Output fields sections for the returned record, Errors for failure codes, and Events and prices for result events and the separate platform start.

FieldTypeMeaning
batchesarray1–20 batches, each a JSON string encoding an array of row arrays, up to 1,000 object rows and 1 MB per batch. No storage IDs, URLs, credentials, scripts or joins.
keyFieldsstringComma-separated top-level key fields; empty means full canonical JSON equality.

Events and prices

EventTitleCharged whenFREE / BRONZESILVERGOLD / PLATINUM / DIAMOND
batch-cleanedBatch CleanedOne successful input processed and its readable result stored.$0.0012$0.00108$0.00096

Platform usage is not passed through. Apify's automatic actor-start event remains $0.00005 per started GB (one GB or less counts once). The synthetic dataset-item event is absent. Charge limits stop further paying work; unprocessed inputs receive uncharged errors. Completed readable pending events are settled on abort.

Worked cost example: ten successful batch cleaned events cost $0.012 at list, plus actor start. Failures are not included in that count.

Call it from an agent

Through Apify's MCP server (https://mcp.apify.com) use call-actor:

{
"actor": "hermeskd/dataset-json-cleaner",
"input": {
"batches": [
"[[{\"sku\": \"a\", \"qty\": 2}, {\"sku\": \"b\", \"qty\": 1}], [{\"sku\": \"a\", \"qty\": 2}]]"
]
},
"callOptions": {
"maxTotalChargeUsd": 0.01,
"timeout": 600
},
"waitSecs": 30
}

Then call get-dataset-items with the returned defaultDatasetId. Dedicated tool URL: https://mcp.apify.com?tools=hermeskd/dataset-json-cleaner

Output fields

FieldMeaning
batchThe caller supplied input, carried unchanged.
okTrue for a returned result; a failure is never charged.
rowsDeduplicated rows in stable first-seen order.
inputRowsCount of rows across all arrays before deduplication.
outputRowsCount of retained rows.
duplicatesRemovedNumber of duplicate rows removed.
csvRFC 4180 CSV; spreadsheet formula cells prefixed with a quote; original JSON unchanged.
errorFailure, always uncharged.

Limits and run time

The revised result price clears the retained conservative cold/default model on the measured successful cases at BRONZE, SILVER and GOLD. Actual platform costs, cold startup, source smoke and the deploy pricing floor remain release gates; local measurements do not prove hosted costs.

Complete serialized results must fit an 8 MB delivery budget, including input identity and JSON escaping. Oversized results are refused without a result charge. Invalid Unicode in failure echoes is escaped. Failure input echoes longer than 8,192 characters are shortened; blank list entries refuse the whole input without silently dropping entries.

1–20 batches, each a JSON string encoding an array of row arrays, up to 1,000 object rows and 1 MB per batch. No storage IDs, URLs, credentials, scripts or joins.

The default run timeout is 600 seconds. Local production-image smoke on 2026-10-28: 2.55 seconds at 256 MB and one CPU (the smallest configured memory). Platform cold start, billing and pricing-floor verification remain deploy gates.

Errors

CodeMeaning
invalid_batchThe string is not an array of row arrays, has non-object rows, a missing selected key or exceeds the stated limits.
download_failedThe request or connection failed within its bounded deadline.
robots_disallowedrobots.txt forbids fetching the URL; no request was made to it.
blocked_hostThe host is on the deny-list or resolves to a private or local address; no request was made.
timeoutThe input did not finish within the run's time budget.
invalid_inputThe run input passed the input schema but cannot be used; the message names the field.
internal_errorUnexpected failure; the message carries the error class.
charge_limit_reachedThe run reached its maximum total charge; this input was not processed.

No failure record is charged. A run fails only when all input outcomes are Actor-side failures; caller errors and a mixture of caller/Actor failures do not fail the run.

Sources and terms

Only process content you have the right to process. Nothing is fetched. Synthetic product rows are CC0; caller-supplied arrays only. No personal-data extraction, enrichment or inference.

Not affiliated

This Actor is not affiliated with the source providers named here. Process only content you have the right to process.

Changelog

  • 1.0 (2026-10-28) — Initial implementation, main-path fixtures and local production-image examples verified; publication awaits the scheduled merge.