Smart Dataset Merger, Cleaner & Pattern Splitter (CSV + XLSX) avatar

Smart Dataset Merger, Cleaner & Pattern Splitter (CSV + XLSX)

Pricing

from $0.10 / actor start

Go to Apify Store
Smart Dataset Merger, Cleaner & Pattern Splitter (CSV + XLSX)

Smart Dataset Merger, Cleaner & Pattern Splitter (CSV + XLSX)

Merge mixed CSV & Excel files by pattern, standardize columns, clean leads, remove duplicates, extract domains, and split outputs by row limits.

Pricing

from $0.10 / actor start

Rating

0.0

(0)

Developer

sadique shaikh

sadique shaikh

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

13 hours ago

Last modified

Share

Smart Multi-Format Dataset Merger, Cleaner & Pattern Splitter ๐Ÿš€

A high-performance Apify Actor to merge mixed CSV and Excel (.xlsx) files, auto-group by column patterns, clean leads, remove duplicate records, split large outputs by row limits, and ingest directly from Apify Datasets, ZIP archives, or Public URLs.


๐ŸŒŸ Key Features & USPs

  • ๐Ÿง  Pattern-Based Auto Grouping: Prevents column misalignment and data corruption by automatically grouping files matching exact column signatures.
  • โšก Mixed File Ingestion: Process .csv and .xlsx files simultaneously in a single run.
  • ๐ŸŽฏ Custom Row-Limit Splitting: Split output files into custom row counts (e.g. 50,000 for CRMs, 100,000 for Google Sheets, 500,000 for balanced handling).
  • ๐Ÿงน Lead Cleaning & Deduplication:
    • Remove duplicates across merged datasets.
    • Lowercase all email addresses (USER@GMAIL.COM -> user@gmail.com).
    • Trim extra whitespace from all text columns.
    • Split Full Name into first_name and last_name.
    • Extract root domain (company.com) from email or website columns.
  • โ˜๏ธ Cloud Native Integration: Ingest direct Apify Dataset IDs, ZIP download links, or public CSV/Excel file URLs.
  • ๐Ÿ“ฆ Multi-Format Export: Export output files as CSV, Excel (.xlsx), or JSON.

๐Ÿ“‹ Input Parameters

ParameterTypeDefaultDescription
zipFileUrlStringnullDirect URL to a .zip file containing CSV or Excel files.
fileUrlsArray[]List of public URLs to direct CSV/XLSX files.
apifyDatasetIdsArray[]List of Apify Dataset IDs to merge directly cloud-to-cloud.
rowsPerFileInteger500000Max rows allowed per split output file.
autoStandardizeHeadersBooleantrueMap alias headers (Email Address, e-mail -> email).
removeDuplicatesBooleantrueRemove duplicate records across datasets.
dedupColumnStringnullColumn to deduplicate on (e.g. email).
trimWhitespaceBooleantrueTrim spaces from text cells.
lowercaseEmailsBooleantrueLowercase email addresses.
splitFullNamesBooleanfalseSplit Full Name into first_name & last_name.
extractDomainsBooleanfalseExtract root domains into a domain column.
outputFormatString"csv"Output file format (csv, xlsx, json).

๐Ÿ“ค Output Artifacts

  • Key-Value Store: Output split files (format_1_part_1.csv, format_1_part_2.csv, etc.) ready for download.
  • Dataset Summary: A JSON report logging total files processed, pattern groups, row counts, and column schemas.

๐Ÿ› ๏ธ How to Deploy to Apify

  1. Install Apify CLI:
    $npm install -g apify-cli
  2. Log in to your Apify account:
    $apify login
  3. Push to your Apify console:
    $apify push

๐Ÿ‘จโ€๐Ÿ’ป Support & Issues

For feature requests or issues, reach out on the Apify Store actor discussion page!