Merge, Dedup & Transform Datasets avatar
Merge, Dedup & Transform Datasets

Pricing

Pay per usage

Go to Store
Merge, Dedup & Transform Datasets

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

Developed by

Lukáš Křivka

Maintained by Community

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

0.0 (0)

Pricing

Pay per usage

73

Monthly users

138

Runs succeeded

97%

Response time

11 days

Last modified

2 months ago

MO

It's not merging and deduping like it used to

Closed
Moudi opened this issue
7 months ago

I have 2 data sets that i want to merge and dedup but it is not working. usually this actor works perfectly fine but with this large dataset for some reason it is just adding them together but not merging them at all. i spent $200 on google maps scraper and email extractor if this doesn't work than that data is useless. please help me fix it

lukaskrivka avatar

Hello,

Thanks for the report.

  1. You don't have anything in "Fields for deduplication" so the Actor doesn't know what it should dedup by.
  2. You are deduping between Contact Details and Google Maps, that will not merge the data because it doesn't know how. That is actually what Google Maps Email Extractor does. So instead you should resurrect the Google Maps Email Extractor run that you probably aborted, it will pick up the Google and contact runs and merge them.
MO

Moudi

7 months ago

øk i followed your steps, finished all the actors and put the title as the field to dedup. It did what i wanted but the issue i have now is that I'm not getting any emails in the data. this is the most important thing for me.

here is the run: https://console.apify.com/organization/wTBD9nCgifroPF7eY/actors/runs/H20HED8u2Yy7IKpsa#output

lukaskrivka avatar

You should only run the Google Maps Email Extractor Actor, it has the correct logic to merge the data. Just let me know the run IDs I should rework and I will process it.

paja avatar

Hi again,

I'm going to close the issue for now, but if anything else comes up, please, let us know.

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.