Apollo Scraper - Pay per leads avatar

Apollo Scraper - Pay per leads

Try for free

Pay $5.00 for 1,000 results

Go to Store
Apollo Scraper - Pay per leads

Apollo Scraper - Pay per leads

curious_coder/apollo-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape apollo to get b2b leads with emails, work history, company website, company phone numbers, etc

MF

Lots of Duplicates

Closed

matt_futureflow opened this issue
3 months ago

Hi there, I was hoping someone could help me reduce the number of duplicate contacts I am scraping in my runs. I have been segmenting my searches as I know the scraper can only scrape up to page 100 (2,500 contacts) but since the scraper can only do 1,000 at a time if scrape a list of 3,000 2 times. Every scrape after the first one generates lots of duplicates which reduces the effectiveness of the scrape.

Wonder if there are any workarounds for this issue?

curious_coder avatar

In order to quickly identify the reason of your issue, I need to inspect your run.

Please share the URL of the run where you faced this issue. You can find your runs on this page: https://console.apify.com/actors/runs

curious_coder avatar

Can you show me samples of duplicate rows ? If you always use same "net new" search url across multiple runs, then it shouldn't give you duplicates.

MF

matt_futureflow

3 months ago

I have already deleted the duplicates but I didn't know if you used the same "net new" url that it will give different results.

With that in mind, does that mean that if the lead list was say 2k contacts and I did 2 1k scrapes then I should technically have all the leads in that list?

I'm trying to find the most efficient way of using this tool and scrape the most amount of leads that I can.

Appreciate your help!

curious_coder avatar

You are right. Net new results are always unique as long as you run with 'Get email' option enabled

Developer
Maintained by Community

Actor Metrics

  • 169 monthly users

  • 38 stars

  • >99% runs succeeded

  • 12 days response time

  • Created in Aug 2023

  • Modified 3 days ago