🎉 Apollo Scraper. $1.2/1k leads. Upto 50k leads per URL avatar
🎉 Apollo Scraper. $1.2/1k leads. Upto 50k leads per URL

Pricing

Pay per event

Go to Store
🎉 Apollo Scraper. $1.2/1k leads. Upto 50k leads per URL

🎉 Apollo Scraper. $1.2/1k leads. Upto 50k leads per URL

Developed by

Caleb David

Caleb David

Maintained by Community

Pull up to 50k leads from a single Apollo URL

3.3 (35)

Pricing

Pay per event

55

Total users

2.6K

Monthly users

1.4K

Runs succeeded

>99%

Issues response

9.8 hours

Last modified

11 days ago

GH

Prevent Duplicate Results When Scraping Same URL Multiple Times

Closed

ghimirebikal opened this issue
13 days ago

When using the Apollo Scraper on the free plan and crawling a URL (e.g., using the 100-at-once mode), I receive duplicate data on subsequent runs—even when scraping the exact same link again.

Feature Request: Please add a feature or option to automatically skip or filter out previously retrieved (duplicate) results, so that every run yields only fresh and unique data, even when the same link is scraped multiple times. This would significantly improve the usability of the tool and help ensure clean, deduplicated datasets across runs.

microworlds avatar

Technically, that is possible but economically, it's not feasible - because every request incurs costs on our end and not charging for the skipped duplicates will run down the actor. I hope you understand.

Thanks!