Instagram Scraper avatar
Instagram Scraper
Try for free

Pay $2.30 for 1,000 results

View all Actors
Instagram Scraper

Instagram Scraper

apify/instagram-scraper
Try for free

Pay $2.30 for 1,000 results

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
PB

Is there a way for me to check for duplicates?

Closed

picturesque_buckeye opened this issue
2 months ago

Is there a way for me to check for duplicates so that the scraped content does not get scrapped again?

alexey avatar

Hi!

No direct way, you need to scrape posts based on amount or date, then dedup by i.e. https://apify.com/lukaskrivka/dedup-datasets or other tools.

You can also ask community in Apify Discord #hire-freelancers to build a simple integration script for this.

I´m going to close the issue now, but if there would be anything else we could help with, please let us know.

Developer
Maintained by Apify
Actor metrics
  • 4.4k monthly users
  • 283 stars
  • 100.0% runs succeeded
  • 1.8 days response time
  • Created in Apr 2019
  • Modified 1 day ago