Instagram Post Scraper avatar
Instagram Post Scraper
Try for free

No credit card required

View all Actors
Instagram Post Scraper

Instagram Post Scraper

apify/instagram-post-scraper
Try for free

No credit card required

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

User avatar

Allow user to skip old pinned posts

Open

fine_neonate opened this issue
2 months ago

I wanted to follow up on the issue above: https://console.apify.com/actors/nH2AHrwxeTRJoN5hX/issues/Cb1U2J8s7W5Tsk2Ex

If you'd like to maintain the default behavior, can you at least add another input variable to ignore old pinned posts? This would open up the periodic scraping use case for me to use here and keep the old behavior for customers with more ad-hoc jobs. Scraping specific accounts daily is a common use case as evidenced by the other comment on my issue before it was closed and this older issue here: https://console.apify.com/actors/nH2AHrwxeTRJoN5hX/issues/5bQdhfugmlsnVAysO

Filtering on our side is too inefficient for our use case when the accounts we're using post at a frequency of 1x per week (very common). This means each week (7 runs, 0-3 pinned posts) I'll get 1 new post vs. 7-14 copies of the irrelevent pinned posts. Practically this results in the agent stepping into the post-page to scrape and wasting 90% it's compute time on resources that fall outside the date filter in the first place. It's also an easy html tag to grab, and filter at the agent level before it spends the compute to open the post and grab the post details.

User avatar

nurturing_spray

a month ago

agree

User avatar

Hey, that seems reasonable, we will discuss how to do it best (and if possible).

User avatar

fine_neonate

a month ago

Thanks! I appreciate it. I'll keep an eye out for updates, would love to use this as part of my project

Developer
Maintained by Apify
Actor metrics
  • 1.5k monthly users
  • 0 stars
  • 99.9% runs succeeded
  • 2.2 days response time
  • Created in Nov 2021
  • Modified 1 day ago