Instagram API Scraper avatar
Instagram API Scraper
Try for free

30 days trial then $39.00/month - No credit card required now

View all Actors
Instagram API Scraper

Instagram API Scraper

apify/instagram-api-scraper
Try for free

30 days trial then $39.00/month - No credit card required now

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

User avatar

Reels aren't scraped with hashtag search?

Closed

cautious_cypress opened this issue
5 months ago

I'm scraping for a hashtag, and I've noticed that only traditional in-feed posts are being returned (single image, carousel, and video posts). Reels are not being returned.

Can you confirm that Reels are not scraped with this Actor?

User avatar

Hi! Perhaps just misunderstanding: reels are posts of video types, from your run: https://api.apify.com/v2/datasets/u6OB3iVDAmeMEOmen/items?clean=true&fields=type,shortCode&format=json there was no reels in results, however for sample run https://console.apify.com/view/runs/w4ylCBTYCMOU9p57B there is https://api.apify.com/v2/datasets/JfSNOdtH9wd66cS7d/items?clean=true&fields=type,shortCode&format=json

For example

1{
2  "type": "Video",
3  "shortCode": "CXDEh-zAJPu"
4}

available as https://www.instagram.com/reel/CXDEh-zAJPu in dataset urls saved in shorter format https://www.instagram.com/p/CXDEh-zAJPu

User avatar

cautious_cypress

5 months ago

Thank you so much for your response. There's still a problem, though. If what you say is correct, we should see Reels in our Apify runs when scraping the #buckuback tag.

There are Reels tagged with #buckuback as you can see here:

https://www.instagram.com/explore/tags/buckuback (We use the same URL in our Actor)

The first Reel in those results is this one, posted on Nov 27th, 2023: https://www.instagram.com/p/C0JSzFnthxM/

I ran an Actor with a start date of 2023-11-25. Here are the results https://api.apify.com/v2/datasets/9Vt09RyhcYt8TX6zE/items?clean=true&format=json&limit=1000 .

The post above (https://www.instagram.com/p/C0JSzFnthxM/) is not included in the results. And that post was originally posted as a Reel (not as an in-feed video post). This behavior is consistent with this Actor, which is why I believe Reels are not included in the Apify results.

When I look at my historical runs in Apify, I consistently see that no Reels have been included. Yes, we have video posts, but not posts that were originally uploaded as Reels. And that's a problem for us. We need to see all posts that are tagged with #buckuback.

Based on your explanation above, Reels are just Video posts. But that means they should consistently show up in our results. The opposite is true: Reels are consistently missing.

Thanks in advance for your help with this. Justin

--

If you are not the intended recipient of this email, please reply to notify us and delete this message. This email may contain confidential information and dissemination, distribution or copying of this message is prohibited.

User avatar

Hi! Thanks for detailed feedback. After some research confirmed that reels not available in hashtag feed without login. Data flow at the time of writing (chosen because recent reel can be seen at first page of results): https://www.instagram.com/explore/tags/rayong/ "We Are Open" reel in right bottom corner is second reel from https://www.instagram.com/doctor.offduty/reels/ Without login reel is visible at https://www.instagram.com/doctor.offduty/reels/ but not at https://www.instagram.com/explore/tags/rayong/

Screens attached, also tried to add parameters to data calls, unfortunately no way around. Thanks again for details, according to https://www.reddit.com/r/Instagram/comments/j31lj1/reels_not_appearing_under_hashtags/ this rule applied by IG from the mid of 2023 (latest reddit comments dated as 8 months ago)

User avatar

cautious_cypress

5 months ago

Thank you for your explanation.

Best, Justin

--

If you are not the intended recipient of this email, please reply to notify us and delete this message. This email may contain confidential information and dissemination, distribution or copying of this message is prohibited.

User avatar

Hi, I'm going to close the issue for now, but if anything else comes up, feel free to reach out. Happy Scraping!

Developer
Maintained by Apify
Actor metrics
  • 129 monthly users
  • 1 star
  • 99.9% runs succeeded
  • 14 hours response time
  • Created in May 2022
  • Modified about 15 hours ago