Instagram API Scraper avatar

Instagram API Scraper

Try for free

30 days trial then $39.00/month - No credit card required now

Go to Store
Instagram API Scraper

Instagram API Scraper

apify/instagram-api-scraper
Try for free

30 days trial then $39.00/month - No credit card required now

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Do you want to learn more about this Actor?

Get a demo
CC

Reels aren't scraped with hashtag search?

Closed

cautious_cypress opened this issue
a year ago

I'm scraping for a hashtag, and I've noticed that only traditional in-feed posts are being returned (single image, carousel, and video posts). Reels are not being returned.

Can you confirm that Reels are not scraped with this Actor?

alexey avatar

Hi! Perhaps just misunderstanding: reels are posts of video types, from your run: https://api.apify.com/v2/datasets/u6OB3iVDAmeMEOmen/items?clean=true&fields=type,shortCode&format=json there was no reels in results, however for sample run https://console.apify.com/view/runs/w4ylCBTYCMOU9p57B there is https://api.apify.com/v2/datasets/JfSNOdtH9wd66cS7d/items?clean=true&fields=type,shortCode&format=json

For example

1{
2  "type": "Video",
3  "shortCode": "CXDEh-zAJPu"
4}

available as https://www.instagram.com/reel/CXDEh-zAJPu in dataset urls saved in shorter format https://www.instagram.com/p/CXDEh-zAJPu

CC

cautious_cypress

a year ago

Thank you so much for your response. There's still a problem, though. If what you say is correct, we should see Reels in our Apify runs when scraping the #buckuback tag.

There are Reels tagged with #buckuback as you can see here:

https://www.instagram.com/explore/tags/buckuback (We use the same URL in our Actor)

The first Reel in those results is this one, posted on Nov 27th, 2023: https://www.instagram.com/p/C0JSzFnthxM/

I ran an Actor with a start date of 2023-11-25. Here are the results https://api.apify.com/v2/datasets/9Vt09RyhcYt8TX6zE/items?clean=true&format=json&limit=1000 .

The post above (https://www.instagram.com/p/C0JSzFnthxM/) is not included in the results. And that post was originally posted as a Reel (not as an in-feed video post). This behavior is consistent with this Actor, which is why I believe Reels are not included in the Apify results.

When I look at my historical runs in Apify, I consistently see that no Reels have been included. Yes, we have video posts, but not posts that were originally uploaded as Reels. And that's a problem for us. We need to see all posts that are tagged with #buckuback.

Based on your explanation above, Reels are just Video posts. But that means they should consistently show up in our results. The opposite is true: Reels are consistently missing.

Thanks in advance for your help with this. Justin

--

If you are not the intended recipient of this email, please reply to ... [trimmed]

alexey avatar

Hi! Thanks for detailed feedback. After some research confirmed that reels not available in hashtag feed without login. Data flow at the time of writing (chosen because recent reel can be seen at first page of results): https://www.instagram.com/explore/tags/rayong/ "We Are Open" reel in right bottom corner is second reel from https://www.instagram.com/doctor.offduty/reels/ Without login reel is visible at https://www.instagram.com/doctor.offduty/reels/ but not at https://www.instagram.com/explore/tags/rayong/

Screens attached, also tried to add parameters to data calls, unfortunately no way around. Thanks again for details, according to https://www.reddit.com/r/Instagram/comments/j31lj1/reels_not_appearing_under_hashtags/ this rule applied by IG from the mid of 2023 (latest reddit comments dated as 8 months ago)

CC

cautious_cypress

a year ago

Thank you for your explanation.

Best, Justin

--

If you are not the intended recipient of this email, please reply to notify us and delete this message. This email may contain confidential information and dissemination, distribution or copying of this message is prohibited.

paja avatar

Hi, I'm going to close the issue for now, but if anything else comes up, feel free to reach out. Happy Scraping!

Developer
Maintained by Apify

Actor Metrics

  • 158 monthly users

  • 38 stars

  • >99% runs succeeded

  • 38 days response time

  • Created in May 2022

  • Modified 21 hours ago