Instagram API Scraper avatar
Instagram API Scraper
Try for free

30 days trial then $39.00/month - No credit card required now

View all Actors
Instagram API Scraper

Instagram API Scraper

apify/instagram-api-scraper
Try for free

30 days trial then $39.00/month - No credit card required now

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

User avatar

Finishes work after a dozen or so records.

Closed

lukaszyla opened this issue
2 months ago

I wanted to scrape the data by the hashtags and then download the photos through another actor. Unfortunately, the program finished work after a dozen or so records. With log: "CheerioCrawler: Finished! Total 21 requests: 21 succeeded, 0 failed. {"terminal":true} 2024-03-18T16:51:52.517Z INFO [Status message]: Direct URL scraper finished".

User avatar

Hi! In your shared run you doing search for hashtags so actor will only save details for search results: https://api.apify.com/v2/datasets/QcjaNqlnb5Zw17egm/items?clean=true&format=json This logic enforced because results might be not logically correct and you need to review manually and decide what to use as direct URLs for scraping posts, then run again.

Or may be you using search by mistake, most of results from your run is equal to found tag names, i.e. search for "barcelona" returns https://www.instagram.com/explore/tags/barcelona/ and there is no advantage to do search, just use your terms as part of URL https://www.instagram.com/explore/tags/NAME_OF_YOUR_HASHTAG

If there would be anything else we could help with, please let us know.

User avatar

Hi, I'm closing this issue for now, but feel free to reopen it, should you have any further questions or comments.

Developer
Maintained by Apify
Actor metrics
  • 97 monthly users
  • 99.9% runs succeeded
  • 0.8 days response time
  • Created in May 2022
  • Modified about 5 hours ago