
Instagram Hashtag Scraper
Pricing
$19.99/month + usage

Instagram Hashtag Scraper
Effortlessly scrape Instagram hashtag data, including top posts and engagement metrics. Perfect for marketers, researchers, and data analysts looking to gain insights from Instagram trends and content performance. 📊
4.6 (2)
Pricing
$19.99/month + usage
14
Total users
430
Monthly users
77
Runs succeeded
>99%
Issues response
1.9 days
Last modified
a month ago
Crawling for older dates
Open
Is there any fix for dates older than 2024? I am not getting results and the crawler stops scrolling before request is completed.

Theoretically, yes, if you can't find it, please provide your apify run log logs, we'll check it.
funkybadgerbutt
I've put in dates from 2020-04-01 to 2020-04-24. It looks like the crawler just stops.
2025-06-18T17:09:22.393Z ACTOR: Pulling Docker image of build 1N6PzRr5C3vor7wT8 from registry.2025-06-18T17:09:33.117Z ACTOR: Creating Docker container.2025-06-18T17:09:33.173Z ACTOR: Starting Docker container.2025-06-18T17:09:33.388Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent2025-06-18T17:09:35.745Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {2025-06-18T17:09:35.747Z _isPuppeteerCore: true,2025-06-18T17:09:35.749Z _changedBrowsers: false,2025-06-18T17:09:35.751Z connect: [Function: bound bound connect],2025-06-18T17:09:35.752Z defaultBrowserRevision: '131.0.6778.87',2025-06-18T17:09:35.754Z configuration: { defaultBrowser: 'chrome' },2025-06-18T17:09:35.756Z launch: [Function: bound launch],2025-06-18T17:09:35.758Z executablePath: [Function: bound executablePath],2025-06-18T17:09:35.768Z defaultArgs: [Function: bound defaultArgs],2025-06-18T17:09:35.770Z trimCache: [Function: bound trimCache] AsyncFunction2025-06-18T17:09:35.771Z }2025-06-18T17:09:35.806Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.4","crawleeVersion":"3.13.4","osType":"Linux","nodeVersion":"v20.19.2"}2025-06-18T17:09:36.409Z INFO PuppeteerCrawler: Starting the crawler.2025-06-18T17:09:37.890Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...2025-06-18T17:10:07.896Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-18T17:10:07.952Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":1}2025-06-18T17:10:10.464Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...2025-06-18T17:10:36.409Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60452,"retryHistogram":[]}2025-06-18T17:10:36.462Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.217},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-18T17:10:40.473Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-18T17:10:40.476Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":2}2025-06-18T17:10:43.259Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...2025-06-18T17:11:13.467Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-18T17:11:13.469Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":3}2025-06-18T17:11:18.668Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...2025-06-18T17:11:36.409Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120451,"retryHistogram":[]}2025-06-18T17:11:36.464Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.04},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.367},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-18T17:11:49.016Z ERROR PuppeteerCrawler: Request failed and reached maximum retries. TimeoutError: Navigation timeout of 30000 ms exceeded2025-06-18T17:11:49.018Z at new Deferred (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:60:34)2025-06-18T17:11:49.020Z at Deferred.create (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:21:16)2025-06-18T17:11:49.023Z at new LifecycleWatcher (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/LifecycleWatcher.js:69:60)2025-06-18T17:11:49.025Z at CdpFrame.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/Frame.js:149:29)2025-06-18T17:11:49.027Z at CdpFrame.<anonymous> (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/decorators.js:109:27)2025-06-18T17:11:49.029Z at CdpPage.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/api/Page.js:574:43)2025-06-18T17:11:49.031Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32)2025-06-18T17:11:49.033Z at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","method":"GET","uniqueKey":"https://www.instagram.com/explore/search/keyword?q=%23gowokegobroke"}2025-06-18T17:11:49.223Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down.2025-06-18T17:11:49.811Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":35092,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":35092,"requestsTotal":1,"crawlerRuntimeMillis":133851}2025-06-18T17:11:49.814Z INFO PuppeteerCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Navigation timeout of 30000 ms exceeded (file:///home/myuser/src/main.js:71:32)"]}2025-06-18T17:11:49.831Z INFO PuppeteerCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}
funkybadgerbutt
Set to no proxy.
funkybadgerbutt
Any advice for scrolling for dates in 2023? I got another failed run.
2025-06-23T04:10:07.138Z ACTOR: Pulling Docker image of build CNllbWnioa3OilGXl from registry.2025-06-23T04:10:07.140Z ACTOR: Creating Docker container.2025-06-23T04:10:07.223Z ACTOR: Starting Docker container.2025-06-23T04:10:07.455Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent2025-06-23T04:10:08.916Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {2025-06-23T04:10:08.922Z _isPuppeteerCore: true,2025-06-23T04:10:08.924Z _changedBrowsers: false,2025-06-23T04:10:08.926Z connect: [Function: bound bound connect],2025-06-23T04:10:08.928Z defaultBrowserRevision: '131.0.6778.87',2025-06-23T04:10:08.934Z configuration: { defaultBrowser: 'chrome' },2025-06-23T04:10:08.936Z launch: [Function: bound launch],2025-06-23T04:10:08.938Z executablePath: [Function: bound executablePath],2025-06-23T04:10:08.940Z defaultArgs: [Function: bound defaultArgs],2025-06-23T04:10:08.942Z trimCache: [Function: bound trimCache] AsyncFunction2025-06-23T04:10:08.944Z }2025-06-23T04:10:09.001Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.5","crawleeVersion":"3.13.8","osType":"Linux","nodeVersion":"v20.19.2"}2025-06-23T04:10:09.848Z INFO PuppeteerCrawler: Starting the crawler.2025-06-23T04:10:12.074Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...2025-06-23T04:10:17.946Z Scrolling time...12025-06-23T04:10:22.225Z Scrolling time...22025-06-23T04:10:26.357Z Scrolling time...32025-06-23T04:10:32.152Z Scrolling time...42025-06-23T04:10:35.421Z Scrolling time...52025-06-23T04:10:39.229Z Saved 0 items2025-06-23T04:10:40.449Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down.2025-06-23T04:10:41.713Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":1,"requestsFailed":0,"retryHistogram":[1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":29135,"requestsFinishedPerMinute":2,"requestsFailedPerMinute":0,"requestTotalDurationMillis":29135,"requestsTotal":1,"crawlerRuntimeMillis":32553}2025-06-23T04:10:41.718Z INFO PuppeteerCrawler: Finished! Total 1 requests: 1 succeeded, 0 failed. {"terminal":true}