Instagram Hashtag Scraper avatar
Instagram Hashtag Scraper

Pricing

$19.99/month + usage

Go to Store
Instagram Hashtag Scraper

Instagram Hashtag Scraper

Developed by

EasyApi

EasyApi

Maintained by Community

Effortlessly scrape Instagram hashtag data, including top posts and engagement metrics. Perfect for marketers, researchers, and data analysts looking to gain insights from Instagram trends and content performance. 📊

4.6 (2)

Pricing

$19.99/month + usage

14

Total users

430

Monthly users

77

Runs succeeded

>99%

Issues response

1.9 days

Last modified

a month ago

FU

Crawling for older dates

Open

funkybadgerbutt opened this issue
a month ago

Is there any fix for dates older than 2024? I am not getting results and the crawler stops scrolling before request is completed.

easyapi avatar

Theoretically, yes, if you can't find it, please provide your apify run log logs, we'll check it.

FU

funkybadgerbutt

a month ago

I've put in dates from 2020-04-01 to 2020-04-24. It looks like the crawler just stops.

2025-06-18T17:09:22.393Z ACTOR: Pulling Docker image of build 1N6PzRr5C3vor7wT8 from registry.
2025-06-18T17:09:33.117Z ACTOR: Creating Docker container.
2025-06-18T17:09:33.173Z ACTOR: Starting Docker container.
2025-06-18T17:09:33.388Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent
2025-06-18T17:09:35.745Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {
2025-06-18T17:09:35.747Z _isPuppeteerCore: true,
2025-06-18T17:09:35.749Z _changedBrowsers: false,
2025-06-18T17:09:35.751Z connect: [Function: bound bound connect],
2025-06-18T17:09:35.752Z defaultBrowserRevision: '131.0.6778.87',
2025-06-18T17:09:35.754Z configuration: { defaultBrowser: 'chrome' },
2025-06-18T17:09:35.756Z launch: [Function: bound launch],
2025-06-18T17:09:35.758Z executablePath: [Function: bound executablePath],
2025-06-18T17:09:35.768Z defaultArgs: [Function: bound defaultArgs],
2025-06-18T17:09:35.770Z trimCache: [Function: bound trimCache] AsyncFunction
2025-06-18T17:09:35.771Z }
2025-06-18T17:09:35.806Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.4","crawleeVersion":"3.13.4","osType":"Linux","nodeVersion":"v20.19.2"}
2025-06-18T17:09:36.409Z INFO PuppeteerCrawler: Starting the crawler.
2025-06-18T17:09:37.890Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...
2025-06-18T17:10:07.896Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded
2025-06-18T17:10:07.952Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":1}
2025-06-18T17:10:10.464Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...
2025-06-18T17:10:36.409Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60452,"retryHistogram":[]}
2025-06-18T17:10:36.462Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.217},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2025-06-18T17:10:40.473Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded
2025-06-18T17:10:40.476Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":2}
2025-06-18T17:10:43.259Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...
2025-06-18T17:11:13.467Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded
2025-06-18T17:11:13.469Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","retryCount":3}
2025-06-18T17:11:18.668Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...
2025-06-18T17:11:36.409Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120451,"retryHistogram":[]}
2025-06-18T17:11:36.464Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.04},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.367},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2025-06-18T17:11:49.016Z ERROR PuppeteerCrawler: Request failed and reached maximum retries. TimeoutError: Navigation timeout of 30000 ms exceeded
2025-06-18T17:11:49.018Z at new Deferred (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:60:34)
2025-06-18T17:11:49.020Z at Deferred.create (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:21:16)
2025-06-18T17:11:49.023Z at new LifecycleWatcher (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/LifecycleWatcher.js:69:60)
2025-06-18T17:11:49.025Z at CdpFrame.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/Frame.js:149:29)
2025-06-18T17:11:49.027Z at CdpFrame.<anonymous> (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/decorators.js:109:27)
2025-06-18T17:11:49.029Z at CdpPage.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/api/Page.js:574:43)
2025-06-18T17:11:49.031Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32)
2025-06-18T17:11:49.033Z at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"STSc64GEU7hxv82","url":"https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke","method":"GET","uniqueKey":"https://www.instagram.com/explore/search/keyword?q=%23gowokegobroke"}
2025-06-18T17:11:49.223Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down.
2025-06-18T17:11:49.811Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":35092,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":35092,"requestsTotal":1,"crawlerRuntimeMillis":133851}
2025-06-18T17:11:49.814Z INFO PuppeteerCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Navigation timeout of 30000 ms exceeded (file:///home/myuser/src/main.js:71:32)"]}
2025-06-18T17:11:49.831Z INFO PuppeteerCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}
FU

funkybadgerbutt

a month ago

Set to no proxy.

FU

funkybadgerbutt

a month ago

Any advice for scrolling for dates in 2023? I got another failed run.

2025-06-23T04:10:07.138Z ACTOR: Pulling Docker image of build CNllbWnioa3OilGXl from registry.
2025-06-23T04:10:07.140Z ACTOR: Creating Docker container.
2025-06-23T04:10:07.223Z ACTOR: Starting Docker container.
2025-06-23T04:10:07.455Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent
2025-06-23T04:10:08.916Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {
2025-06-23T04:10:08.922Z _isPuppeteerCore: true,
2025-06-23T04:10:08.924Z _changedBrowsers: false,
2025-06-23T04:10:08.926Z connect: [Function: bound bound connect],
2025-06-23T04:10:08.928Z defaultBrowserRevision: '131.0.6778.87',
2025-06-23T04:10:08.934Z configuration: { defaultBrowser: 'chrome' },
2025-06-23T04:10:08.936Z launch: [Function: bound launch],
2025-06-23T04:10:08.938Z executablePath: [Function: bound executablePath],
2025-06-23T04:10:08.940Z defaultArgs: [Function: bound defaultArgs],
2025-06-23T04:10:08.942Z trimCache: [Function: bound trimCache] AsyncFunction
2025-06-23T04:10:08.944Z }
2025-06-23T04:10:09.001Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.5","crawleeVersion":"3.13.8","osType":"Linux","nodeVersion":"v20.19.2"}
2025-06-23T04:10:09.848Z INFO PuppeteerCrawler: Starting the crawler.
2025-06-23T04:10:12.074Z Processing https://www.instagram.com/explore/search/keyword/?q=%23gowokegobroke...
2025-06-23T04:10:17.946Z Scrolling time...1
2025-06-23T04:10:22.225Z Scrolling time...2
2025-06-23T04:10:26.357Z Scrolling time...3
2025-06-23T04:10:32.152Z Scrolling time...4
2025-06-23T04:10:35.421Z Scrolling time...5
2025-06-23T04:10:39.229Z Saved 0 items
2025-06-23T04:10:40.449Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down.
2025-06-23T04:10:41.713Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":1,"requestsFailed":0,"retryHistogram":[1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":29135,"requestsFinishedPerMinute":2,"requestsFailedPerMinute":0,"requestTotalDurationMillis":29135,"requestsTotal":1,"crawlerRuntimeMillis":32553}
2025-06-23T04:10:41.718Z INFO PuppeteerCrawler: Finished! Total 1 requests: 1 succeeded, 0 failed. {"terminal":true}