
Instagram Hashtag Scraper
Pricing
$19.99/month + usage
Go to Store


Instagram Hashtag Scraper
Effortlessly scrape Instagram hashtag data, including top posts and engagement metrics. Perfect for marketers, researchers, and data analysts looking to gain insights from Instagram trends and content performance. 📊
4.6 (2)
Pricing
$19.99/month + usage
11
Total users
337
Monthly users
44
Runs succeeded
>99%
Issues response
14 days
Last modified
15 days ago
Crawling seems to be broken
Open
niklas.klausner opened this issue
a day ago
Since a couple of hours all requests seem to fail. Proxies are high quality mobiles and nothing has changed from before.
funkybadgerbutt
a day ago
I'm experiencing this issue too. Here's my output.
2025-06-06T20:01:18.267Z ACTOR: Pulling Docker image of build 1N6PzRr5C3vor7wT8 from registry.2025-06-06T20:01:18.358Z ACTOR: Creating Docker container.2025-06-06T20:01:18.555Z ACTOR: Starting Docker container.2025-06-06T20:01:18.782Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent2025-06-06T20:01:19.973Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {2025-06-06T20:01:19.975Z _isPuppeteerCore: true,2025-06-06T20:01:19.977Z _changedBrowsers: false,2025-06-06T20:01:19.979Z connect: [Function: bound bound connect],2025-06-06T20:01:19.981Z defaultBrowserRevision: '131.0.6778.87',2025-06-06T20:01:19.983Z configuration: { defaultBrowser: 'chrome' },2025-06-06T20:01:19.985Z launch: [Function: bound launch],2025-06-06T20:01:19.986Z executablePath: [Function: bound executablePath],2025-06-06T20:01:19.988Z defaultArgs: [Function: bound defaultArgs],2025-06-06T20:01:19.990Z trimCache: [Function: bound trimCache] AsyncFunction2025-06-06T20:01:19.992Z }2025-06-06T20:01:20.054Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.4","crawleeVersion":"3.13.4","osType":"Linux","nodeVersion":"v20.19.2"}2025-06-06T20:01:20.974Z INFO PuppeteerCrawler: Starting the crawler.2025-06-06T20:01:30.479Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-06T20:02:00.781Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-06T20:02:00.784Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","retryCount":1}2025-06-06T20:02:04.376Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-06T20:02:20.974Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60624,"retryHistogram":[]}2025-06-06T20:02:21.076Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.019},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.048},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-06T20:02:34.583Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-06T20:02:34.585Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","retryCount":2}2025-06-06T20:02:38.569Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-06T20:03:08.585Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-06T20:03:08.587Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","retryCount":3}2025-06-06T20:03:17.784Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-06T20:03:21.663Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120624,"retryHistogram":[]}2025-06-06T20:03:24.420Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.039},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.163},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-06T20:03:48.250Z ERROR PuppeteerCrawler: Request failed and reached maximum retries. TimeoutError: Navigation timeout of 30000 ms exceeded2025-06-06T20:03:48.252Z at new Deferred (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:60:34)2025-06-06T20:03:48.254Z at Deferred.create (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/Deferred.js:21:16)2025-06-06T20:03:48.256Z at new LifecycleWatcher (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/LifecycleWatcher.js:69:60)2025-06-06T20:03:48.258Z at CdpFrame.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/cdp/Frame.js:149:29)2025-06-06T20:03:48.260Z at CdpFrame.<anonymous> (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/util/decorators.js:109:27)2025-06-06T20:03:48.261Z at CdpPage.goto (/home/myuser/node_modules/puppeteer-core/lib/cjs/puppeteer/api/Page.js:574:43)2025-06-06T20:03:48.263Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32)2025-06-06T20:03:48.265Z at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","method":"GET","uniqueKey":"https://www.instagram.com/explore/search/keyword?q=%23blacklivesmatter"}2025-06-06T20:03:48.317Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down.2025-06-06T20:03:48.984Z INFO PuppeteerCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":39435,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":39435,"requestsTotal":1,"crawlerRuntimeMillis":148634}2025-06-06T20:03:48.986Z INFO PuppeteerCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Navigation timeout of 30000 ms exceeded (file:///home/myuser/src/main.js:71:32)"]}2025-06-06T20:03:48.988Z INFO PuppeteerCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}

a day ago
Hi, fixed, please try now
funkybadgerbutt
a day ago
I'm still seeing the same error. No configurations were changed aside from the dates.
2025-06-07T00:18:21.850Z ACTOR: Pulling Docker image of build 1N6PzRr5C3vor7wT8 from registry.2025-06-07T00:18:44.289Z ACTOR: Creating Docker container.2025-06-07T00:18:45.144Z ACTOR: Starting Docker container.2025-06-07T00:18:45.457Z Will run command: xvfb-run -a -s "-ac -screen 0 1920x1080x24+32 -nolisten tcp" /bin/sh -c npm start --silent2025-06-07T00:18:46.898Z Warning: Plugin is not derived from PuppeteerExtraPlugin, ignoring. PuppeteerNode {2025-06-07T00:18:46.899Z _isPuppeteerCore: true,2025-06-07T00:18:46.900Z _changedBrowsers: false,2025-06-07T00:18:46.901Z connect: [Function: bound bound connect],2025-06-07T00:18:46.902Z defaultBrowserRevision: '131.0.6778.87',2025-06-07T00:18:46.903Z configuration: { defaultBrowser: 'chrome' },2025-06-07T00:18:46.904Z launch: [Function: bound launch],2025-06-07T00:18:46.905Z executablePath: [Function: bound executablePath],2025-06-07T00:18:46.906Z defaultArgs: [Function: bound defaultArgs],2025-06-07T00:18:46.907Z trimCache: [Function: bound trimCache] AsyncFunction2025-06-07T00:18:46.908Z }2025-06-07T00:18:46.959Z INFO System info {"apifyVersion":"3.4.2","apifyClientVersion":"2.12.4","crawleeVersion":"3.13.4","osType":"Linux","nodeVersion":"v20.19.2"}2025-06-07T00:18:47.763Z INFO PuppeteerCrawler: Starting the crawler.2025-06-07T00:19:47.763Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60415,"retryHistogram":[]}2025-06-07T00:19:47.789Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-07T00:19:49.890Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-07T00:20:19.893Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-07T00:20:19.894Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","retryCount":1}2025-06-07T00:20:47.762Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120414,"retryHistogram":[]}2025-06-07T00:20:47.792Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-07T00:21:21.768Z Processing https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter...2025-06-07T00:21:47.762Z INFO PuppeteerCrawler:Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":180415,"retryHistogram":[]}2025-06-07T00:21:47.794Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}2025-06-07T00:21:51.772Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Navigation timeout of 30000 ms exceeded2025-06-07T00:21:51.773Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:71:32) {"id":"oVznTYS5o5eMy1g","url":"https://www.instagram.com/explore/search/keyword/?q=%23blacklivesmatter","retryCount":2}2025-06-07T00:22:18.316Z ACTOR: The Actor run was aborted by the user.