Google Trends Scraper

Hi! Can you please provide list of countries? Proxy availability vary a lot based on country so a lot of blocking might be just because there is not enough proxies per given country.

Australia,United States, Canada, France, Sweden, United Kingdom, Germany, World Wide

Hey, thanks for reporting back, we will look into it.

14.224Z ACTOR: Pulling Docker image of build CAkEmkearZWi8gBuV from repository. 2024-05-26T12:47:14.338Z ACTOR: Creating Docker container. 2024-05-26T12:47:14.549Z ACTOR: Starting Docker container. 2024-05-26T12:47:15.273Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-05-26T12:47:15.280Z Executing main command 2024-05-26T12:47:16.448Z INFO System info {"apifyVersion":"3.2.0","apifyClientVersion":"2.9.3","crawleeVersion":"3.9.2","osType":"Linux","nodeVersion":"v20.12.2"} 2024-05-26T12:47:16.918Z INFO Created 3 Start URLs 2024-05-26T12:47:17.862Z INFO Starting crawler. 2024-05-26T12:47:18.321Z INFO PuppeteerCrawler: Starting the crawler. 2024-05-26T12:47:19.672Z WARN Puppeteer Utils: Using other request methods than GET, rewriting headers and adding payloads has a high impact on performance in recent versions of Puppeteer. Use only when necessary. 2024-05-26T12:47:22.534Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat"} 2024-05-26T12:47:23.046Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:23.047Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"QZGoEh9QzkVIODK","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat","retryCount":1} 2024-05-26T12:47:24.309Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Celine+Dion"} 2024-05-26T12:47:25.450Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Bing"} 2024-05-26T12:47:25.590Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:25.592Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"fwsykzveHV3E4ve","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Celine+Dion","retryCount":1} 2024-05-26T12:47:25.974Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:25.976Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"W1L1rDZjmRZdGgW","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Bing","retryCount":1} 2024-05-26T12:47:28.751Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat"} 2024-05-26T12:47:29.977Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:29.980Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"QZGoEh9QzkVIODK","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat","retryCount":2} 2024-05-26T12:47:32.122Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Celine+Dion"} 2024-05-26T12:47:33.448Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:33.449Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"fwsykzveHV3E4ve","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Celine+Dion","retryCount":2} 2024-05-26T12:47:39.701Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Bing"} 2024-05-26T12:47:41.406Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:41.407Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"W1L1rDZjmRZdGgW","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Bing","retryCount":2} 2024-05-26T12:47:44.240Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat"} 2024-05-26T12:47:44.913Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Cookie generation fails 2024-05-26T12:47:44.915Z at pageUnlocker (file:///home/myuser/dist/constants.js:35:15) {"id":"fwsykzveHV3E4ve","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Celine+Dion","retryCount":3} 2024-05-26T12:47:44.917Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:44.919Z at PuppeteerCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/dist/main.js:153:19) {"id":"QZGoEh9QzkVIODK","url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Mario+Pelchat","retryCount":3} 2024-05-26T12:47:47.546Z INFO Processing: {"url":"https://trends.google.com/trends/explore?geo=CA&date=today+3-m&q=Bing"} 2024-05-26T12:47:48.853Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. DATA ERROR 2024-05-26T12:47:48.855Z at PuppeteerCrawler.requestHandler [a

Hello, we're still looking into this. Google Trends seems to return 429 (Too many requests) even if we send only one request. It seems they're blocking users that are not logged in, even in a normal browser.