Google Shopping Insights

2022-05-05T11:41:16.053Z INFO System info {"apifyVersion":"2.2.1","apifyClientVersion":"2.0.5","osType":"Linux","nodeVersion":"v16.13.1"} 2022-05-05T11:41:16.287Z INFO Search URLs: 2022-05-05T11:41:16.289Z http://www.google.fr/search?q=Cartes%20de%20visite&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.291Z http://www.google.fr/search?q=Flyers%20A4%20A5&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.293Z http://www.google.fr/search?q=Banner&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.295Z http://www.google.fr/search?q=Roll-up&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.297Z http://www.google.fr/search?q=D%C3%A9pliants&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.299Z http://www.google.fr/search?q=Affiches&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.301Z http://www.google.fr/search?q=Calendriers%20muraux&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.303Z http://www.google.fr/search?q=Brochure&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.305Z http://www.google.fr/search?q=Vinyle%20Adh%C3%A9sif&tbm=shop&tbs=vw:l 2022-05-05T11:41:16.432Z INFO Starting crawler. 2022-05-05T11:41:16.585Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}} 2022-05-05T11:41:21.061Z INFO Processing: http://www.google.fr/search?q=Cartes%20de%20visite&tbm=shop&tbs=vw:l 2022-05-05T11:41:21.063Z INFO Number of page: 1 2022-05-05T11:41:51.282Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"http://www.google.fr/search?q=Cartes%20de%20visite&tbm=shop&tbs=vw:l","retryCount":1,"id":"8gHkCSPIr8pJr2y"} 2022-05-05T11:41:51.284Z Error: Page didn't load properly, retrying... 2022-05-05T11:41:51.286Z at Object.exports.SEARCH_PAGE (/home/myuser/src/routes.js:17:15) 2022-05-05T11:41:51.289Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2022-05-05T11:41:51.291Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:73:27) 2022-05-05T11:41:55.356Z INFO Processing: http://www.google.fr/search?q=Roll-up&tbm=shop&tbs=vw:l 2022-05-05T11:41:55.359Z INFO Number of page: 1 2022-05-05T11:41:55.366Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"http://www.google.fr/search?q=Roll-up&tbm=shop&tbs=vw:l","retryCount":1,"id":"KyA2ZoP5kWSZZV6"} 2022-05-05T11:41:55.368Z Error: Page didn't load properly, retrying... 2022-05-05T11:41:55.370Z at Object.exports.SEARCH_PAGE (/home/myuser/src/routes.js:34:15) 2022-05-05T11:41:55.372Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2022-05-05T11:41:55.374Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:73:27) 2022-05-05T11:42:16.623Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":7,"desiredConcurrency":8,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.02},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.019},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2022-05-05T11:42:16.652Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60223,"retryHistogram":[]} 2022-05-05T11:42:18.896Z INFO Processing: http://www.google.fr/search?q=D%C3%A9pliants&tbm=shop&tbs=vw:l 2022-05-05T11:42:18.898Z INFO Number of page: 1 2022-05-05T11:42:18.900Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"http://www.google.fr/search?q=D%C3%A9pliants&tbm=shop&tbs=vw:l","retryCount":1,"id":"t0Q8Fc1VZGyudIh"} 2022-05-05T11:42:18.902Z Error: Page didn't load properly, retrying...