Similarweb Scraper avatar
Similarweb Scraper
Try for free

7 days trial then $25.00/month - No credit card required now

View all Actors
Similarweb Scraper

Similarweb Scraper

tri_angle/similarweb-scraper
Try for free

7 days trial then $25.00/month - No credit card required now

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

AS

No results

Closed

advantageous_spruce opened this issue
2 years ago

I don't see any results when running this actor, it used to work a few weeks ago. See longs 2022-08-15T04:04:45.127Z ACTOR: Pulling Docker image from repository. 2022-08-15T04:04:45.924Z ACTOR: Creating Docker container. 2022-08-15T04:04:46.141Z ACTOR: Starting Docker container. 2022-08-15T04:04:48.652Z INFO System info {"apifyVersion":"2.3.2","apifyClientVersion":"2.3.1","osType":"Linux","nodeVersion":"v16.15.0"} 2022-08-15T04:04:50.561Z INFO Starting the crawl. 2022-08-15T04:04:50.624Z INFO CheerioCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.7,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}} 2022-08-15T04:04:54.611Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/turing.com","retryCount":1,"id":"Z1ZsSUCqbAKPDBl"} 2022-08-15T04:04:54.614Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/turing.com 2022-08-15T04:05:04.072Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/whatfix.com","retryCount":1,"id":"SS9NX0WgnUSKhdN"} 2022-08-15T04:05:04.075Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/whatfix.com 2022-08-15T04:05:05.386Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/turing.com","retryCount":2,"id":"Z1ZsSUCqbAKPDBl"} 2022-08-15T04:05:05.390Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/turing.com 2022-08-15T04:05:10.693Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/whatfix.com","retryCount":2,"id":"SS9NX0WgnUSKhdN"} 2022-08-15T04:05:10.696Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/whatfix.com 2022-08-15T04:05:16.092Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/turing.com","retryCount":3,"id":"Z1ZsSUCqbAKPDBl"} 2022-08-15T04:05:16.095Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/turing.com 2022-08-15T04:05:23.114Z ERROR CheerioCrawler: Request failed and reached maximum retries {"id":"Z1ZsSUCqbAKPDBl","url":"https://similarweb.com/website/turing.com","method":"GET","uniqueKey":"https://similarweb.com/website/turing.com"} 2022-08-15T04:05:23.118Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/turing.com 2022-08-15T04:05:23.483Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://similarweb.com/website/whatfix.com","retryCount":3,"id":"SS9NX0WgnUSKhdN"} 2022-08-15T04:05:23.486Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/whatfix.com 2022-08-15T04:05:29.173Z ERROR CheerioCrawler: Request failed and reached maximum retries {"id":"SS9NX0WgnUSKhdN","url":"https://similarweb.com/website/whatfix.com","method":"GET","uniqueKey":"https://similarweb.com/website/whatfix.com"} 2022-08-15T04:05:29.178Z App data JSON parse failed! Error: SyntaxError: Unexpected end of JSON input -- https://similarweb.com/website/whatfix.com 2022-08-15T04:05:29.266Z INFO CheerioCrawler: All the requests from request list and/or request queue have been processed, the crawler will shut down. 2022-08-15T04:05:29.541Z INFO CheerioCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":2,"retryHistogram":[null,null,null,2],"requestAvgFailedDurationMillis":2952,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":3,"requestTotalDurationMillis":5903,"requestsTotal":2,"crawlerRuntimeMillis":38986} 2022-08-15T04:05:29.544Z INFO Crawl finished.

AS

advantageous_spruce

2 years ago

Can you please update the scraper asap?

m0uka avatar

Hi, sorry about the delay, I was very busy, this issue has been solved.

Developer
Maintained by Apify
Actor metrics
  • 56 monthly users
  • 8 stars
  • 99.9% runs succeeded
  • Created in May 2022
  • Modified about 1 month ago