Similarweb Quick Scraper avatar
Similarweb Quick Scraper

Pricing

$10.00 / 1,000 results

Go to Store
Similarweb Quick Scraper

Similarweb Quick Scraper

Developed by

mscraper

mscraper

Maintained by Community

A quick scraper for Similarweb. Get needed data instantly for domains of your choice. Export accumulated data into formats such as HTML, JSON, or Excel.

5.0 (1)

Pricing

$10.00 / 1,000 results

20

Total users

596

Monthly users

30

Runs succeeded

98%

Last modified

10 months ago

EH

Runs with no result

Closed

electric_harpsichord opened this issue
2 years ago

I've tried running the scrapper but no positive result comes up. THis is the log:

2023-09-01T14:13:55.960Z ACTOR: Pulling Docker image from repository. 2023-09-01T14:13:57.049Z ACTOR: Creating Docker container. 2023-09-01T14:13:57.239Z ACTOR: Starting Docker container. 2023-09-01T14:14:00.022Z INFO System info {"apifyVersion":"3.1.7","apifyClientVersion":"2.7.1","crawleeVersion":"3.4.0","osType":"Linux","nodeVersion":"v16.20.1"} 2023-09-01T14:14:00.716Z INFO HttpCrawler: Starting the crawl 2023-09-01T14:14:01.001Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:01.002Z {"id":"TjWtUBjJNrER6WF","url":"https://similarweb.com/website/01.xyz","retryCount":1} 2023-09-01T14:14:01.081Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:01.082Z {"id":"5wCBWO7EdF4MfO2","url":"https://similarweb.com/website/jan3.com","retryCount":1} 2023-09-01T14:14:04.732Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:04.733Z {"id":"TjWtUBjJNrER6WF","url":"https://similarweb.com/website/01.xyz","retryCount":2} 2023-09-01T14:14:04.866Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:04.868Z {"id":"5wCBWO7EdF4MfO2","url":"https://similarweb.com/website/jan3.com","retryCount":2} 2023-09-01T14:14:10.064Z WARN... [trimmed]

mscraper avatar

Please use residential US proxy

EH

electric_harpsichord

2 years ago

Should I always use the proxy from now on?

EH

electric_harpsichord

2 years ago

I have attached the change.

mscraper avatar

Yes, you should (in that scraper). Is it working now?

pt., 1 wrz 2023 o 17:17 Daniel Jean < topic+uhhznnoc2sttr5np5d@reply.apify.com> napisał(a):

EH

electric_harpsichord

2 years ago

Yes, it's working. I'm closing this issue.