Similarweb Quick Scraper avatar

Similarweb Quick Scraper

Try for free

Pay $10.00 for 1,000 results

Go to Store
Similarweb Quick Scraper

Similarweb Quick Scraper

mscraper/similarweb-quick-scraper
Try for free

Pay $10.00 for 1,000 results

A quick scraper for Similarweb. Get needed data instantly for domains of your choice. Export accumulated data into formats such as HTML, JSON, or Excel.

EH

Runs with no result

Closed

electric_harpsichord opened this issue
a year ago

I've tried running the scrapper but no positive result comes up. THis is the log:

2023-09-01T14:13:55.960Z ACTOR: Pulling Docker image from repository. 2023-09-01T14:13:57.049Z ACTOR: Creating Docker container. 2023-09-01T14:13:57.239Z ACTOR: Starting Docker container. 2023-09-01T14:14:00.022Z INFO System info {"apifyVersion":"3.1.7","apifyClientVersion":"2.7.1","crawleeVersion":"3.4.0","osType":"Linux","nodeVersion":"v16.20.1"} 2023-09-01T14:14:00.716Z INFO HttpCrawler: Starting the crawl 2023-09-01T14:14:01.001Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:01.002Z {"id":"TjWtUBjJNrER6WF","url":"https://similarweb.com/website/01.xyz","retryCount":1} 2023-09-01T14:14:01.081Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:01.082Z {"id":"5wCBWO7EdF4MfO2","url":"https://similarweb.com/website/jan3.com","retryCount":1} 2023-09-01T14:14:04.732Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:04.733Z {"id":"TjWtUBjJNrER6WF","url":"https://similarweb.com/website/01.xyz","retryCount":2} 2023-09-01T14:14:04.866Z WARN HttpCrawler: Reclaiming failed request back to the list or queue. Response code 403 (Forbidden) 2023-09-01T14:14:04.868Z {"id":"5wCBWO7EdF4MfO2","url":"https://similarweb.com/website/jan3.com","retryCount":2} 2023-09-01T14:14:10.064Z WARN... [trimmed]

mscraper avatar

Please use residential US proxy

EH

electric_harpsichord

a year ago

Should I always use the proxy from now on?

EH

electric_harpsichord

a year ago

I have attached the change.

mscraper avatar

Yes, you should (in that scraper). Is it working now?

pt., 1 wrz 2023 o 17:17 Daniel Jean < topic+uhhznnoc2sttr5np5d@reply.apify.com> napisał(a):

EH

electric_harpsichord

a year ago

Yes, it's working. I'm closing this issue.

Developer
Maintained by Community

Actor Metrics

  • 35 monthly users

  • 15 stars

  • >99% runs succeeded

  • Created in Jun 2023

  • Modified 4 months ago

Categories