Similarweb Scraper avatar
Similarweb Scraper

Pricing

$8.00 / 1,000 results

Go to Store
Similarweb Scraper

Similarweb Scraper

Developed by

Tri⟁angle

Tri⟁angle

Maintained by Apify

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

4.6 (7)

Pricing

$8.00 / 1,000 results

66

Total users

2.9k

Monthly users

160

Runs succeeded

>99%

Response time

9.8 hours

Last modified

2 months ago

EV

Not getting any results

Closed

eventvesta opened this issue
2 years ago

I am sending a list of ~860 websites to scrape and letting the actor run for ~1 hour before aborting and getting no results.

Not sure what is going wrong.

EV

eventvesta

2 years ago

It looks like the crawler is getting stopped by Captcha on every page.

misa avatar

Hey, our apologies for the delay in responding, would you mind resharing the run link as the one you've provided has expired, so we can further look into it? Thank you!

EV

eventvesta

2 years ago

Unfortunately the run no longer exists, as runs are purged after 7 days (see screenshot).

We were attempting to crawl ~860 urls. Here is a sample of 20 of those urls:

1[
2 "https://www.similarweb.com/website/columbustelegram.com/#overview",
3 "https://www.similarweb.com/website/kctoday.6amcity.com/#overview",
4 "https://www.similarweb.com/website/omahamagazine.com/#overview",
5 "https://www.similarweb.com/website/journalstar.com/#overview",
6 "https://www.similarweb.com/website/klkntv.com/#overview",
7 "https://www.similarweb.com/website/journalstar.com/#overview",
8 "https://www.similarweb.com/website/fun4alamokids.com/#overview",
9 "https://www.similarweb.com/website/wmfe.org/#overview",
10 "https://www.similarweb.com/website/kmov.com/#overview",
11 "https://www.similarweb.com/website/heraldtribune.com/#overview",
12 "https://www.similarweb.com/website/rvaonthecheap.com/#overview",
13 "https://www.similarweb.com/website/news-journalonline.com/#overview",
14 "https://www.similarweb.com/website/tallahassee.com/#overview",
15 "https://www.similarweb.com/website/tallahasseemagazine.com/#overview",
16 "https://www.similarweb.com/website/emeraldcoastmagazine.com/#overview",
17 "https://www.similarweb.com/website/850businessmagazine.com/#overview",
18 "https://www.similarweb.com/website/myhorrynews.com/#overview",
19 "https://www.similarweb.com/website/miaminewtimes.com/#overview",
20 "https://www.similarweb.com/website/sun-sentinel.com/#overview",
21 "https://www.similarweb.com/website/spirito... [trimmed]
misa avatar

Hi, I tried inputting the list of URLs you've provided and managed to scrape data as expected, so please try re-running your input and let us know should you experience any further issues.