Similarweb Scraper avatar

Similarweb Scraper

Try for free

No credit card required

View all Actors
Similarweb Scraper

Similarweb Scraper

tri_angle/similarweb-scraper
Try for free

No credit card required

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Do you want to learn more about this Actor?

Get a demo
EV

Not getting any results

Closed

eventvesta opened this issue
a year ago

I am sending a list of ~860 websites to scrape and letting the actor run for ~1 hour before aborting and getting no results.

Not sure what is going wrong.

EV

eventvesta

a year ago

It looks like the crawler is getting stopped by Captcha on every page.

misa avatar

Hey, our apologies for the delay in responding, would you mind resharing the run link as the one you've provided has expired, so we can further look into it? Thank you!

EV

eventvesta

a year ago

Unfortunately the run no longer exists, as runs are purged after 7 days (see screenshot).

We were attempting to crawl ~860 urls. Here is a sample of 20 of those urls:

1[
2 "https://www.similarweb.com/website/columbustelegram.com/#overview",
3 "https://www.similarweb.com/website/kctoday.6amcity.com/#overview",
4 "https://www.similarweb.com/website/omahamagazine.com/#overview",
5 "https://www.similarweb.com/website/journalstar.com/#overview",
6 "https://www.similarweb.com/website/klkntv.com/#overview",
7 "https://www.similarweb.com/website/journalstar.com/#overview",
8 "https://www.similarweb.com/website/fun4alamokids.com/#overview",
9 "https://www.similarweb.com/website/wmfe.org/#overview",
10 "https://www.similarweb.com/website/kmov.com/#overview",
11 "https://www.similarweb.com/website/heraldtribune.com/#overview",
12 "https://www.similarweb.com/website/rvaonthecheap.com/#overview",
13 "https://www.similarweb.com/website/news-journalonline.com/#overview",
14 "https://www.similarweb.com/website/tallahassee.com/#overview",
15 "https://www.similarweb.com/website/tallahasseemagazine.com/#overview",
16 "https://www.similarweb.com/website/emeraldcoastmagazine.com/#overview",
17 "https://www.similarweb.com/website/850businessmagazine.com/#overview",
18 "https://www.similarweb.com/website/myhorrynews.com/#overview",
19 "https://www.similarweb.com/website/miaminewtimes.com/#overview",
20 "https://www.similarweb.com/website/sun-sentinel.com/#overview",
21 "https://www.similarweb.com/website/spirito... [trimmed]
misa avatar

Hi, I tried inputting the list of URLs you've provided and managed to scrape data as expected, so please try re-running your input and let us know should you experience any further issues.

Developer
Maintained by Apify
Actor metrics
  • 122 monthly users
  • 24 stars
  • 99.9% runs succeeded
  • 6 hours response time
  • Created in May 2022
  • Modified 2 days ago