Similarweb Scraper
No credit card required
Similarweb Scraper
No credit card required
A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..
Do you want to learn more about this Actor?
Get a demoI am sending a list of ~860 websites to scrape and letting the actor run for ~1 hour before aborting and getting no results.
Not sure what is going wrong.
It looks like the crawler is getting stopped by Captcha on every page.
Hey, our apologies for the delay in responding, would you mind resharing the run link as the one you've provided has expired, so we can further look into it? Thank you!
Unfortunately the run no longer exists, as runs are purged after 7 days (see screenshot).
We were attempting to crawl ~860 urls. Here is a sample of 20 of those urls:
1[ 2 "https://www.similarweb.com/website/columbustelegram.com/#overview", 3 "https://www.similarweb.com/website/kctoday.6amcity.com/#overview", 4 "https://www.similarweb.com/website/omahamagazine.com/#overview", 5 "https://www.similarweb.com/website/journalstar.com/#overview", 6 "https://www.similarweb.com/website/klkntv.com/#overview", 7 "https://www.similarweb.com/website/journalstar.com/#overview", 8 "https://www.similarweb.com/website/fun4alamokids.com/#overview", 9 "https://www.similarweb.com/website/wmfe.org/#overview", 10 "https://www.similarweb.com/website/kmov.com/#overview", 11 "https://www.similarweb.com/website/heraldtribune.com/#overview", 12 "https://www.similarweb.com/website/rvaonthecheap.com/#overview", 13 "https://www.similarweb.com/website/news-journalonline.com/#overview", 14 "https://www.similarweb.com/website/tallahassee.com/#overview", 15 "https://www.similarweb.com/website/tallahasseemagazine.com/#overview", 16 "https://www.similarweb.com/website/emeraldcoastmagazine.com/#overview", 17 "https://www.similarweb.com/website/850businessmagazine.com/#overview", 18 "https://www.similarweb.com/website/myhorrynews.com/#overview", 19 "https://www.similarweb.com/website/miaminewtimes.com/#overview", 20 "https://www.similarweb.com/website/sun-sentinel.com/#overview", 21 "https://www.similarweb.com/website/spirito... [trimmed]
Hi, I tried inputting the list of URLs you've provided and managed to scrape data as expected, so please try re-running your input and let us know should you experience any further issues.