Similarweb Scraper avatar
Similarweb Scraper
Try for free

7 days trial then $25.00/month - No credit card required now

View all Actors
Similarweb Scraper

Similarweb Scraper

m0uka/similarweb-scraper
Try for free

7 days trial then $25.00/month - No credit card required now

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

User avatar

Not getting any results

Closed

eventvesta opened this issue
9 months ago

I am sending a list of ~860 websites to scrape and letting the actor run for ~1 hour before aborting and getting no results.

Not sure what is going wrong.

User avatar

eventvesta

9 months ago

It looks like the crawler is getting stopped by Captcha on every page.

User avatar

Hey, our apologies for the delay in responding, would you mind resharing the run link as the one you've provided has expired, so we can further look into it? Thank you!

User avatar

eventvesta

8 months ago

Unfortunately the run no longer exists, as runs are purged after 7 days (see screenshot).

We were attempting to crawl ~860 urls. Here is a sample of 20 of those urls:

1[
2 "https://www.similarweb.com/website/columbustelegram.com/#overview",
3 "https://www.similarweb.com/website/kctoday.6amcity.com/#overview",
4 "https://www.similarweb.com/website/omahamagazine.com/#overview",
5 "https://www.similarweb.com/website/journalstar.com/#overview",
6 "https://www.similarweb.com/website/klkntv.com/#overview",
7 "https://www.similarweb.com/website/journalstar.com/#overview",
8 "https://www.similarweb.com/website/fun4alamokids.com/#overview",
9 "https://www.similarweb.com/website/wmfe.org/#overview",
10 "https://www.similarweb.com/website/kmov.com/#overview",
11 "https://www.similarweb.com/website/heraldtribune.com/#overview",
12 "https://www.similarweb.com/website/rvaonthecheap.com/#overview",
13 "https://www.similarweb.com/website/news-journalonline.com/#overview",
14 "https://www.similarweb.com/website/tallahassee.com/#overview",
15 "https://www.similarweb.com/website/tallahasseemagazine.com/#overview",
16 "https://www.similarweb.com/website/emeraldcoastmagazine.com/#overview",
17 "https://www.similarweb.com/website/850businessmagazine.com/#overview",
18 "https://www.similarweb.com/website/myhorrynews.com/#overview",
19 "https://www.similarweb.com/website/miaminewtimes.com/#overview",
20 "https://www.similarweb.com/website/sun-sentinel.com/#overview",
21 "https://www.similarweb.com/website/spiritofomaha.com/#overview"
22]
User avatar

Hi, I tried inputting the list of URLs you've provided and managed to scrape data as expected, so please try re-running your input and let us know should you experience any further issues.

Developer
Maintained by Apify
Actor metrics
  • 49 monthly users
  • 99.7% runs succeeded
  • Created in May 2022
  • Modified 5 months ago