3 days trial then $19.00/month - No credit card required now

Similarweb scraper

curious_coder/similarweb-scraper

3 days trial then $19.00/month - No credit card required now

Scrape similarweb to get insights for websites in bulk including website traffic, pages per visit, time spent on website, bounce rate, rank, etc

Back to issues Create new issue

Crawler keeps failing, even when re-running with different proxies

Closed

dyf opened this issue

I noticed it hit a point where all the requests started failing despite re-runs.

Curious Coder (curious_coder)

The issue was due to using urls instead of domain names, I've sent an update to convert the urls into domains automatically

dyf

Ahhh okay, gotcha. So you're saying the ideal format would have been "whatever.com" vs "https://whatever.com" ?

Thanks so much for the quick update!

Curious Coder (curious_coder)

Yes!

Add comment

Developer

Curious Coder

Actor metrics

93 monthly users
9 stars
100.0% runs succeeded
3.1 hours response time
Created in Jul 2023
Modified 24 days ago

Categories

Business

Advanced Similarweb Scraper

riccee/advanced-similarweb-scraper

Advanced scraper for Simlarweb. Gets data such as companies' ranks, total visits, competitor analysis, etc. Also offers the option to scrape all top-level employees from all scraped companies.

Joseph Schady

Similarweb Advanced Scraper

curious_coder/similarweb-advanced-scraper

Enrich website details in bulk from Similarweb by scraping all available data at an affordable cost. Get traffic info, Competitors, Audience insights, etc

Curious Coder

288

Similarweb Quick Scraper

mscraper/similarweb-quick-scraper

A quick scraper for Similarweb. Get needed data instantly for domains of your choice. Export accumulated data into formats such as HTML, JSON, or Excel.

mscraper

445

Similarweb Speedy Scraper (with full page Screenshot)

karamelo/similarweb-speedy-scraper-with-full-page-screenshot

Powerful Detailed and Fast Scraper for similarweb.com. Scrape comprehensive domain traffic insights, websites comparing data, sitemaps, and trending domains. for any website with detailed information. Includes full page screenshot.

karamelo

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

17.1k

330

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

14.8k

188

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

58.4k

485

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

24.5k

189

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

78.4k

549

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

37.7k

203