No credit card required

Similarweb Scraper

tri_angle/similarweb-scraper

No credit card required

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Back to issues Create new issue

Crawler is constantly timing out due to "Queue head still returned requests that need to be processed"

Open

relevance opened this issue

We are seeing almost all our actor runs in the last week time out, where the log constantly records "Queue head still returned requests that need to be processed (or that are locked by other clients)" until it reaches our set timeout length.

Tri⟁angle (tri_angle)

Hi there, thank you for your message, we are looking into it

Tri⟁angle (tri_angle)

Hi again, we just pushed a new version, please test it and let us know how it works for you. Thank you!

Tri⟁angle (tri_angle)

I forgot to mention: please use timeout at least 180 seconds in the input

Add comment

Developer

Tri⟁angle

Actor Metrics

175 monthly users
39 stars
>99% runs succeeded
1.3 days response time
Created in May 2022
Modified 9 days ago

Categories

SEO tools

Advanced Similarweb Scraper

riccee/advanced-similarweb-scraper

Advanced scraper for Simlarweb. Gets data such as companies' ranks, total visits, competitor analysis, etc. Also offers the option to scrape all top-level employees from all scraped companies.

Joseph Schady

Similarweb Fast Scraper

tri_angle/fast-similarweb-scraper

Scrape Similarweb faster and get data about website traffic, visits, global/country rank and more

Tri⟁angle

Similar Web Scraper

pintostudio/similar-web-scraper

The SimilarWeb Scraper is a robust tool designed to extract detailed website analytics and traffic insights directly from SimilarWeb.

Pinto Studio

Similarweb Quick Scraper

mscraper/similarweb-quick-scraper

A quick scraper for Similarweb. Get needed data instantly for domains of your choice. Export accumulated data into formats such as HTML, JSON, or Excel.

mscraper

521

Similarweb Advanced Scraper

curious_coder/similarweb-advanced-scraper

Enrich website details in bulk from Similarweb by scraping all available data at an affordable cost. Get traffic info, Competitors, Audience insights, etc

Curious Coder

364

Similarweb Speedy Scraper (with full page Screenshot)

karamelo/similarweb-speedy-scraper-with-full-page-screenshot

Powerful Detailed and Fast Scraper for similarweb.com. Scrape comprehensive domain traffic insights, websites comparing data, sitemaps, and trending domains. for any website with detailed information. Includes full page screenshot.

karamelo

Google Ads Scraper

silva95gustavo/google-ads-scraper

Extract text, image and video ads from Google Ads, scraped from the ad library provided by Google Ads Transparency Center. Gain access to ad details, ad copy, locations, and more. Dive deeper into the Google Ads Transparency Center for a competitive edge.

Gustavo Silva

953

LinkedIn Ads Scraper

silva95gustavo/linkedin-ad-library-scraper

Extract ads of any format from LinkedIn Ad Library. Gain access to ad details, ad copy, media URL, call-to-action buttons and more. Dive deeper into the LinkedIn Ad Library for a competitive edge.

Gustavo Silva

1.2k

BizBuySell Scraper

acquistion-automation/bizbuysell-scraper

Supercharge your business buying with our BizBuySell Scraper! Automate daily scrapes of all BizBuySell listings across multiple markets, saving time and ensuring you get the most accurate, up-to-date data. Stop relying on unreliable alerts—gain the edge in deal flow with precision and speed.