Similarweb Scraper avatar
Similarweb Scraper

Pricing

$8.00 / 1,000 results

Go to Store
Similarweb Scraper

Similarweb Scraper

Developed by

Tri⟁angle

Tri⟁angle

Maintained by Apify

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

4.6 (7)

Pricing

$8.00 / 1,000 results

66

Total users

2.9k

Monthly users

160

Runs succeeded

>99%

Response time

9.8 hours

Last modified

2 months ago

RE

Crawler is constantly timing out due to "Queue head still returned requests that need to be processed"

Closed

relevance opened this issue
3 months ago

We are seeing almost all our actor runs in the last week time out, where the log constantly records "Queue head still returned requests that need to be processed (or that are locked by other clients)" until it reaches our set timeout length.

tri_angle avatar

Hi there, thank you for your message, we are looking into it

tri_angle avatar

Hi again, we just pushed a new version, please test it and let us know how it works for you. Thank you!

tri_angle avatar

I forgot to mention: please use timeout at least 180 seconds in the input

tri_angle avatar

This issue is fixed, please reopen the issue if it happens again