No credit card required

Similarweb Scraper

seadapp/similarweb-scraper

No credit card required

Less than $3/K results, Gets you Sites data from Similarweb. Unofficial API. Download your data as JSON, HTML Table, CSV, Execl, RSS Feed and JSONL

Similarweb Scraper is a web scraping tool that enables you to extract sites data from Similarweb by using Domains.

You can get the following data from every scrape:

Website information
Company information
Traffic: Total visits, pages per visit, avg. visit duration, bounce rate and history
Top Countries Traffics
Top Interested Websites
Top Interested Topics
Top Interested Categories
Top Similarity Competitors
Top Incoming Categories
Searches Source
Incoming Referrals
Top Networks Source
Outgoing Referrals
Top Outgoing Categories
Country Rank Competitors
Category Rank Competitors
More ...

How does it work?

Simply insert the Domains in the input field you want to scrape. Then download the data from the Dataset tab.

For an input example, check the Input tab.

Why REQUESTS "0 of 0 handled"?

This is a simple request queue manager, avoiding the usage of REQUESTS can save resource.

Recommendation settings:

Memory: 1024MB
Proxy configuration: Residential

Similarweb Scraper Test Results:

Memory 1024MB vs 2048MB

Proxy Residential

Results	Price	Start Date	End Date	Duration	Version	Memory
100	$0.317	2024-04-02 19:16:32	2024-04-02 19:25:25	8m 52s	0.0.82	2 GB
100	$0.306	2024-04-02 19:16:32	2024-04-02 19:24:44	8m 12s	0.0.82	2 GB
100	$0.309	2024-04-02 19:16:31	2024-04-02 19:24:49	8m 18s	0.0.82	2 GB
100	$0.313	2024-04-02 19:16:20	2024-04-02 19:25:03	8m 42s	0.0.82	2 GB
100	$0.283	2024-04-02 18:50:15	2024-04-02 19:02:42	12m 27s	0.0.82	1 GB
100	$0.275	2024-04-02 18:49:59	2024-04-02 19:01:38	11m 38s	0.0.82	1 GB
100	$0.281	2024-04-02 18:49:45	2024-04-02 19:01:59	12m 14s	0.0.82	1 GB
100	$0.277	2024-04-02 18:49:42	2024-04-02 19:01:44	12m 1s	0.0.82	1 GB

Sample output from Similarweb Scraper

1[
2  {
3    "domain": "apify.com",
4    "status": "success",
5    "data": {
6      "interests": {
7        "interestedWebsitesTotalCount": 10,
8        "topInterestedWebsites": [
9          {
10            "domain": "github.com",
11            "icon": "https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b"
12          },
13          {
14            "domain": "stackoverflow.com",
15            "icon": "https://site-images.similarcdn.com/image?url=stackoverflow.com&t=2&s=1&h=04179ebf8566da481b023bba12856a0748752b1e4a75d1b145220282ef93f21c"
16          },
17          {
18            "domain": "accounts.google.com",
19            "icon": "https://site-images.similarcdn.com/image?url=accounts.google.com&t=2&s=1&h=e7bbf324f8b1fece5635282a0abeb31cd2f132bd1c09b3aed8dedaf78d53afe1"
20          },
21          {
22            "domain": "reddit.com",
23            "icon": "https://site-images.similarcdn.com/image?url=reddit.com&t=2&s=1&h=66f2412047e0362ec60d5583d4b186511a8e859446bb112c60d22968facae906"
24          },
25          {
26            "domain": "youtube.com",
27            "icon": "https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20"
28          }
29        ],
30        "topInterestedTopics": [
31          "google",
32          "business",
33          "news",
34          "search",
35          "internet tools"
36        ],
37        "topInterestedCategories": [
38          "computers_electronics_and_technology/computers_electronics_and_technology",
39          "computers_electronics_and_technology/programming_and_developer_software",
40          "computers_electronics_and_technology/social_networks_and_online_communities",
41          "computers_electronics_and_technology/graphics_multimedia_and_web_design",
42          "business_and_consumer_services/online_marketing"
43        ]
44      },
45      "competitors": {
46        "topSimilarityCompetitors": [
47          {
48            "domain": "scraperapi.com",
49            "icon": "https://site-images.similarcdn.com/image?url=scraperapi.com&t=2&s=1&h=4c0af08959b60e108f82c9a27f8084eb29ae1d09006d23839e9b6b68db11255e",
50            "visitsTotalCount": 109940,
51            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
52            "categoryRank": 9586,
53            "affinity": 1,
54            "isDataFromGa": false
55          },
56          {
57            "domain": "oxylabs.io",
58            "icon": "https://site-images.similarcdn.com/image?url=oxylabs.io&t=2&s=1&h=35e259e4de4df73136cacf118058b13978003bb6c5bb802c708ca506f2708aff",
59            "visitsTotalCount": 544260,
60            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
61            "categoryRank": 3482,
62            "affinity": 0.9840398210245832,
63            "isDataFromGa": false
64          },
65          {
66            "domain": "serpapi.com",
67            "icon": "https://site-images.similarcdn.com/image?url=serpapi.com&t=2&s=1&h=02d8d33feda4b216b1e5714b47becb8e23fe7e86e010668b1a2fabe29d6c5b19",
68            "visitsTotalCount": 343915,
69            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
70            "categoryRank": 4736,
71            "affinity": 0.9607133300305807,
72            "isDataFromGa": false
73          },
74          {
75            "domain": "rapidapi.com",
76            "icon": "https://site-images.similarcdn.com/image?url=rapidapi.com&t=2&s=1&h=de9ae3ebc37e7a92943ca90f5ab87958a60d86fe1c54a2adf9e6a9cd3f19c508",
77            "visitsTotalCount": 1486777,
78            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
79            "categoryRank": 1118,
80            "affinity": 0.9535301679417021,
81            "isDataFromGa": false
82          },
83          {
84            "domain": "gmapsextractor.com",
85            "icon": "https://site-images.similarcdn.com/image?url=gmapsextractor.com&t=2&s=1&h=7391847d08183002801e23ba06d187bc3388b43e7334b1345c82b1e92a8268cb",
86            "visitsTotalCount": 41063,
87            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
88            "categoryRank": 23715,
89            "affinity": 0.9415422443468328,
90            "isDataFromGa": false
91          },
92          {
93            "domain": "stevesie.com",
94            "icon": "https://site-images.similarcdn.com/image?url=stevesie.com&t=2&s=1&h=da4c037450544a7afdb058e2afea74e7c2ef21589ab2414fdbc00fd60e258035",
95            "visitsTotalCount": 54472,
96            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
97            "categoryRank": 32356,
98            "affinity": 0.9156629520113374,
99            "isDataFromGa": false
100          },
101          {
102            "domain": "browse.ai",
103            "icon": "https://site-images.similarcdn.com/image?url=browse.ai&t=2&s=1&h=2142772960081bf7fd9c022323c42d763fd4314549c29b07aff5b2b60c64cbbf",
104            "visitsTotalCount": 301123,
105            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
106            "categoryRank": 3568,
107            "affinity": 0.8874372943968774,
108            "isDataFromGa": false
109          },
110          {
111            "domain": "prospectss.com",
112            "icon": "https://site-images.similarcdn.com/image?url=prospectss.com&t=2&s=1&h=a2a1d85cb3d0f2e98aea862c1dac9b3f6484671c3c267e30dba958916edd6414",
113            "visitsTotalCount": 8081,
114            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
115            "categoryRank": 95087,
116            "affinity": 0.8861573362808473,
117            "isDataFromGa": false
118          },
119          {
120            "domain": "prowebscraper.com",
121            "icon": "https://site-images.similarcdn.com/image?url=prowebscraper.com&t=2&s=1&h=cf5df033350698f98bd13cdf748c816f534b640f92f42af25e3a97bb529df600",
122            "visitsTotalCount": 35415,
123            "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
124            "categoryRank": 60114,
125            "affinity": 0.867554951207188,
126            "isDataFromGa": false
127          },
128          {
129            "domain": "octoparse.com",
130            "icon": "https://site-images.similarcdn.com/image?url=octoparse.com&t=2&s=1&h=c3b0fe1c71cd16076498c2f0587c1c5bb42a35df3bc455d331dc98749471d8e0",
131            "visitsTotalCount": 369813,
132            "categoryId": "computers_electronics_and_technology/graphics_multimedia_and_web_design",
133            "categoryRank": 1073,
134            "affinity": 0.861465396766195,
135            "isDataFromGa": false
136          }
137        ]
138      },
139      "searchesSource": {
140        "organicSearchShare": 0.9168492372464254,
141        "paidSearchShare": 0.08315076275357458,
142        "keywordsTotalCount": 4775,
143        "topKeywords": [
144          {
145            "name": "apify",
146            "estimatedValue": 23200.739016224485,
147            "volume": 31640,
148            "cpc": 1.213712125
149          },
150          {
151            "name": "twitter scraper",
152            "estimatedValue": 1322.2916657432218,
153            "volume": 5940,
154            "cpc": 2.4468865
155          },
156          {
157            "name": "maps locations python api google",
158            "estimatedValue": 988.8810979783125,
159            "volume": 60,
160            "cpc": null
161          },
162          {
163            "name": "reddit scraper",
164            "estimatedValue": 986.680540278284,
165            "volume": 1570,
166            "cpc": 3.7678375
167          },
168          {
169            "name": "octoparse",
170            "estimatedValue": 867.9541727474888,
171            "volume": 38910,
172            "cpc": 0.6903099375
173          }
174        ]
175      },
176      "incomingReferrals": {
177        "referralSitesTotalCount": 49,
178        "topReferralSites": [
179          {
180            "domain": "",
181            "icon": "",
182            "visitsShare": 0.18621491929116338,
183            "isLocked": true,
184            "isAvailable": true
185          },
186          {
187            "domain": "",
188            "icon": "",
189            "visitsShare": 0.0867737999049548,
190            "isLocked": true,
191            "isAvailable": true
192          },
193          {
194            "domain": "",
195            "icon": "",
196            "visitsShare": 0.08625124330207273,
197            "isLocked": true,
198            "isAvailable": true
199          },
200          {
201            "domain": "presearch.com",
202            "icon": "https://site-images.similarcdn.com/image?url=presearch.com&t=2&s=1&h=7ffeae3ec4d86d6b4d7de6e72c80c276b200dbaf06528c8d524628ea11411525",
203            "visitsShare": 0.0470200240579357,
204            "isLocked": false,
205            "isAvailable": true
206          },
207          {
208            "domain": "webscrapingapi.com",
209            "icon": "https://site-images.similarcdn.com/image?url=webscrapingapi.com&t=2&s=1&h=06c5582ca5a2f61a5930c7c4ada0e84cef44ef0fc3627e3fae5af8f5c3f4697d",
210            "visitsShare": 0.044987325462789204,
211            "isLocked": false,
212            "isAvailable": true
213          },
214          {
215            "domain": "medium.com",
216            "icon": "https://site-images.similarcdn.com/image?url=medium.com&t=2&s=1&h=b0c5a9f5b3d96e35be6b72743b666fe5da97feb4e4bfe500d901de16b5221b3e",
217            "visitsShare": 0.0436299927120715,
218            "isLocked": false,
219            "isAvailable": true
220          }
221        ],
222        "topIncomingCategories": [
223          {
224            "category": "Computers_Electronics_and_Technology/Programming_and_Developer_Software",
225            "visitsShare": 0.31814316907809104
226          },
227          {
228            "category": "Computers_Electronics_and_Technology/Computers_Electronics_and_Technology",
229            "visitsShare": 0.21360379844190655
230          },
231          {
232            "category": "Reference_Materials/Dictionaries_and_Encyclopedias",
233            "visitsShare": 0.08677379990495485
234          },
235          {
236            "category": "Finance/Investing",
237            "visitsShare": 0.057836733343772984
238          },
239          {
240            "category": "Business_and_Consumer_Services/Business_and_Consumer_Services",
241            "visitsShare": 0.04362999271207151
242          }
243        ]
244      },
245      "adsSource": {
246        "adsSitesTotalCount": 0,
247        "adsNetworksTotalCount": 2,
248        "topAdsSites": []
249      },
250      "socialNetworksSource": {
251        "topSocialNetworks": [
252          {
253            "name": "Youtube",
254            "visitsShare": 0.5932009649937526,
255            "icon": "https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20"
256          },
257          {
258            "name": "Reddit",
259            "visitsShare": 0.16265075880978921,
260            "icon": "https://site-images.similarcdn.com/image?url=reddit.com&t=2&s=1&h=66f2412047e0362ec60d5583d4b186511a8e859446bb112c60d22968facae906"
261          },
262          {
263            "name": "Facebook",
264            "visitsShare": 0.05413052154110566,
265            "icon": "https://site-images.similarcdn.com/image?url=facebook.com&t=2&s=1&h=be773d6b77aa3d59b6a671c5c27ad729b1ae77400e89776e2f749cce6b926c4b"
266          },
267          {
268            "name": "Instagram",
269            "visitsShare": 0.05390441291414935,
270            "icon": "https://site-images.similarcdn.com/image?url=instagram.com&t=2&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49"
271          },
272          {
273            "name": "WhatsApp Webapp",
274            "visitsShare": 0.044066145075363085,
275            "icon": "https://site-images.similarcdn.com/image?url=web.whatsapp.com&t=2&s=1&h=451e82ca011741d37d72edee1d8fdc272155924d894fe937e292066acb713bc8"
276          }
277        ],
278        "socialNetworksTotalCount": 12
279      },
280      "outgoingReferrals": {
281        "outgoingSitesTotalCount": 34,
282        "topOutgoingSites": [
283          {
284            "domain": "",
285            "icon": "",
286            "visitsShare": 0.8724250647458455,
287            "isLocked": true,
288            "isAvailable": true
289          },
290          {
291            "domain": "",
292            "icon": "",
293            "visitsShare": 0.02721523597903907,
294            "isLocked": true,
295            "isAvailable": true
296          },
297          {
298            "domain": "",
299            "icon": "",
300            "visitsShare": 0.014748486453321986,
301            "isLocked": true,
302            "isAvailable": true
303          },
304          {
305            "domain": "github.com",
306            "icon": "https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b",
307            "visitsShare": 0.008657548029077807,
308            "isLocked": false,
309            "isAvailable": true
310          },
311          {
312            "domain": "cyotek.com",
313            "icon": "https://site-images.similarcdn.com/image?url=cyotek.com&t=2&s=1&h=fe44695e924f8e5bc1ba2c5ee12a0a90b2b31f1c6a9d7fb6491f33ef69d7975e",
314            "visitsShare": 0.0077427264886233286,
315            "isLocked": false,
316            "isAvailable": true
317          },
318          {
319            "domain": "llamaindex.ai",
320            "icon": "https://site-images.similarcdn.com/image?url=llamaindex.ai&t=2&s=1&h=2f2ef71ab1af231751c9204593bf303e7e920f09b201dfec1ac6b97a4ca428d4",
321            "visitsShare": 0.007616667755916286,
322            "isLocked": false,
323            "isAvailable": true
324          }
325        ],
326        "topOutgoingCategories": [
327          {
328            "category": "Computers_Electronics_and_Technology/Search_Engines",
329            "visitsShare": 0.8728033583259824
330          },
331          {
332            "category": "Computers_Electronics_and_Technology/Programming_and_Developer_Software",
333            "visitsShare": 0.06531512295859482
334          },
335          {
336            "category": "Arts_and_Entertainment/TV_Movies_and_Streaming",
337            "visitsShare": 0.014748486453321991
338          },
339          {
340            "category": "Computers_Electronics_and_Technology/Computers_Electronics_and_Technology",
341            "visitsShare": 0.013440910738077693
342          },
343          {
344            "category": "Business_and_Consumer_Services/Online_Marketing",
345            "visitsShare": 0.011031603642682922
346          }
347        ]
348      },
349      "compareCompetitor": null,
350      "technologies": {
351        "categories": [
352          {
353            "categoryId": "conversion_and_analytics",
354            "topTechName": "Google Analytics",
355            "topTechIconUrl": "https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1",
356            "technologiesTotalCount": 11
357          },
358          {
359            "categoryId": "payment_and_currencies",
360            "topTechName": "Euro",
361            "topTechIconUrl": "https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=2691",
362            "technologiesTotalCount": 10
363          },
364          {
365            "categoryId": "advertising",
366            "topTechName": "DoubleClick",
367            "topTechIconUrl": "https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=239",
368            "technologiesTotalCount": 7
369          },
370          {
371            "categoryId": "audio_video_media",
372            "topTechName": "YouTube",
373            "topTechIconUrl": "https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1209",
374            "technologiesTotalCount": 4
375          }
376        ],
377        "categoriesTotalCount": 17,
378        "technologiesTotalCount": 53
379      },
380      "recentAds": {
381        "recentAds": [],
382        "isMoreAds": false
383      },
384      "snapshotDate": "2024-02-01T00:00:00+00:00",
385      "domain": "apify.com",
386      "icon": "https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
387      "previewDesktop": "https://site-images.similarcdn.com/image?url=apify.com&t=1&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
388      "previewMobile": "https://site-images.similarcdn.com/image?url=apify.com&t=4&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
389      "isInvalidTrafficData": false,
390      "domainGaStatus": 0,
391      "isDataFromGaHighlyDiscrepant": false,
392      "isDataFromGa": false,
393      "categoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
394      "overview": {
395        "description": "apify is your one-stop shop for web scraping, data extraction, and rpa. automate anything you can do manually in a browser.",
396        "globalRank": 71509,
397        "globalRankChange": 1030,
398        "countryAlpha2Code": "US",
399        "countryUrlCode": "united-states",
400        "countryRank": 58153,
401        "countryRankChange": 6507,
402        "categoryRank": 1333,
403        "categoryRankChange": 148,
404        "visitsTotalCount": 500445,
405        "bounceRate": 0.3712443674359483,
406        "pagesPerVisit": 8.105410730726438,
407        "visitsAvgDurationFormatted": "00:03:55",
408        "companyFeedbackRecaptcha": "6LfEq1gUAAAAACEE4w7Zek8GEmBooXMMWDpBjI6r",
409        "companyName": "Apify",
410        "companyYearFounded": 2015,
411        "companyHeadquarterCountryCode": "CZ",
412        "companyHeadquarterStateCode": null,
413        "companyHeadquarterCity": "Prague 1",
414        "companyEmployeesMin": 51,
415        "companyEmployeesMax": 200,
416        "companyRevenueMin": 2000000,
417        "companyRevenueMax": 5000000,
418        "companyCategoryId": "computers_electronics_and_technology/computers_electronics_and_technology",
419        "companyRevenueCurrency": null,
420        "companyParentDomain": "apify.com"
421      },
422      "traffic": {
423        "visitsTotalCount": 500445,
424        "visitsTotalCountChange": -0.10247925880491977,
425        "bounceRate": 0.3712443674359483,
426        "pagesPerVisit": 8.105410730726438,
427        "visitsAvgDurationFormatted": "00:03:55",
428        "history": [
429          {
430            "date": "2023-12-01T00:00:00",
431            "visits": 563547
432          },
433          {
434            "date": "2024-01-01T00:00:00",
435            "visits": 557586
436          },
437          {
438            "date": "2024-02-01T00:00:00",
439            "visits": 500445
440          }
441        ],
442        "competitors": [
443          {
444            "domain": "apify.com",
445            "icon": "https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
446            "isDataFromGa": false,
447            "visits": 500445
448          },
449          {
450            "domain": "scraperapi.com",
451            "icon": "https://site-images.similarcdn.com/image?url=scraperapi.com&t=2&s=1&h=4c0af08959b60e108f82c9a27f8084eb29ae1d09006d23839e9b6b68db11255e",
452            "isDataFromGa": false,
453            "visits": 109940
454          },
455          {
456            "domain": "oxylabs.io",
457            "icon": "https://site-images.similarcdn.com/image?url=oxylabs.io&t=2&s=1&h=35e259e4de4df73136cacf118058b13978003bb6c5bb802c708ca506f2708aff",
458            "isDataFromGa": false,
459            "visits": 544260
460          },
461          {
462            "domain": "serpapi.com",
463            "icon": "https://site-images.similarcdn.com/image?url=serpapi.com&t=2&s=1&h=02d8d33feda4b216b1e5714b47becb8e23fe7e86e010668b1a2fabe29d6c5b19",
464            "isDataFromGa": false,
465            "visits": 343915
466          },
467          {
468            "domain": "rapidapi.com",
469            "icon": "https://site-images.similarcdn.com/image?url=rapidapi.com&t=2&s=1&h=de9ae3ebc37e7a92943ca90f5ab87958a60d86fe1c54a2adf9e6a9cd3f19c508",
470            "isDataFromGa": false,
471            "visits": 1486777
472          }
473        ]
474      },
475      "trafficSources": {
476        "directVisitsShare": 0.42857373052520903,
477        "referralVisitsShare": 0.02366682307782831,
478        "organicSearchVisitsShare": 0.4385262892969718,
479        "paidSearchVisitsShare": 0.03977076487738564,
480        "socialNetworksVisitsShare": 0.049190080929538846,
481        "mailVisitsShare": 0.019999786075411644,
482        "adsVisitsShare": 0.0002725252176547385,
483        "topCompetitorInsight": {
484          "domain": "scraperapi.com",
485          "source": "PaidSearchVisitsShare",
486          "share": 0.18359105745414445,
487          "icon": "https://site-images.similarcdn.com/image?url=scraperapi.com&t=2&s=1&h=4c0af08959b60e108f82c9a27f8084eb29ae1d09006d23839e9b6b68db11255e"
488        }
489      },
490      "ranking": {
491        "globalRankCompetitors": [
492          {
493            "rank": 71507,
494            "domain": "arabsessentials.com",
495            "icon": "https://site-images.similarcdn.com/image?url=arabsessentials.com&t=2&s=1&h=ba9041988bc6cfa0944e0824d9b6d84d7dbf0af3751a2a82bd7d56c984a8741b"
496          },
497          {
498            "rank": 71508,
499            "domain": "prefeitura.rio",
500            "icon": "https://site-images.similarcdn.com/image?url=prefeitura.rio&t=2&s=1&h=46611f29a1ad5c2cc2d08d2a6e4547fdef95790a7e8b3e6126192e5b77e13df7"
501          },
502          {
503            "rank": 71509,
504            "domain": "apify.com",
505            "icon": "https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6"
506          },
507          {
508            "rank": 71510,
509            "domain": "playnightingale.com",
510            "icon": "https://site-images.similarcdn.com/image?url=playnightingale.com&t=2&s=1&h=db84ddb55de8b103872dff59f51da1d283703206fcc21c39c6bb11299faa709f"
511          },
512          {
513            "rank": 71511,
514            "domain": "9995677.cc",
515            "icon": "https://site-images.similarcdn.com/image?url=9995677.cc&t=2&s=1&h=501b9805064727d4aaf378355250e8ceddb6388bffb5a17cb5d553af96386b2a"
516          }
517        ],
518        "globalRankHistory": [
519          {
520            "date": "2023-12-01T00:00:00+00:00",
521            "rank": 66248
522          },
523          {
524            "date": "2024-01-01T00:00:00+00:00",
525            "rank": 72539
526          },
527          {
528            "date": "2024-02-01T00:00:00+00:00",
529            "rank": 71509
530          }
531        ],
532        "countryRankCompetitors": [
533          {
534            "rank": 58151,
535            "domain": "generationalsaver.com",
536            "icon": "https://site-images.similarcdn.com/image?url=generationalsaver.com&t=2&s=1&h=8857795e936e1cd0456f8211487279447e69d676b904692e59d4d0aaf4eb25e3"
537          },
538          {
539            "rank": 58152,
540            "domain": "isseymiyake.com",
541            "icon": "https://site-images.similarcdn.com/image?url=isseymiyake.com&t=2&s=1&h=17cc81dfe1fbe925167ce8a00db0fd98039548595cec905a52b54eca87fb7af2"
542          },
543          {
544            "rank": 58153,
545            "domain": "apify.com",
546            "icon": "https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6"
547          },
548          {
549            "rank": 58154,
550            "domain": "sultanmusic.ir",
551            "icon": "https://site-images.similarcdn.com/image?url=sultanmusic.ir&t=2&s=1&h=15e14b1a8abf994d4520d26954417d4da30151e11dd1d64c26ba01cb3e04775b"
552          },
553          {
554            "rank": 58155,
555            "domain": "pbys.co",
556            "icon": "https://site-images.similarcdn.com/image?url=pbys.co&t=2&s=1&h=96437635fa3cbdc3b0c17c510baa5327979f7bf4a1156d3526a546cbf8af2e5e"
557          }
558        ],
559        "countryRankHistory": [
560          {
561            "date": "2023-12-01T00:00:00+00:00",
562            "rank": 67894
563          },
564          {
565            "date": "2024-01-01T00:00:00+00:00",
566            "rank": 64660
567          },
568          {
569            "date": "2024-02-01T00:00:00+00:00",
570            "rank": 58153
571          }
572        ],
573        "categoryRankCompetitors": [
574          {
575            "rank": 1331,
576            "domain": "x.ai",
577            "icon": "https://site-images.similarcdn.com/image?url=x.ai&t=2&s=1&h=f952543edca0c41ff2e393d1f47e5a3f48a857082d31b9f592515a68048334f2"
578          },
579          {
580            "rank": 1332,
581            "domain": "bigtimer.net",
582            "icon": "https://site-images.similarcdn.com/image?url=bigtimer.net&t=2&s=1&h=c31210497f183ae516a6224717612b07eff398b96cec6d22c98f50d4f8b6dfe3"
583          },
584          {
585            "rank": 1333,
586            "domain": "apify.com",
587            "icon": "https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6"
588          },
589          {
590            "rank": 1334,
591            "domain": "literati.com",
592            "icon": "https://site-images.similarcdn.com/image?url=literati.com&t=2&s=1&h=1c94695154e0d68ee4b16cebf5243a076a0397e28fb0c4680018215e7812f271"
593          },
594          {
595            "rank": 1335,
596            "domain": "curogram.com",
597            "icon": "https://site-images.similarcdn.com/image?url=curogram.com&t=2&s=1&h=fa8ab3c0ef7d3c05527ae3ec479e02eaf325ee2c91188ce1810708a3104682a1"
598          }
599        ],
600        "categoryRankHistory": [
601          {
602            "date": "2023-12-01T00:00:00+00:00",
603            "rank": 1545
604          },
605          {
606            "date": "2024-01-01T00:00:00+00:00",
607            "rank": 1481
608          },
609          {
610            "date": "2024-02-01T00:00:00+00:00",
611            "rank": 1333
612          }
613        ],
614        "globalRank": 71509,
615        "globalRankPrev": 72539,
616        "globalRankChange": 1030,
617        "categoryRank": 1333,
618        "categoryRankPrev": 1481,
619        "categoryRankChange": 148,
620        "countryRank": 58153,
621        "countryRankPrev": 64660,
622        "countryRankChange": 6507,
623        "countryAlpha2Code": "US",
624        "countryUrlCode": "united-states"
625      },
626      "demographics": {
627        "ageDistribution": [
628          {
629            "minAge": 25,
630            "maxAge": 34,
631            "value": 0.3909595625133851
632          },
633          {
634            "minAge": 18,
635            "maxAge": 24,
636            "value": 0.20338096309939035
637          },
638          {
639            "minAge": 35,
640            "maxAge": 44,
641            "value": 0.1792907968270886
642          },
643          {
644            "minAge": 45,
645            "maxAge": 54,
646            "value": 0.1273882477029681
647          },
648          {
649            "minAge": 55,
650            "maxAge": 64,
651            "value": 0.06434502642388104
652          },
653          {
654            "minAge": 65,
655            "maxAge": null,
656            "value": 0.03463540343328688
657          }
658        ],
659        "genderDistribution": {
660          "male": 0.7003821016698183,
661          "female": 0.2996178983301817
662        }
663      },
664      "geography": {
665        "countriesTotalCount": 94,
666        "topCountriesTraffics": [
667          {
668            "countryAlpha2Code": "US",
669            "countryUrlCode": "united-states",
670            "visitsShare": 0.17399318382267998,
671            "visitsShareChange": 0.07197083836248774
672          },
673          {
674            "countryAlpha2Code": "IN",
675            "countryUrlCode": "india",
676            "visitsShare": 0.08978324437389347,
677            "visitsShareChange": 0.1687194304623858
678          },
679          {
680            "countryAlpha2Code": "GB",
681            "countryUrlCode": "united-kingdom",
682            "visitsShare": 0.08403718849052308,
683            "visitsShareChange": 0.10468598605000756
684          },
685          {
686            "countryAlpha2Code": "BR",
687            "countryUrlCode": "brazil",
688            "visitsShare": 0.0497277832804597,
689            "visitsShareChange": -0.21847563976056927
690          },
691          {
692            "countryAlpha2Code": "DE",
693            "countryUrlCode": "germany",
694            "visitsShare": 0.03763165586938262,
695            "visitsShareChange": -0.05479354740669373
696          }
697        ]
698      }
699    },
700    "crawledAt": "2024-04-02T04:35:17.903Z"
701  }
702]

Sample output 404

1[
2    {
3        "domain": "sharedproxies.com",
4        "status": "failure",
5        "data": [],
6        "crawledAt": "2024-04-01T23:04:00.122Z"
7    }
8]

Developer

Seadapp

Actor metrics

18 monthly users
92.5% runs succeeded
days response time
Created in Apr 2024
Modified about 1 month ago

Categories

Marketing

Business

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

63.2k

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

43.7k

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

14.1k

Website Content Crawler

apify/website-content-crawler

Automatically crawl and extract text content from websites with documentation, knowledge bases, help centers, or blogs. This Actor is designed to provide data to feed, fine-tune, or train large language models such as ChatGPT or LLaMA.

Apify

13.2k

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

17.4k

Twitter Scraper

quacker/twitter-scraper

Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Quacker

24.5k

GPT Scraper

drobnikj/gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

4.3k

AI Product Matcher

equidem/ai-product-matcher

Match products across multiple e-commerce websites. Use this AI product matching Actor whenever you need to find matching pairs of products from different online shops for dynamic pricing, competitor analysis or market research.

Matěj Sochor

315

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

38k

What is data parsing? Process, techniques, tools, and use cases

Pros and cons of web scraping

Top 5 web scraping tools to help you gather retail analytics

Build new tools

Are you a developer? Build your own Actors and run them on Apify.

Learn more

Get a custom solution

Get a custom web scraping or RPA solution.

Book a demo

Similarweb Scraper

How does it work?

Why REQUESTS "0 of 0 handled"?

Recommendation settings:

Similarweb Scraper Test Results:

Sample output from Similarweb Scraper