🏯 Twitter Scraper Lite: Harder, better, faster, stronger 🏯

Light as a feather, cheap as a chips! This Twitter scraper is a lightweight version of the mighty Tweet Scraper. It's perfect for scraping tweets by search terms, Twitter handles, or Twitter URLs. It's also great for scraping tweets by date. The scraper is built to be fast and efficient, so you can get the data you need quickly.

Probably, you saw a couple of different options around the market. Most of them are either super expensive, or just doesn't work. Our mighty 👑 Tweet Scraper is very well known by it's fame. This actor? This is lighter, cheaper, faster, stronger. Exactly what you are looking for 🐉

‼️ Important Notice

Please keep in mind that the free users are limited to 10 results per run. Consider subscribing to a plan at - https://apify.com/pricing.

Also please note that using our actor for monitoring activies is not allowed. In other words: you should not try to initiate the same run in a very short period of time with time filters in order to understand if a profile tweeted or not. The actor's main purpose is to fetch historical tweets, not monitor profiles in real time. If you do this, you will get ratelimitted automatically and banned very shortly if you continue doing this.

🌐 Supported URLs

• Keyword search: https://twitter.com/search?q=wikipedia&f=live&src=typed_query
• Cashtag search: https://twitter.com/search?q=%24eth&src=typed_query&f=live
• Advanced search: https://twitter.com/search?q=(%23gpt)&src=typed_query
• Tweet: https://twitter.com/elonmusk/status/1744812135937396788
• User profile: https://twitter.com/google
• User replies: https://twitter.com/google/with_replies

any many more...

📈 Features

• Search and retrieve all the publicly available tweets with extensive/enriched data. Favorite count, view count, created at, user mentions, hashtags, urls, author, tweet source, geolocation, polls, votes, symbols, and many other things.
• Extract any author information. Usernames, followers, followings, tweet counts, media counts, verified status, and more.
• Search tweets using keywords
• Search tweets using hashtags
• Search tweets using cashtags
• Search tweet trends
• Build your search query, and get everything right away.
• No proxy required.

🆓 Demo Mode & Free Users

The users that are on Free Plan can use the actor only on Demo Mode. Please keep in mind that the users that are on Free Plan can retrieve a maximum of 10 items, and cannot use the actor via API. If you want to use this actor without any limitation, you have to subscribe to a paid plan on Apify. You can check this link to subscribe easily.

⚙️ Sample Input

1{
2    "searchTerms": ["cnn"],
3    "startUrls": ["https://twitter.com/search?q=wikipedia&f=live&src=typed_query"],
4    "maxItems": 500,
5    "sort": "Latest",
6    "twitterHandles": ["apify"],
7    "start": "2023-01-01",
8    "end": "2024-01-02"
9  }

🍜 Sample Output

1{
2	"type": "tweet",
3	"id": "1728108619189874825",
4	"url": "https://x.com/elonmusk/status/1728108619189874825",
5	"twitterUrl": "https://twitter.com/elonmusk/status/1728108619189874825",
6	"text": "More than 10 per human on average",
7	"retweetCount": 11311,
8	"replyCount": 6526,
9	"likeCount": 104121,
10	"quoteCount": 2915,
11	"createdAt": "Fri Nov 24 17:49:36 +0000 2023",
12	"lang": "en",
13	"quoteId": "1728107610631729415",
14	"bookmarkCount": 702,
15	"isReply": false,
16	"card": {},
17	"place": {},
18	"source:": "Twitter for Android",
19	"author": {
20		"type": "user",
21		"userName": "elonmusk",
22		"url": "https://x.com/elonmusk",
23		"twitterUrl": "https://twitter.com/elonmusk",
24		"id": "44196397",
25		"name": "Elon Musk",
26		"isVerified": true,
27        "isBlueVerified": true,
28        "verifiedType": "business",
29		"hasNftAvatar": false,
30		"profilePicture": "https://pbs.twimg.com/profile_images/1683325380441128960/yRsRRjGO_normal.jpg",
31		"coverPicture": "https://pbs.twimg.com/profile_banners/44196397/1690621312",
32		"description": "",
33		"location": "",
34		"followers": 172669889,
35		"following": 538,
36		"protected": false,
37		"status": "",
38		"canDm": false,
39		"canMediaTag": false,
40		"advertiserAccountType": "promotable_user",
41		"analyticsType": "enabled",
42		"createdAt": "Tue Jun 02 20:12:29 +0000 2009",
43		"entities": {
44			"description": {
45				"hashtags": [],
46				"symbols": [],
47				"urls": [],
48				"user_mentions": []
49			}
50		},
51		"fastFollowersCount": 0,
52		"favouritesCount": 42455,
53		"geoEnabled": false,
54		"hasCustomTimelines": true,
55		"hasExtendedProfile": true,
56		"isTranslator": false,
57		"mediaCount": 2002,
58		"profileBackgroundColor": "C0DEED",
59		"statusesCount": 37933,
60		"translatorTypeEnum": "None",
61		"withheldInCountries": [],
62		"affiliatesHighlightedLabel": {
63			"label": {
64				"url": {
65					"urlType": "DeepLink",
66					"url": "https://twitter.com/X"
67				},
68				"badge": {
69					"url": "https://pbs.twimg.com/profile_images/1683899100922511378/5lY42eHs_bigger.jpg"
70				},
71				"userLabelType": "BusinessLabel",
72				"userLabelDisplayType": "Badge",
73				"description": "X"
74			}
75		}
76	},
77	"extendedEntities": {},
78	"isRetweet": false,
79	"isQuote": true,
80	"quote": {
81		"type": "tweet",
82		"id": "1728107610631729415",
83		"text": "The posts on 𝕏 gets ~ 100 billion impressions every day.\n\n https://t.co/AuF1KStCFf",
84		"retweetCount": 646,
85		"replyCount": 789,
86		"likeCount": 3983,
87		"quoteCount": 2493,
88		"createdAt": "Fri Nov 24 17:45:35 +0000 2023",
89		"lang": "en",
90		"bookmarkCount": 127,
91		"author": {
92			"type": "user",
93			"userName": "cb_doge",
94			"url": "https://x.com/cb_doge",
95			"twitterUrl": "https://twitter.com/cb_doge",
96			"id": "1389913567671975937",
97			"name": "DogeDesigner",
98			"isVerified": true,
99            "isBlueVerified": true,
100            "verifiedType": "business",
101			"hasNftAvatar": false,
102			"profilePicture": "https://pbs.twimg.com/profile_images/1498070100393754625/C2V-fbll_normal.jpg",
103			"coverPicture": "https://pbs.twimg.com/profile_banners/1389913567671975937/1707664307",
104			"description": "UX/UI & Graphic Designer at Dogecoin & MyDoge Inc./ 𝕏 Creator",
105			"location": "Dogecoin.com",
106			"followers": 441904,
107			"following": 867,
108			"protected": false,
109			"status": "",
110			"canDm": true,
111			"canMediaTag": false,
112			"advertiserAccountType": "promotable_user",
113			"analyticsType": "disabled",
114			"createdAt": "Wed May 05 12:03:43 +0000 2021",
115			"entities": {
116				"url": {
117					"urls": [
118						{
119							"display_url": "MyDoge.com",
120							"expanded_url": "http://MyDoge.com",
121							"indices": [
122								0,
123								23
124							],
125							"url": "https://t.co/E0fsFaNdeI"
126						}
127					]
128				},
129				"description": {
130					"hashtags": [],
131					"symbols": [],
132					"urls": [],
133					"user_mentions": []
134				}
135			},
136			"fastFollowersCount": 0,
137			"favouritesCount": 70660,
138			"geoEnabled": true,
139			"hasCustomTimelines": true,
140			"hasExtendedProfile": true,
141			"isTranslator": false,
142			"mediaCount": 10987,
143			"profileBackgroundColor": "F5F8FA",
144			"statusesCount": 24918,
145			"translatorTypeEnum": "None",
146			"withheldInCountries": [],
147			"affiliatesHighlightedLabel": {
148				"label": {
149					"url": {
150						"urlType": "DeepLink",
151						"url": "https://twitter.com/MyDogeOfficial"
152					},
153					"badge": {
154						"url": "https://pbs.twimg.com/profile_images/1656530956801523719/SC7nEKMa_bigger.png"
155					},
156					"userLabelType": "BusinessLabel",
157					"userLabelDisplayType": "Badge",
158					"description": "MyDoge Wallet"
159				}
160			}
161		},
162		"extendedEntities": {
163			"media": [
164				{
165					"additional_media_info": {
166						"monetizable": false,
167						"graphql_source_user": {
168							"user": {
169								"legacy": {
170									"id_str": "1389913567671975937",
171									"screen_name": "cb_doge",
172									"name": "DogeDesigner",
173									"profile_image_url_https": "https://pbs.twimg.com/profile_images/1498070100393754625/C2V-fbll_normal.jpg",
174									"verified": false,
175									"protected": false,
176									"can_dm": true,
177									"can_media_tag": false
178								}
179							}
180						}
181					},
182					"display_url": "pic.twitter.com/AuF1KStCFf",
183					"expanded_url": "https://twitter.com/cb_doge/status/1727821969343533149/video/1",
184					"ext_media_availability": {
185						"status": "Available"
186					},
187					"id_str": "1727821919171313664",
188					"indices": [
189						59,
190						82
191					],
192					"media_key": "13_1727821919171313664",
193					"media_url_https": "https://pbs.twimg.com/amplify_video_thumb/1727821919171313664/img/t2oLSNoW4igyatu6.jpg",
194					"original_info": {
195						"width": 1920,
196						"height": 1080,
197						"focus_rects": []
198					},
199					"sizes": {
200						"large": {
201							"w": 1920,
202							"h": 1080
203						}
204					},
205					"source_status_id_str": "1727821969343533149",
206					"source_user_id_str": "1389913567671975937",
207					"type": "video",
208					"url": "https://t.co/AuF1KStCFf",
209					"video_info": {
210						"aspect_ratio": [
211							16,
212							9
213						],
214						"duration_millis": 3566,
215						"variants": [
216							{
217								"url": "https://video.twimg.com/amplify_video/1727821919171313664/pl/aGHTtMOSK_JQx9Q1.m3u8?tag=14&container=cmaf",
218								"content_type": "application/x-mpegURL"
219							},
220							{
221								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/480x270/EkwZuvHPaMbH7O1a.mp4?tag=14",
222								"content_type": "video/mp4",
223								"bitrate": 288000
224							},
225							{
226								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/640x360/0XXJiF8kImc0SNUN.mp4?tag=14",
227								"content_type": "video/mp4",
228								"bitrate": 832000
229							},
230							{
231								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/1280x720/VvbDj9laYWdX1dfX.mp4?tag=14",
232								"content_type": "video/mp4",
233								"bitrate": 2176000
234							}
235						]
236					},
237					"allow_download_status": {
238						"allow_download": true
239					}
240				}
241			]
242		}
243	},
244	"media": []
245}

🧪 Limitations & Solutions

By default, Twitter returns around 800 results per search query. To overcome this limitation, you split your search by different date ranges. Simply search for the same keyword/query multiple times but using different date ranges. You can build your query and initiate multiple API calls, such as:

https://twitter.com/search?q=apify%20until%3A2023-02-31%20since%3A2023-01-01&src=typed_query&f=live - Searches for the keyword apify from 2023-01-01 until 2023-01-31 https://twitter.com/search?q=apify%20until%3A2023-02-28%20since%3A2023-02-01&src=typed_query&f=live - Searches for the keyword apify from 2023-02-01 until 2023-02-28 https://twitter.com/search?q=apify%20until%3A2023-03-31%20since%3A2023-03-01&src=typed_query&f=live - Searches for the keyword apify from 2023-03-01 until 2023-03-31 https://twitter.com/search?q=apify%20until%3A2023-03-31%20since%3A2023-03-01&src=typed_query&f=live - Searches for the keyword apify from 2023-04-01 until 2023-04-30

🔧 Troubleshooting

• Getting Few Results? Check "Maximum number of items on output" (maxItems) field, and "Maximum charged results" fields. These two fields enable you to handle the total number of results. Leaving both empty will result infinite results.
• Are Some Outputs Missing? Ensure that you review all fields, not just the overview. You can navigate to the "Storage" tab and select either "Download the results" or "Open in a New Tab."
• Getting No Results? Confirm that your parameters are not overly restrictive.
• Incomplete Tweet Collection? Keep in mind that sensitive or spam-filtered comments may not be accessible for scraping. Additionally, in a surface-level run, replies to replies might not be included in the collected data.
• Not Receiving New Tweets After a Large Batch? Examine the log for messages like "Logging is too fast, some lines were skipped." If you encounter this issue, consider scraping smaller amounts of data to avoid it.

📞 Contact and Feature Requests

If you need any sort of support, please send an email to apidojo10@gmail.com. You name it, we get it.

🈴 Other Actors you might want to check

• Tweet Scraper
• Twitter List Scraper
• Twitter User Scraper
• TikTok Comment Scraper
• TikTok User Scraper