🏯 Twitter Scraper Lite: Harder, better, faster, stronger 🏯

Light as a feather, cheap as a chips! This Twitter scraper is a lightweight version of the mighty Tweet Scraper. It's perfect for scraping tweets by search terms, Twitter handles, or Twitter URLs. It's also great for scraping tweets by date. The scraper is built to be fast and efficient, so you can get the data you need quickly.

Probably, you saw a couple of different options around the market. Most of them are either super expensive, or just doesn't work. Our mighty 👑 Tweet Scraper is very well known by it's fame. This actor? This is lighter, cheaper, faster, stronger. Exactly what you are looking for 🐉

‼️ Important Notice

This actor is only for testing purposes and you shouldn't use it in production since it is not maintained. Please use Tweet Scraper in production.

Please keep in mind that the free users are limited to 10 results per run. Consider subscribing to a plan at - https://apify.com/pricing.

Also please note that using our actor for monitoring activies is not allowed. In other words: you should not try to initiate the same run in a very short period of time with time filters in order to understand if a profile tweeted or not or to see if there are any new tweets for a specific keyword/location etc. The actor's main purpose is to fetch historical tweets, not monitor profiles in real time. If you do this, you will get rate-limited automatically and banned very shortly if you continue doing this.

Besides monitoring, these rules also apply:

• You can have max 1 run concurrently (max 5 queries batched) and you need to have a couple of minutes between your runs.
• You need to fetch at least 50 tweets per query (handle, search keyword, etc). If you are batching several of them, you need to increase this. Let's say, if you are fetching 5 handles at the same time, you have to fetch 250 tweets. Please avoid using undetermenistic queries. This is very important and you will get automatically banned. If you fetch less than 50 tweets, the cost of that query becomes greater than the profit and we make a negative margin.
• Fetching a single tweet (with tweet URL) is strictly forbidden unless you get a permission from us. Please get in touch first via Discord or email if you want to fetch single tweets.

🌐 Supported URLs

• Keyword search: https://twitter.com/search?q=wikipedia&f=live&src=typed_query
• Cashtag search: https://twitter.com/search?q=%24eth&src=typed_query&f=live
• Advanced search: https://twitter.com/search?q=(%23gpt)&src=typed_query
• Tweet: https://twitter.com/elonmusk/status/1744812135937396788
• User profile: https://twitter.com/google
• User replies: https://twitter.com/google/with_replies

any many more...

📈 Features

• Search and retrieve all the publicly available tweets with extensive/enriched data. Favorite count, view count, created at, user mentions, hashtags, urls, author, tweet source, geolocation, polls, votes, symbols, and many other things.
• Extract any author information. Usernames, followers, followings, tweet counts, media counts, verified status, and more.
• Search tweets using keywords
• Search tweets using hashtags
• Search tweets using cashtags
• Search tweet trends
• Build your search query, and get everything right away.
• No proxy required.

🆓 Demo Mode & Free Users

The users that are on Free Plan can use the actor only on Demo Mode. Please keep in mind that the users that are on Free Plan can retrieve a maximum of 10 items, and cannot use the actor via API. If you want to use this actor without any limitation, you have to subscribe to a paid plan on Apify. You can check this link to subscribe easily.

⚙️ Sample Input

1{
2    "searchTerms": ["cnn"],
3    "startUrls": ["https://twitter.com/search?q=wikipedia&f=live&src=typed_query"],
4    "maxItems": 500,
5    "sort": "Latest",
6    "twitterHandles": ["apify"],
7    "start": "2023-01-01",
8    "end": "2024-01-02"
9  }

🍜 Sample Output

1{
2	"type": "tweet",
3	"id": "1728108619189874825",
4	"url": "https://x.com/elonmusk/status/1728108619189874825",
5	"twitterUrl": "https://twitter.com/elonmusk/status/1728108619189874825",
6	"text": "More than 10 per human on average",
7	"retweetCount": 11311,
8	"replyCount": 6526,
9	"likeCount": 104121,
10	"quoteCount": 2915,
11	"createdAt": "Fri Nov 24 17:49:36 +0000 2023",
12	"lang": "en",
13	"quoteId": "1728107610631729415",
14	"bookmarkCount": 702,
15	"isReply": false,
16	"card": {},
17	"place": {},
18	"source:": "Twitter for Android",
19	"author": {
20		"type": "user",
21		"userName": "elonmusk",
22		"url": "https://x.com/elonmusk",
23		"twitterUrl": "https://twitter.com/elonmusk",
24		"id": "44196397",
25		"name": "Elon Musk",
26		"isVerified": true,
27        "isBlueVerified": true,
28        "verifiedType": "business",
29		"hasNftAvatar": false,
30		"profilePicture": "https://pbs.twimg.com/profile_images/1683325380441128960/yRsRRjGO_normal.jpg",
31		"coverPicture": "https://pbs.twimg.com/profile_banners/44196397/1690621312",
32		"description": "",
33		"location": "",
34		"followers": 172669889,
35		"following": 538,
36		"protected": false,
37		"status": "",
38		"canDm": false,
39		"canMediaTag": false,
40		"advertiserAccountType": "promotable_user",
41		"analyticsType": "enabled",
42		"createdAt": "Tue Jun 02 20:12:29 +0000 2009",
43		"entities": {
44			"description": {
45				"hashtags": [],
46				"symbols": [],
47				"urls": [],
48				"user_mentions": []
49			}
50		},
51		"fastFollowersCount": 0,
52		"favouritesCount": 42455,
53		"geoEnabled": false,
54		"hasCustomTimelines": true,
55		"hasExtendedProfile": true,
56		"isTranslator": false,
57		"mediaCount": 2002,
58		"profileBackgroundColor": "C0DEED",
59		"statusesCount": 37933,
60		"translatorTypeEnum": "None",
61		"withheldInCountries": [],
62		"affiliatesHighlightedLabel": {
63			"label": {
64				"url": {
65					"urlType": "DeepLink",
66					"url": "https://twitter.com/X"
67				},
68				"badge": {
69					"url": "https://pbs.twimg.com/profile_images/1683899100922511378/5lY42eHs_bigger.jpg"
70				},
71				"userLabelType": "BusinessLabel",
72				"userLabelDisplayType": "Badge",
73				"description": "X"
74			}
75		}
76	},
77	"extendedEntities": {},
78	"isRetweet": false,
79	"isQuote": true,
80	"quote": {
81		"type": "tweet",
82		"id": "1728107610631729415",
83		"text": "The posts on 𝕏 gets ~ 100 billion impressions every day.\n\n https://t.co/AuF1KStCFf",
84		"retweetCount": 646,
85		"replyCount": 789,
86		"likeCount": 3983,
87		"quoteCount": 2493,
88		"createdAt": "Fri Nov 24 17:45:35 +0000 2023",
89		"lang": "en",
90		"bookmarkCount": 127,
91		"author": {
92			"type": "user",
93			"userName": "cb_doge",
94			"url": "https://x.com/cb_doge",
95			"twitterUrl": "https://twitter.com/cb_doge",
96			"id": "1389913567671975937",
97			"name": "DogeDesigner",
98			"isVerified": true,
99            "isBlueVerified": true,
100            "verifiedType": "business",
101			"hasNftAvatar": false,
102			"profilePicture": "https://pbs.twimg.com/profile_images/1498070100393754625/C2V-fbll_normal.jpg",
103			"coverPicture": "https://pbs.twimg.com/profile_banners/1389913567671975937/1707664307",
104			"description": "UX/UI & Graphic Designer at Dogecoin & MyDoge Inc./ 𝕏 Creator",
105			"location": "Dogecoin.com",
106			"followers": 441904,
107			"following": 867,
108			"protected": false,
109			"status": "",
110			"canDm": true,
111			"canMediaTag": false,
112			"advertiserAccountType": "promotable_user",
113			"analyticsType": "disabled",
114			"createdAt": "Wed May 05 12:03:43 +0000 2021",
115			"entities": {
116				"url": {
117					"urls": [
118						{
119							"display_url": "MyDoge.com",
120							"expanded_url": "http://MyDoge.com",
121							"indices": [
122								0,
123								23
124							],
125							"url": "https://t.co/E0fsFaNdeI"
126						}
127					]
128				},
129				"description": {
130					"hashtags": [],
131					"symbols": [],
132					"urls": [],
133					"user_mentions": []
134				}
135			},
136			"fastFollowersCount": 0,
137			"favouritesCount": 70660,
138			"geoEnabled": true,
139			"hasCustomTimelines": true,
140			"hasExtendedProfile": true,
141			"isTranslator": false,
142			"mediaCount": 10987,
143			"profileBackgroundColor": "F5F8FA",
144			"statusesCount": 24918,
145			"translatorTypeEnum": "None",
146			"withheldInCountries": [],
147			"affiliatesHighlightedLabel": {
148				"label": {
149					"url": {
150						"urlType": "DeepLink",
151						"url": "https://twitter.com/MyDogeOfficial"
152					},
153					"badge": {
154						"url": "https://pbs.twimg.com/profile_images/1656530956801523719/SC7nEKMa_bigger.png"
155					},
156					"userLabelType": "BusinessLabel",
157					"userLabelDisplayType": "Badge",
158					"description": "MyDoge Wallet"
159				}
160			}
161		},
162		"extendedEntities": {
163			"media": [
164				{
165					"additional_media_info": {
166						"monetizable": false,
167						"graphql_source_user": {
168							"user": {
169								"legacy": {
170									"id_str": "1389913567671975937",
171									"screen_name": "cb_doge",
172									"name": "DogeDesigner",
173									"profile_image_url_https": "https://pbs.twimg.com/profile_images/1498070100393754625/C2V-fbll_normal.jpg",
174									"verified": false,
175									"protected": false,
176									"can_dm": true,
177									"can_media_tag": false
178								}
179							}
180						}
181					},
182					"display_url": "pic.twitter.com/AuF1KStCFf",
183					"expanded_url": "https://twitter.com/cb_doge/status/1727821969343533149/video/1",
184					"ext_media_availability": {
185						"status": "Available"
186					},
187					"id_str": "1727821919171313664",
188					"indices": [
189						59,
190						82
191					],
192					"media_key": "13_1727821919171313664",
193					"media_url_https": "https://pbs.twimg.com/amplify_video_thumb/1727821919171313664/img/t2oLSNoW4igyatu6.jpg",
194					"original_info": {
195						"width": 1920,
196						"height": 1080,
197						"focus_rects": []
198					},
199					"sizes": {
200						"large": {
201							"w": 1920,
202							"h": 1080
203						}
204					},
205					"source_status_id_str": "1727821969343533149",
206					"source_user_id_str": "1389913567671975937",
207					"type": "video",
208					"url": "https://t.co/AuF1KStCFf",
209					"video_info": {
210						"aspect_ratio": [
211							16,
212							9
213						],
214						"duration_millis": 3566,
215						"variants": [
216							{
217								"url": "https://video.twimg.com/amplify_video/1727821919171313664/pl/aGHTtMOSK_JQx9Q1.m3u8?tag=14&container=cmaf",
218								"content_type": "application/x-mpegURL"
219							},
220							{
221								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/480x270/EkwZuvHPaMbH7O1a.mp4?tag=14",
222								"content_type": "video/mp4",
223								"bitrate": 288000
224							},
225							{
226								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/640x360/0XXJiF8kImc0SNUN.mp4?tag=14",
227								"content_type": "video/mp4",
228								"bitrate": 832000
229							},
230							{
231								"url": "https://video.twimg.com/amplify_video/1727821919171313664/vid/avc1/1280x720/VvbDj9laYWdX1dfX.mp4?tag=14",
232								"content_type": "video/mp4",
233								"bitrate": 2176000
234							}
235						]
236					},
237					"allow_download_status": {
238						"allow_download": true
239					}
240				}
241			]
242		}
243	},
244	"media": []
245}

🧪 Limitations & Solutions

By default, Twitter returns around 800 results per search query. To overcome this limitation, you split your search by different date ranges. Simply search for the same keyword/query multiple times but using different date ranges. You can build your query and initiate multiple API calls, such as:

https://twitter.com/search?q=apify%20until%3A2023-02-31%20since%3A2023-01-01&src=typed_query&f=live - Searches for the keyword apify from 2023-01-01 until 2023-01-31 https://twitter.com/search?q=apify%20until%3A2023-02-28%20since%3A2023-02-01&src=typed_query&f=live - Searches for the keyword apify from 2023-02-01 until 2023-02-28 https://twitter.com/search?q=apify%20until%3A2023-03-31%20since%3A2023-03-01&src=typed_query&f=live - Searches for the keyword apify from 2023-03-01 until 2023-03-31 https://twitter.com/search?q=apify%20until%3A2023-03-31%20since%3A2023-03-01&src=typed_query&f=live - Searches for the keyword apify from 2023-04-01 until 2023-04-30

🔧 Troubleshooting

• Getting Few Results? Check "Maximum number of items on output" (maxItems) field, and "Maximum charged results" fields. These two fields enable you to handle the total number of results. Leaving both empty will result infinite results.
• Are Some Outputs Missing? Ensure that you review all fields, not just the overview. You can navigate to the "Storage" tab and select either "Download the results" or "Open in a New Tab."
• Getting No Results? Confirm that your parameters are not overly restrictive.
• Incomplete Tweet Collection? Keep in mind that sensitive or spam-filtered comments may not be accessible for scraping. Additionally, in a surface-level run, replies to replies might not be included in the collected data.
• Not Receiving New Tweets After a Large Batch? Examine the log for messages like "Logging is too fast, some lines were skipped." If you encounter this issue, consider scraping smaller amounts of data to avoid it.

📞 Contact and Feature Requests

If you need any sort of support, please send an email to apidojo10@gmail.com. You name it, we get it.

🈴 Other Actors you might want to check

• Tweet Scraper
• Twitter List Scraper
• Twitter User Scraper
• TikTok Comment Scraper
• TikTok User Scraper
• Instagram Comments Scraper