🐦 Twitter Scraper - Unlimited Tweets, Fixed Price

🚀 Overview

The Twitter Scraper allows you to extract valuable data from Twitter, including:

• User tweets
• Search tweets
• Tweet conversations

With advanced filtering, multi-language support, and high efficiency, it is the ultimate tool for data collection.

✨ Features and Functionality

📌 General Features

• Detailed User Information – Perfect for data mining.
• Multi-Language Support – Works globally without restrictions.
• Geo-Targeting – Filter tweets based on location.
• Lightning Fast & Efficient – Ideal for integration into any platform.
• Query Wizard – Simple input tool for non-technical users.
• Advanced Search Integration – Use Twitter Advanced Search with ease.

🔎 Scraping Options

• Custom Start URLs
  Start scraping from:

  • User profiles: https://x.com/KMbappe
  • Search queries: https://x.com/search?q=real%20madrid&src=typed_query
  • Specific tweets: https://x.com/realmadrid/status/1877491794000412879

• Search Queries
  Provide a list of keywords to find relevant tweets (e.g., "barca", "atletico madrid").

• Search Modes

  • Latest – Most recent tweets
  • Top – Most popular tweets

• Date Filters

  • Tweets newer than a specific date (YYYY-MM-DD)
  • Tweets older than a specific date (YYYY-MM-DD)

• Content Filters

  • Only tweets with media (images, videos, GIFs)
  • Only tweets from verified users
  • Exclude replies, retweets, or links

• Tweet Stats Filters

  • Filter tweets based on minimum likes, replies, or retweets.

• Account Filters

  • Scrape tweets:
    • From a specific account
    • To a specific account
    • Mentioning a specific account

• Language & Location

  • Filter tweets by specific languages.
  • Find tweets near a defined location.

• Proxy Configuration

  • Use advanced proxy settings for anonymous & efficient scraping.

• Limitations

  • Set a maximum number of tweets or pages for optimized performance.

🎯 Who Needs This?

The Twitter Scraper delivers enriched data at high speed and low cost, benefiting a wide range of users:

📊 Cryptocurrency Analysts & Investors

• Track sentiment and influencer opinions.
• Catch panic buying/selling trends instantly.

🔍 Market Research Analysts

• Gather public opinions and trends.
• Analyze consumer behavior and market patterns.

📚 Academic Researchers

• Study social behaviors, communication trends, and misinformation spread.
• Understand public reactions to major events.

🏢 HR & Recruitment Specialists

• Monitor industry trends and job market sentiment.
• Identify potential candidates for recruitment.

---

With its powerful filters, high-speed performance, and easy integration, the Twitter Scraper is the perfect tool for data-driven decision-making. 🚀

🔧 Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

⚙️ Input and Definitions

Field	Type	Description
startUrls	array	Twitter (X) URLs.
searchQueries	array	Search queries you want to search from Twitter (X). Check this page for further reference.
searchMode	String	Search mode for search tweets. It can be either "Latest" or "Top".
authTokens	array	Authentication tokens for Twitter (X).
conversationIds	array	Conversation IDs that you want to get from Twitter (X)
maxItems	number	Maximum number of items that you want to receive as output
endPage	number	End page for the scraper. It can be used to limit the number of pages to scrape.
since	String	Returns tweets newer than the given date.
until	String	Returns tweets older than the given date.
minLikes	number	Returns tweets with at least the given number of likes.
minReplies	number	Returns tweets with at least the given number of replies.
minRetweets	number	Returns tweets with at least the given number of retweets.
fromUser	String	Returns tweets from the given user.
toUser	String	Returns tweets to the given user.
mentioningUser	String	Returns tweets that mention the given user.
onlyNativeRetweets	boolean	Returns only native retweets.
onlyMedia	boolean	Returns only tweets with media.
onlyNativeImages	boolean	Returns only tweets with native images.
onlyImages	boolean	Returns only tweets with images.
onlyVideos	boolean	Returns only tweets with videos.
onlyNews	boolean	Returns only tweets with news.
onlyVerified	boolean	Returns only tweets from verified users.
onlyNativeVideo	boolean	Returns only tweets with native video.
onlyReplies	boolean	Returns only tweets with replies.
onlyLinks	boolean	Returns only tweets with links.
onlySafe	boolean	Returns only tweets marked as potentially sensitive.
onlyQuote	boolean	Returns only tweets that quote other tweets.
onlyProVideo	boolean	Returns only tweets with pro video.
excludeNativeRetweets	boolean	Returns tweets without native retweets.
excludeMedia	boolean	Returns tweets without media.
excludeNativeImages	boolean	Returns tweets without native images.
excludeImages	boolean	Returns tweets without images.
excludeVideos	boolean	Returns tweets without videos.
excludeNews	boolean	Returns tweets without news.
excludeVerified	boolean	Returns tweets from unverified users.
excludeNativeVideo	boolean	Returns tweets without native video.
excludeReplies	boolean	Returns tweets without replies.
excludeLinks	boolean	Returns tweets without links.
excludeSafe	boolean	Returns tweets marked as potentially sensitive.
excludeQuote	boolean	Returns tweets that quote other tweets.
excludeProVideo	boolean	Returns tweets with pro video.

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Tip

Important: You must provide your own Twitter/X authentication tokens in the authTokens array for the scraper to work. These can be obtained from your Twitter accounts.

When you want to scrape over a specific list URL, just copy and paste the link as one of the startUrl.

If you would like to scrape only the first page of a list then put the link for the page and have the endPage as 1.

With the last approach that is explained above you can also fetch any interval of pages. If you provide the 5th page of a list and define the endPage parameter as 6 then you'll have the 5th and 6th pages only.

Compute Unit Consumption

The actor is optimized to run blazing fast and scrape as many items as possible. Therefore, it forefronts all the detailed requests. If the actor doesn't block very often it can scrape 2000-3000 tweets in 2 minutes with ~0.07-0.08 compute units.

Twitter Scraper Input example

1{
2    "proxy": {
3        "useApifyProxy": true
4    },
5    "startUrls": [
6        "https://x.com/KMbappe",
7        "https://x.com/search?q=real%20madrid&src=typed_query",
8        "https://x.com/realmadrid/status/1877491794000412879"
9    ],
10    "searchQueries": [
11        "barcelona",
12        "atletico madrid"
13    ],
14    "searchMode": "Latest",
15    "maxItems": 100,
16    "endPage": 5,
17    "authTokens": [
18        
19    ],
20}

During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified. When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

Tweet Export

During the run, the actor stores results into a dataset. Each tweet is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Twitter actor.

Scraped Twitter Properties

The structure of each tweet looks like this:

Tweet Detail

1{
2	"id": "1877102356627673443",
3	"url": "https://x.com/10Ronaldinho/status/1877102356627673443",
4	"text": "Hermosos recuerdos en Barcelona... Sempre Barça!!!!! https://t.co/1ljiuvNHf9",
5	"retweetCount": 4078,
6	"replyCount": 357,
7	"likeCount": 58982,
8	"quoteCount": 147,
9	"createdAt": "Wed Jan 08 21:17:31 +0000 2025",
10	"lang": "es",
11	"protected": false,
12	"bookmarkCount": 421,
13	"isReply": false,
14	"entities": {
15		"hashtags": [],
16		"media": [
17			{
18				"display_url": "pic.x.com/1ljiuvNHf9",
19				"expanded_url": "https://x.com/10Ronaldinho/status/1877102356627673443/photo/1",
20				"id_str": "1877102283202162688",
21				"indices": [
22					53,
23					76
24				],
25				"media_key": "3_1877102283202162688",
26				"media_url_https": "https://pbs.twimg.com/media/GgzOlM1W8AAXri7.jpg",
27				"type": "photo",
28				"url": "https://t.co/1ljiuvNHf9",
29				"ext_media_availability": {
30					"status": "Available"
31				},
32				"features": {
33					"all": {
34						"tags": [
35							{
36								"user_id": "96951800",
37								"name": "FC Barcelona",
38								"screen_name": "FCBarcelona",
39								"type": "user"
40							}
41						]
42					},
43					"large": {
44						"faces": []
45					},
46					"medium": {
47						"faces": []
48					},
49					"small": {
50						"faces": []
51					},
52					"orig": {
53						"faces": []
54					}
55				},
56				"sizes": {
57					"large": {
58						"h": 1280,
59						"w": 1280,
60						"resize": "fit"
61					},
62					"medium": {
63						"h": 1200,
64						"w": 1200,
65						"resize": "fit"
66					},
67					"small": {
68						"h": 680,
69						"w": 680,
70						"resize": "fit"
71					},
72					"thumb": {
73						"h": 150,
74						"w": 150,
75						"resize": "crop"
76					}
77				},
78				"original_info": {
79					"height": 1280,
80					"width": 1280,
81					"focus_rects": [
82						{
83							"x": 0,
84							"y": 0,
85							"w": 1280,
86							"h": 717
87						},
88						{
89							"x": 0,
90							"y": 0,
91							"w": 1280,
92							"h": 1280
93						},
94						{
95							"x": 111,
96							"y": 0,
97							"w": 1123,
98							"h": 1280
99						},
100						{
101							"x": 352,
102							"y": 0,
103							"w": 640,
104							"h": 1280
105						},
106						{
107							"x": 0,
108							"y": 0,
109							"w": 1280,
110							"h": 1280
111						}
112					]
113				},
114				"media_results": {
115					"result": {
116						"media_key": "3_1877102283202162688"
117					}
118				}
119			}
120		],
121		"symbols": [],
122		"timestamps": [],
123		"urls": [],
124		"user_mentions": []
125	},
126	"extentedEntities": {
127		"media": [
128			{
129				"display_url": "pic.x.com/1ljiuvNHf9",
130				"expanded_url": "https://x.com/10Ronaldinho/status/1877102356627673443/photo/1",
131				"id_str": "1877102283202162688",
132				"indices": [
133					53,
134					76
135				],
136				"media_key": "3_1877102283202162688",
137				"media_url_https": "https://pbs.twimg.com/media/GgzOlM1W8AAXri7.jpg",
138				"type": "photo",
139				"url": "https://t.co/1ljiuvNHf9",
140				"ext_media_availability": {
141					"status": "Available"
142				},
143				"features": {
144					"all": {
145						"tags": [
146							{
147								"user_id": "96951800",
148								"name": "FC Barcelona",
149								"screen_name": "FCBarcelona",
150								"type": "user"
151							}
152						]
153					},
154					"large": {
155						"faces": []
156					},
157					"medium": {
158						"faces": []
159					},
160					"small": {
161						"faces": []
162					},
163					"orig": {
164						"faces": []
165					}
166				},
167				"sizes": {
168					"large": {
169						"h": 1280,
170						"w": 1280,
171						"resize": "fit"
172					},
173					"medium": {
174						"h": 1200,
175						"w": 1200,
176						"resize": "fit"
177					},
178					"small": {
179						"h": 680,
180						"w": 680,
181						"resize": "fit"
182					},
183					"thumb": {
184						"h": 150,
185						"w": 150,
186						"resize": "crop"
187					}
188				},
189				"original_info": {
190					"height": 1280,
191					"width": 1280,
192					"focus_rects": [
193						{
194							"x": 0,
195							"y": 0,
196							"w": 1280,
197							"h": 717
198						},
199						{
200							"x": 0,
201							"y": 0,
202							"w": 1280,
203							"h": 1280
204						},
205						{
206							"x": 111,
207							"y": 0,
208							"w": 1123,
209							"h": 1280
210						},
211						{
212							"x": 352,
213							"y": 0,
214							"w": 640,
215							"h": 1280
216						},
217						{
218							"x": 0,
219							"y": 0,
220							"w": 1280,
221							"h": 1280
222						}
223					]
224				},
225				"media_results": {
226					"result": {
227						"media_key": "3_1877102283202162688"
228					}
229				}
230			}
231		]
232	},
233	"author": {
234		"username": "10Ronaldinho",
235		"url": "https://x.com/10Ronaldinho",
236		"id": "29479000",
237		"name": "Ronaldinho",
238		"isVerified": false,
239		"isBlueVerified": true,
240		"profilePicture": "https://pbs.twimg.com/profile_images/1537593562619060225/AmmxIwWi_normal.jpg",
241		"coverPicture": "https://pbs.twimg.com/profile_banners/29479000/1650911561",
242		"description": "Twitter oficial de Ronaldinho Gaúcho. Duas vezes eleito o melhor do mundo pela FIFA.\n\n@BetifyOfficial embaixador\nhttps://t.co/jctU4nkSvp",
243		"location": "",
244		"followers": 21437149,
245		"following": 152,
246		"canDm": false,
247		"canMediaTag": false,
248		"createdAt": "Tue Apr 07 16:11:50 +0000 2009",
249		"entities": {
250			"description": {
251				"urls": [
252					{
253						"display_url": "bit.ly/RonniexBetify",
254						"expanded_url": "https://bit.ly/RonniexBetify",
255						"url": "https://t.co/jctU4nkSvp",
256						"indices": [
257							113,
258							136
259						]
260					}
261				]
262			},
263			"url": {
264				"urls": [
265					{
266						"display_url": "nooke.ag",
267						"expanded_url": "http://www.nooke.ag",
268						"url": "https://t.co/f6O6lqd6yM",
269						"indices": [
270							0,
271							23
272						]
273					}
274				]
275			}
276		},
277		"fastFollowersCount": 0,
278		"favouritesCount": 1552,
279		"listedCount": 26192,
280		"hasCustomTimelines": false,
281		"isTranslator": false,
282		"mediaCount": 3449,
283		"statusesCount": 7101,
284		"withheldInCountries": [],
285		"affiliatesHighlightedLabel": {}
286	}
287}

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? business@epctex.com is at your service.