Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.
Search for an specific terms and extract tweets for that term.
Search mode changes the way the data is received
"live", "user", "image", "video"
If you have a file or a url list of twitter urls, you provide them here
Tweets newer than
Will get tweets that are newer than this date. Can be used in conjunction with 'Tweets older than' to create specific date slices. Can use specific dates, such as YYYY-MM-DD or relative ones, like '1 month' or '2 days'
Tweets older than
Will start getting tweets from this date and older. Can be used in conjunction 'Tweets newer than'. Can use specific dates, such as YYYY-MM-DD or relative ones, like '1 month' or '2 days'
Maximum number of tweets
Maximum number of tweets to retrieve. Twitter have a default limit of around 3200 tweets. Check the README for workarounds.
Add user information
Appends an object to each tweet containing the user information. You can decrease the size of your dataset by turning this off.
Select the tweet types to get. Only tweets or tweets and replies for the selected handle when visiting profiles.
List of usernames to scrape
The twitter handles of the profiles you want to scrape. Shortcut instead of inputting https://twitter.com/username urls
It's required to use proxies when running on the platform.
Extend Output Function
Add or remove properties on the output object or omit the output returning null
Extend Scraper Function
Advanced function that allows you to extend the default scraper functionality, allowing you to manually perform actions on the page
Any data that you want to have available inside the Extend Output/Scraper Function
Max timeout seconds
Max timeout for the handlePageFunction. Can be increased for long running processes
Enabling stealth allows to decrease the chance of your scrape being detected as an automated process. Recommended to enable if you're providing your login cookies.
Your login cookies will be used to bypass the login wall. See README for instructions.