Download profiles from Twitter with Python
Use Twitter Scraper to get profiles from Twitter with Python. Want to grab profiles from Twitter? Twitter Scraper makes it quick and easy. Just tell it what to download and you’ll get your Twitter profile available offline, for whenever you want it.
1Get an Apify account
You can’t get data from the inside of the platform if you’re not authorized in it. So to get started, create an Apify account. It only takes a minute and it's free of charge.
Sign up for free
2Initialize the API using your token
After you’ve registered, it’s time to add your secret authentication token. You can find your API token on the Integrations page in Apify Console.
Get your token in Console3Define input and copy it in JSON
To get the data from Twitter you first need to use Twitter Scraper to extract it. So let’s add a simple input and transfer it to your code. You can copy your input as a JSON from the Twitter Scraper’s Input tab in Console.
4Integrate Apify into your codebase
Finally, call the Twitter Scraper from your Python project. Use Apify Client or Endpoints. You’ll be able to export scraped Twitter data in no time by running the sample code below ↓.
5Monitor your Twitter Scraper runs
Head over to our dashboard and see how Twitter Scraper runs are executed in real time. Here you can also download the run logs and keep an eye on the API’s performance.
Go to dashboardGet your Python project up and running
Add-on to step 4: start your Python project by executing this code snippet in your go-to environment.
1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4client = ApifyClient("<YOUR_API_TOKEN>")
5
6# Prepare the Actor input
7run_input = {
8 "handles": ["Apify"],
9 "tweetsDesired": 100,
10 "proxyConfig": { "useApifyProxy": True },
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("quacker/twitter-scraper").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
18for item in client.dataset(run["defaultDatasetId"]).iterate_items():
19 print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
Free $5 usage every monthEnjoy $5 of free platform usage every month to explore and kickstart your projects.
No credit card requiredGet started on Apify instantly without the hassle of entering your credit card information.
Supportive community on DiscordJoin our Discord community to ask questions, share ideas, and connect with developers.
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
apidojo/tweet-scraper
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
API Dojo
3.7k
Twitter Scraper
microworlds/twitter-scraper
Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.
Caleb David
11.6k
Twitter followers scraper
curious_coder/twitter-scraper
Scrape followers, following and subscriptions list of any twitter profile
Curious Coder
1.2k
Ready to start downloading Twitter profiles?
You just need a free Apify account
Instagram Profile Media Downloader
trudax/instagram-profile-media-downloader
Download images and videos from public Instagram profiles.
Gustavo Rudiger
23
Meta Threads Profile Scraper
apify/threads-profile-api-scraper
Scrape Threads profile info. Add one or more Threads usernames and extract number of followers, bio, profile details, URLs, picture URL, full name, username and more. Download structured data in JSON, CSV, XML, Excel, and HTML to use in applications and reports.
Apify
180
Onlyfans profile scraper
curious_coder/onlyfans-scraper
Onlyfans data extractor scrapes profiles in bulk with all details including, name, bio, last online, engagement insights, social media urls, etc
Curious Coder
660
Apify’s wide range of tools use a technique called web scraping to extract public data from websites. These scrapers access the website the same way as you would with a browser, find the image, video, or text you want, and download it for you. They’re a fast and efficient way to get data at scale.
Web scraping is a handy method for collecting information from various websites. It's like having a digital assistant that visits web pages on your behalf, pulling out the details you need such as prices, descriptions, addresses, and contact information. But it's more than just text; this tool can also download images and videos, making it a comprehensive way to gather content from the online world. It takes care of all the complex, technical parts, so you don't have to.
Web scraping is a method where you choose websites to collect specific content, including text, images, and videos. You begin by identifying the web pages that host the visual media you're interested in. Next, you use a web scraping tool tailored to locate the parts of the page containing the images or videos you want to download. Once the tool is set up and run, it navigates to the chosen web pages, identifies the images and videos, and downloads them for you. It's a streamlined way to gather pictures and videos from online sources without having to manually download each item.
Yes, web scraping is legal for gathering public information from websites. But be careful with personal or confidential data, as well as intellectual property, because laws and regulations might protect them. It's good practice to check the website's rules or terms of service to know what's allowed. If you're not sure, getting legal advice can help ensure you're using web scraping correctly and within the law.
Actors are serverless cloud programs that run on the Apify platform and do computing jobs. They’re called Actors because, like human actors, they perform actions based on a script. They can perform anything from simple actions (such as filling out a web form or sending an email) to complex operations (such as crawling an entire website or removing duplicates from a large dataset). Actor runs can be as short or as long as necessary. They could last seconds, hours, or even run infinitely.