Twitter Profile Scraper

Interested in scraping Twitter profiles? Get it here: Twitter Profile Scraper. Extract detailed information from Twitter profiles and posts efficiently.

Features

• Data Export and Integration: Export the extracted data in JSON or CSV format. Customize the fields to integrate with other tools and platforms for in-depth analysis.
• Automatic Retry and Error Handling: The scraper includes built-in retry functionality to handle network issues or timeouts gracefully, ensuring uninterrupted data collection.
• Ability to Resume Last Failed Runs: Resume data collection from the last failed attempt with a simple click, allowing you to pick up where you left off.

Sample Output

Here is a sample output of this scraper:

1{
2  "biography": null,
3  "birth_date": null,
4  "category_name": null,
5  "date_joined": "2009-06-02T20:12:29.000Z",
6  "external_link": null,
7  "followers": 193576643,
8  "following": 690,
9  "id": "elonmusk",
10  "input": {
11    "url": "https://x.com/elonmusk"
12  },
13  "is_business_account": false,
14  "is_government_account": false,
15  "is_verified": true,
16  "location": null,
17  "posts": [
18    {
19      "date_posted": "2022-04-28T00:56:58.000Z",
20      "description": "Next I’m buying Coca-Cola to put the cocaine back in",
21      "hashtags": [],
22      "likes": 4457583,
23      "photos": null,
24      "post_id": "1519480761749016577",
25      "post_url": "https://twitter.com/44196397/status/1519480761749016577",
26      "replies": 182384,
27      "reposts": 623761,
28      "videos": null,
29      "views": null
30    }
31  ],
32  "posts_count": 49004,
33  "profile_image_link": "https://pbs.twimg.com/profile_images/1815749056821346304/jS8I28PL_normal.jpg",
34  "profile_name": "Elon Musk",
35  "subscriptions": 158,
36  "suggested_profiles": [
37    {
38      "profile_id": "50393960",
39      "profile_image": "https://pbs.twimg.com/profile_images/1674815862879178752/nTGMV1Eo_normal.jpg",
40      "profile_name": "Bill Gates",
41      "profile_url": "https://x.com/BillGates"
42    }
43  ],
44  "url": "https://x.com/elonmusk",
45  "x_id": "44196397"
46}

Output Data Documentation

Here is the JSON fields documentation without including the sample values:

• biography (string): A short biography of the user.
• birth_date (string): The birth date of the user.
• category_name (string): The category or type of account.
• date_joined (string): The date when the user joined Twitter.
• external_link (string): Any external link associated with the user’s profile.
• followers (number): The number of followers the user has.
• following (number): The number of accounts the user is following.
• id (string): The user’s internal Twitter ID.
• input (object): Contains the URL of the user’s Twitter profile.
• is_business_account (boolean): Indicates if the account is a business account.
• is_government_account (boolean): Indicates if the account is a government account.
• is_verified (boolean): Indicates if the account is verified.
• location (string): The location of the user.
• posts (array): An array of posts by the user.
• posts_count (number): The total number of posts made by the user.
• profile_image_link (string): The URL of the user’s profile image.
• profile_name (string): The name of the user.
• subscriptions (number): The number of subscriptions the user has.
• suggested_profiles (array): A list of suggested profiles related to the user.
• url (string): The URL of the user’s Twitter profile.
• x_id (string): The user’s unique ID on Twitter.