Mastodon Explorer avatar
Mastodon Explorer
Try for free

7 days trial then $30.00/month - No credit card required now

View all Actors
Mastodon Explorer

Mastodon Explorer

jupri/mastodon-scraper
Try for free

7 days trial then $30.00/month - No credit card required now

Scrape data from Mastodon Social websites

Welcome to Mastodon Scraper

don't be sad readme is here

About Mastodon (social network)

Mastodon is free and open-source software for running self-hosted social networking services. It has microblogging features similar to Twitter, which are offered by a large number of independently run nodes, known as instances, each with its own code of conduct, terms of service, privacy policy, privacy options, and content moderation policies.[6][7][8]

About This Actor

Scrape data from Mastadon, the decentralized alternative to Twitter. Extract information on users, their "toots," likes, and favorites or scrape data based on a search query, such as a hashtag or a keyword. Export accumulated data into a variety of database formats.

Tutorial

By default the actor will scrape posts from trend section of the mastodon.social portal (eg: https://mastodon.social/explore)

Example 1: Portal

To scrape from other portal, use portal parameter and specify the website/portal hostname :

1{
2	"portal": "fosstodon.org"
3}

Example 2: Scraping #hastag

1{
2	"query": "#microsoft"
3}

Notes : the # character is optional

Example 3: Scraping user posts

1{
2	"query": "@username"
3}

Example 4: Using URL as input

When you specify URL for query parameter, it will automatically parsed with appropriate parameter :

1{
2	"query": "https://fosstodon.org/@Joefree/media"
3}

Example 5: Number of results

By default you will only get 5 posts. Use limit parameter to get more results.

1{
2	"query": "microsoft",
3	"limit": 100
4}

Output Examples

1{
2    "account": {
3        "acct": "Gargron",
4        "avatar": "https://files.mastodon.social/accounts/avatars/000/000/001/original/dc4286ceb8fab734.jpg",
5        "avatar_static": "https://files.mastodon.social/accounts/avatars/000/000/001/original/dc4286ceb8fab734.jpg",
6        "created_at": "2016-03-16T00:00:00.000Z",
7        "discoverable": true,
8        "display_name": "Eugen Rochko",
9        "fields": [
10            {
11                "name": "Patreon",
12                "value": "<a href=\"https://www.patreon.com/mastodon\" target=\"_blank\" rel=\"nofollow noopener noreferrer me\"><span class=\"invisible\">https://www.</span><span class=\"\">patreon.com/mastodon</span><span class=\"invisible\"></span></a>"
13            },
14            {
15                "name": "GitHub",
16                "value": "<a href=\"https://github.com/Gargron\" target=\"_blank\" rel=\"nofollow noopener noreferrer me\"><span class=\"invisible\">https://</span><span class=\"\">github.com/Gargron</span><span class=\"invisible\"></span></a>",
17                "verified_at": "2023-02-07T23:24:40.347+00:00"
18            }
19        ],
20        "followers_count": 312471,
21        "following_count": 395,
22        "header": "https://files.mastodon.social/accounts/headers/000/000/001/original/3b91c9965d00888b.jpeg",
23        "header_static": "https://files.mastodon.social/accounts/headers/000/000/001/original/3b91c9965d00888b.jpeg",
24        "id": "1",
25        "last_status_at": "2023-04-28",
26        "note": "<p>Founder, CEO and lead developer <span class=\"h-card\"><a href=\"https://mastodon.social/@Mastodon\" class=\"u-url mention\">@<span>Mastodon</span></a></span>, Germany.</p>",
27        "statuses_count": 73541,
28        "url": "https://mastodon.social/@Gargron",
29        "username": "Gargron"
30    },
31    "application": {
32        "name": "Web"
33    },
34    "card": {
35        "blurhash": "U34x7la*9EoYxNfQayfR4mj:?cWIajfRj[a{",
36        "description": "Learn how to get verified on Mastodon",
37        "height": 267,
38        "image": "https://files.mastodon.social/cache/preview_cards/images/059/998/839/original/74e91efacf98def0.png",
39        "title": "Verification",
40        "type": "link",
41        "url": "https://joinmastodon.org/verification",
42        "width": 400
43    },
44    "content": "<p>Looks like <span class=\"h-card\"><a href=\"https://mastodon.social/@arstechnica\" class=\"u-url mention\">@<span>arstechnica</span></a></span> is now verified on here! Always great to see this feature used. It'll be even more prominent in the future.</p><p><a href=\"https://joinmastodon.org/verification\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><span class=\"invisible\">https://</span><span class=\"\">joinmastodon.org/verification</span><span class=\"invisible\"></span></a></p>",
45    "created_at": "2023-04-27T22:37:39.080Z",
46    "favourites_count": 420,
47    "id": "110273171231251728",
48    "language": "en",
49    "mentions": [
50        {
51            "acct": "arstechnica",
52            "id": "110266162634306901",
53            "url": "https://mastodon.social/@arstechnica",
54            "username": "arstechnica"
55        }
56    ],
57    "reblogs_count": 280,
58    "replies_count": 14,
59    "uri": "https://mastodon.social/users/Gargron/statuses/110273171231251728",
60    "url": "https://mastodon.social/@Gargron/110273171231251728",
61    "visibility": "public"
62}
Developer
Maintained by Community
Actor metrics
  • 2 monthly users
  • 100.0% runs succeeded
  • 6.7 days response time
  • Created in Apr 2023
  • Modified about 1 year ago
Categories