What is TikTok Scraper

This Scraper crawls Tiktok and extracts information on the videos hosted on the website. The video information is very detailed and can be exported to the following formats CSV,EXCEL,HTML, JSON,XML

Features

Scraper allows you to scrape:

• Individual Video Posts - by using a specific video URL.
• Account - Results from individual Tiktok account names.
• Hashtag - Videos that contain a specific hashtag.

Sample Input

1{
2	"maxCommentsPerPost": 20,
3	"maxVideosPerPage": 20,
4	"proxyConfig": {
5	    "useApifyProxy": true
6	},
7	"profiles": [
8	    "khaby.lame"
9	],
10	"hashtags": [
11	    "tiktokshortfilm"
12	]
13}

Output

The output can be be set to contain or ignore comments to the videos.

Comments

The default output has been set to a maximum of 20 videos and 20 comments. Changing the number of maximum comments in the Input allows for increase/decrease the number of comments per video.

Sample output;

1{
2  "id": "7167271500058234139",
3  "desc": "Apa?? Ternyata pacarku kelly…😱@Kelly 🍒 #drama #dramatiktok #tiktokviral #tiktokshortfilm #romantis #romance #fyptiktok #anhong @Anhong Media International ",
4  "createTime": 1668760442,
5  "duetInfo": {
6    "duetFromId": "0"
7  },
8  "commentCount": 11400,
9  "diggCount": 3600000,
10  "playCount": 53200000,
11  "shareCount": 12900,
12  "originCover": "https://p16-sign-va.tiktokcdn.com/obj/tos-useast2a-p-0037-aiso/0ec5a3c9ecee4252a8927756e8ed51fd_1668760536?x-expires=1674644400&x-signature=CAoZ29sxfOTVVxJFyCB85ULqaTM%3D",
13  "streamVideoUrl": "https://v16-webapp-prime.us.tiktok.com/video/tos/useast2a/tos-useast2a-pve-0037-aiso/oIxKzhoWIKxQGvBsUA30dnfWAuUF2hN6PoAzFs/?a=1988&ch=0&cr=0&dr=0&lr=tiktok&cd=0%7C0%7C1%7C0&cv=1&br=2554&bt=1277&cs=0&ds=3&ft=4KJMyMzm8Zmo0aasI64jVJhrdpWrKsdm&mime_type=video_mp4&qs=0&rc=PDY0aTY8NDplN2Q5NGllM0BpM3dyM2k6ZnBuZzMzZjgzM0AzMzZfY2E1NS4xYl8uMWJiYSNeYC8ycjQwMm9gLS1kL2Nzcw%3D%3D&expire=1674645146&l=202301250510008F7B77C1CFC2DD10507B&policy=2&signature=52d71b82952a38650f479efd76a53b9c&tk=tt_chain_token",
14  "videoUrl": "https://www.tiktok.com/@mrdanielwille/video/7167271500058234139",
15  "downloadAddress": "https://v16-webapp-prime.us.tiktok.com/video/tos/useast2a/tos-useast2a-pve-0037-aiso/oIxKzhoWIKxQGvBsUA30dnfWAuUF2hN6PoAzFs/?a=1988&ch=0&cr=0&dr=0&lr=tiktok&cd=0%7C0%7C1%7C0&cv=1&br=2554&bt=1277&cs=0&ds=3&ft=4KJMyMzm8Zmo0aasI64jVJhrdpWrKsdm&mime_type=video_mp4&qs=0&rc=PDY0aTY8NDplN2Q5NGllM0BpM3dyM2k6ZnBuZzMzZjgzM0AzMzZfY2E1NS4xYl8uMWJiYSNeYC8ycjQwMm9gLS1kL2Nzcw%3D%3D&expire=1674645146&l=202301250510008F7B77C1CFC2DD10507B&policy=2&signature=52d71b82952a38650f479efd76a53b9c&tk=tt_chain_token",
16  "subtitleInfos": [
17    {
18      "Format": "webvtt",
19      "LanguageCodeName": "ind-ID",
20      "LanguageID": "23",
21      "Size": 2916,
22      "Source": "ASR",
23      "Url": "https://v16m-webapp.tiktokcdn-us.com/a9ba3accff466fb8a4d944bc469c7d96/63d10e9a/video/tos/useast2a/tos-useast2a-pv-0037-aiso/d60dcf7113054125887c8b9c89caa1c8/?a=1988&ch=0&cr=0&dr=0&lr=tiktok&cd=0%7C0%7C1%7C0&cv=1&br=20216&bt=10108&cs=0&ds=4&ft=4KLMeMzm8Zmo0aasI64jVJhrdpWrKsdm&mime_type=video_mp4&qs=13&rc=M3dyM2k6ZnBuZzMzZjgzM0BpM3dyM2k6ZnBuZzMzZjgzM0BeYC8ycjQwMm9gLS1kL2NzYSNeYC8ycjQwMm9gLS1kL2Nzcw%3D%3D&l=202301250510008F7B77C1CFC2DD10507B",
24      "UrlExpire": 1674645146,
25      "Version": "1",
26      "VideoSubtitleID": 1315104337
27    }
28  ],
29  "format": "mp4",
30  "shareCover": [
31    "",
32    "https://p16-sign-va.tiktokcdn.com/tos-useast2a-p-0037-aiso/0ec5a3c9ecee4252a8927756e8ed51fd_1668760536~tplv-tiktok-play.jpeg?x-expires=1675227600&x-signature=NYwd8Vs7bJ3Lhj6hXalHdA8TQ9U%3D",
33    "https://p16-sign-va.tiktokcdn.com/tos-useast2a-p-0037-aiso/0ec5a3c9ecee4252a8927756e8ed51fd_1668760536~tplv-tiktokx-share-play.jpeg?x-expires=1675227600&x-signature=%2F7904J0FVZ994cbFCSwA1Sbfmrk%3D"
34  ],
35  "authorInfo": {
36    "avatarLarger": "https://p16-sign-va.tiktokcdn.com/tos-useast2a-avt-0068-giso/3577672cbac84a1508af092fcfa36922~c5_1080x1080.jpeg?x-expires=1674795600&x-signature=MduKVqV%2FbBevOY%2BcZvBHTTs74WU%3D",
37    "avatarMedium": "https://p16-sign-va.tiktokcdn.com/tos-useast2a-avt-0068-giso/3577672cbac84a1508af092fcfa36922~c5_720x720.jpeg?x-expires=1674795600&x-signature=oieGs9%2BWFW4wmtKdFywzp5qrLHY%3D",
38    "avatarThumb": "https://p16-sign-va.tiktokcdn.com/tos-useast2a-avt-0068-giso/3577672cbac84a1508af092fcfa36922~c5_100x100.jpeg?x-expires=1674795600&x-signature=rnzcrz6Khvkyq6MVXSAOAhxEoSc%3D",
39    "commentSetting": 0,
40    "downloadSetting": 0,
41    "duetSetting": 0,
42    "ftc": false,
43    "id": "7079634028320179227",
44    "isADVirtual": false,
45    "isEmbedBanned": false,
46    "nickname": "mrdanielwille",
47    "openFavorite": false,
48    "privateAccount": false,
49    "relation": 0,
50    "secUid": "MS4wLjABAAAARaGT-NJ_7ETosv8GdNB_lohxK-O7evzvfPxLm-Mi12hhk_uicQW1bVA6xynLvaEj",
51    "secret": false,
52    "signature": "Di-follow ya akun IG kita🤗\nDM for business inquiries",
53    "stitchSetting": 0,
54    "ttSeller": false,
55    "uniqueId": "mrdanielwille",
56    "verified": false,
57    "diggCount": 756,
58    "followerCount": 2100000,
59    "followingCount": 15,
60    "heart": 53400000,
61    "heartCount": 53400000,
62    "videoCount": 217
63  },
64  "musicInfo": {
65    "album": "Dino Song",
66    "authorName": "Mr. Popolo",
67    "coverLarge": "https://p16-sg.tiktokcdn.com/aweme/720x720/tos-alisg-v-2774/f14e4f0561c14962b7686f0f8d928cc5.jpeg",
68    "coverMedium": "https://p16-sg.tiktokcdn.com/aweme/200x200/tos-alisg-v-2774/f14e4f0561c14962b7686f0f8d928cc5.jpeg",
69    "coverThumb": "https://p16-sg.tiktokcdn.com/aweme/100x100/tos-alisg-v-2774/f14e4f0561c14962b7686f0f8d928cc5.jpeg",
70    "duration": 31,
71    "id": "7036910067001591810",
72    "original": false,
73    "playUrl": "https://sf16-ies-music-sg.tiktokcdn.com/obj/tos-alisg-ve-2774/oYBRUbPcQDWDxxjBX6jtSniBioeRQPYbgCEeUZ",
74    "title": "Dino Song"
75  },
76  "isAd": false,
77  "adAuthorization": false,
78  "adLabelVersion": 0,
79  "hashtags": [
80    {
81      "hashtagId": "5673",
82      "hashtagName": "drama"
83    },
84    {
85      "hashtagId": "1589208482678785",
86      "hashtagName": "dramatiktok"
87    },
88    {
89      "hashtagId": "86427221",
90      "hashtagName": "tiktokviral"
91    },
92    {
93      "hashtagId": "1614906296858629",
94      "hashtagName": "tiktokshortfilm"
95    },
96    {
97      "hashtagId": "14081669",
98      "hashtagName": "romantis"
99    },
100    {
101      "hashtagId": "57155",
102      "hashtagName": "romance"
103    },
104    {
105      "hashtagId": "1630284807035909",
106      "hashtagName": "fyptiktok"
107    },
108    {
109      "hashtagId": "67447817",
110      "hashtagName": "anhong"
111    }
112  ],
113  "challenges": [
114    {
115      "id": "5673",
116      "title": "drama",
117      "desc": "",
118      "profileThumb": "",
119      "coverThumb": "",
120      "isCommerce": false,
121      "stats": {
122        "videoCount": 0,
123        "viewCount": 0
124      }
125    },
126    {
127      "id": "1589208482678785",
128      "title": "dramatiktok",
129      "desc": "",
130      "profileThumb": "",
131      "coverThumb": "",
132      "isCommerce": false,
133      "stats": {
134        "videoCount": 0,
135        "viewCount": 0
136      }
137    },
138    {
139      "id": "86427221",
140      "title": "tiktokviral",
141      "desc": "",
142      "profileThumb": "",
143      "coverThumb": "",
144      "isCommerce": false,
145      "stats": {
146        "videoCount": 0,
147        "viewCount": 0
148      }
149    },
150    {
151      "id": "1614906296858629",
152      "title": "tiktokshortfilm",
153      "desc": "To celebrate our partnership with Cannes International Film Festival, we invite you to join our global #TikTokShortFilm competition. \n\nFrom March 15th to April 8th, create and submit your scripted vertical short film (from 30 seconds to 3 minutes) for a chance to win a trip to Cannes International Film Festival and a cash prize up to 10.000 Euros. The 3 finalists, selected amongst 3 awards by renowned judges, will also have the chance to travel to Cannes to receive their prize during our TikTok Awards Ceremony, and attend exclusive screenings during the Festival. No matter your budget or your experience, we want to see your talent and creativity. \n\nTo enter the competition and submit your video, please make sure to follow all the necessary steps, consult Terms & Conditions and Video Requirements here: https://zjsms.com/NBj9YLj/",
154      "profileThumb": "https://p16-amd-va.tiktokcdn.com/obj/musically-maliva-obj/25350af495e36baa1bdf5d5865902bbf.png",
155      "coverThumb": "",
156      "isCommerce": false,
157      "stats": {
158        "videoCount": 0,
159        "viewCount": 0
160      }
161    },
162    {
163      "id": "14081669",
164      "title": "romantis",
165      "desc": "",
166      "profileThumb": "",
167      "coverThumb": "",
168      "isCommerce": false,
169      "stats": {
170        "videoCount": 0,
171        "viewCount": 0
172      }
173    },
174    {
175      "id": "57155",
176      "title": "romance",
177      "desc": "",
178      "profileThumb": "",
179      "coverThumb": "",
180      "isCommerce": false,
181      "stats": {
182        "videoCount": 0,
183        "viewCount": 0
184      }
185    },
186    {
187      "id": "1630284807035909",
188      "title": "fyptiktok",
189      "desc": "",
190      "profileThumb": "",
191      "coverThumb": "",
192      "isCommerce": false,
193      "stats": {
194        "videoCount": 0,
195        "viewCount": 0
196      }
197    },
198    {
199      "id": "67447817",
200      "title": "anhong",
201      "desc": "",
202      "profileThumb": "",
203      "coverThumb": "",
204      "isCommerce": false,
205      "stats": {
206        "videoCount": 0,
207        "viewCount": 0
208      }
209    }
210  ],
211  "warnInfo": [],
212  "originalItem": false,
213  "officalItem": false,
214  "comments": [
215    {
216      "cid": "7177241965708493595",
217      "text": "lks support",
218      "aweme_id": "7167271500058234139",
219      "create_time": 1671081889,
220      "comment_language": "en",
221      "digg_count": 0,
222      "reply_comment_total": 0,
223      "share_info": {
224        "url": "https://m.tiktok.com/v/7167271500058234139.html?_d=e64fck7c57i4e5&comment_author_id=7167311497546236954&language=ja-JP&preview_pb=0&share_comment_id=7177241965708493595&share_item_id=7167271500058234139&source=h5_m&u_code=0",
225        "acl": {
226          "code": 1,
227          "extra": "{\"item_share_acl\":\"empty item value\"}"
228        },
229        "desc": "juragan.sellerindoのコメント: lks support",
230        "title": "Apa?? Ternyata pacarku kelly…😱@Kelly 🍒 #drama #dramatiktok #tiktokviral #tiktokshortfilm #romantis #romance #fyptiktok #anhong @Anhong Media International "
231      },
232      "user": {
233        "uid": "7167311497546236954",
234        "unique_id": "juragan.sellerindo",
235        "nickname": "juragan.sellerindo"
236      }
237    }
238  ],
239  "secret": false,
240  "shareEnabled": true,
241  "showNotPass": false,
242  "forFriend": false
243}

Requirements

The actor requires access to proxies (.i.e proxies provided by Apify or custom proxies provided by the user).

Changelog

All notable changes to this project will be documented in this section. There are no breaking changes to the project.

Added

• Added an optional input field simplifyComments that simplifies the comments. When the input field is enabled the decrease structure of comments is replaced with the format

1{
2    "cid": "7118984082901631770",
3    "text": "Khaby you are legend...And love from Nepal❤️",
4    "uid": "7115738522267632646",
5    "unique_id": "pra.jwol",
6    "nickname": "Lol"
7}

• Added an optional input field earliestDate that is used to filter videos posted after the latest Date of Oldest Video

• Fixed a bug with post engagement data.