Xiaohongshu (RED) Scraper 🔍

Overview 📋

A powerful and flexible scraper for RedNote(Xiaohongshu/小红书), one of China's largest social media and e-commerce platforms. This actor supports multiple scraping modes and can extract various types of data including search results, comments, user profiles, and user posts.

Features ⭐

• 🔎 Search Mode: Extract posts based on keywords
• 💬 Comment Mode: Collect comments from specific posts
• 👤 Profile Mode: Gather user profile information
• 📝 User Posts Mode: Scrape all posts from specific users
• 🤖 Anti-detection measures built-in
• ⚡ Fast and efficient data collection
• 🎯 Customizable maximum items limit

Use Cases 🎯

• Market Research
• Influencer Analysis
• Content Monitoring
• Trend Analysis
• Consumer Insights
• Competitive Analysis

Input Parameters 📝

Parameter	Type	Description
mode	String	Scraping mode: 'search', 'comment', 'profile', or 'userPosts'
keywords	Array	Keywords for search mode
postUrls	Array	Post URLs for comment mode
profileUrls	Array	Profile URLs for profile and userPosts modes
maxItems	Integer	Maximum number of items to scrape

Output Format 📊

The actor provides structured JSON data including:

• Post content and metadata
• User information
• Engagement metrics
• Timestamps
• Media URLs
• Location data (when available)

Limitations ⚠️

• Respects Xiaohongshu's rate limits
• Some content may require authentication
• Results may vary based on network conditions

Tips for Best Results 💡

1. Use reasonable maxItems values to avoid timeouts
2. Space out multiple runs to avoid rate limiting
3. Keep keywords specific for better search results
4. Regularly update your input URLs

Need help or have questions? Feel free to reach out! 🤝

search mode input Example

1{
2    "keywords": [
3        "ai"
4    ],
5    "maxItems": 20
6}

search mode output sample

1[
2    {
3        "keyword": "ai",
4        "item": {
5            "id": "670a46a50000000024017580",
6            "model_type": "note",
7            "note_card": {
8                "image_list": [
9                    {
10                        "height": 1660,
11                        "width": 1242,
12                        "info_list": [
13                            {
14                                "image_scene": "WB_DFT",
15                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1"
16                            },
17                            {
18                                "image_scene": "WB_PRV",
19                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1"
20                            }
21                        ]
22                    },
23                    {
24                        "width": 1242,
25                        "info_list": [
26                            {
27                                "image_scene": "WB_DFT",
28                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/cb13ef72141a0909ab3b57587bb769b6/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_mw_1"
29                            },
30                            {
31                                "image_scene": "WB_PRV",
32                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/b8d4bba0de0cb741ac7e8d376a23d288/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_prv_1"
33                            }
34                        ],
35                        "height": 1660
36                    },
37                    {
38                        "width": 1242,
39                        "info_list": [
40                            {
41                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6d4ef8a530523eebdcbb8e918b63e1b0/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_mw_1",
42                                "image_scene": "WB_DFT"
43                            },
44                            {
45                                "image_scene": "WB_PRV",
46                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/7122c7c99f28c5c2ed66ae4995b12680/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_prv_1"
47                            }
48                        ],
49                        "height": 1660
50                    },
51                    {
52                        "height": 1660,
53                        "width": 1242,
54                        "info_list": [
55                            {
56                                "image_scene": "WB_DFT",
57                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/458a8ee764c354d9dcffecc1b93c970c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_mw_1"
58                            },
59                            {
60                                "image_scene": "WB_PRV",
61                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/eac2bd35f2e92f3a2931a472eec4ee7c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_prv_1"
62                            }
63                        ]
64                    },
65                    {
66                        "info_list": [
67                            {
68                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/5e4c46ae972bdf4ebe01fea6627c1afa/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_mw_1",
69                                "image_scene": "WB_DFT"
70                            },
71                            {
72                                "image_scene": "WB_PRV",
73                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6a9fb402316da5ca0aa56ec49b5f537b/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_prv_1"
74                            }
75                        ],
76                        "height": 1660,
77                        "width": 1242
78                    },
79                    {
80                        "info_list": [
81                            {
82                                "image_scene": "WB_DFT",
83                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0cf93838983808e3f5fc0b88b12a2427/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_mw_1"
84                            },
85                            {
86                                "image_scene": "WB_PRV",
87                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/33c6bee6e587e28dea26e00bd5a08a41/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_prv_1"
88                            }
89                        ],
90                        "height": 1660,
91                        "width": 1242
92                    },
93                    {
94                        "height": 1660,
95                        "width": 1242,
96                        "info_list": [
97                            {
98                                "image_scene": "WB_DFT",
99                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0a4ae6466a84fa1e9e947cb3b4fd6894/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_mw_1"
100                            },
101                            {
102                                "image_scene": "WB_PRV",
103                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/a48ab77a62e1f4ac0b00be5c544212c2/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_prv_1"
104                            }
105                        ]
106                    },
107                    {
108                        "height": 1660,
109                        "width": 1242,
110                        "info_list": [
111                            {
112                                "image_scene": "WB_DFT",
113                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d8d9c0de7f30c85f4af984b6c62ac311/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_mw_1"
114                            },
115                            {
116                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/3c5083da80364fcb80dd8a26e4dddfbb/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_prv_1",
117                                "image_scene": "WB_PRV"
118                            }
119                        ]
120                    },
121                    {
122                        "height": 1660,
123                        "width": 1242,
124                        "info_list": [
125                            {
126                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d9823a69036cb4800208e8f9b588d7b8/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_mw_1",
127                                "image_scene": "WB_DFT"
128                            },
129                            {
130                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/4586583b89ac468f08155e2d5c3eee45/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_prv_1",
131                                "image_scene": "WB_PRV"
132                            }
133                        ]
134                    }
135                ],
136                "type": "normal",
137                "display_title": "国内AI工具推荐，亲测好用！",
138                "user": {
139                    "nick_name": "千寻AI部落",
140                    "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo3138f13q208005og26aok1l06olihpp8?imageView2/2/w/80/format/jpg",
141                    "user_id": "620232b1000000001000d406",
142                    "nickname": "千寻AI部落",
143                    "xsec_token": "ABaVqWXGkAIRf-8QqiYwjllFDByVIFaMhzHeALEsf6PWA="
144                },
145                "interact_info": {
146                    "liked": false,
147                    "liked_count": "13759"
148                },
149                "cover": {
150                    "width": 1242,
151                    "url_default": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1",
152                    "url_pre": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1",
153                    "height": 1660
154                }
155            },
156            "xsec_token": "AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4="
157        },
158        "link": "https://www.xiaohongshu.com/explore/670a46a50000000024017580?xsec_token=AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4=&xsec_source=pc_search&source=web_explore_feed",
159        "scrapedAt": "2025-01-17T03:06:58.355Z"
160    },
161    ...
162]

comment mode input Example

1{
2    "postUrls": [
3        "https://www.xiaohongshu.com/explore/6764f52c000000000900c655?xsec_token=ABQuGdhHV4zPI_3lR2iWdS9VxX_4RmI3bUSh394ppVitk=&xsec_source=pc_search&source=web_explore_feed"
4    ],
5    "maxItems": 30
6}

comment mode output sample

1[
2    {
3        "postUrl": "https://www.xiaohongshu.com/explore/6764f52c000000000900c655?xsec_token=ABQuGdhHV4zPI_3lR2iWdS9VxX_4RmI3bUSh394ppVitk=&xsec_source=pc_search&source=web_explore_feed",
4        "comment": {
5            "sub_comments": [
6                {
7                    "create_time": 1734965575000,
8                    "ip_location": "北京",
9                    "target_comment": {
10                        "id": "6764f606000000000e01f2e9",
11                        "user_info": {
12                            "xsec_token": "ABG61P7ExGt1pmyAe585yBJW-gjC5ysiJFg1Jg-g9AU7o=",
13                            "user_id": "66178cdc000000000d0248dd",
14                            "nickname": "coconut",
15                            "image": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31apbclo07c5g5pgnhje3ci6t4k8bcho?imageView2/2/w/120/format/jpg"
16                        }
17                    },
18                    "id": "67697946000000000d038642",
19                    "content": "111",
20                    "like_count": "1",
21                    "show_tags": [],
22                    "user_info": {
23                        "user_id": "5dbe41fc00000000010055d4",
24                        "nickname": "Julia",
25                        "image": "https://sns-avatar-qc.xhscdn.com/avatar/2b4cefbb01e0a0824f5c173dde7f98b2.jpg?imageView2/2/w/120/format/jpg",
26                        "xsec_token": "ABjd3DLnAEKK3w2_6aMwp6rShFyiq3XHPptA60BJ5yWJA="
27                    },
28                    "note_id": "6764f52c000000000900c655",
29                    "status": 0,
30                    "at_users": [],
31                    "liked": false
32                }
33            ],
34            "at_users": [],
35            "like_count": "7",
36            "sub_comment_cursor": "67697946000000000d038642",
37            "sub_comment_has_more": true,
38            "content": "28岁ai设计师一枚，工作了两年，最近不忙，打算带几个徒弟，教ai表情包接单，有电脑，18+，观🐷凭伦\"111\"就好啦！",
39            "show_tags": [
40                "is_author",
41                "user_top"
42            ],
43            "create_time": 1734669831000,
44            "note_id": "6764f52c000000000900c655",
45            "status": 4,
46            "user_info": {
47                "nickname": "coconut",
48                "image": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31apbclo07c5g5pgnhje3ci6t4k8bcho?imageView2/2/w/120/format/jpg",
49                "xsec_token": "ABG61P7ExGt1pmyAe585yBJW-gjC5ysiJFg1Jg-g9AU7o=",
50                "user_id": "66178cdc000000000d0248dd"
51            },
52            "ip_location": "湖南",
53            "sub_comment_count": "28",
54            "id": "6764f606000000000e01f2e9",
55            "liked": false
56        },
57        "scrapedAt": "2025-01-17T05:45:22.613Z"
58    },
59    ...
60]

profile mode input Example

1{
2    "profileUrls": [
3        "https://www.xiaohongshu.com/user/profile/6784ba7f00000000080191fb"
4    ]
5}

profile mode output sample

1[
2    {
3        "profileUrl": "https://www.xiaohongshu.com/user/profile/6784ba7f00000000080191fb",
4        "profileData": {
5            "basicInfo": {
6                "redId": "95435108495",
7                "gender": 2,
8                "ipLocation": "美国",
9                "desc": "时尚 | 美国老师\nfashion | teacher",
10                "imageb": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31ckhgbu3gu005ps4n9vi34frj3f5o2o?imageView2/2/w/540/format/webp",
11                "nickname": "hopeawinters",
12                "images": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo31ckhgbu3gu005ps4n9vi34frj3f5o2o?imageView2/2/w/360/format/webp"
13            },
14            "interactions": [
15                {
16                    "count": "40",
17                    "type": "follows",
18                    "name": "关注"
19                },
20                {
21                    "type": "fans",
22                    "name": "粉丝",
23                    "count": "206881"
24                },
25                {
26                    "name": "获赞与收藏",
27                    "count": "294998",
28                    "type": "interaction"
29                }
30            ],
31            "tags": [
32                {
33                    "name": "25岁",
34                    "tagType": "info"
35                }
36            ]
37        },
38        "scrapedAt": "2025-01-17T15:51:01.110Z"
39    },
40    ...
41]

userPosts mode input Example

1{
2    "profileUrls": [
3        "https://www.xiaohongshu.com/user/profile/639946a0000000002702b173"
4    ],
5    "maxItems": 50
6}

userPosts mode output sample

1[
2    {
3        "profileUrl": "https://www.xiaohongshu.com/user/profile/639946a0000000002702b173",
4        "postData": {
5            "postUrl": "https://www.xiaohongshu.com/explore/6789fdb1000000001c00d095?xsec_token=ABXpV9UyO95kLI6G51DaZsNZIBb3QfMn584SISV_F2QiE=&xsec_source=pc_user",
6            "type": "video",
7            "displayTitle": "只有穷人冬天的被窝才会噼里啪啦的",
8            "user": {
9                "nickName": "显眼包小涛",
10                "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/63994933d9b187973501cb7a.jpg",
11                "userId": "639946a0000000002702b173",
12                "nickname": "显眼包小涛"
13            },
14            "interactInfo": {
15                "liked": false,
16                "likedCount": "8794",
17                "sticky": false
18            },
19            "cover": {
20                "width": 694,
21                "url": "",
22                "traceId": "",
23                "infoList": [
24                    {
25                        "imageScene": "WB_PRV",
26                        "url": "http://sns-webpic-qc.xhscdn.com/202501180028/e8da355f0f66b93801735d44d2403f93/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_prv_1"
27                    },
28                    {
29                        "imageScene": "WB_DFT",
30                        "url": "http://sns-webpic-qc.xhscdn.com/202501180028/9a9667b8e0ea82be10f388b8c279d9d4/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_mw_1"
31                    }
32                ],
33                "urlPre": "http://sns-webpic-qc.xhscdn.com/202501180028/e8da355f0f66b93801735d44d2403f93/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_prv_1",
34                "urlDefault": "http://sns-webpic-qc.xhscdn.com/202501180028/9a9667b8e0ea82be10f388b8c279d9d4/spectrum/1040g0k031coeec8616005osp8qg9tcbj7tkmhh8!nc_n_webp_mw_1",
35                "fileId": "",
36                "height": 925
37            },
38            "noteId": "6789fdb1000000001c00d095",
39            "xsecToken": "ABXpV9UyO95kLI6G51DaZsNZIBb3QfMn584SISV_F2QiE="
40        },
41        "scrapedAt": "2025-01-17T16:28:25.191Z"
42    },
43    ...
44]