XiaoHongShu Profile Scraper / 小红书个人资料爬虫

This scraper can get data from xiaohongshu user profile. / 该爬虫可以从小红书用户个人资料页面获取数据。

Features / 功能

• Get useful data from user profile page like https://www.xiaohongshu.com/user/profile/577285526a6a697c22af03fe / 从用户个人资料页面获取有用数据，例如：https://www.xiaohongshu.com/user/profile/577285526a6a697c22af03fe
• Get useful data from user post detail page / 从用户帖子详情页面获取有用数据
• Can filter data by date-range / 可按日期范围过滤数据

Usage Tips / 使用技巧

• To get cover images, set download_image parameter to true. Images will be saved as <date>_cover_<post_id>.webp / 要获取封面图片，请将 download_image 参数设置为 true。图片将保存为 <date>_cover_<post_id>.webp
• For tags, date and location information, enable scrape_detail_page and provide cookies (JSON format) / 要获取标签、日期和位置信息，请启用 scrape_detail_page 并提供 cookies（JSON 格式）

Exporting Cookies / 导出 Cookie

Using Browser Developer Tools / 使用浏览器开发者工具

1. Open browser and navigate to target website / 打开浏览器并导航到目标网站
2. Access developer tools (F12 or right-click → Inspect) / 访问开发者工具（F12 或右键单击 → 检查）
3. Go to Application tab → Storage → Cookies / 转到应用程序选项卡 → 存储 → Cookie
4. Select 'web_session' → right-click value → export or copy manually / 选择web_session → 右键单击 值→ 手动复制

Recommended Tools / 推荐工具

• EditThisCookie: Browser extension for easy cookie export / 用于轻松导出 Cookie 的浏览器扩展
• Cookie-Editor: Another versatile cookie export tool / 另一个多功能 Cookie 导出工具

Example Configuration / 示例配置

1{
2  "scrape_detail_page": true,
3  "cookie_val":"...",
4}

Data Examples / 数据示例

Profile Page / 个人资料页面

Post Detail Page / 帖子详情页面

Scraped Data / 抓取的数据

Data Format / 数据格式

1[
2  {
3    "id": "655bfa160000000032009e1a",
4    "cover": "http://sns-webpic-qc.xhscdn.com/202311212112/629ecb62902a91998666e62eee403d23/1040g00830rnggn8q2e004btv5lp801r86pu2s2o!nc_n_webp_mw_1format/jpg",
5    "title": "粉条豆腐包",
6    "url": "https://www.xiaohongshu.com/user/profile/5bfb3280e7444b0001520768/655bfa160000000032009e1a",
7    "num_count": "9",
8    "top_tag": false,
9    "author": "小楼（美食日记）",
10    "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/60a5f35a957c7c083b9b97aa.jpg?imageView2/2/w/540/format/webp|imageMogr2/strip2",
11    "author_url": "https://www.xiaohongshu.com/user/profile/5bfb3280e7444b0001520768",
12    "desc": "冬天怎么能少得了一锅香喷喷的粉条豆腐包呢，你也赶紧去试试吧",
13    "tags": [
14      "豆腐粉条包子话题可以点击搜索啦~",
15      "粉条豆腐包",
16      "豆腐包子"
17    ],
18    "date": "2023-11-21",
19    "location": "四川",
20    "video": "https://sns-video-bd.xhscdn.com/stream/110/258/01e55bf9d67fb0a1010370038bef498eda_258.mp4"
21  }
22]