XiaoHongShu Profile Scraper avatar
XiaoHongShu Profile Scraper

Pricing

$20.00/month + usage

Go to Store
XiaoHongShu Profile Scraper

XiaoHongShu Profile Scraper

Developed by

kuai ma

kuai ma

Maintained by Community

本工具可以处理小红书用户页数据及其发表的文章详情页数据。[小红书](https://www.xiaohongshu.com/) is a famous social e-commerce platform that combines user-generated content with online shopping, catering to the needs of young Chinese consumers. This scraper can get data from xiaohongshu user profile and detail pages.

0.0 (0)

Pricing

$20.00/month + usage

6

Total users

174

Monthly users

10

Runs succeeded

98%

Last modified

21 days ago

BN

startUrls input not working

Closed

billy_nmg opened this issue
2 years ago

After changing the value of startUrls, the crawling result still be the default profile value

kuaima avatar

kuai ma (kuaima)

2 years ago

what's starturl you used? Give me example starturl or your running url, let me check.

BN

billy_nmg

2 years ago

here is my code snippet:

const input = {
startUrls: [
{
url: "https://www.xiaohongshu.com/user/profile/5bfb3280e7444b0001520768",
},
],
scrape_detail_page: false,
download_image: false,
};
// Run the Actor and wait for it to finish
const run = await client.actor("kuaima/xiaohongshu-profile").call(input);
kuaima avatar

kuai ma (kuaima)

2 years ago

I'm try this url now. By the way, is this your first time use this scraper?

kuaima avatar

kuai ma (kuaima)

2 years ago

do some update, try the latest version again. Let me know if it works for you.

BN

billy_nmg

2 years ago

Yes, first time use this scraper.

kuaima avatar

kuai ma (kuaima)

2 years ago

Do you try the latest version I just updated. I think it should work for your url now.

BN

billy_nmg

2 years ago

It works now. One more question, can the scraper get the video link in profile page also?

kuaima avatar

kuai ma (kuaima)

2 years ago

It can get the video link if it's a video. But I need double check, maybe it need some adjust. It will be helpful if you can provide some sample profile link which include video post.

kuaima avatar

kuai ma (kuaima)

2 years ago

Get it. I'll try this profile first.

kuaima avatar

kuai ma (kuaima)

2 years ago

add video link support now. Just need configure input parameter scrape_detail_page to true.

BN

billy_nmg

2 years ago

Thanks, video link works fine. Would scraper support fetch notes by Date range or by page or the default scraping behaviour will try to get all notes from profile?

kuaima avatar

kuai ma (kuaima)

2 years ago

Filter notes by date range is possible. It need some logic change and code flow change. I'll try it later.

kuaima avatar

kuai ma (kuaima)

2 years ago

It's now can filter by date range. Need enable scrape_detail_page first. Let me know if it works.

If any other funtion or requirement, please open new issue to discuss about it.

kuaima avatar

kuai ma (kuaima)

2 years ago

Close this issue for problem solved.