# Douban Groups Discussion Scraper (`mrdoe/douban-groups-discussion-scraper`) Actor

- **URL**: https://apify.com/mrdoe/douban-groups-discussion-scraper.md
- **Developed by:** [MrDoe](https://apify.com/mrdoe) (community)
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.50 / 1,000 topic returneds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

![Douban Groups Discussion Scraper - Douban groups scraper showing trending discussion topics with like counts and group names](https://api.apify.com/v2/key-value-stores/kE36venAoVchGsE6b/records/douban-groups-discussion-scraper--hero.png)

### What does Douban Groups Discussion Scraper do?

Douban Groups Discussion Scraper reads Douban's cross-group discussion-highlights feed - the trending topics surfaced from across its thousands of interest groups - and returns each topic's title, like count, the group it came from, a text snippet, an image when the post has one, and a direct link, optionally filtered down to only topics matching keywords you give it.

### Why use Douban Groups Discussion Scraper?

- One feed covers trending discussion across thousands of separate Douban groups - no need to monitor each group individually.
- Like counts let you rank topics by actual engagement, not just recency.
- Keyword filtering narrows a broad trending feed to only the topics relevant to you.
- Snippets and images give enough context to judge relevance without opening every link.
- No account or API key.

### What makes this different

Douban's interest groups are a major source of organic Chinese consumer opinion, but there's no single search across all of them. This Actor reads the one feed Douban itself uses to surface what's trending across every group, so you get breadth without picking groups yourself.

### Who can use the Douban Groups Scraper and how?

- **Social listening teams:** Track what's trending in Chinese interest communities without monitoring dozens of groups by hand.
- **Market researchers:** Spot emerging consumer topics and sentiment shifts early.
- **Content creators:** Find trending discussion topics worth covering or responding to.
- **Brand monitoring:** Filter the feed by brand or product keywords to catch organic mentions.
- **Trend-tracking apps:** Feed a trending-topics widget from a reliable cross-group source.

### How it works

![Douban Groups Discussion Scraper workflow: your input, collection, output](https://api.apify.com/v2/key-value-stores/kE36venAoVchGsE6b/records/douban-groups-discussion-scraper--how-it-works.png)

1. **Your input** — set how many topics you want and, optionally, keywords to filter by
2. **The Actor collects it** — the Actor reads Douban's cross-group discussion-highlights feed, paginating until it has enough matching topics
3. **Your output** — you get one row per topic, newest and most prominent first

### What data can you extract?

The dataset has 9 fields per row:

| Field | Type | Description |
|---|---|---|
| `topicId` | string | Douban's internal topic ID. |
| `title` | string | Topic title. |
| `url` | string | Direct link to the discussion. |
| `likes` | number | Number of likes on the topic. |
| `groupName` | string | Name of the Douban group the topic came from. |
| `groupUrl` | string | Link to the source group. |
| `snippet` | string | Text preview of the topic's content. |
| `imageUrl` | string | Image URL, when the topic has one. |
| `publishedAtText` | string | Publish time as shown on Douban (relative or absolute). |

### How to use Douban Groups Discussion Scraper

![Douban Groups Discussion Scraper input form](https://api.apify.com/v2/key-value-stores/kE36venAoVchGsE6b/records/douban-groups-discussion-scraper--input.png)

1. Open the Actor and go to the **Input** tab.
2. Set Max Results, and optionally add Keywords to only keep matching topics.
3. Optionally set filters and a **Max results** limit.
4. Click **Start**. A default run finishes in under a minute.
5. Open the **Output** tab, then download the dataset or connect it to your tools.

### Input Parameters

| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| `maxResults` | integer | No | `20` | Maximum number of discussion topics to return, newest/most-featured first. Set to 0 for everything available in the feed. |
| `keywords` | array | No | `[]` | Only topics whose title or snippet mentions one of these words. |
| `proxyConfiguration` | object | No | `{"useApifyProxy":false}` | Optional. The data is public and works without a proxy. |

### Output Data

![Douban Groups Discussion Scraper dataset table](https://api.apify.com/v2/key-value-stores/kE36venAoVchGsE6b/records/douban-groups-discussion-scraper--output.png)

Each row is one trending discussion topic: its title, like count, source group, a text snippet, an image URL when available, and a direct link.

![Douban Groups Discussion Scraper field map of one record](https://api.apify.com/v2/key-value-stores/kE36venAoVchGsE6b/records/douban-groups-discussion-scraper--fields.png)

A real dataset item:

```json
{
  "type": "topic",
  "topicId": "502243023",
  "title": "舍弃性缘脑",
  "url": "https://www.douban.com/group/topic/502243023/",
  "likes": 17,
  "groupName": "主体性复建计划小组",
  "groupUrl": "https://www.douban.com/group/754422/",
  "snippet": "在女性普遍精致美丽的大流行里，舍弃性缘脑吧！\n         以前很长一段时间总会觉得任何异性靠近我所做的一举一动都是对我有意思，但现在发现完全错误，而且性缘脑让我没办法和异性好好相处...",
  "imageUrl": "https://img3.doubanio.com/view/group_topic/small/public/p749661770.jpg",
  "publishedAtText": "今天12:09",
  "scrapedAt": "2026-10-16T05:22:19.118Z"
}
```

### Usage Examples

#### Top 20 trending topics

```json
{
  "maxResults": 20
}
```

#### Filter by keyword

```json
{
  "maxResults": 50,
  "keywords": [
    "电影",
    "职场"
  ]
}
```

### Tips for Best Results

- Use specific keywords (brand names, product terms) rather than broad ones to keep results relevant.
- Run it on a schedule to build a trend history over time, since the feed itself only shows what's currently trending.
- Default is 5 results for a fast test. Set the max to 0 to return everything available.

### Known Limitations

- The feed reflects what Douban currently surfaces as trending, not an exhaustive list of all group posts.
- Keyword filtering only matches against the title and snippet text actually shown in the feed.

### Integrations

Run it from the Apify API, on a schedule, or from a webhook. Send results straight to Google Sheets, Make, Zapier, Slack or your own database with Apify's built-in integrations.

### Export Formats

Download the dataset as JSON, CSV, Excel, XML, HTML table or RSS from the **Output** tab or the API.

### Frequently Asked Questions

#### Does it need a Douban login?

No. The Actor reads Douban's public discussion-highlights feed and needs no account or key.

#### Can I search for a specific group?

This Actor reads the cross-group trending feed and filters it by keyword; it doesn't target one specific group by name.

#### How far back does the feed go?

Douban's highlights feed is a rolling window of a few hundred recent trending topics, not a full historical archive.

#### Do I need an account or login?

No. The Actor reads public data and needs no account or key.

#### Am I charged for failed runs or empty results?

You are only charged for results that are actually written to the dataset.

#### Can I run it on a schedule?

Yes. Create a Task with your input and add a schedule in Apify Console. With monitor mode on, each scheduled run returns only what changed since the previous one.

### Enterprise and custom work

Need higher volumes, a custom output schema, dedicated scheduling or a no-breaking-changes commitment for a production pipeline? Open an issue on the Actor page and describe your use case. Bulk terms and custom builds are available.

### Support

Questions or a missing field? Open an issue from the **Issues** tab on this Actor's page and it will be looked at.

### Legal / Responsible Use

You are responsible for using the data in line with the source's terms and applicable law. The Actor collects publicly available data only and is not affiliated with the source.

# Actor input Schema

## `maxResults` (type: `integer`):

Maximum number of discussion topics to return, newest/most-featured first. Set to 0 for everything available in the feed.

## `keywords` (type: `array`):

Only topics whose title or snippet mentions one of these words.

## `proxyConfiguration` (type: `object`):

Optional. The data is public and works without a proxy.

## Actor input object example

```json
{
  "maxResults": 20,
  "keywords": [],
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `results` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxResults": 20
};

// Run the Actor and wait for it to finish
const run = await client.actor("mrdoe/douban-groups-discussion-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxResults": 20 }

# Run the Actor and wait for it to finish
run = client.actor("mrdoe/douban-groups-discussion-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxResults": 20
}' |
apify call mrdoe/douban-groups-discussion-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,mrdoe/douban-groups-discussion-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/MfhKMzXoROWNHf9jy/builds/MOP3pQ2n6LBn1yMMP/openapi.json
