# Weibo Scraper - Hot Topics & Public Posts (`khadinakbar/weibo-scraper`) Actor Scrape Weibo hot topics without credentials, plus cookie-backed public Weibo keyword posts and user timelines into clean JSON datasets. - **URL**: https://apify.com/khadinakbar/weibo-scraper.md - **Developed by:** [Khadin Akbar](https://apify.com/khadinakbar) (community) - **Categories:** Social media, MCP servers, AI - **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $8.00 / 1,000 weibo records This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Weibo Scraper: Hot Topics and Public Posts Collect structured Weibo records for China-market research, social listening, and brand monitoring. Start with public hot topics for a compact trend dataset, then use an authorized Weibo session for keyword-post or user-timeline records with source URLs, public author metadata, engagement counts, media links, and collection time. ### Best fit for this Actor - Use `hotTopics` to monitor the public topics circulating on Weibo at collection time. - Use `searchPosts` to collect posts matching a set of Chinese or English keywords from an authorized Weibo session. - Use `userPosts` to collect the public timeline records for known numeric Weibo user IDs. - Choose a modest `maxResults` when an agent needs a concise research brief, or schedule bounded runs when a team needs a recurring trend feed. ### Focused standalone workflow This actor is designed as a focused standalone workflow for turning a Weibo trend, keyword set, or known user ID into a structured dataset. It works well as the collection step before an analyst groups topics, compares engagement, or passes source URLs and post text into a separate approved research process. ### China social-listening workflow A market researcher starts with `hotTopics` to see topics receiving attention in the public feed. They then select relevant terms, use `searchPosts` with their authorized session, and compare the returned text, engagement fields, and source URLs. Next, they can export the dataset for a report, a dashboard, or a downstream language-analysis workflow while preserving the collection time for provenance. ### Quick start input Public hot topics: ```json { "mode": "hotTopics", "maxResults": 25 } ```` Keyword posts from an authorized Weibo session: ```json { "mode": "searchPosts", "searchQueries": ["特斯拉", "OpenAI"], "maxResults": 50, "maxPages": 3, "weiboCookie": "SUB=_2A25example; SUBP=example" } ``` ### Input reference | Field | Type | What it controls | | --- | --- | --- | | `mode` | string | Selects `hotTopics`, `searchPosts`, or `userPosts`. The default is `hotTopics`. | | `searchQueries` | string array | One or more keyword queries for `searchPosts`, such as `特斯拉` or `OpenAI`. | | `userIds` | string array | Numeric user IDs or public profile URLs for `userPosts`, such as `2803301701`. | | `maxResults` | integer | Total number of dataset records to save, from 1 through 500. | | `maxPages` | integer | Number of mobile API pages to request for each search query or user ID, from 1 through 20. | | `weiboCookie` | secret string | Full `SUB=` cookie header from a Weibo session that you are authorized to use for search and timeline routes. | ### What data you receive Each dataset item represents one Weibo hot topic or public post at the time of collection. `recordType` identifies the item shape, and every item includes `sourceUrl` plus `scrapedAt` for inspection and provenance. | Field | Meaning | | --- | --- | | `recordType` | `hotTopic` or `post`. | | `topic`, `rank`, `query` | Public hot-topic label, feed order, and decoded query. | | `postId`, `bid`, `sourceUrl` | Stable post identifiers and a source URL. | | `authorName`, `authorId`, `authorVerified` | Public author metadata supplied by Weibo. | | `text`, `textHtml` | Post content in plain text and source HTML. | | `likesCount`, `commentsCount`, `repostsCount` | Engagement fields supplied at collection time. | | `pictures`, `videoUrl` | Public media URLs supplied by Weibo. | | `scrapedAt` | ISO 8601 collection timestamp. | Hot-topic record: ```json { "recordType": "hotTopic", "sourceUrl": "https://m.weibo.cn/search?containerid=100103type%3D1%26q%3DOpenAI", "topic": "#OpenAI#", "rank": 1, "query": "OpenAI", "isHashtag": true, "scrapedAt": "2026-07-19T12:00:00.000Z" } ``` Post record: ```json { "recordType": "post", "postId": "5050000000000000", "authorName": "People Daily", "text": "OpenAI 发布了新的模型更新。", "likesCount": 900, "commentsCount": 45, "sourceUrl": "https://m.weibo.cn/detail/5050000000000000", "scrapedAt": "2026-07-19T12:00:00.000Z" } ``` ### Use through the API ```bash curl -X POST "https://api.apify.com/v2/acts/khadinakbar~weibo-scraper/runs" \ -H "Authorization: Bearer YOUR_APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"mode":"hotTopics","maxResults":25}' ``` After execution completes, read the default dataset for records and the `OUTPUT` and `RUN_SUMMARY` key-value records for the terminal outcome, counts, warnings, and dataset identifier. ### Use with AI agents through Apify MCP Connect the Actor through the [Apify MCP integration](https://docs.apify.com/platform/integrations/mcp) and ask: > Collect the top 20 public Weibo hot topics, return the topic, rank, query, source URL, and collection time, then inspect the run outcome and dataset readback before preparing a concise China-market briefing. For a keyword or user-timeline job, an agent can use your authorized Weibo session, keep the `maxResults` scope aligned with the requested analysis, preserve `sourceUrl` and `scrapedAt` for provenance, and read the terminal outcome before using the dataset. ### Pricing This Actor uses Pay per event plus Apify platform usage. Open the live Pricing tab for current event details, then set an Apify run cost control that matches the number of records needed for the workflow. ### Best results - Start with `hotTopics` for a current public trend snapshot and use the returned `query` values to refine a later keyword collection. - Provide a fresh, authorized `SUB=` cookie for search and user-timeline work, then keep `maxPages` focused on the time window that matters to the analysis. - Schedule bounded collections when tracking a recurring topic, and use `scrapedAt` together with `sourceUrl` when comparing snapshots over time. - Pair each dataset with the terminal `OUTPUT` and `RUN_SUMMARY` records so downstream tools can use the outcome and counts alongside the data. ### Builder's note I designed the default around the public `weibo.cn` hot-topic page after finding that it provides a useful compact trend surface for routine collection. My goal was to keep every returned item flat, source-linked, and timestamped so an analyst or agent can carry the data into a later research step with clear provenance. ### Responsible use Collect publicly visible data and session-backed data you are authorized to access. Use the Actor in line with applicable laws, privacy requirements, and Weibo terms. # Actor input Schema ## `mode` (type: `string`): Use this when choosing which Weibo data surface to scrape. Accepted values are hotTopics, searchPosts, and userPosts; the default hotTopics mode needs no cookie and is best for public trend monitoring. searchPosts runs Weibo keyword post search and userPosts reads public posts from numeric user IDs, both requiring weiboCookie. This is not a comments, fan-list, private profile, or login automation mode. ## `searchQueries` (type: `array`): Use this when mode is searchPosts and the user wants public Weibo posts matching one or more keywords, such as '特斯拉' or 'OpenAI'. Enter plain keywords or hashtag text without URL encoding; the Actor submits each query to Weibo's mobile search endpoint. Defaults are not used by hotTopics or userPosts. This is not a user ID list, profile URL list, or private-message search. ## `userIds` (type: `array`): Use this when mode is userPosts and the user provides numeric Weibo user IDs or profile URLs like '2803301701' or 'https://m.weibo.cn/u/2803301701'. The Actor normalizes supported URLs to numeric IDs before requesting post timelines. Provide one or more values and keep maxPages modest for reliable runs. This is not a username lookup, follower graph, or private account extractor. ## `maxResults` (type: `integer`): Maximum number of records to save across all requested Weibo sources. Enter an integer from 1 through 500; the default is 25. The Actor stops writing and charging after this cap, even if Weibo returns more data. This is a saved-record limit, not a guarantee that every query or user has that many public results. ## `maxPages` (type: `integer`): Maximum Weibo API pages to request per search query or user ID. Enter an integer from 1 through 20; the default is 3 to keep cookie-backed runs short and agent-friendly. This field is ignored by hotTopics because the public hot-topic page is a single feed. This is not a retry count or browser scroll setting. ## `weiboCookie` (type: `string`): Cookie header from your own authorized Weibo browser session containing SUB=. Required only for searchPosts and userPosts because those routes are login-gated by Weibo. Paste the full cookie header, not a password; the value is secret and is never written to the dataset or summary. This is not an Apify API token, proxy credential, or permission to scrape private content. ## Actor input object example ```json { "mode": "hotTopics", "searchQueries": [ "特斯拉" ], "userIds": [ "2803301701" ], "maxResults": 25, "maxPages": 3, "weiboCookie": "SUB=_2A25example; SUBP=example" } ``` # Actor output Schema ## `dataset` (type: `string`): Validated Weibo hot-topic and public-post records collected during this execution. ## `runSummary` (type: `string`): Detailed terminal diagnostics, counters, source outcomes, and execution metadata. ## `output` (type: `string`): Compact machine-readable outcome with record counts, billing counts, dataset ID, and warnings. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "hotTopics", "searchQueries": [ "特斯拉" ], "maxResults": 20, "maxPages": 2 }; // Run the Actor and wait for it to finish const run = await client.actor("khadinakbar/weibo-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "hotTopics", "searchQueries": ["特斯拉"], "maxResults": 20, "maxPages": 2, } # Run the Actor and wait for it to finish run = client.actor("khadinakbar/weibo-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "hotTopics", "searchQueries": [ "特斯拉" ], "maxResults": 20, "maxPages": 2 }' | apify call khadinakbar/weibo-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=khadinakbar/weibo-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Weibo Scraper - Hot Topics & Public Posts", "description": "Scrape Weibo hot topics without credentials, plus cookie-backed public Weibo keyword posts and user timelines into clean JSON datasets.", "version": "1.0", "x-build-id": "pe0MHe4QaReJTUxZM" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/khadinakbar~weibo-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-khadinakbar-weibo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/khadinakbar~weibo-scraper/runs": { "post": { "operationId": "runs-sync-khadinakbar-weibo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/khadinakbar~weibo-scraper/run-sync": { "post": { "operationId": "run-sync-khadinakbar-weibo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Scraping mode", "enum": [ "hotTopics", "searchPosts", "userPosts" ], "type": "string", "description": "Use this when choosing which Weibo data surface to scrape. Accepted values are hotTopics, searchPosts, and userPosts; the default hotTopics mode needs no cookie and is best for public trend monitoring. searchPosts runs Weibo keyword post search and userPosts reads public posts from numeric user IDs, both requiring weiboCookie. This is not a comments, fan-list, private profile, or login automation mode.", "default": "hotTopics" }, "searchQueries": { "title": "Search queries", "type": "array", "description": "Use this when mode is searchPosts and the user wants public Weibo posts matching one or more keywords, such as '特斯拉' or 'OpenAI'. Enter plain keywords or hashtag text without URL encoding; the Actor submits each query to Weibo's mobile search endpoint. Defaults are not used by hotTopics or userPosts. This is not a user ID list, profile URL list, or private-message search.", "items": { "type": "string" }, "default": [ "特斯拉" ] }, "userIds": { "title": "User IDs or profile URLs", "type": "array", "description": "Use this when mode is userPosts and the user provides numeric Weibo user IDs or profile URLs like '2803301701' or 'https://m.weibo.cn/u/2803301701'. The Actor normalizes supported URLs to numeric IDs before requesting post timelines. Provide one or more values and keep maxPages modest for reliable runs. This is not a username lookup, follower graph, or private account extractor.", "items": { "type": "string" }, "default": [] }, "maxResults": { "title": "Maximum records", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of records to save across all requested Weibo sources. Enter an integer from 1 through 500; the default is 25. The Actor stops writing and charging after this cap, even if Weibo returns more data. This is a saved-record limit, not a guarantee that every query or user has that many public results.", "default": 25 }, "maxPages": { "title": "Maximum pages per source", "minimum": 1, "maximum": 20, "type": "integer", "description": "Maximum Weibo API pages to request per search query or user ID. Enter an integer from 1 through 20; the default is 3 to keep cookie-backed runs short and agent-friendly. This field is ignored by hotTopics because the public hot-topic page is a single feed. This is not a retry count or browser scroll setting.", "default": 3 }, "weiboCookie": { "title": "Weibo SUB cookie", "type": "string", "description": "Cookie header from your own authorized Weibo browser session containing SUB=. Required only for searchPosts and userPosts because those routes are login-gated by Weibo. Paste the full cookie header, not a password; the value is secret and is never written to the dataset or summary. This is not an Apify API token, proxy credential, or permission to scrape private content." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```