# Kickstarter Comments Scraper 💬 (`shahidirfan/kickstarter-comments-scraper`) Actor Scrape all campaign comments, backer feedback & engagement data from Kickstarter projects. Extract commenter names, timestamps, replies & sentiment. Ideal for market research, campaign analysis, founder insights, competitor tracking & crowdfunding trends. CSV/JSON ready. - **URL**: https://apify.com/shahidirfan/kickstarter-comments-scraper.md - **Developed by:** [Shahid Irfan](https://apify.com/shahidirfan) (community) - **Categories:** Developer tools, Automation, Other - **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Kickstarter Comments Scraper Extract public comments from Kickstarter project pages with fast, reliable data collection. This scraper collects comment text, timestamps, author details, project details, creator information, badge indicators, and pagination-aware comment history for research, monitoring, and analysis. ### Features - **Project comment extraction** - Collect comments from Kickstarter project or comments URLs. - **Flexible URL support** - Use project pages, comments pages, numeric Kickstarter URLs, or signed comments URLs. - **Pagination handling** - Continue through comment pages until your requested result count or page limit is reached. - **Clean dataset output** - Empty and unavailable values are skipped so exports stay tidy. - **Author and project context** - Include author names, badges, avatar links, project names, project state, and creator details. --- ### Use Cases #### Campaign Sentiment Research Analyze backer reactions across a Kickstarter campaign. Track recurring questions, concerns, praise, delivery expectations, and creator response patterns. #### Product Feedback Analysis Collect public comments for board games, gadgets, books, films, or other Kickstarter categories. Use the data to understand what backers value before launching a similar project. #### Creator Monitoring Monitor comment activity for active or completed campaigns. Keep a structured record of public community discussion for reporting, support planning, or competitive research. #### Market Intelligence Compare public discussion across multiple campaigns. Identify common objections, frequently requested features, fulfillment concerns, and community language around a niche. --- ### Input Parameters | Parameter | Type | Required | Default | Description | |-----------|------|----------|---------|-------------| | `startUrl` | String | Yes | - | Kickstarter project URL, comments URL, numeric comments URL, or signed comments URL. | | `results_wanted` | Integer | No | `20` | Maximum number of comments to collect. | | `max_pages` | Integer | No | `10` | Maximum number of comment pages to fetch. Kickstarter usually returns 10 comments per page. | | `proxyConfiguration` | Object | No | Apify Proxy | Proxy settings for cloud runs. | --- ### Output Data Each item in the dataset can contain: | Field | Type | Description | |-------|------|-------------| | `comment_id` | Integer | Kickstarter comment identifier. | | `body` | String | Public comment text. | | `created_at` | String | Comment creation time in ISO 8601 format. | | `created_at_timestamp` | Integer | Original Kickstarter timestamp. | | `deleted_at` | String | Comment deletion time, when available. | | `next_comment_id` | Integer | Cursor-related comment identifier, when provided. | | `project_id` | Integer | Kickstarter project identifier. | | `project_name` | String | Project name. | | `project_slug` | String | Project slug. | | `project_state` | String | Project state, such as live, successful, or canceled. | | `project_url` | String | Public project URL. | | `comments_count` | Integer | Total public comment count shown by Kickstarter. | | `creator_id` | Integer | Project creator identifier. | | `creator_name` | String | Project creator display name. | | `creator_slug` | String | Project creator slug. | | `author_id` | Integer | Comment author identifier. | | `author_name` | String | Comment author display name. | | `author_is_superbacker` | Boolean | Whether the author has a Superbacker badge. | | `author_has_admin_message_badge` | Boolean | Whether Kickstarter marks the author with an admin message badge. | | `author_partner_badge` | String | Partner badge value, when present. | | `author_backing_action_count` | Integer | Author backing action count, when present. | | `author_avatar_thumb` | String | Thumbnail avatar URL. | | `author_avatar_small` | String | Small avatar URL. | | `author_avatar_medium` | String | Medium avatar URL. | --- ### Usage Examples #### Project Comments Page Collect the first 20 comments from a Kickstarter comments page: ```json { "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time/comments", "results_wanted": 20, "max_pages": 10 } ```` #### Project Page URL Start from the main campaign page and let the actor find the comment feed: ```json { "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time", "results_wanted": 50, "max_pages": 5 } ``` #### Numeric Kickstarter URL Use Kickstarter's numeric project URL format: ```json { "startUrl": "https://www.kickstarter.com/projects/1132381565/1904466044/comments", "results_wanted": 30, "max_pages": 3 } ``` *** ### Sample Output ```json { "comment_id": 47698431, "body": "Will late pledges be available after the campaign?", "created_at": "2026-07-20T14:24:12.000Z", "created_at_timestamp": 1784557452, "project_id": 1904466044, "project_name": "War of the Dragon: The Wheel of Time", "project_slug": "war-of-the-dragon-the-wheel-of-time", "project_state": "successful", "project_url": "https://www.kickstarter.com/projects/direwolf/war-of-the-dragon-the-wheel-of-time", "comments_count": 862, "creator_id": 1132381565, "creator_name": "Dire Wolf", "author_id": 12345678, "author_name": "Example Backer", "author_is_superbacker": true, "author_avatar_thumb": "https://i.kickstarter.com/assets/example_thumb.jpg" } ``` *** ### Tips for Best Results #### Use Public Campaign URLs - Use a Kickstarter project URL or comments URL that opens in a normal browser. - For active campaigns, keep `max_pages` modest when testing. - Increase `results_wanted` only after a small run succeeds. #### Balance Page Limits - Kickstarter usually returns 10 comments per page. - Set `max_pages` high enough for your target result count. - If `results_wanted` is `100`, use at least `10` pages. #### Export Clean Data - Use JSON for raw analysis workflows. - Use CSV or Excel for spreadsheet review. - Empty source values are skipped, so columns may vary when Kickstarter does not provide a field. #### Proxy Configuration For Apify cloud runs, residential proxies are recommended: ```json { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` *** ### Integrations Connect your data with: - **Google Sheets** - Review campaign comments with your team. - **Airtable** - Build searchable campaign research databases. - **Slack** - Send run notifications to a workspace. - **Webhooks** - Deliver results to your own endpoint. - **Make** - Automate comment monitoring workflows. - **Zapier** - Trigger actions from completed runs. #### Export Formats - **JSON** - For developers and data pipelines. - **CSV** - For spreadsheet analysis. - **Excel** - For business reporting. - **XML** - For system integrations. *** ### Frequently Asked Questions #### Can I scrape any Kickstarter project comments? Yes, you can collect public comments from Kickstarter project pages that are accessible without logging in. #### Can I use a normal project URL instead of a comments URL? Yes, the actor accepts the main project URL and automatically resolves the related comments feed. #### How many comments can I collect? You can collect as many public comments as the campaign provides, subject to your `results_wanted` and `max_pages` settings. #### Why do some output fields not appear on every item? Some fields are only present when Kickstarter provides them for that comment, author, or project. Empty values are skipped to keep the dataset clean. #### Does this actor collect private backer data? No, it only collects public comment and profile information that Kickstarter exposes on accessible campaign pages. *** ### Support For issues or feature requests, contact support through the Apify Console. #### Resources - [Apify Documentation](https://docs.apify.com/) - [API Reference](https://docs.apify.com/api/v2) - [Scheduling Runs](https://docs.apify.com/schedules) *** ### Legal Notice This actor is designed for legitimate data collection purposes. Users are responsible for ensuring compliance with Kickstarter's terms of service and applicable laws. Use data responsibly and respect rate limits. # Actor input Schema ## `startUrl` (type: `string`): Kickstarter project or comments URL to scrape. ## `results_wanted` (type: `integer`): Maximum number of comments to collect. ## `max_pages` (type: `integer`): Maximum number of comment API pages to fetch. Kickstarter currently returns 10 comments per page. ## `proxyConfiguration` (type: `object`): Proxy settings. Apify Proxy can improve reliability on cloud runs. ## Actor input object example ```json { "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time/comments", "results_wanted": 20, "max_pages": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time/comments", "results_wanted": 20, "max_pages": 10 }; // Run the Actor and wait for it to finish const run = await client.actor("shahidirfan/kickstarter-comments-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time/comments", "results_wanted": 20, "max_pages": 10, } # Run the Actor and wait for it to finish run = client.actor("shahidirfan/kickstarter-comments-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrl": "https://www.kickstarter.com/projects/direwolfdigital/war-of-the-dragon-the-wheel-of-time/comments", "results_wanted": 20, "max_pages": 10 }' | apify call shahidirfan/kickstarter-comments-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=shahidirfan/kickstarter-comments-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Kickstarter Comments Scraper 💬", "description": "Scrape all campaign comments, backer feedback & engagement data from Kickstarter projects. Extract commenter names, timestamps, replies & sentiment. Ideal for market research, campaign analysis, founder insights, competitor tracking & crowdfunding trends. CSV/JSON ready.", "version": "0.0", "x-build-id": "4SOANVAma7cqAm8I5" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/shahidirfan~kickstarter-comments-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-shahidirfan-kickstarter-comments-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/shahidirfan~kickstarter-comments-scraper/runs": { "post": { "operationId": "runs-sync-shahidirfan-kickstarter-comments-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/shahidirfan~kickstarter-comments-scraper/run-sync": { "post": { "operationId": "run-sync-shahidirfan-kickstarter-comments-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrl" ], "properties": { "startUrl": { "title": "Kickstarter URL", "type": "string", "description": "Kickstarter project or comments URL to scrape." }, "results_wanted": { "title": "Results wanted", "minimum": 1, "type": "integer", "description": "Maximum number of comments to collect.", "default": 20 }, "max_pages": { "title": "Max pages", "minimum": 1, "type": "integer", "description": "Maximum number of comment API pages to fetch. Kickstarter currently returns 10 comments per page.", "default": 10 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Proxy settings. Apify Proxy can improve reliability on cloud runs.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```