# Product Hunt Daily Products Scraper (`wsgcjj/product-hunt-scraper`) Actor

Scrape Product Hunt for daily/top products with votes, reviews, descriptions, and maker information. Perfect for competitive analysis, market research, and founder intelligence.

- **URL**: https://apify.com/wsgcjj/product-hunt-scraper.md
- **Developed by:** [陈俊杰](https://apify.com/wsgcjj) (community)
- **Categories:** Developer tools, AI
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Product Hunt Scraper — Apify Actor

[![Apify Actor](https://img.shields.io/badge/Apify-Actor-blue)](https://apify.com/)
[![Python](https://img.shields.io/badge/Python-3.14+-brightgreen)](https://python.org)

Scrape [Product Hunt](https://www.producthunt.com) for daily and top products, including upvotes, comment counts, descriptions, maker information, tags, and more. This actor is perfect for:

- **Competitive analysis** — track new product launches in your niche.
- **Market research** — discover trending products and categories.
- **Founder intelligence** — build lead lists of makers and their projects.
- **Content curation** — aggregate Product Hunt data for newsletters or dashboards.

---

### How it works

1. The actor sends a standard HTTP GET request to the Product Hunt collection page of your choice (e.g. `https://www.producthunt.com/tech`).
2. Product Hunt is built with **Next.js**, so the initial page state is serialised into a `<script id="__NEXT_DATA__">` tag.
3. The actor parses this JSON payload to extract products **without** needing a headless browser — making it fast and resource-efficient.
4. Each product is normalised, filtered (by minimum upvotes), limited, and pushed to the Apify dataset.

---

### Input parameters

| Field          | Type   | Default       | Description                                                              |
|----------------|--------|---------------|--------------------------------------------------------------------------|
| `date`         | string | today         | The date to scrape (YYYY-MM-DD). Used for reference; Product Hunt often returns currently featured products. |
| `collection`   | enum   | `tech`        | Which Product Hunt collection to scrape.                                 |
| `min_votes`    | int    | 0             | Minimum number of upvotes — products below this threshold are dropped.   |
| `limit`        | int    | 25            | Maximum number of products to return (capped at 100).                    |

#### Available collections

- `tech`
- `games`
- `podcasts`
- `books`
- `developer-tools`
- `artificial-intelligence`
- `all` (home page / trending)

---

### Example output

Each item in the dataset is a JSON object like this:

```json
{
  "name": "Not Diamond",
  "tagline": "The AI model router that improves every LLM output",
  "description": "Not Diamond automatically routes each query to the best LLM, saving costs and improving quality.",
  "url": "https://www.producthunt.com/posts/not-diamond",
  "slug": "not-diamond",
  "upvotes": 987,
  "comments_count": 42,
  "maker_name": "Tommy Sun",
  "thumbnail_url": "https://ph-files.imgix.net/...",
  "website_url": "https://notdiamond.ai",
  "tags": ["artificial-intelligence", "developer-tools", "open-source"],
  "featured_at": "2025-05-26T07:01:00Z",
  "id": "123456"
}
````

#### Field descriptions

| Field              | Type     | Description                                        |
|--------------------|----------|----------------------------------------------------|
| `name`             | string   | Product name                                       |
| `tagline`          | string   | Short one-line description                         |
| `description`      | string   | Full description (often same as tagline)           |
| `url`              | string   | Product Hunt post URL                              |
| `slug`             | string   | URL slug                                           |
| `upvotes`          | integer  | Number of upvotes ▲                                |
| `comments_count`   | integer  | Number of comments                                 |
| `maker_name`       | string   | Name of the first listed maker                     |
| `thumbnail_url`    | string   | Thumbnail image URL                                |
| `website_url`      | string   | Product's external website                         |
| `tags`             | array    | List of topic/category tags                        |
| `featured_at`      | string   | ISO 8601 timestamp when featured                   |
| `id`               | string   | Unique Product Hunt ID                             |

***

### Example usage (Apify client)

#### Python

```python
from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")

run_input = {
    "collection": "tech",
    "min_votes": 50,
    "limit": 10,
    "date": "2025-05-26",
}

run = client.actor("your-actor-id").call(run_input=run_input)
dataset_items = client.dataset(run["defaultDatasetId"]).list_items().items

for item in dataset_items:
    print(f"{item['name']} — ▲ {item['upvotes']} by {item['maker_name']}")
```

#### JavaScript / TypeScript

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const input = {
  collection: 'developer-tools',
  min_votes: 100,
  limit: 5,
};

const run = await client.actor('your-actor-id').call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();

items.forEach(item => {
  console.log(`${item.name} — ▲ ${item.upvotes}`);
});
```

***

### Local development

```bash
## 1. Clone the repository
git clone <repo-url> product-hunt-scraper
cd product-hunt-scraper

## 2. Create a virtual environment
python -m venv venv
source venv/bin/activate  ## or venv\Scripts\activate on Windows

## 3. Install dependencies
pip install -r requirements.txt

## 4. Run the actor locally
python -m src
```

> **Note:** When running locally without the Apify platform, `Actor.push_data()` and `Actor.get_input()` require either the Apify CLI (`apify run`) or environment variables. For quick tests, you can set `APIFY_LOCAL_EMULATION=true` or use the Apify CLI.

***

### Technical details

- **Language:** Python 3.14
- **HTTP client:** `httpx` (async)
- **HTML parsing:** `BeautifulSoup` is declared as a dependency, but the primary extraction path uses the `__NEXT_DATA__` JSON payload — no full DOM parsing needed.
- **Scraping approach:** Static HTTP request with a real browser User-Agent. No headless browser (Puppeteer/Playwright) required.
- **Dataset:** Each product is pushed individually via `Actor.push_data()`.

***

### Limitations

- Product Hunt **rate-limits** aggressive requests. Adding randomised delays between multiple runs is recommended.
- The `__NEXT_DATA__` JSON structure may change when Product Hunt updates their frontend. The actor includes fallback logic to find product data by key name, but occasional breakage is possible.
- Only **publicly visible** data on collection pages is extracted. Authentication-gated data (e.g. private follow feeds) is not supported.

***

### License

MIT

# Actor input Schema

## `date` (type: `string`):

The date to scrape products for (format: YYYY-MM-DD). Defaults to today.

## `collection` (type: `string`):

Product Hunt collection to scrape.

## `min_votes` (type: `integer`):

Minimum upvotes filter — only products with at least this many upvotes will be included.

## `limit` (type: `integer`):

Maximum number of products to return.

## Actor input object example

```json
{
  "date": "2026-05-26",
  "collection": "tech",
  "min_votes": 0,
  "limit": 25
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("wsgcjj/product-hunt-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("wsgcjj/product-hunt-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call wsgcjj/product-hunt-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=wsgcjj/product-hunt-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Product Hunt Daily Products Scraper",
        "description": "Scrape Product Hunt for daily/top products with votes, reviews, descriptions, and maker information. Perfect for competitive analysis, market research, and founder intelligence.",
        "version": "0.0",
        "x-build-id": "WKSZMggaF3s8V7eTi"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/wsgcjj~product-hunt-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/wsgcjj~product-hunt-scraper/runs": {
            "post": {
                "operationId": "runs-sync-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/wsgcjj~product-hunt-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {
                    "date": {
                        "title": "Date",
                        "type": "string",
                        "description": "The date to scrape products for (format: YYYY-MM-DD). Defaults to today.",
                        "default": "2026-05-26"
                    },
                    "collection": {
                        "title": "Collection",
                        "enum": [
                            "tech",
                            "games",
                            "podcasts",
                            "books",
                            "developer-tools",
                            "artificial-intelligence",
                            "all"
                        ],
                        "type": "string",
                        "description": "Product Hunt collection to scrape.",
                        "default": "tech"
                    },
                    "min_votes": {
                        "title": "Minimum Upvotes",
                        "type": "integer",
                        "description": "Minimum upvotes filter — only products with at least this many upvotes will be included.",
                        "default": 0
                    },
                    "limit": {
                        "title": "Limit",
                        "maximum": 100,
                        "type": "integer",
                        "description": "Maximum number of products to return.",
                        "default": 25
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```