Product Hunt Scraper

Scrape Product Hunt products with detailed information including upvotes, comments, makers, topics, and launch dates.

Features

• Multiple Search Modes: Search by keyword, topic, time frame, or specific date
• Comprehensive Data: Extracts name, tagline, description, votes, comments, makers, topics, and more
• Dual Extraction: Uses Next.js data extraction with HTML parsing fallback
• Smart Pagination: Automatically handles multiple pages
• Rate Limiting: Built-in delays to respect Product Hunt's servers

Input Parameters

Parameter	Type	Description	Default
searchQuery	String	Search keyword (e.g., "AI tools")	"AI tools"
topic	Select	Filter by topic category	"all"
timeFrame	Select	Time period (today, this_week, this_month, this_year)	"today"
sortBy	Select	Sort by popular or newest	"popular"
dateUrl	String	Direct URL to specific date's leaderboard	-
maxResults	Number	Maximum products to scrape (1-1000)	100

Output Data

Each product contains:

{
  "name": "Product Name",
  "tagline": "Short description",
  "description": "Full description",
  "votesCount": 1250,
  "commentsCount": 45,
  "topics": ["AI", "Productivity"],
  "websiteUrl": "https://example.com",
  "productUrl": "https://www.producthunt.com/posts/product-name",
  "thumbnailUrl": "https://...",
  "makers": ["Maker Name"],
  "launchDate": "2024-01-15T00:00:00Z",
  "ranking": 1,
  "isFeatured": true,
  "reviewRating": 4.5
}

Available Topics

• All Topics
• Artificial Intelligence
• Developer Tools
• Design Tools
• Marketing
• Productivity
• SaaS
• Fintech
• Education
• Health & Fitness

Usage Examples

Search for AI tools

{
  "searchQuery": "AI tools",
  "maxResults": 50
}

Get today's top products

{
  "timeFrame": "today",
  "sortBy": "popular",
  "maxResults": 20
}

Browse a specific topic

{
  "topic": "artificial-intelligence",
  "timeFrame": "this_week",
  "maxResults": 100
}

Scrape a specific date

{
  "dateUrl": "https://www.producthunt.com/leaderboard/daily/2024/1/15",
  "maxResults": 50
}

Rate Limiting

The scraper includes built-in rate limiting (2-3 seconds between requests) to be respectful to Product Hunt's servers.

Technical Details

• Engine: Node.js 20+
• Framework: Apify SDK 3.0
• Parser: Cheerio 1.0
• Type Safety: TypeScript strict mode
• Architecture: ES2022 modules

Error Handling

• HTTP errors are logged and scraping continues
• Falls back to HTML parsing if Next.js data extraction fails
• Validates and sanitizes all extracted data
• Graceful degradation on missing fields

Deployment

Built for Apify platform with multi-stage Docker build for optimal performance.

npm install
npm run build
npm start

License

MIT