✍️ HackerNoon Scraper

Extract stories from HackerNoon across 22 categories (AI, Web3, Business, Finance, Programming, and more). Discover tech writing from a large community of contributing authors.

Just pick a category, set how many posts you want (up to 300), and export titles, full text, authors, tags, and engagement metrics as CSV or JSON.

💡 Perfect for…

• Tech research & content teams: Follow AI, startups, programming, and Web3 conversations.
• Trend & engagement analysis: Use views, comments, and tags across categories.
• Newsletters & digests: Pull structured stories with excerpts and TL;DRs.
• 📚 RAG & AI workflows: Index articleBody and metadata with clear source links.

✨ Why you'll love this scraper

• 🎯 22 categories: From Top Stories and AI to Programming, Startups, Web3, and Writing.
• 📰 Rich article data: Title, excerpt, TL;DR, full body, tags, images, and dates.
• 👤 Author profiles: Display name, handle, avatar, bio, and trust/brand flags when available.
• 📊 Engagement: Comments count and page views when present.

🎯 Supported categories

• Technology: AI, Programming, Tech Companies, Tech Stories, Cybersecurity, Cloud, Data Science
• Business: Business, Finance, Startups, Management, Product Management
• Lifestyle: Life Hacking, Remote Work, Gaming, Writing
• Science & innovation: Science, Futurism, Web3
• Community: HackerNoon, Society, Media
• Special: Top Stories

📦 What's inside the data?

• Article: id, title, slug, link, excerpt, tldr, articleBody, createdAt, parentCategory, tags, commentsCount, pageViews, arweave
• Media: mainImage, mainImageHeight, mainImageWidth, socialPreviewImage
• Author: author_name, author_handle, author_avatar, author_bio, author_isBrand, author_isTrusted

🚀 Quick start

1. Choose a category (e.g. AI or Top Stories).
2. Set max_posts (50–300). For Top Stories, results may stop earlier (around 150).
3. Click Start and export JSON or CSV.

---

Example input

{
  "category": "AI",
  "max_posts": 100
}

Example output

{
  "id": "rxhvxiLNxsRwnMGivMFc",
  "title": "The Future of AI in Healthcare",
  "slug": "the-future-of-ai-in-healthcare",
  "link": "https://hackernoon.com/the-future-of-ai-in-healthcare",
  "excerpt": "Exploring how AI is revolutionizing medical diagnosis...",
  "tldr": "AI is transforming healthcare through improved diagnostics and personalized treatment.",
  "articleBody": "Full article content here...",
  "createdAt": "2023-09-30T21:36:56.367Z",
  "parentCategory": "ai",
  "tags": ["artificial-intelligence", "healthcare", "machine-learning"],
  "commentsCount": 15,
  "pageViews": 348080,
  "author_name": "Dr. Sarah Johnson",
  "author_handle": "sarahj_ai",
  "author_isTrusted": true
}

Parameter	Type	Required	Description
category	string	Yes	HackerNoon category (see list above). Default in schema: AI.
max_posts	integer	No	How many articles to collect. Min 50, max 300, default 200. Top Stories may return fewer.