Reddit Post Scraper - Extract Post Details & Duplicate Links

Overview

The Reddit Post Scraper fetches structured metadata for one or more Reddit posts from their full URLs. Use it when you already know the post links and need title, author, subreddit, score, comment count, permalink, and body/selftext in clean JSON.

Built for content researchers, brand analysts, journalists, and data engineers who track specific threads. Optionally resolve duplicate posts for each URL so you can map crossposts and reposts across communities.

Returns clean, structured JSON per post (and per duplicate when enabled), ready for analytics warehouses, monitoring dashboards, or enrichment pipelines.

Features

• Scrape multiple Reddit post URLs in one run
• Accepts full https://www.reddit.com/r/.../comments/... URLs and /r/... paths
• Structured fields: id, title, author, subreddit, score, comment count, timestamps, URLs, body excerpt
• Optional duplicate-post discovery (includeDuplicates)
• Concurrent fetching for batch URL lists
• Type-tagged rows (post / duplicate / error) for easy filtering
• Reliable JSON output without browser automation

Use Cases

• Brand monitoring — Track specific complaint or praise threads
• Content research — Archive source posts before they edit or delete
• Competitor analysis — Follow competitor announcements and AMAs
• Market research — Capture product launch discussion posts
• Data analytics — Feed known URLs into scoring / NLP pipelines
• AI training datasets — Build labeled corpora from curated threads
• Academic research — Collect canonical post records for studies

Input

Parameter	Type	Required	Default	Description
postUrls	array of strings	Yes	—	Full Reddit post URLs (one per line).
includeDuplicates	boolean	No	false	When true, also fetch duplicate/crosspost listings for each URL.

How parameters affect the run: postUrls defines the fetch queue. Enabling includeDuplicates adds an extra API call per post and emits additional rows with type: "duplicate".

Example input

{
  "postUrls": [
    "https://www.reddit.com/r/technology/comments/1abc234/openai_releases_new_model/"
  ],
  "includeDuplicates": true
}

Output

Dataset rows are flat objects. Common listing fields come from the shared post summary mapper:

Field	Type	Description
type	string	"post", "duplicate", or "error"
sourceUrl	string	Original input URL
id	string | null	Reddit thing ID
name	string | null	Fullname (e.g. t3_...)
kind	string | null	Reddit kind (t3 for posts)
title	string | null	Post title
author	string | null	Author username
subreddit	string | null	Subreddit name
score	number | null	Score / upvotes
numComments	number | null	Comment count
createdUtc	number | string | null	Creation time (Unix or API value)
permalink	string | null	Relative or absolute permalink
url	string | null	Linked URL or post URL
body	string | null	Selftext / body (may be truncated)

Error rows include error with a human-readable message. Duplicate rows reuse the same summary fields for each matching duplicate post.

Example Output

[
  {
    "type": "post",
    "sourceUrl": "https://www.reddit.com/r/technology/comments/1abc234/openai_releases_new_model/",
    "id": "1abc234",
    "name": "t3_1abc234",
    "kind": "t3",
    "title": "OpenAI releases new model with major reasoning upgrades",
    "author": "techreporter42",
    "subreddit": "technology",
    "score": 18420,
    "numComments": 2143,
    "createdUtc": 1718208000,
    "permalink": "https://www.reddit.com/r/technology/comments/1abc234/openai_releases_new_model/",
    "url": "https://www.theverge.com/openai-new-model",
    "body": null
  },
  {
    "type": "duplicate",
    "sourceUrl": "https://www.reddit.com/r/technology/comments/1abc234/openai_releases_new_model/",
    "id": "1def567",
    "title": "OpenAI's latest model is here",
    "author": "crossposter99",
    "subreddit": "MachineLearning",
    "score": 3201,
    "numComments": 412,
    "createdUtc": 1718211600,
    "permalink": "https://www.reddit.com/r/MachineLearning/comments/1def567/openais_latest_model_is_here/",
    "url": "https://www.theverge.com/openai-new-model",
    "body": null
  }
]

Related Scrapers

• Reddit Comment Tree Scraper — Full comment threads for the same post URLs
• Reddit Search Scraper — Discover posts by keyword before scraping details
• Reddit Subreddit Posts Scraper — Bulk posts from a community feed
• Reddit Popular Posts Scraper — Trending posts across Reddit