Reddit Comments Scraper

Reddit Comments Scraper is a powerful and flexible tool designed to extract comments from any Reddit post effortlessly. Whether you need a flat list of comments or the full nested comment structure, this scraper provides both formats for your convenience. Perfect for researchers, analysts, and developers working with Reddit data.

Update Jan. 24, 2025: Fixed a bug that would occur when encountering a deleted commment.

Key Features

• Customizable Depth Levels:
  Scrape only top-level comments, direct replies, or dive deeper to capture the full thread hierarchy. Example:

  • Depth []: Extracts all comments.
  • Depth [0]: Extracts only top-level comments.
  • Depth [0,1]: Captures top-level comments and their direct replies.

• Two Output Formats:

  • Flat: A simple list of all comments.
  • Nested: Reflects Reddit's natural comment-reply structure for easy visualization.

• Ease of Use:
  Quickly and efficiently scrape comments from any Reddit post with minimal setup.

Why Use This Scraper?

• Save Time: Avoid manually navigating Reddit threads.
• Customizable: Extract only the data you need.
• SEO & Marketing Research: Analyze audience sentiments or popular topics.
• Data Analysis: Perform sentiment analysis, topic modeling, or build datasets.

How It Works

1. Input: Provide the URL of the Reddit post.
2. Configure Depth: Specify the comment depth you want to scrape.
3. Run the Scraper: Fetch comments in the desired format.
4. Output: Access your data in flat and nested JSON formats.

Example Use Cases

• Market Research: Understand audience opinions about a product or topic.
• Content Analysis: Identify popular phrases or themes in Reddit discussions.
• Data for AI Models: Use Reddit conversations to train NLP models.

Output Formats

1. Flat:

   1[
   2  "Comment 1",
   3  "Reply 1.1",
   4  "Reply 1.1.1",
   5  "Reply 1.2",
   6  "Comment 2",
   7]
   

2. Nested:

   1{
   2  "Comment 1": {
   3    "Reply 1.1": {
   4      "Reply 1.1.1": {}
   5    },
   6    "Reply 1.2": {}
   7  },
   8  "Comment 2": {}
   9}
   

Example output:

Given URL: https://www.reddit.com/r/ProgrammerHumor/comments/1gx3tj4/theupgrade/

1[{
2  "flat_comments": [
3    {
4      "content": "Your submission was removed for the following reason:\nRule 2: Content that is part of top of all time, reached trending in the past 2 months, or has recently been posted, is considered a repost and will be removed.\nIf you disagree with this removal, you can appeal by sending us a modmail.",
5      "commentid": "t1_lyg8d4m",
6      "depth": "0",
7      "author": "ProgrammerHumor-ModTeam",
8      "score": "1",
9      "parentid": null
10    },
11    {
12      "content": "As a compsci student procrastinating a c# assignment im now conflected",
13      "commentid": "t1_lye6tmc",
14      "depth": "0",
15      "author": "CrossFire011",
16      "score": "398",
17      "parentid": null
18    },
19    {
20      "content": "C# is the dream. So much good tooling, the BEST ide(imo) and .net core is a joy to work with.",
21      "commentid": "t1_lye9y5v",
22      "depth": "1",
23      "author": "RoutineWolverine1745",
24      "score": "353",
25      "parentid": "t1_lye6tmc"
26    },
27    {
28      "content": "The dotnet cli and omnisharp are great tools (haven't tried roslyn), but unfortunately rzls (the language server for blazor) doesn't work outside of Visual Studio or VSCode. That's the only thing lacking for me to say it has great tooling overall.",
29      "commentid": "t1_lyebnvn",
30      "depth": "2",
31      "author": "DestopLine555",
32      "score": "70",
33      "parentid": "t1_lye9y5v"
34    },
35    {
36      "content": "Doesn't work in VS Code either.",
37      "commentid": "t1_lyenm41",
38      "depth": "3",
39      "author": "sharkydad",
40      "score": "31",
41      "parentid": "t1_lyebnvn"
42    },
43    {
44      "content": "Which IDE are you talking about?",
45      "commentid": "t1_lyebynz",
46      "depth": "2",
47      "author": "Fadamaka",
48      "score": "27",
49      "parentid": "t1_lye9y5v"
50    },
51    {
52      "content": "Notepad++",
53      "commentid": "t1_lyeec48",
54      "depth": "3",
55      "author": "cosmic_cosmosis",
56      "score": "126",
57      "parentid": "t1_lyebynz"
58    },
59    {
60      "content": "Visual Studio id guess.",
61      "commentid": "t1_lyeek4p",
62      "depth": "3",
63      "author": "ToastedHedgehog",
64      "score": "30",
65      "parentid": "t1_lyebynz"
66    },
67    {
68      "content": "I think Rider is slept on, way better than VS",
69      "commentid": "t1_lyf2y4s",
70      "depth": "3",
71      "author": "Singularity42",
72      "score": "3",
73      "parentid": "t1_lyebynz"
74    },
75    {
76      "content": "Visual Studio ain't bad. Yeah it's slow and sometimes buggy but it's crazy intuitive and easy to use",
77      "commentid": "t1_lyejlf9",
78      "depth": "3",
79      "author": "OhItsJustJosh",
80      "score": "8",
81      "parentid": "t1_lyebynz"
82    }
83  ],
84  "nested_comments": [
85    {
86      "content": "Your submission was removed for the following reason:\nRule 2: Content that is part of top of all time, reached trending in the past 2 months, or has recently been posted, is considered a repost and will be removed.\nIf you disagree with this removal, you can appeal by sending us a modmail.",
87      "commentid": "t1_lyg8d4m",
88      "depth": "0",
89      "author": "ProgrammerHumor-ModTeam",
90      "score": "1",
91      "parentid": null,
92      "replies": []
93    },
94    {
95      "content": "As a compsci student procrastinating a c# assignment im now conflected",
96      "commentid": "t1_lye6tmc",
97      "depth": "0",
98      "author": "CrossFire011",
99      "score": "398",
100      "parentid": null,
101      "replies": [
102        {
103          "content": "C# is the dream. So much good tooling, the BEST ide(imo) and .net core is a joy to work with.",
104          "commentid": "t1_lye9y5v",
105          "depth": "1",
106          "author": "RoutineWolverine1745",
107          "score": "353",
108          "parentid": "t1_lye6tmc",
109          "replies": [
110            {
111              "content": "The dotnet cli and omnisharp are great tools (haven't tried roslyn), but unfortunately rzls (the language server for blazor) doesn't work outside of Visual Studio or VSCode. That's the only thing lacking for me to say it has great tooling overall.",
112              "commentid": "t1_lyebnvn",
113              "depth": "2",
114              "author": "DestopLine555",
115              "score": "70",
116              "parentid": "t1_lye9y5v",
117              "replies": [
118                {
119                  "content": "Doesn't work in VS Code either.",
120                  "commentid": "t1_lyenm41",
121                  "depth": "3",
122                  "author": "sharkydad",
123                  "score": "31",
124                  "parentid": "t1_lyebnvn",
125                  "replies": []
126                }
127              ]
128            },
129            {
130              "content": "Which IDE are you talking about?",
131              "commentid": "t1_lyebynz",
132              "depth": "2",
133              "author": "Fadamaka",
134              "score": "27",
135              "parentid": "t1_lye9y5v",
136              "replies": [
137                {
138                  "content": "Notepad++",
139                  "commentid": "t1_lyeec48",
140                  "depth": "3",
141                  "author": "cosmic_cosmosis",
142                  "score": "126",
143                  "parentid": "t1_lyebynz",
144                  "replies": []
145                },
146                {
147                  "content": "Visual Studio id guess.",
148                  "commentid": "t1_lyeek4p",
149                  "depth": "3",
150                  "author": "ToastedHedgehog",
151                  "score": "30",
152                  "parentid": "t1_lyebynz",
153                  "replies": []
154                },
155                {
156                  "content": "I think Rider is slept on, way better than VS",
157                  "commentid": "t1_lyf2y4s",
158                  "depth": "3",
159                  "author": "Singularity42",
160                  "score": "3",
161                  "parentid": "t1_lyebynz",
162                  "replies": []
163                },
164                {
165                  "content": "Visual Studio ain't bad. Yeah it's slow and sometimes buggy but it's crazy intuitive and easy to use",
166                  "commentid": "t1_lyejlf9",
167                  "depth": "3",
168                  "author": "OhItsJustJosh",
169                  "score": "8",
170                  "parentid": "t1_lyebynz",
171                  "replies": []
172                }
173              ]
174            }
175          ]
176        }
177      ]
178    }
179  ]
180}]