Reddit API Scraper

What is Reddit API Scraper?

Reddit API Scraper is a web scraping tool created to extract data from Reddit such as posts and user details by keyword. It can also scrape posts in specific subreddits. This Search API doesn’t need Reddit API keys and is a good fit for you if you need to:

• scrape posts from Reddit search by keywords
• scrape posts from subreddits by keywords
• sort Reddit data by top, newest, most relevant, or most comments first
• get up to 250 results per search term
• export Reddit data via API or download in JSON, Excel, CSV formats

What data can I extract from Reddit?

With this Reddit API, you will be able to extract the following data from Reddit:

How much does it cost to scrape Reddit data?

This scraper uses the pay-per-result pricing model, so your costs can be easily calculated. It will cost you $5 to scrape 1,000 search results, so 0.005 USD per item.

Apify’s Free plan provides $5 free usage credits every month. For those credits, you can get up to 1,000 results from Reddit for free.

If you need to get more Reddit data regularly, you should grab an Apify subscription. We recommend our $49/month Starter plan - that one could get you up to 10,000 Reddit results every month. Or get up to 100,000 results for $499 with the Scale plan - wow!

How to scrape Reddit data?

You don't need any programming skills or experience to use Reddit Scraper.

1. Create a free Apify account using your email.
2. Find Reddit API Scraper.
3. Choose a keyword or subreddit to scrape posts.
4. Click "Start" and wait for the data to be extracted.
5. Download your data extracted from Reddit in JSON, XML, CSV, Excel, or HTML.

⬇️ Input example

This scraper will extract posts based on a keyword or a subreddit name. To get started, simply enter a search term or the name of a subreddit. You’ll extract all data associated with specific keywords in communities and posts. You can also specify the number of posts to scrape. Click on the input tab for a full explanation of input in JSON.

1{
2  "over18": true,
3  "proxy": {
4    "useApifyProxy": true,
5    "apifyProxyGroups": [
6      "RESIDENTIAL"
7    ]
8  },
9  "resultsLimit": 5,
10  "searchList": [
11    "lake"
12  ],
13  "sortBy": "new",
14  "subRedditList": [
15    "explainlikeimfive"
16  ]
17}

⬆️ Output example

The scraped results will be shown as a dataset which you can find in the Storage tab. Note that the output will be organized as a table for viewing convenience.

Here’s a JSON example of one scraped place on Reddit with all the details. You can preview all the fields and download the file with Reddit data in various formats (JSON, CSV, Excel, and more).

1{
2  "metaData": {
3    "keyword": "lake",
4    "subRedditName": "explainlikeimfive"
5  },
6  "id": "15bwpbo",
7  "subreddit": "IdahoNSFW",
8  "title": "Any F or MF looking to hang out on a boat out on lake couer d alene?",
9  "subreddit_name_prefixed": "r/IdahoNSFW",
10  "name": "t3_15bwpbo",
11  "link_flair_text_color": "dark",
12  "subreddit_type": "public",
13  "author_fullname": "t2_61mm5fwpd",
14  "crosspost_parent_list": [
15    {
16      "approved_at_utc": null,
17      "subreddit": "IdahoSwingers",
18      "selftext": "Taking boat out on the lake this weekend and looking for someone to share in the sun and fun. Maybe boat up to Harrison and take in the sites and have a lot of fun.\nHit me up🏴‍☠️ SM 6’3 athletic and got looking to enjoy the sun",
19      "author_fullname": "t2_61mm5fwpd",
20      "saved": false,
21      "mod_reason_title": null,
22      "gilded": 0,
23      "clicked": false,
24      "title": "Any F or MF looking to hang out on a boat out on lake couer d alene?",
25      "link_flair_richtext": [],
26      "subreddit_name_prefixed": "r/IdahoSwingers",
27      "hidden": false,
28      "pwls": null,
29      "link_flair_css_class": null,
30      "downs": 0,
31      "top_awarded_type": null,
32      "hide_score": true,
33      "name": "t3_15bwo7l",
34      "quarantine": false,
35      "link_flair_text_color": "dark",
36      "upvote_ratio": 1,
37      "author_flair_background_color": null,
38      "subreddit_type": "public",
39      "ups": 1,
40      "total_awards_received": 0,
41      "media_embed": {},
42      "author_flair_template_id": null,
43      "is_original_content": false,
44      "user_reports": [],
45      "secure_media": null,
46      "is_reddit_media_domain": true,
47      "is_meta": false,
48      "category": null,
49      "secure_media_embed": {},
50      "link_flair_text": null,
51      "can_mod_post": false,
52      "score": 1,
53      "approved_by": null,
54      "is_created_from_ads_ui": false,
55      "author_premium": false,
56      "thumbnail": "",
57      "edited": false,
58      "author_flair_css_class": null,
59      "author_flair_richtext": [],
60      "gildings": {},
61      "content_categories": null,
62      "is_self": false,
63      "mod_note": null,
64      "created": 1690548845,
65      "link_flair_type": "text",
66      "wls": null,
67      "removed_by_category": null,
68      "banned_by": null,
69      "author_flair_type": "text",
70      "domain": "i.redd.it",
71      "allow_live_comments": false,
72      "selftext_html": "<!-- SC_OFF --><div class=\"md\"><p>Taking boat out on the lake this weekend and looking for someone to share in the sun and fun. Maybe boat up to Harrison and take in the sites and have a lot of fun.\nHit me up🏴‍☠️ SM 6’3 athletic and got looking to enjoy the sun</p>\n</div><!-- SC_ON -->",
73      "likes": null,
74      "suggested_sort": null,
75      "banned_at_utc": null,
76      "url_overridden_by_dest": "https://i.redd.it/qbhmjksndpeb1.jpg",
77      "view_count": null,
78      "archived": false,
79      "no_follow": true,
80      "is_crosspostable": false,
81      "pinned": false,
82      "over_18": true,
83      "all_awardings": [],
84      "awarders": [],
85      "media_only": false,
86      "can_gild": false,
87      "spoiler": false,
88      "locked": false,
89      "author_flair_text": null,
90      "treatment_tags": [],
91      "visited": false,
92      "removed_by": null,
93      "num_reports": null,
94      "distinguished": null,
95      "subreddit_id": "t5_39269d",
96      "author_is_blocked": false,
97      "mod_reason_by": null,
98      "removal_reason": null,
99      "link_flair_background_color": "",
100      "id": "15bwo7l",
101      "is_robot_indexable": true,
102      "report_reasons": null,
103      "author": "tombraider6869",
104      "discussion_type": null,
105      "num_comments": 0,
106      "send_replies": true,
107      "whitelist_status": null,
108      "contest_mode": false,
109      "mod_reports": [],
110      "author_patreon_flair": false,
111      "author_flair_text_color": null,
112      "permalink": "/r/IdahoSwingers/comments/15bwo7l/any_f_or_mf_looking_to_hang_out_on_a_boat_out_on/",
113      "parent_whitelist_status": null,
114      "stickied": false,
115      "url": "https://i.redd.it/qbhmjksndpeb1.jpg",
116      "subreddit_subscribers": 10657,
117      "created_utc": 1690548845,
118      "num_crossposts": 3,
119      "media": null,
120      "is_video": false
121    }
122  ],
123  "link_flair_type": "text",
124  "author_flair_type": "text",
125  "domain": "i.redd.it",
126  "url_overridden_by_dest": "https://i.redd.it/qbhmjksndpeb1.jpg",
127  "subreddit_id": "t5_526k6l",
128  "author": "tombraider6869",
129  "crosspost_parent": "t3_15bwo7l",
130  "permalink": "/r/IdahoNSFW/comments/15bwpbo/any_f_or_mf_looking_to_hang_out_on_a_boat_out_on/",
131  "url": "https://i.redd.it/qbhmjksndpeb1.jpg"
132},
133{
134  "metaData": {
135    "keyword": "lake",
136    "subRedditName": "explainlikeimfive"
137  },
138  "id": "15bwowb",
139  "subreddit": "r4rbrisbane",
140  "selftext": "(M4F)",
141  "author_fullname": "t2_qa4p5tsc",
142  "title": "26 kiwi male looking for older female to show a good time DM is open (forest lake area) 😏",
143  "subreddit_name_prefixed": "r/r4rbrisbane",
144  "name": "t3_15bwowb",
145  "link_flair_text_color": "dark",
146  "subreddit_type": "public",
147  "link_flair_type": "text",
148  "author_flair_type": "text",
149  "domain": "self.r4rbrisbane",
150  "selftext_html": "<!-- SC_OFF --><div class=\"md\"><p>(M4F)</p>\n</div><!-- SC_ON -->",
151  "subreddit_id": "t5_2ut7l",
152  "author": "New_Stable3679",
153  "permalink": "/r/r4rbrisbane/comments/15bwowb/26_kiwi_male_looking_for_older_female_to_show_a/",
154  "url": "https://old.reddit.com/r/r4rbrisbane/comments/15bwowb/26_kiwi_male_looking_for_older_female_to_show_a/"
155},
156{
157  "metaData": {
158    "keyword": "lake",
159    "subRedditName": "explainlikeimfive"
160  },
161  "id": "15bworq",
162  "subreddit": "madisonwi",
163  "selftext": "I see tons of construction equipment there. Are they building something on this prime waste of space or is this just a staging area for some other purpose?",
164  "author_fullname": "t2_uw61dro9",
165  "title": "What’s going on with the big parking lot on East Wash by the Capitol?",
166  "subreddit_name_prefixed": "r/madisonwi",
167  "name": "t3_15bworq",
168  "link_flair_text_color": "dark",
169  "subreddit_type": "public",
170  "link_flair_type": "text",
171  "author_flair_type": "text",
172  "domain": "i.redd.it",
173  "selftext_html": "<!-- SC_OFF --><div class=\"md\"><p>I see tons of construction equipment there. Are they building something on this prime waste of space or is this just a staging area for some other purpose?</p>\n</div><!-- SC_ON -->",
174  "url_overridden_by_dest": "https://i.redd.it/yxs39rmsdpeb1.jpg",
175  "subreddit_id": "t5_2r8rz",
176  "author": "scottjones608",
177  "whitelist_status": "all_ads",
178  "permalink": "/r/madisonwi/comments/15bworq/whats_going_on_with_the_big_parking_lot_on_east/",
179  "parent_whitelist_status": "all_ads",
180  "url": "https://i.redd.it/yxs39rmsdpeb1.jpg"
181},
182{
183  "metaData": {
184    "keyword": "lake",
185    "subRedditName": "explainlikeimfive"
186  },
187  "id": "15bwo7l",
188  "subreddit": "IdahoSwingers",
189  "selftext": "Taking boat out on the lake this weekend and looking for someone to share in the sun and fun. Maybe boat up to Harrison and take in the sites and have a lot of fun.\nHit me up🏴‍☠️ SM 6’3 athletic and got looking to enjoy the sun",
190  "author_fullname": "t2_61mm5fwpd",
191  "title": "Any F or MF looking to hang out on a boat out on lake couer d alene?",
192  "subreddit_name_prefixed": "r/IdahoSwingers",
193  "name": "t3_15bwo7l",
194  "link_flair_text_color": "dark",
195  "subreddit_type": "public",
196  "link_flair_type": "text",
197  "author_flair_type": "text",
198  "domain": "i.redd.it",
199  "selftext_html": "<!-- SC_OFF --><div class=\"md\"><p>Taking boat out on the lake this weekend and looking for someone to share in the sun and fun. Maybe boat up to Harrison and take in the sites and have a lot of fun.\nHit me up🏴‍☠️ SM 6’3 athletic and got looking to enjoy the sun</p>\n</div><!-- SC_ON -->",
200  "url_overridden_by_dest": "https://i.redd.it/qbhmjksndpeb1.jpg",
201  "subreddit_id": "t5_39269d",
202  "author": "tombraider6869",
203  "permalink": "/r/IdahoSwingers/comments/15bwo7l/any_f_or_mf_looking_to_hang_out_on_a_boat_out_on/",
204  "url": "https://i.redd.it/qbhmjksndpeb1.jpg"
205},
206{
207  "metaData": {
208    "keyword": "lake",
209    "subRedditName": "explainlikeimfive"
210  },
211  "id": "15bwlsf",
212  "subreddit": "dirtyr4r",
213  "selftext": "I recently took time off to write a novel, currently staying at a secluded lake house so also trying to socialize! But I’m mainly looking to meet people with interesting stories to tell, or with interesting things to share. Message and inspire me?",
214  "author_fullname": "t2_geq8ixnog",
215  "title": "32 [M4F] NC - Writer seeking inspiration or more",
216  "subreddit_name_prefixed": "r/dirtyr4r",
217  "name": "t3_15bwlsf",
218  "link_flair_text_color": "light",
219  "subreddit_type": "public",
220  "link_flair_text": "male",
221  "link_flair_type": "text",
222  "author_flair_type": "text",
223  "domain": "self.dirtyr4r",
224  "selftext_html": "<!-- SC_OFF --><div class=\"md\"><p>I recently took time off to write a novel, currently staying at a secluded lake house so also trying to socialize! But I’m mainly looking to meet people with interesting stories to tell, or with interesting things to share. Message and inspire me?</p>\n</div><!-- SC_ON -->",
225  "link_flair_template_id": "d897238a-545a-11eb-8db1-0e23163a9deb",
226  "subreddit_id": "t5_2vqun",
227  "link_flair_background_color": "#0079d3",
228  "author": "moonglowing",
229  "permalink": "/r/dirtyr4r/comments/15bwlsf/32_m4f_nc_writer_seeking_inspiration_or_more/",
230  "url": "https://old.reddit.com/r/dirtyr4r/comments/15bwlsf/32_m4f_nc_writer_seeking_inspiration_or_more/"
231}]

❓ FAQ

Do I need proxies to scrape Reddit?

If you run the scraper on the Apify platform, for successful Reddit scraping you will need residential proxies which are included in Apify's monthly Starter plan ($49).

For more details about how our pricing works, platform credits, proxies, and usage, see the platform pricing page.

Want to scrape Reddit by URLs?

If you want to scrape Reddit data by direct URLs, for example, you can try out a Reddit scraper made by another developer.

Can I integrate this Reddit scraper with other apps?

Yes. Reddit Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, LangChain, Zapier, Slack, Airbyte, GitHub, Google Sheets, Google Drive, and more.

Or you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever Reddit Scraper successfully finishes a run.

Can I use Reddit Scraper data with API?

Yes. You can do so using the Apify API which will enable you to manage, schedule, and run Apify scrapers, including this one. The API also lets you access any datasets, monitor actor performance, fetch results, create and update versions, and more.

To access the API using Node.js, use the apify-client NPM package. To access the API using Python, use the apify-client PyPI package. Check out the Apify API reference docs for full details or click on the API tab for code examples.

Is it legal to scrape Reddit data?

It is legal to scrape publicly available data. However, you should be aware that the results from your Reddit web scraping might contain personal information.

Personal data is protected by GDPR (EU Regulation 2016/679), and by other regulations around the world. Generally, you should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, please consult your lawyers. You can also read our blog post on the legality of web scraping.