Reddit Data Scraper

A Python library to scrape data from Reddit.

Examples

Input:

{
  "limit": 10,
  "subreddit": "web",
  "time": "all",
  "sort": "new",
  "proxy_configuration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ],
    "apifyProxyCountry": "US"
  }
}

Output:

[
  {
    "title": "Question sur mon hébergement",
    "description": "Bonjour, j’ai un site Internet depuis bientôt trois ans et je trouve que l’hébergement est assez cher… environ 200€ par an. Je n’ai pas les moyens financiers de le payer cette année…\nJ’habite en France et mon site est hébergé sur o2switch. Je voulais savoir : si je ne ",
    "link": "https://www.reddit.com/r/web/comments/1nsao75/question_sur_mon_hébergement/",
    "permalink": "/r/web/comments/1nsao75/question_sur_mon_hébergement/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1nsao75",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 2,
    "num_crossposts": 0,
    "media_type": "text",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1759019245,
    "author": "Loaneyum",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "Is there a Chrome extension that can download all PDF files on a webpage automatically?",
    "description": "",
    "link": "https://www.reddit.com/r/web/comments/1nqgrxz/is_there_a_chrome_extension_that_can_download_all/",
    "permalink": "/r/web/comments/1nqgrxz/is_there_a_chrome_extension_that_can_download_all/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1nqgrxz",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 1,
    "num_crossposts": 0,
    "media_type": "text",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1758829997,
    "author": "Massive_Leading_9206",
    "author_flair_text": null,
    "flair": "Discussion",
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "Anyone else get overwhelmed picking a web host?",
    "description": "I've been looking into launching a side project and figured I’d finally get serious about choosing a decent web host. But man… there are so many out there, each with different pricing, features, and random hidden fees.  \n  \nI went down a rabbit hole trying to compare t",
    "link": "https://www.reddit.com/r/web/comments/1novzh6/anyone_else_get_overwhelmed_picking_a_web_host/",
    "permalink": "/r/web/comments/1novzh6/anyone_else_get_overwhelmed_picking_a_web_host/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1novzh6",
    "ups": 10,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 1,
    "num_crossposts": 0,
    "media_type": "self",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1758667870,
    "author": "Parking-Buy-1113",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "Scam or Legit??",
    "description": "Can you guys help me check if this website is actually legit for topping up a game?",
    "link": "https://www.reddit.com/r/web/comments/1nmm698/scam_or_legit/",
    "permalink": "/r/web/comments/1nmm698/scam_or_legit/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1nmm698",
    "ups": 0,
    "downs": 0,
    "upvote_ratio": 0.5,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "image",
    "media_urls": [
      "https://i.redd.it/04azoyn96hqf1.jpeg"
    ],
    "thumbnail": "https://a.thumbs.redditmedia.com/4c45d7KnJrLb73cCxu39n6lv88pX7UEYt51mLyIZg18.jpg",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1758441796,
    "author": "Fragrant_Guava_2350",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "i.redd.it"
  },
  {
    "title": "My web browser that ended up failing (And it was the most secure in passwords etc.)",
    "description": "At first I was going to make an app, because although, yes, this browser that I made is super private since it uses lists of urls in the js script and the html loads them, you still have chrome or edge or gx, do you think it's a good idea to adapt it to .exe and .apk? ",
    "link": "https://www.reddit.com/r/web/comments/1njj669/my_web_browser_that_ended_up_failing_and_it_was/",
    "permalink": "/r/web/comments/1njj669/my_web_browser_that_ended_up_failing_and_it_was/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1njj669",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "text",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1758129305,
    "author": "Elpapasoxd",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "Is the Wi-Fi slow, or is the filter just doing its job?",
    "description": "You set up web content filtering to protect the users, devices, network- basically **Everything!**  \nThey say you’re “killing productivity” because, ‘Reddit’s down.’  \n  \nOne user even opened a ticket:\n\n**Subject: “Emergency - Need access to YouTube for…research.”**\n\nL",
    "link": "https://www.reddit.com/r/web/comments/1n0fbst/is_the_wifi_slow_or_is_the_filter_just_doing_its/",
    "permalink": "/r/web/comments/1n0fbst/is_the_wifi_slow_or_is_the_filter_just_doing_its/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1n0fbst",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 0.66,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "self",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1756193183,
    "author": "Academic-Soup2604",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "Manage Amazon Inventory with Odoo ERP Solutions",
    "description": "",
    "link": "https://www.reddit.com/r/web/comments/1mkxurs/manage_amazon_inventory_with_odoo_erp_solutions/",
    "permalink": "/r/web/comments/1mkxurs/manage_amazon_inventory_with_odoo_erp_solutions/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1mkxurs",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "link",
    "media_urls": [],
    "thumbnail": "https://external-preview.redd.it/GTPySZlif2Tn6Rcu6qTLYN_aICMnkg-TPMAsYKtSDfs.jpeg?width=140&height=75&crop=140:75,smart&auto=webp&s=9001ee0df0cde4ddb2d6e8a2b692b795e74af8ba",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1754665954,
    "author": "waqararif",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "numla.com"
  },
  {
    "title": "High performing websites for cheap rates",
    "description": "\n\nHey everyone! if you are looking for a website for your business that is cheap and high performing, you can contact me! i have two years of experience in the web development field and i can also offer social media management services.\n\nSo if you don't know where to s",
    "link": "https://www.reddit.com/r/web/comments/1md8sx7/high_performing_websites_for_cheap_rates/",
    "permalink": "/r/web/comments/1md8sx7/high_performing_websites_for_cheap_rates/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1md8sx7",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "text",
    "media_urls": [],
    "thumbnail": "self",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1753887439,
    "author": "BeqaKs",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "self.web"
  },
  {
    "title": "The Weird World Of Shapes Season 2 teaser",
    "description": "",
    "link": "https://www.reddit.com/r/web/comments/1m89gnr/the_weird_world_of_shapes_season_2_teaser/",
    "permalink": "/r/web/comments/1m89gnr/the_weird_world_of_shapes_season_2_teaser/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1m89gnr",
    "ups": 1,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 0,
    "num_crossposts": 0,
    "media_type": "link",
    "media_urls": [],
    "thumbnail": "https://external-preview.redd.it/EapmU06woggZRciW2HUekWP2tRIo3hcOKsRcAtlczr8.jpeg?width=140&height=78&crop=140:78,smart&auto=webp&s=1f0f671168042e594859312cc8f74c256551ad29",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1753375431,
    "author": "Thekittycrinkleshow",
    "author_flair_text": null,
    "flair": null,
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "newgrounds.com"
  },
  {
    "title": "Only OG people used this browser",
    "description": "",
    "link": "https://www.reddit.com/r/web/comments/1m39dp2/only_og_people_used_this_browser/",
    "permalink": "/r/web/comments/1m39dp2/only_og_people_used_this_browser/",
    "subreddit": "r/web",
    "subreddit_id": "t5_2qofi",
    "subreddit_subscribers": 5682,
    "post_id": "1m39dp2",
    "ups": 4,
    "downs": 0,
    "upvote_ratio": 1,
    "num_comments": 3,
    "num_crossposts": 0,
    "media_type": "image",
    "media_urls": [
      "https://i.redd.it/frcebx4w9odf1.jpeg"
    ],
    "thumbnail": "https://a.thumbs.redditmedia.com/oU5qkJldICC4U9wEc-LH41JLdRde-AQ4q9iBw-n9Wg4.jpg",
    "is_video": false,
    "is_gallery": false,
    "created_utc": 1752861738,
    "author": "mrnathani",
    "author_flair_text": null,
    "flair": "Discussion",
    "is_original_content": false,
    "awards_count": 0,
    "over_18": false,
    "is_spoiler": false,
    "is_locked": false,
    "is_stickied": false,
    "content_categories": null,
    "allow_live_comments": false,
    "domain": "i.redd.it"
  }
]