Reddit Scraper

  • trudax/reddit-scraper
  • Modified
  • Users 1.4k
  • Runs 56.2k
  • Created by Author's avatarGustavo Rudiger

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Free trial for 1 day

Then $45.00/month

No credit card required now

Reddit Scraper

Free trial for 1 day

Then $45.00/month

Start URLs

startUrls

Optional

array

If you already have URL(s) of page(s) you wish to scrape, you can set them here. If you want to use the search field below, remove all startUrls here.

Skip comments

skipComments

Optional

boolean

This will skip scrapping comments when going through posts

Search Term

searches

Optional

array

Here you can provide a search query which will be used to search Reddit`s topics.

Search for posts

searchPosts

Optional

boolean

Will search for posts with the provided search

Search for comments

searchComments

Optional

boolean

Will search for comments with the provided search

Search for communities

searchCommunities

Optional

boolean

Will search for communities with the provided search

Search for users

searchUsers

Optional

boolean

Will search for users with the provided search

sort

Optional

Enum

Sort search by Relevance, Hot, Top, New or Comments

Options:

"relevance": string"hot": string"top": string"new": string"comments": string

Filter by date (Posts only)

time

Optional

Enum

Filter posts by last hour, week, day, month or year

Options:

"all": string"hour": string"day": string"week": string"month": string"year": string

Maximum number of items to be saved

maxItems

Optional

integer

The maximum number of items that will be saved in the dataset. If you are scrapping for Communities&Users, remember to consider that each category inside a community is saved as a separated item.

Limit of posts scraped inside a single page

maxPostCount

Optional

integer

The maximum number of posts that will be scraped for each Posts Page or Communities&Users URL

Limit of comments scraped inside a single page

maxComments

Optional

integer

The maximum number of comments that will be scraped for each Comments Page. If you don't want to scrape comments you can set this to zero.

Limit of `Communities`'s pages scraped

maxCommunitiesCount

Optional

integer

The maximum number of Communities's pages that will be scraped if your search or startUrl is a Communities type.

Limit of `Users`'s pages scraped

maxUserCount

Optional

integer

The maximum number of Users's pages that will be scraped.

Extended Output Function

extendOutputFunction

Optional

string

Here you can write your custom javascript code to extract custom data from the page.

Page scroll timeout (seconds)

scrollTimeout

Optional

integer

Set the timeout in seconds in which the page will stop scrolling down to load new items

Proxy configuration

proxy

Required

object

Either use Apify proxy, or provide your own proxy servers.

Debug Mode

debugMode

Optional

boolean

Activate to see detailed logs