Reddit Scraper
1 day trial then $45.00/month - No credit card required now
Reddit Scraper
1 day trial then $45.00/month - No credit card required now
Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
Start URLs
startUrls
arrayOptional
If you already have URL(s) of page(s) you wish to scrape, you can set them here. If you want to use the search field below, remove all startUrls here.
Skip comments
skipComments
booleanOptional
This will skip scrapping comments when going through posts
Default value of this property is false
Skip user posts
skipUserPosts
booleanOptional
This will skip scrapping user posts when going through user activity
Default value of this property is false
Skip community
skipCommunity
booleanOptional
This will skip scrapping community info but will still get community posts if they were not skipped.
Default value of this property is false
Search Term
searches
arrayOptional
Here you can provide a search query which will be used to search Reddit`s topics.
Search for posts
searchPosts
booleanOptional
Will search for posts with the provided search
Default value of this property is true
Search for comments
searchComments
booleanOptional
Will search for comments with the provided search
Default value of this property is false
Search for communities
searchCommunities
booleanOptional
Will search for communities with the provided search
Default value of this property is false
Search for users
searchUsers
booleanOptional
Will search for users with the provided search
Default value of this property is false
Sort search
sort
EnumOptional
Sort search by Relevance, Hot, Top, New or Comments
Value options:
"relevance": string"hot": string"top": string"new": string"rising": string"comments": string
Default value of this property is "new"
Filter by date (Posts only)
time
EnumOptional
Filter posts by last hour, week, day, month or year
Value options:
"all": string"hour": string"day": string"week": string"month": string"year": string
Include NSFW content
includeNSFW
booleanOptional
You can choose to include or exclude NSFW content from your search
Default value of this property is true
Maximum number of items to be saved
maxItems
integerOptional
The maximum number of items that will be saved in the dataset. If you are scrapping for Communities&Users, remember to consider that each category inside a community is saved as a separated item.
Default value of this property is 10
Limit of posts scraped inside a single page
maxPostCount
integerOptional
The maximum number of posts that will be scraped for each Posts Page or Communities&Users URL
Default value of this property is 10
Post date limit
postDateLimit
stringOptional
Use this value when you want to get only posts after a specific date
Limit of comments scraped inside a single page
maxComments
integerOptional
The maximum number of comments that will be scraped for each Comments Page. If you don't want to scrape comments you can set this to zero.
Default value of this property is 10
Limit of `Communities`'s pages scraped
maxCommunitiesCount
integerOptional
The maximum number of Communities
's pages that will be scraped if your search or startUrl is a Communities type.
Default value of this property is 2
Limit of `Users`'s pages scraped
maxUserCount
integerOptional
The maximum number of Users
's pages that will be scraped.
Default value of this property is 2
Page scroll timeout (seconds)
scrollTimeout
integerOptional
Set the timeout in seconds in which the page will stop scrolling down to load new items
Default value of this property is 40
Actor Metrics
317 monthly users
-
60 stars
>99% runs succeeded
12 hours response time
Created in Feb 2022
Modified 21 days ago