Reddit Scraper avatar

Reddit Scraper

Try for free

1 day trial then $45.00/month - No credit card required now

Go to Store
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Start URLs

startUrlsarrayOptional

If you already have URL(s) of page(s) you wish to scrape, you can set them here. If you want to use the search field below, remove all startUrls here.

Skip comments

skipCommentsbooleanOptional

This will skip scrapping comments when going through posts

Default value of this property is false

Skip user posts

skipUserPostsbooleanOptional

This will skip scrapping user posts when going through user activity

Default value of this property is false

Skip community

skipCommunitybooleanOptional

This will skip scrapping community info but will still get community posts if they were not skipped.

Default value of this property is false

Search Term

searchesarrayOptional

Here you can provide a search query which will be used to search Reddit`s topics.

Search for posts

searchPostsbooleanOptional

Will search for posts with the provided search

Default value of this property is true

Search for comments

searchCommentsbooleanOptional

Will search for comments with the provided search

Default value of this property is false

Search for communities

searchCommunitiesbooleanOptional

Will search for communities with the provided search

Default value of this property is false

Search for users

searchUsersbooleanOptional

Will search for users with the provided search

Default value of this property is false

Sort search

sortEnumOptional

Sort search by Relevance, Hot, Top, New or Comments

Value options:

"relevance": string"hot": string"top": string"new": string"rising": string"comments": string

Default value of this property is "new"

Filter by date (Posts only)

timeEnumOptional

Filter posts by last hour, week, day, month or year

Value options:

"all": string"hour": string"day": string"week": string"month": string"year": string

Include NSFW content

includeNSFWbooleanOptional

You can choose to include or exclude NSFW content from your search

Default value of this property is true

Maximum number of items to be saved

maxItemsintegerOptional

The maximum number of items that will be saved in the dataset. If you are scrapping for Communities&Users, remember to consider that each category inside a community is saved as a separated item.

Default value of this property is 10

Limit of posts scraped inside a single page

maxPostCountintegerOptional

The maximum number of posts that will be scraped for each Posts Page or Communities&Users URL

Default value of this property is 10

Post date limit

postDateLimitstringOptional

Use this value when you want to get only posts after a specific date

Limit of comments scraped inside a single page

maxCommentsintegerOptional

The maximum number of comments that will be scraped for each Comments Page. If you don't want to scrape comments you can set this to zero.

Default value of this property is 10

Limit of `Communities`'s pages scraped

maxCommunitiesCountintegerOptional

The maximum number of Communities's pages that will be scraped if your search or startUrl is a Communities type.

Default value of this property is 2

Limit of `Users`'s pages scraped

maxUserCountintegerOptional

The maximum number of Users's pages that will be scraped.

Default value of this property is 2

Page scroll timeout (seconds)

scrollTimeoutintegerOptional

Set the timeout in seconds in which the page will stop scrolling down to load new items

Default value of this property is 40

Proxy configuration

proxyobjectRequired

Either use Apify proxy, or provide your own proxy servers.

Default value of this property is {"useApifyProxy":true,"apifyProxyGroups":["RESIDENTIAL"]}

Debug Mode

debugModebooleanOptional

Activate to see detailed logs

Default value of this property is false

Developer
Maintained by Community

Actor Metrics

  • 317 monthly users

  • 60 stars

  • >99% runs succeeded

  • 12 hours response time

  • Created in Feb 2022

  • Modified 21 days ago

Categories