Reddit Profile Crawler
Pricing
from $1.00 / 1,000 results
Pricing
from $1.00 / 1,000 results
Rating
5.0
(2)
Developer
Crawler Bros
Maintained by CommunityActor stats
3
Bookmarked
107
Total users
4
Monthly active users
20 days ago
Last modified
Categories
Share
List of Reddit usernames to scrape. Accepts bare names (spez), u/ prefixed (u/spez) or profile URLs.
[ "spez", "u/example_user", "https://www.reddit.com/user/another_user/"]Emit a user_profile record with karma breakdown (post/comment/awardee/awarder), premium, verified email, moderator and employee flags, avatar, bio, account age.
Also fetch the user's trophy case (trophy names + icon URLs) from their profile page. Adds one page load per user; trophies are omitted when the user has none.
Also fetch the list of communities the user moderates (subreddit name, subscribers, type, mod permissions) and attach it to the user_profile record. Omitted when the user moderates nothing.
Which sections of the user's history to scrape. 'Overview' returns the combined posts + comments feed. Leave the default ['posts'] for posts only.
[ "posts"][ "posts", "comments"]Maximum number of posts to scrape per user (from the posts and overview sections).
Maximum number of comments to scrape per user (from the comments and overview sections).
How to sort the user's history.
Time filter when sorting history by 'top' or 'controversial'.
Include NSFW posts in the user's history.
Keep only posts that have a link flair set. Has no effect on comments (comments don't carry link flair).
Only keep posts/comments made in these subreddits (case-insensitive). Accepts bare names (python), r/ prefixed (r/python), or subreddit URLs. Leave empty to include every subreddit in the user's history.
[ "AskReddit", "r/technology"]Only keep posts/comments whose title, self-text or comment body contains this text (case-insensitive substring match). Leave empty to disable.
Only keep posts whose title contains this text (case-insensitive substring match). Has no effect on comments. Leave empty to keep all titles.
Only keep self (text) posts whose body contains this text (case-insensitive substring match). Link/image/video posts have no body text and are excluded when this is set. Has no effect on comments. Leave empty to keep all posts.
Only keep posts whose link flair text contains this text (case-insensitive substring match). Has no effect on comments. Leave empty to keep all flairs.
Only keep posts whose link domain contains this text (case-insensitive, e.g. 'youtube.com' or 'self.python'). Has no effect on comments. Leave empty to keep all domains.
Only keep posts distinguished by Reddit as moderator, admin or special (e.g. Reddit-team) posts, or only regular (non-distinguished) posts. Has no effect on comments. Leave unset to keep all posts.
Only keep posts with at least this many total awards. Has no effect on comments. Leave unset to keep all posts.
When enabled, only posts the author tagged as original content are kept. Has no effect on comments.
When enabled, posts that Reddit has archived (locked from further voting/commenting after 6 months) are dropped from the results. Has no effect on comments.
Drop posts whose title, self-text body or flair contains any of these keywords or phrases (case-insensitive substring match) — useful for filtering out megathreads, giveaways or spam boilerplate. Has no effect on comments. Leave empty to keep all posts.
[ "megathread"]Only keep self (text) posts whose body is at least this many characters long. Link/image/video posts have no body and are excluded when this is set. Has no effect on comments. Leave unset to keep all lengths.
Only keep self (text) posts whose body is at most this many characters long. Has no effect on comments. Leave unset to keep all lengths.
Keep only posts of the selected content type. Leave unset to keep all types. Has no effect on comments.
Only keep posts/comments with a score at or above this value. Leave unset to keep all scores.
Only keep posts/comments with a score at or below this value. Useful for finding overlooked/low-visibility items. Leave unset to keep all scores.
Only keep posts that have at least this many comments (the post's own comment count — not to be confused with 'Maximum comments per user' above, which caps how many comment records are scraped). Has no effect on comments.
Only keep posts that have at most this many comments. Useful for finding under-discussed posts. Has no effect on comments.
Only keep posts whose upvote ratio (fraction of votes that are upvotes, 0-1) is at or above this value. Useful for filtering out controversial/divisive posts. Has no effect on comments.
When enabled, posts pinned/stickied in their community are dropped from the results.
When enabled, posts removed by a moderator, Reddit, or deleted by their author (marker: removed_by_category) are dropped from the results.
When enabled, posts that are crossposts from another subreddit are dropped, keeping only the user's original submissions.
When enabled, posts marked as a spoiler by their author are dropped from the results.
When enabled, posts with comments locked by a moderator are dropped from the results.
When enabled, posts whose author account was deleted (shown as [deleted]/[removed]) are dropped from the results.
Only keep items created on or after this date (UTC).