SubReddit Media Search Scraper 🎯

Advanced Reddit scraper that extracts media content (images and videos) from subreddit search results with rich metadata.

🌟 Features

• Search and extract media posts from any subreddit
• Support for multiple media types (images, videos, galleries)
• Advanced sorting options (relevance, top, new, comments, hot)
• Time-based filtering (hour, day, week, month, year, all)
• Safe search toggle
• Configurable maximum items limit

📊 Output Data Structure

Each scraped post includes:

• Post ID and basic metadata
• Subreddit information
• Author details
• Creation timestamp (ISO format)
• Post title and URL
• Engagement metrics (score, comments)
• Content flags (NSFW, spoiler, archived)
• Media details:
  • For images: source URL, srcset, alt text
  • For videos: source URL, poster image, duration, dimensions

💡 Use Cases

• Content curation and analysis
• Social media monitoring
• Market research
• Trend analysis
• Digital asset collection
• Community engagement tracking
• Visual content research
• Meme tracking and analysis

🔧 Input Parameters

Parameter	Type	Description
query	String	Search keyword or phrase
subReddit	String	Target subreddit name (without 'r/')
sort	String	Sort results by: 'relevance', 'top', 'new', 'comments', or 'hot'
time	String	Time range filter: 'hour', 'day', 'week', 'month', 'year', or 'all'
safeSearch	String	Enable/disable safe search ('0' for safe, '1' for unsafe)
maxItems	Integer	Maximum number of items to scrape

Input Example

A full explanation of an input example in JSON.

1{
2    "query": "ai",
3    "subReddit": "ChatGPT",
4    "sort": "relevance",
5    "time": "all",
6    "safeSearch": "0",
7    "maxItems": 45
8}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

1[
2	{
3		"post_id": "t3_1ettmf9",
4		"subreddit": "AppIdeas",
5		"author_id": "t2_t4okkrvf",
6		"created_time": "2024-08-16T16:42:26.663Z",
7		"title": "I created a platform that gives you tasks based on the goals you want to achieve. Called https://plani.ai/",
8		"type": "image",
9		"url": "https://www.reddit.com/r/AppIdeas/comments/1ettmf9/i_created_a_platform_that_gives_you_tasks_based/",
10		"score": 0,
11		"comments": 8,
12		"nsfw": false,
13		"spoiler": false,
14		"archived": false,
15		"media_type": "image",
16		"image": {
17			"src": "https://preview.redd.it/i-created-a-platform-that-gives-you-tasks-based-on-the-v0-powbj1x412jd1.png?width=640&crop=smart&auto=webp&s=8e871070ac1afee2445314d781acef6dac720c31",
18			"alt": "r/AppIdeas"
19		}
20	},
21	{
22		"post_id": "t3_1emdp7k",
23		"subreddit": "AppIdeas",
24		"author_id": "t2_bpicyhlm",
25		"created_time": "2024-08-07T14:47:33.839Z",
26		"title": "Working on an idea to capture tasks using voice and then auto cateogize them with AI. I think this will be useful when you want to capture thoughts when driving or jogging. Let me know if this will be useful? Got plans of integrating it with Google Calendar and Trello, but that'll come later.",
27		"type": "video",
28		"url": "https://www.reddit.com/r/AppIdeas/comments/1emdp7k/working_on_an_idea_to_capture_tasks_using_voice/",
29		"score": 7,
30		"comments": 2,
31		"nsfw": false,
32		"spoiler": false,
33		"archived": false,
34		"media_type": "video",
35		"video": {
36			"poster": "https://external-preview.redd.it/working-on-an-idea-to-capture-tasks-using-voice-and-then-v0-Zjg3aml6dm04OWhkMekSC856TfBJbyYqHyM9L9mPIdzo9IlgPmCqbXrSpK3W.png?format=pjpg&auto=webp&s=d1584f39adc99497814286181d29c9fa83c0f216",
37			"src": "https://packaged-media.redd.it/xpbem0wm89hd1/pb/m2-res_392p.mp4?m=DASHPlaylist.mpd&v=1&e=1730710800&s=3573eb993b5aed13269b7ee00be788708a11462e",
38			"duration": 117,
39			"dimensions": {
40				"width": 202,
41				"height": 392
42			}
43		}
44	},
45    ...
46]