# Reddit Community Scraper (`rigelbytes/reddit-scraper`) Actor Scrape posts from any Reddit community (subreddit). Bypasses captcha automatically and extracts post data including title, text, author, score, comments count, and more. - **URL**: https://apify.com/rigelbytes/reddit-scraper.md - **Developed by:** [Rigel Bytes](https://apify.com/rigelbytes) (community) - **Categories:** Social media, Integrations, MCP servers - **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.70 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Reddit Community Scraper Scrape posts from any public Reddit community (subreddit) to power content analysis, trend research, competitive intelligence, and automated monitoring — for just **$2 per 1,000 posts**. Enter a subreddit URL or name, choose your sort order, and get structured post data in minutes. ### What can Reddit Community Scraper do for you? - **Monitor community discussions** across any subreddit — track trending topics, sentiment shifts, and emerging conversations in your industry or niche. - **Extract post metadata at scale** — titles, authors, scores, comment counts, flairs, and timestamps for every post, ready for analysis. - **Build content datasets** for AI training, market research, or academic studies using Reddit's vast repository of public discussions. - **Track competitor communities** — watch what competitors are posting, how their audience engages, and which topics gain traction. - **Automate Reddit data collection** — run on a schedule to capture new posts daily, weekly, or hourly without manual effort. - **Export to any format** — download results as JSON, CSV, Excel, or access them programmatically via Apify API. ### What data can you extract? The scraper returns structured post data with 30+ fields for each record: | Category | Fields | |----------|--------| | 📝 **Content** | `title`, `selftext`, `url`, `fullUrl`, `permalink`, `domain` | | 👤 **Author** | `author`, `distinguished` | | 📊 **Engagement** | `score`, `ups`, `upvoteRatio`, `numComments`, `totalAwardsReceived`, `gilded` | | 🏷️ **Community** | `subreddit`, `subredditNamePrefixed`, `sourceQuery`, `linkFlairText` | | ⏱️ **Timestamps** | `createdAt` | | 🏷️ **Flags** | `over18`, `spoiler`, `stickied`, `pinned`, `locked`, `archived`, `isSelf`, `isVideo`, `isGallery` | | 🖼️ **Media** | `thumbnailUrl`, `postHint`, `galleryUrls` | | 🔑 **Identifiers** | `id` | ### Why use this scraper? - 🔬 **Content research** — Analyze what topics resonate in any Reddit community. Study post titles, engagement patterns, and discussion themes across time. - 📈 **Trend monitoring** — Track which posts gain traction, monitor upvote velocity, and identify emerging trends before they go mainstream. - 🏢 **Competitive intelligence** — Follow brand mentions, product discussions, and competitor community activity from subreddits relevant to your market. - 🤖 **AI training data** — Build high-quality text datasets from Reddit discussions for fine-tuning language models or powering analytics dashboards. - 🔔 **Automated alerts** — Schedule runs to get notified when new posts match your criteria, enabling real-time community monitoring. ### Pricing - **$2/1,000 posts** - Apify platform plan discounts available: Bronze $1.90, Silver $1.80, Gold $1.70 per 1,000. - No hidden fees or limits on usage. ### How to use Reddit Community Scraper 1. **Create an Apify account** — Sign up at [Apify Console](https://console.apify.com). 2. **Open the actor** — Go to the [Reddit Community Scraper](https://apify.com/rigelbytes/reddit-scraper) in Apify Store. 3. **Configure your input** — Add subreddit URLs or community names (see Input section below). 4. **Choose sort options** — Select Hot, New, Top, Rising, or Controversial, with optional time filters. 5. **Start the run** — Click Start and wait for the scraper to collect your data. 6. **Download results** — Export your dataset as JSON, CSV, Excel, or access via API. ### Input The actor accepts the following input parameters: | Field | Type | Required | Description | |-------|------|----------|-------------| | `startUrls` | Array | No | Reddit community URLs (e.g. `https://www.reddit.com/r/python/`) | | `searchQueries` | Array | No | Subreddit names without URL (e.g. `AI_Agents`, `python`). Alternative to startUrls. | | `sortBy` | String | No | Sort order: `hot` (default), `new`, `top`, `rising`, `controversial` | | `timeFilter` | String | No | Time filter for top/controversial: `hour`, `day`, `week`, `month`, `year`, `all` (default) | | `maxItems` | Integer | No | Max posts to scrape (0 = unlimited, default) | | `proxyConfiguration` | Object | No | Proxy settings. Residential proxies are strongly recommended. | #### 📝 Copy for Use: ```json { "searchQueries": ["AI_Agents", "python"], "sortBy": "hot", "timeFilter": "all", "maxItems": 100, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` ### Output Each record in the dataset represents one Reddit post with the following fields: ```json { "id": "1vhilqp", "title": "Which AI agent platform is best for enterprise voice support?", "sourceQuery": "r/AI_Agents", "selftext": "We're looking at AI agent platforms for enterprise voice support...", "author": "elementary_constable", "subreddit": "AI_Agents", "subredditNamePrefixed": "r/AI_Agents", "score": 34, "ups": 34, "upvoteRatio": 0.97, "numComments": 16, "totalAwardsReceived": 0, "createdAt": "2026-08-06T22:20:48+00:00", "url": "https://www.reddit.com/r/AI_Agents/comments/1vhilqp/...", "permalink": "/r/AI_Agents/comments/1vhilqp/...", "fullUrl": "https://www.reddit.com/r/AI_Agents/comments/1vhilqp/...", "domain": "self.AI_Agents", "linkFlairText": "Resource Request", "over18": false, "spoiler": false, "stickied": false, "isSelf": true, "isVideo": false, "isGallery": false, "thumbnailUrl": "", "postHint": "", "galleryUrls": [], "gilded": 0, "distinguished": "", "pinned": false, "locked": false, "archived": false } ``` ### Why Choose This Scraper? - **Affordable**: Pay only $2 per 1,000 posts scraped. Scale up or down as needed with no commitment. - **Comprehensive**: Extracts 30+ data fields per post including content, engagement metrics, author info, media flags, and community metadata. - **Easy to Use**: Just provide a subreddit URL or name — no complex configuration, no API keys to manage, no browser setup required. - **Reliable**: Built with automatic captcha solving for uninterrupted access to public Reddit communities. Runs on Apify's cloud infrastructure with automatic retries. ### Recommended Proxy Providers - ## **Shifter** - Reliable residential proxies all over the world. - Cheap rates - [Order Shifter Now](https://shifter.io/r/YoBB/order) - Get 10% Off any product, use coupan `rigelbytes-YoBB`. - ## **OxyLabs** - **100M+ Proxies** - Fastest proxies in the market - Real profile, human-like Residential IPs - Quality assurance framework for most reliable IPs - [Get Proxies](https://oxylabs.go2cloud.org/aff_c?offer_id=7\&aff_id=1366\&url_id=7) - ## **DataImpulse** - Covers **200+ Counties** - Reliable Residential Proxies for just $1/GB - [Get Residential Proxies](https://dataimpulse.com/?aff=89421) ### [![Learn More About Proxies](https://img.shields.io/badge/Learn_More-About_Proxies-blue?style=for-the-badge)](#understanding-proxies) ### 🙌 Why Buy Through Our Affiliate Link? - Exclusive Deals: Some providers may offer special discounts or bonuses when you use our link. - Support Our Work: Each purchase helps us maintain and improve the tools and services we provide. - No Extra Cost: You pay the same price, but part of it goes to supporting our efforts. #### Running via Apify Console You can run this actor from the Apify Console by providing the necessary input parameters. #### Running via API You can trigger this actor using the Apify API, passing the required input in the request body. ### API Examples Run the Reddit Community Scraper via Apify API: #### Python ```python from apify_client import ApifyClient client = ApifyClient("YOUR_API_TOKEN") run = client.actor("rigelbytes/reddit-scraper").call(run_input={ "searchQueries": ["AI_Agents", "python"], "sortBy": "hot", "maxItems": 100, "proxyConfiguration": {"useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"]} }) items = client.dataset(run["defaultDatasetId"]).list_items().items print(f"Scraped {len(items)} posts") ``` #### JavaScript ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR_API_TOKEN' }); const run = await client.actor('rigelbytes/reddit-scraper').call({ searchQueries: ['AI_Agents', 'python'], sortBy: 'hot', maxItems: 100, proxyConfiguration: { useApifyProxy: true, apifyProxyGroups: ['RESIDENTIAL'] } }); const items = await client.dataset(run.defaultDatasetId).listItems(); console.log(`Scraped ${items.items.length} posts`); ``` #### cURL ```shell curl -X POST "https://api.apify.com/v2/acts/rigelbytes~reddit-scraper/runs" \ -H "Authorization: Bearer YOUR_API_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "searchQueries": ["AI_Agents", "python"], "sortBy": "hot", "maxItems": 100, "proxyConfiguration": {"useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"]} }' ``` ### Scheduling & Deduplication - **Scheduling:** Set up recurring runs from the Apify Console Scheduler tab. For active communities, run daily or hourly to capture new posts as they appear. When using `searchQueries` with multiple subreddits, consider running separate schedules per community for better rate management. - **Deduplication:** Each post includes a unique Reddit `id` field. To avoid processing the same post twice in your pipeline, deduplicate on the `id` field. The actor respects `maxItems` to cap output per run. - **Webhooks:** Configure a webhook URL in Apify Console to trigger downstream processing whenever a run completes — useful for feeding new posts into a database, notification system, or analytics pipeline. ### 🚀 Other Tools by Rigel Bytes Explore **127** more scraping tools by Rigel Bytes, organized by use case: #### 📱 Social Media Scrape Instagram, TikTok, LinkedIn, and more for content research and marketing intelligence. - **[Export Instagram Reels](https://apify.com/rigelbytes/export-instagram-reels)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Facebook Ads Scraper](https://apify.com/rigelbytes/facebook-ads-scraper)** — Extract posts, profiles, and engagement data from Facebook for content research, influencer tracking, and marketing analytics. - **[Instagram Analytics Tool](https://apify.com/rigelbytes/instagram-analytics-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Comment Scraper](https://apify.com/rigelbytes/instagram-comment-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Creator Stats](https://apify.com/rigelbytes/instagram-creator-stats)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Engagement Tool](https://apify.com/rigelbytes/instagram-engagement-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Post Scraper](https://apify.com/rigelbytes/instagram-post-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[instagram-posts](https://apify.com/rigelbytes/instagram-posts)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Profile Scraper](https://apify.com/rigelbytes/instagram-profile-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Reel Scraper](https://apify.com/rigelbytes/instagram-reel-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[linkedin-company-details](https://apify.com/rigelbytes/linkedin-company-details)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Linkedin Company Scraper](https://apify.com/rigelbytes/linkedin-company-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[LinkedIn Job Scraper](https://apify.com/rigelbytes/linkedin-job-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[LinkedIn Profile Scraper](https://apify.com/rigelbytes/linkedin-profile-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Scrape Instagram Creators](https://apify.com/rigelbytes/scrape-instagram-creators)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Tiktok Comment Scraper](https://apify.com/rigelbytes/tiktok-comment-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Creator Stats](https://apify.com/rigelbytes/tiktok-creator-stats)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Engagement Rate](https://apify.com/rigelbytes/tiktok-engagement-rate)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[TikTok Profile Scraper](https://apify.com/rigelbytes/tiktok-profile-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[YouTube Comment Scraper](https://apify.com/rigelbytes/youtube-comment-scraper)** — Extract posts, profiles, and engagement data from YouTube for content research, influencer tracking, and marketing analytics. #### 🏠 Real Estate Extract property listings, prices, and agent data from top real estate platforms. - **[Aengevelt Scraper — German Real Estate Property Listings](https://apify.com/rigelbytes/aengevelt-scraper)** — Extract property listings from Aengevelt Immobilien. Get pricing, location, contact data, and images from Germany's... - **[Airbnb Address Finder](https://apify.com/rigelbytes/airbnb-address-finder)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Availability Calendar](https://apify.com/rigelbytes/airbnb-availability-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Detailed Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-detailed-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Images Downloader](https://apify.com/rigelbytes/airbnb-images-downloader)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing](https://apify.com/rigelbytes/airbnb-listing)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing Urls](https://apify.com/rigelbytes/airbnb-listing-urls)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Property Details](https://apify.com/rigelbytes/airbnb-property-details)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Reviews](https://apify.com/rigelbytes/airbnb-reviews)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Apartments.com Scraper](https://apify.com/rigelbytes/apartments-scraper)** — Scrape rental listings from apartments.com by entering location search queries. Returns property details including... - **[Aqar.fm Scraper — النسخة العربية](https://apify.com/rigelbytes/aqar-fm-scraper)** — Scrapes Saudi real estate listings from aqar.fm via Next.js RSC search API. Supports Arabic search paths, start... - **[Asunnot Oikotie.fi Real Estate Scraper](https://apify.com/rigelbytes/asunnot-oikotie-fi)** — Scrape Finnish property listings from asunnot.oikotie.fi by location, filters, or search/listing URLs. Optionally... - **[Bayut Scraper](https://apify.com/rigelbytes/bayut-scraper)** — Scrape property listings and market data from Bayut for market research, price monitoring, and investment analysis. - **[BNP Paribas Real Estate Scraper](https://apify.com/rigelbytes/bnppre-scraper)** — Scrape commercial property listings from BNP Paribas Real Estate (bnppre.de) — offices, retail, industrial, and... - **[Boliga Denmark Real Estate Scraper](https://apify.com/rigelbytes/boliga-dk-scraper)** — Scrape property listings from Boliga.dk (Denmark). Search by zip code, free text, or result URLs. Optionally fetch... - **[Boligsiden.dk Scraper](https://apify.com/rigelbytes/boligsiden-dk-scraper)** — Scrape Danish real estate listings from Boligsiden.dk — for sale, sold, and rental properties with pricing, details,... - **[CBRE Scraper — Extract German Commercial Property Listings](https://apify.com/rigelbytes/cbre-scraper)** — Scrape commercial real estate letting listings from CBRE Germany (cbre.de). Office & industrial property data for... - **[Colliers Scraper — German Commercial Property Listings](https://apify.com/rigelbytes/colliers-scraper)** — Extract commercial property listings from Colliers.de — offices, industrial, retail & logistics with pricing, map... - **[Crexi Scraper](https://apify.com/rigelbytes/crexi-scraper)** — Scrape Crexi.com commercial real estate listings for sale and lease with filters, search queries, URLs, and optional... - **[Daft.ie Property Scraper](https://apify.com/rigelbytes/daft-ie-scraper)** — Scrapes property listings from Daft.ie including residential, rental, commercial, and new homes across Ireland. - **[DAHLER Real Estate Scraper — German Property Listings API](https://apify.com/rigelbytes/dahler-scraper)** — Extract buy and rent property listings from DAHLER Immobilien across Germany, Austria, and Spain. Get prices,... - **[dubai-listing-scraper](https://apify.com/rigelbytes/dubai-listing-scraper)** — Extract unlimited property listings from Bayut.com — the UAE's largest real estate platform. Get detailed property... - **[Etuovi.com Real Estate Scraper](https://apify.com/rigelbytes/etuovi-scraper)** — Scrape Finnish property listings from Etuovi.com by search location, filters, or search/listing URLs. Optionally... - **[Export Airbnb Calendar](https://apify.com/rigelbytes/export-airbnb-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Funda Netherlands Real Estate Scraper](https://apify.com/rigelbytes/funda-nl-scraper)** — Scrape property listings from Funda.nl — the largest real estate platform in the Netherlands. Supports buy and rent,... - **[Furnished Finder Fast](https://apify.com/rigelbytes/furnished-finder-fast)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[Extract Furnished Finder Hosts](https://apify.com/rigelbytes/furnished-finder-hosts)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[FurnishedFinder](https://apify.com/rigelbytes/furnishedfinder)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[German Real Estate MCP](https://apify.com/rigelbytes/german-realestate-mcp)** — MCP server for German real estate — 14 Rigel Bytes scrapers (ImmoScout24, Immowelt, Kleinanzeigen, RE/MAX, CBRE,... - **[GrandCityProperty Scraper — Extract German Rental Listings](https://apify.com/rigelbytes/grandcityproperty)** — Extract rental property listings from GrandCityProperty.de — prices, floor plans, energy data, and contact details.... - **[Grossmann Berger Scraper — German Real Estate Listings](https://apify.com/rigelbytes/grossmann-berger-scraper)** — Extract property listings, prices, agent contacts, and images from grossmann-berger.de. From $2/1,000 listings.... - **[Hemnet.se Scraper - Swedish Real Estate Listings](https://apify.com/rigelbytes/hemnet-se-scraper)** — Scrape property listings from Hemnet.se including for-sale, upcoming, and sold homes. Search by URL or location... - **[home.dk Real Estate Scraper](https://apify.com/rigelbytes/home-dk-scraper)** — Scrape Danish property listings from home.dk by search location, filters, or search/listing URLs. Optionally enrich... - **[Immobiliare Italy Real Estate Scraper](https://apify.com/rigelbytes/immobiliare-it-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24](https://apify.com/rigelbytes/immobilienscout24)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24-scraper](https://apify.com/rigelbytes/immobilienscout24-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immoweb Scraper - Belgium Property Listings](https://apify.com/rigelbytes/immoweb-scraper)** — Scrapes property listings from Immoweb.be. Supports search result extraction with optional property detail enrichment. - **[Immowelt Property Scraper](https://apify.com/rigelbytes/immowelt-property-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[Immowelt Scraper](https://apify.com/rigelbytes/immowelt-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[JLL Property Scraper — Extract Commercial Investment Listings](https://apify.com/rigelbytes/jll-scraper)** — Scrape commercial and investment property data from JLL Germany (gewerbeimmobilien.jll.de and invest.jll.com).... - **[Land.com Agents Scraper](https://apify.com/rigelbytes/landdotcom-agents)** — Scrape property listings and market data from Land.com for market research, price monitoring, and investment analysis. - **[Land.com Scraper](https://apify.com/rigelbytes/landdotcom-scraper)** — Scrape property listings and market data from Land.com for market research, price monitoring, and investment analysis. - **[Nybolig Denmark Real Estate Scraper](https://apify.com/rigelbytes/nybolig-dk-scraper)** — Scrape property listings from Nybolig.dk (Denmark). Search by zip code, free text, filters, or result/listing URLs.... - **[Outdoorsy Scraper](https://apify.com/rigelbytes/outdoorsy-scraper)** — Scrape property listings and market data from Outdoorsy for market research, price monitoring, and investment analysis. - **[PropertyFinder Eygpt](https://apify.com/rigelbytes/propertyfinder-eygpt)** — Scrape property listings and market data from Property Finder for market research, price monitoring, and investment analysis. - **[Propertyfinder Scraper](https://apify.com/rigelbytes/propertyfinder-scraper)** — Scrape property listings and market data from Property Finder for market research, price monitoring, and investment analysis. - **[Realtor.com Agent Scraper](https://apify.com/rigelbytes/realtor-agent-scraper)** — Scrape real estate agents from Realtor.com by city or ZIP code. Optionally fetch full agent profiles and reviews via... - **[Realtor.com Scraper](https://apify.com/rigelbytes/realtor-scraper)** — Scrape Realtor.com property listings with full search filters via GraphQL. Supports price, beds/baths, property... - **[Redfin Scraper](https://apify.com/rigelbytes/redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[RE/MAX Germany Scraper](https://apify.com/rigelbytes/remax-scraper)** — Scrapes residential and commercial real estate listings from remax.de by German Bundesland. Extracts prices, areas,... - **[Rent.com Scraper](https://apify.com/rigelbytes/rent-com-scraper)** — Scrape rental listings from rent.com — search by location query or URL. Extracts property details, photos, floor... - **[Rightmove Scraper](https://apify.com/rigelbytes/rightmove-scraper)** — Scrape property listings and market data from Rightmove for market research, price monitoring, and investment analysis. - **[RVshare Scraper](https://apify.com/rigelbytes/rvshare-scraper)** — Scrape property listings and market data from RVshare for market research, price monitoring, and investment analysis. - **[Savills Property Scraper — Extract Listings by Location](https://apify.com/rigelbytes/savills-scraper)** — Scrape residential and commercial property listings from Savills by city. Get prices, addresses, sizes, bedrooms,... - **[Unlimited Redfin Scraper](https://apify.com/rigelbytes/unlimited-redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[Wüstenrot Immobilien Scraper — German Property Listings API](https://apify.com/rigelbytes/wuestenrot-immobilien)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Zillow Detail Scraper](https://apify.com/rigelbytes/zillow-detail-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zillow Scraper](https://apify.com/rigelbytes/zillow-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zoopla Scraper](https://apify.com/rigelbytes/zoopla-scraper)** — Scrape property listings and market data from Zoopla for market research, price monitoring, and investment analysis. #### ✈️ Travel & Hospitality Monitor rentals, bookings, and travel listings at scale. - **[Autotrader Scraper](https://apify.com/rigelbytes/autotrader-scraper)** — Scrapes car listings from Autotrader.com with advanced search filters, pagination, and detailed vehicle data. - **[CarMax Scraper](https://apify.com/rigelbytes/carmax-scraper)** — Scrapes used car listings from CarMax.com with search URL, zip code filtering, and pagination support. - **[Cars.com Scraper](https://apify.com/rigelbytes/cars-scraper)** — Scrapes car listings from Cars.com using their GraphQL API. Extracts detailed vehicle data including price, specs,... - **[Cars & Bids Scraper](https://apify.com/rigelbytes/carsandbids-scraper)** — Scrape live, upcoming, and past car auctions from Cars & Bids. Extract vehicle details, bids, photos, comments, and... - **[Ticketmaster Scraper](https://apify.com/rigelbytes/ticketmaster-scraper)** — Collect rental and travel listings from Ticketmaster for pricing intelligence and availability tracking. #### 🛒 E-commerce Scrape products, prices, and marketplace data for competitive research. - **[Amazon Product Scraper](https://apify.com/rigelbytes/amazon-product-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[Amazon Search Scraper](https://apify.com/rigelbytes/amazon-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[AutoScout24 Scraper](https://apify.com/rigelbytes/autoscout24-scraper)** — Scrape car listings from AutoScout24 with full filter support. Extract makes, models, prices, mileage, seller info,... - **[Best Buy Product Scraper](https://apify.com/rigelbytes/best-buy-scraper)** — Scrape Best Buy US and Canada products by search query, category URL, or SKU. Optionally enrich each item with full... - **[Daraz](https://apify.com/rigelbytes/daraz)** — Scrape products, prices, and seller data from Daraz for competitor monitoring, pricing, and product research. - **[Etsy Scraper](https://apify.com/rigelbytes/etsy-scraper)** — Scrape products, prices, and seller data from Etsy for competitor monitoring, pricing, and product research. - **[Homedepot Scraper](https://apify.com/rigelbytes/homedepot-scraper)** — HomeDepot Products Scraper lets you extract product data from homedepot.com using a collection URL and delivery ZIP.... - **[Kleinanzeigen Scraper](https://apify.com/rigelbytes/kleinanzeigen-scraper)** — Scrape listings from kleinanzeigen.de — search results and detail pages for any category (electronics, vehicles,... - **[Otodom Scraper - Polish Real Estate Listings](https://apify.com/rigelbytes/otodom-scraper)** — Scrapes property listings from Otodom.pl, Poland's leading real estate marketplace. Supports filters for transaction... - **[Zalando Product Scraper](https://apify.com/rigelbytes/zalando-scraper)** — Scrape product listings and optional product details from Zalando category pages and search queries. #### 💼 Jobs & Recruitment Collect job listings and company hiring data for market analysis. - **[Glassdoor Jobs Scraper](https://apify.com/rigelbytes/glassdoor-jobs-scraper)** — Scrape job listings from Glassdoor by search query and location, with optional job detail enrichment. - **[StepStone Jobs Scraper — Extract German/DACH Job Listings](https://apify.com/rigelbytes/stepstone-jobs-scraper)** — Scrape thousands of job listings from StepStone (DE, AT, BE, NL) with salary, skills, remote status & more. From... - **[Upwork Jobs Scraper](https://apify.com/rigelbytes/upwork-jobs-scraper)** — Scrapes Upwork freelance job listings by keyword with full search filters (sort, experience, job type, budget,... - **[ZipRecruiter Job Scraper](https://apify.com/rigelbytes/ziprecruiter-scraper)** — Scrape job listings from ZipRecruiter with search queries, locations, and radius filters. Extracts title, company,... #### 📩 Lead Generation Find business contacts, leads, and company data for sales and outreach. - **[Booli.se Scraper](https://apify.com/rigelbytes/booli-se-scraper)** — Scrapes Swedish real estate listings from Booli.se — for sale, sold prices, and new construction. Supports search... - **[Company Service Finder](https://apify.com/rigelbytes/company-service-finder)** — The Company Service Finder uses AI to extract and analyze company services from Google Search & Maps. Get detailed... - **[Doctify Scraper](https://apify.com/rigelbytes/doctify-scraper)** — Doctify Scraper lets you extract doctor and practice data from doctify.com using a search results URL. Collect... - **[Doctolib Scraper](https://apify.com/rigelbytes/doctolib-scraper)** — Scrape doctor profiles, availability, and practice details from Doctolib.de — Germany's largest medical appointment... - **[FindLaw Law Firm Scraper - Attorney & Law Firm Data Extraction](https://apify.com/rigelbytes/findlaw-scraper)** — Scrape law firm profiles from FindLaw.com. Extract detailed attorney and firm information including contact details,... - **[Finn.no Real Estate Scraper](https://apify.com/rigelbytes/finn-no-scraper)** — Scrape Norwegian real-estate listings from Finn.no with search URL or filter-based discovery, optional full details... - **[Google Maps Scraper](https://apify.com/rigelbytes/google-maps-scraper)** — Find business leads and contact details from Google Maps for outbound sales, prospecting, and CRM enrichment. - **[Krogsveen.no Real Estate Scraper](https://apify.com/rigelbytes/krogsveen-no-scraper)** — Scrape Norwegian real-estate listings from Krogsveen.no with search URL or filter-based discovery, optional full... - **[LeadRocks Scraper](https://apify.com/rigelbytes/leadrocks-scraper)** — Export filtered B2B leads from the LeadRocks dataset by category, state, job title, company, and industry. Free... - **[Website Services Finder](https://apify.com/rigelbytes/website-services-finder)** — Automatically extract and analyze company services from any business website using advanced AI. Choose from 5 AI... - **[Zillow Agents](https://apify.com/rigelbytes/zillow-agents)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. - **[Zillow Agents Phone](https://apify.com/rigelbytes/zillow-agents-phone)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. - **[Zillow Agents Vault](https://apify.com/rigelbytes/zillow-agents-vault)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. #### ⭐ Reviews & Ratings Monitor reviews and reputation data across review platforms. - **[Airbnb Listing Reviews](https://apify.com/rigelbytes/airbnb-listing-reviews)** — Collect reviews and ratings from Airbnb for reputation monitoring and customer insights. - **[BBB Scraper](https://apify.com/rigelbytes/bbb-scraper)** — Collect reviews and ratings from BBB for reputation monitoring and customer insights. - **[Costco Product Scraper](https://apify.com/rigelbytes/costco-scraper)** — Scrapes product data from Costco.com including prices, descriptions, ratings, and availability. Supports search... - **[HRS Hotel Reviews Scraper](https://apify.com/rigelbytes/hrs-hotel-reviews-scraper)** — Extract hotel details, room offers, and guest reviews from HRS hotel URLs. - **[HRS Hotel Scraper](https://apify.com/rigelbytes/hrs-scraper)** — Scrapes hotel listings, prices, ratings, and amenities from HRS (hrs.com) by location and travel dates. - **[Google Play Store App Reviews Scraper](https://apify.com/rigelbytes/playstore-app-reviews)** — Scrape Google Play Store app reviews by app ID or Play Store URL. Supports multiple apps, sorting, score filters,... - **[Rottentomatoes Reviews Scraper](https://apify.com/rigelbytes/rottentomatoes-reviews-scraper)** — Collect reviews and ratings from Rotten Tomatoes for reputation monitoring and customer insights. - **[Trustpilot Reviews Scraper](https://apify.com/rigelbytes/trustpilot-reviews)** — Collect reviews and ratings from Trustpilot for reputation monitoring and customer insights. - **[Yelp Scraper](https://apify.com/rigelbytes/yelp-scraper)** — Scrape Yelp business listings by search term, category, location, or URL. Optional full business details with phone,... #### 🍔 Food & Delivery Extract restaurant, grocery, and delivery platform data. - **[Instacart Scraper](https://apify.com/rigelbytes/instacart-scraper)** — Scrape menus, stores, and delivery data from Instacart for data-driven research and automation. - **[Lidl Product Scraper](https://apify.com/rigelbytes/lidl-scraper)** — Scrape Lidl supermarket products across Europe by search query or category/product URL. Optionally enrich each item... - **[Publix Scraper](https://apify.com/rigelbytes/publix-scraper)** — Scrape menus, stores, and delivery data from Publix for data-driven research and automation. #### 📰 News & Media Scrape news, articles, and media content for research. - **[SEC IPO Event Intelligence](https://apify.com/rigelbytes/ipo-events-api)** — Monitors SEC EDGAR for IPO filings and converts them into structured business events, with optional AI company... - **[SEC Filings Scraper](https://apify.com/rigelbytes/sec-filings-intelligence)** — Retrieve clean, normalized SEC EDGAR filing data by ticker, CIK, or company name — with document links, optional... #### 🛠️ Developer Tools General-purpose scraping and automation tools. - **[EU Tenders Scraper](https://apify.com/rigelbytes/eu-tenders-scraper)** — Scrape EU public procurement notices from TED (Tenders Electronic Daily) with advanced search filters,... - **[Web Crawler](https://apify.com/rigelbytes/webcrawler)** — This web crawler is designed to provide users with complete flexibility by allowing them to use their \*\*own... ### Understanding Proxies: When scraping data or browsing anonymously, proxies are essential. They act as intermediaries, masking your original IP address and allowing you to send requests from another location. #### Why Use Proxies? - Avoid IP Blocks: By routing requests through proxies, you prevent the target website from recognizing your IP as a scraper or spammer. - Access Geo-restricted Content: Proxies let you access content or websites restricted by location. - Enhance Anonymity: Hide your actual IP, ensuring privacy while scraping or browsing. #### Types of Proxies 1. Residential Proxies - Real IP addresses provided by ISPs to home users. - They mimic regular users, making them harder to detect. - Best for: Long-term, undetectable scraping, and avoiding blocks. 2. Data Center Proxies - IP addresses from servers in data centers. - Faster and cheaper than residential proxies but easier to detect and block. - Best for: High-speed scraping, but with a higher risk of detection. 3. Mobile Proxies - IPs provided by mobile carriers (3G/4G/5G networks). - Very difficult to detect, as they appear as regular mobile users. - Best for: Mobile-related scraping or avoiding sophisticated blocks. #### Rotating Proxies vs. Straight Proxies - Rotating Proxies: Every request you send goes through a different proxy, making it harder for websites to detect patterns. - Straight Proxies: All requests are sent through the same proxy, making it easier to track your IP. ### FAQs & Troubleshooting #### Q: Why am I getting zero results? Reddit requires captcha verification for scraping. The actor handles this automatically, but you must use residential proxies — datacenter IPs are routinely blocked by Reddit. Make sure `proxyConfiguration` is set to use Apify residential proxies. #### Q: What's the difference between `startUrls` and `searchQueries`? `startUrls` accepts full Reddit URLs like `https://www.reddit.com/r/python/`. `searchQueries` accepts just the subreddit name like `python` or `AI_Agents` — the URL is built automatically. Use whichever is more convenient. You can also combine both. #### Q: How does the `sortBy` and `timeFilter` work? `sortBy` controls the listing order: `hot` (trending), `new` (latest), `top` (highest scored), `rising` (gaining momentum), `controversial` (polarizing). `timeFilter` only applies to `top` and `controversial` — it limits results to a window like past day, week, month, year, or all time. #### Q: What counts as one result in my pricing? Each Reddit post scraped counts as one result. The actor charges **$2 per 1,000 posts** regardless of how many fields are extracted per post. Use `maxItems` to control your cost per run. #### Q: Can I scrape private or NSFW subreddits? The actor scrapes **public** Reddit communities only. Private subreddits, quarantined communities, and age-restricted content that requires login are not accessible. The `over18` flag in the output indicates whether a post is marked NSFW by its author. #### Q: How do I export my results? Results are stored in Apify's default dataset. From the Apify Console you can download as JSON, CSV, Excel, XML, or RSS. You can also access results programmatically via the Apify API using your dataset ID. ### About Rigel Bytes Rigel Bytes specializes in web scraping, automation, and data analytics. We help businesses extract and leverage valuable data for informed decision-making. ### Contact Us - Schedule a call: - Email: ### Detailed Data Here are 3 example records from a scrape of r/AI\_Agents: ```json [ { "id": "1vgbhal", "title": "Weekly Thread: Project Display", "sourceQuery": "r/AI_Agents", "selftext": "Weekly thread to show off your AI Agents and LLM Apps! Top voted projects will be featured in our weekly newsletter.", "author": "help-me-grow", "subreddit": "AI_Agents", "subredditNamePrefixed": "r/AI_Agents", "score": 2, "ups": 2, "upvoteRatio": 1.0, "numComments": 15, "totalAwardsReceived": 0, "createdAt": "2026-08-05T16:00:58+00:00", "url": "https://www.reddit.com/r/AI_Agents/comments/1vgbhal/weekly_thread_project_display/", "permalink": "/r/AI_Agents/comments/1vgbhal/weekly_thread_project_display/", "fullUrl": "https://www.reddit.com/r/AI_Agents/comments/1vgbhal/weekly_thread_project_display/", "domain": "self.AI_Agents", "linkFlairText": "", "over18": false, "spoiler": false, "stickied": true, "isSelf": true, "isVideo": false, "isGallery": false, "thumbnailUrl": "", "postHint": "self", "galleryUrls": [], "gilded": 0, "distinguished": "", "pinned": false, "locked": false, "archived": false }, { "id": "1vhilqp", "title": "Which AI agent platform is best for enterprise voice support?", "sourceQuery": "r/AI_Agents", "selftext": "We're looking at AI agent platforms for enterprise voice support and every vendor seems to claim the same thing. The hard part is finding one that can handle real customer calls without falling apart when the issue gets complex.", "author": "elementary_constable", "subreddit": "AI_Agents", "subredditNamePrefixed": "r/AI_Agents", "score": 34, "ups": 34, "upvoteRatio": 0.97, "numComments": 16, "totalAwardsReceived": 0, "createdAt": "2026-08-06T22:20:48+00:00", "url": "https://www.reddit.com/r/AI_Agents/comments/1vhilqp/...", "permalink": "/r/AI_Agents/comments/1vhilqp/...", "fullUrl": "https://www.reddit.com/r/AI_Agents/comments/1vhilqp/...", "domain": "self.AI_Agents", "linkFlairText": "Resource Request", "over18": false, "spoiler": false, "stickied": false, "isSelf": true, "isVideo": false, "isGallery": false, "thumbnailUrl": "", "postHint": "", "galleryUrls": [], "gilded": 0, "distinguished": "", "pinned": false, "locked": false, "archived": false }, { "id": "1vhhsvz", "title": "Why are most of you still pointing agents at a real Gmail instead of giving them their own inbox?", "sourceQuery": "r/AI_Agents", "selftext": "I work on email built for AI agents, so I'm obviously not neutral here. What I keep running into: people wire an agent into an inbox that belongs to a human.", "author": "JanJanJaJa", "subreddit": "AI_Agents", "subredditNamePrefixed": "r/AI_Agents", "score": 18, "ups": 18, "upvoteRatio": 0.93, "numComments": 26, "totalAwardsReceived": 0, "createdAt": "2026-08-06T20:15:32+00:00", "url": "https://www.reddit.com/r/AI_Agents/comments/1vhhsvz/...", "permalink": "/r/AI_Agents/comments/1vhhsvz/...", "fullUrl": "https://www.reddit.com/r/AI_Agents/comments/1vhhsvz/...", "domain": "self.AI_Agents", "linkFlairText": "Discussion", "over18": false, "spoiler": false, "stickied": false, "isSelf": true, "isVideo": false, "isGallery": false, "thumbnailUrl": "", "postHint": "", "galleryUrls": [], "gilded": 0, "distinguished": "", "pinned": false, "locked": false, "archived": false } ] ``` # Actor input Schema ## `startUrls` (type: `array`): Reddit community URLs to scrape, e.g. https://www.reddit.com/r/AI\_Agents/ or https://old.reddit.com/r/python/. Leave empty if using searchQueries instead. ## `searchQueries` (type: `array`): Reddit community names to scrape (e.g. AI\_Agents, python, MachineLearning). Alternative to startUrls — URLs are built automatically. ## `sortBy` (type: `string`): How to sort posts in the community ## `timeFilter` (type: `string`): Time filter for top/controversial sorting ## `maxItems` (type: `integer`): Maximum number of posts to scrape (0 = unlimited) ## `proxyConfiguration` (type: `object`): Apify proxy for the browser session. Residential proxies are strongly recommended — datacenter IPs are often blocked by Reddit. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.reddit.com/r/AI_Agents/" } ], "searchQueries": [ "AI_Agents" ], "sortBy": "hot", "timeFilter": "all", "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `results` (type: `string`): Dataset containing scraped Reddit posts ## `kvsRecords` (type: `string`): Key-value store records produced by the Actor # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.reddit.com/r/AI_Agents/" } ], "searchQueries": [ "AI_Agents" ], "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("rigelbytes/reddit-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.reddit.com/r/AI_Agents/" }], "searchQueries": ["AI_Agents"], "maxItems": 20, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("rigelbytes/reddit-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.reddit.com/r/AI_Agents/" } ], "searchQueries": [ "AI_Agents" ], "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call rigelbytes/reddit-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,rigelbytes/reddit-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/IFYXRgTFSozEMAk6C/builds/LyrfW6LlKmUYzvvHh/openapi.json