**Crawl 9 platforms** to find **user pain points**. It uses **intelligent scoring** and **trend detection** to help **founders** make **data-driven product decisions**
Which platforms to scrape for pain points. Select multiple sources for comprehensive coverage.
Default value of this property is ["reddit"]
Subreddits
subredditsarrayRequired
Which subreddits to scrape (without r/ prefix). Add multiple for broader coverage.
Default value of this property is ["startups"]
Pain Point Keywords
keywordsarrayRequired
Keywords that indicate pain points in content. More keywords = more results.
Default value of this property is ["struggling","frustrated"]
Max Posts Per Source
maxPostsintegerOptional
Maximum number of posts to fetch from each subreddit/source. Higher = more data but slower.
Default value of this property is 10
Minimum Pain Point Score
minScoreintegerOptional
Minimum relevance score (0-100) to include a pain point. Lower = more results (15-25 recommended for emerging pain points), Higher = stricter quality (40-60 for established pain points).
Default value of this property is 15
Max Concurrency
maxConcurrencyintegerOptional
Number of parallel requests to make simultaneously. Higher = faster but may trigger rate limits. Recommended: 3-5 for most sources, 1-2 if getting blocked.
Default value of this property is 3
Time Range
timeRangeEnumOptional
Time period for fetching posts. Applies to Reddit and other time-filtered sources. Shorter = fresher data, Longer = more historical data.
Remove duplicate pain points based on content similarity (recommended)
Default value of this property is true
Extract Video Content
extractVideoContentbooleanOptional
Include pain points from video posts (Reddit videos, YouTube)
Default value of this property is false
Enable CSV Export
enableCSVExportbooleanOptional
Export pain points to CSV/Excel format for easy analysis
Default value of this property is true
Enable Trend Detection
enableTrendDetectionbooleanOptional
Detect similar pain points across different sources to identify trending problems
Default value of this property is true
Enable Category Classification
enableCategoryClassificationbooleanOptional
Auto-classify pain points into categories (Technical, Marketing, Hiring, etc.)
Default value of this property is true
Enable Sentiment Analysis
enableSentimentAnalysisbooleanOptional
Analyze sentiment of pain points (Critical, Mild, Solution-seeking, Positive)
Default value of this property is true
Enable Competitor Detection
enableCompetitorDetectionbooleanOptional
Detect mentions of competitors/tools in pain points
Default value of this property is false
Enable Keyword Frequency Report
enableKeywordFrequencyReportbooleanOptional
Generate summary report with keyword frequency and statistics
Default value of this property is true
Max Retries
maxRetriesintegerOptional
Maximum number of retries for failed requests (with exponential backoff)
Default value of this property is 3
Enable Summary Statistics Card
enableStatisticsCardbooleanOptional
Generate summary statistics card with total pain points, sources, top 5 by score, average score, and deduplication rate
Default value of this property is true
Enable Multi-Format Export
enableMultiFormatExportbooleanOptional
Export pain points to multiple formats: JSON, CSV, and HTML Report (with filters and pretty table)
Default value of this property is true
Enable Signal Classification
enableSignalClassificationbooleanOptional
Classify pain points into signal types (complaint, feedback, help_request, etc.) with urgency, persona, and business value mapping. Transforms raw data into actionable intelligence.
Default value of this property is true
Enable Data Validation
enableDataValidationbooleanOptional
Enrich pain points with data freshness (age in days), industry classification, and resolution status. Improves data quality and enables time-based filtering.
Default value of this property is true
Enable URL Validation
enableUrlValidationbooleanOptional
Check if pain point URLs are still accessible. Slower but provides more accurate resolution status. Recommended for smaller datasets.
Default value of this property is false
GitHub Personal Access Token (Optional)
githubTokenstringOptional
GitHub Personal Access Token for API authentication. Without this, you're limited to 60 requests/hour. With token: 5000 requests/hour. Create at: https://github.com/settings/tokens