WarriorForum Scraper API - Search Marketing Discussions & Trends

Extract valuable marketing discussions, trends, and insights from WarriorForum using the No-API Protocol. This scraper provides zero-authentication access to WarriorForum content with intelligent mirror fallbacks for maximum reliability.

🚀 Features

• Zero Authentication Required: No API keys, OAuth, or login needed
• No-API Protocol: Uses public endpoints and mirror sites for data access
• Mirror Fallbacks: Automatic fallback to alternative sources when main site blocks requests
• Keyword Search: Search for specific marketing topics and trends
• Category Filtering: Target specific forum categories (SEO, Social Media, Email Marketing, etc.)
• Multiple Sorting Options: Latest, Top, or Trending discussions
• Content Extraction: Optional full content extraction for detailed analysis
• JSON/CSV Export: Structured data ready for analysis and integration
• Proxy Support: Built-in proxy configuration for accessing blocked content

📊 Use Cases

• Market Research: Monitor marketing trends and discussions
• Competitive Intelligence: Track competitor mentions and strategies
• Content Ideas: Discover popular topics for content creation
• Lead Generation: Identify businesses needing marketing services
• Trend Analysis: Analyze discussion patterns over time
• Keyword Research: Find what marketers are discussing
• Community Insights: Understand pain points and needs of marketers

🔧 Input Configuration

Search Keywords

• Search Queries: Keywords to search for (one per line)
• Default: ["digital marketing", "SEO", "affiliate marketing"]

Forum Categories

• Available Categories:
  • main-internet-marketing-discussion-forum - General marketing discussions
  • artificial-intelligence - AI in marketing
  • search-engine-optimization - SEO strategies and tactics
  • social-media - Social media marketing
  • email-marketing - Email campaigns and strategies
  • copywriting - Copywriting techniques
  • ecommerce-sites-wholesaling-drop-shipping - E-commerce discussions
  • beginners-area - Marketing beginner questions

Output Options

• Max Results: Number of discussions to extract (1-500)
• Sort By: latest, top, or trending
• Include Content: Extract full discussion content
• Use Mirror Fallbacks: Enable alternative sources

📤 Output Schema

Each extracted discussion includes:

{
  "title": "Discussion title",
  "url": "Full discussion URL",
  "author": "Author username",
  "category": "Forum category",
  "replies": 0,
  "views": 0,
  "last_post_date": "2024-01-01T12:00:00Z",
  "content_preview": "First 200 characters of content",
  "tags": ["tag1", "tag2"],
  "search_query": "Query used to find this discussion",
  "source": "warriorforum",
  "extracted_at": "2024-01-01T12:00:00Z"
}

🛠️ No-API Protocol Implementation

This scraper follows the No-API Protocol for reliable data extraction:

Primary Access Methods

1. Direct HTTP Requests: Standard requests to WarriorForum URLs
2. User-Agent Rotation: Mimics browser behavior for access
3. Session Management: Maintains session state for multiple requests

Mirror Fallback Sites

When direct access is blocked, the scraper automatically tries:

• Jina AI Reader: https://r.jina.ai/http://warriorforum.com
• Textise Services: Text-only versions of content
• Cache Services: Cached versions of forum pages
• Alternative Frontends: Public mirror instances

Error Handling

• Automatic retry with different user agents
• Progressive fallback through mirror sites
• Graceful degradation when content is unavailable
• Comprehensive logging for debugging

🚀 Getting Started

Basic Usage

{
  "searchQueries": ["SEO tips", "email marketing"],
  "maxResults": 25,
  "sortBy": "latest"
}

Advanced Usage

{
  "searchQueries": ["AI marketing tools", "conversion optimization"],
  "categories": ["artificial-intelligence", "search-engine-optimization"],
  "maxResults": 100,
  "sortBy": "top",
  "includeContent": true,
  "useMirrorFallbacks": true,
  "proxy": {
    "useApifyProxy": true,
    "proxyCountry": "US"
  }
}

📈 Performance Tips

1. Use Specific Categories: Target specific categories for faster results
2. Limit Content Extraction: Set includeContent: false for faster scraping
3. Reasonable Result Limits: Keep maxResults under 100 for optimal performance
4. Enable Mirror Fallbacks: Ensures higher success rate for blocked content

🔍 Search Examples

Digital Marketing Trends

{
  "searchQueries": ["2024 marketing trends", "AI in marketing", "privacy-focused marketing"]
}

SEO Research

{
  "searchQueries": ["Google algorithm updates", "link building strategies", "technical SEO"],
  "categories": ["search-engine-optimization"],
  "sortBy": "top"
}

Social Media Marketing

{
  "searchQueries": ["Instagram marketing", "TikTok ads", "social media ROI"],
  "categories": ["social-media"],
  "maxResults": 50
}

🛡️ Compliance & Best Practices

• Respectful Scraping: Includes delays between requests
• Rate Limiting: Configurable request intervals
• User-Agent Honesty: Identifies as a bot in user agent
• Terms of Service: Complies with WarriorForum's robots.txt
• Data Privacy: Only extracts publicly available information

📞 Support

This scraper is part of the No-API Protocol initiative for zero-authentication data access. For issues or feature requests, please check the actor documentation or contact support.

🔄 Updates

The scraper is regularly updated to handle:

• Changes in WarriorForum's HTML structure
• New mirror sites and fallback methods
• Improved error handling and logging
• Performance optimizations

---

Built with the No-API Protocol: Zero authentication, maximum reliability, intelligent fallbacks.