Part of ScrapeClaw.cc — a suite of production-ready, agentic social media scrapers for Instagram, YouTube, X/Twitter, and Facebook built with Python & Playwright, no API keys required.

A powerful, resilient, and anti-detect YouTube channel metadata scraper. This tool enables automated discovery and deep-scraping of YouTube channels without requiring official API keys or user authentication.

• 🔍 Smart Discovery:
• 📊 Deep Scraping: Extract comprehensive metadata, including:
  • Subscriber counts, total views, and video counts.
  • Channel descriptions, joined dates, and verified status.
  • Recent video uploads with thumbnails and metadata.
  • External social links and location info.
• 🛡️ Anti-Detection: Built-in human-like behavior simulation (random mouse movements, scroll behavior) and custom user-agent rotation to minimize bot detection.
• 🖼️ Media Handling: Automatic downloading and resizing (JPEG compression) of profile pictures, banners, and video thumbnails.
• 🔄 Robust Orchestration: State-managed pipeline with auto-resume, failure recovery, and checkpointing for large-scale scraping operations.

Find channel handles/URLs based on niche and location. This generates a queue file in data/queue/.

$python youtube_channel_discovery.py --categories "tech" --locations "India"

Process a queue file to extract detailed metadata for each channel.

$python youtube_channel_scraper.py --queue data/queue/your_queue_file.json

• data/output/: JSON files for each scraped channel.
• thumbnails/: Organized folders containing profile pics, banners, and video thumbnails.
• data/queue/: Checkpoint files for discovery results.
• data/progress/: Session state files for the orchestrator.