Site Researcher

Pricing

from $5.00 / 1,000 results

Site Researcher

Stop wasting hours on competitor research. Paste any URL → get every image, video, and data point in 60 seconds. Full site crawl, tech stack detection, media download. Perfect for agencies, creators, and marketers.

Pricing

from $5.00 / 1,000 results

Rating

0.0

(0)

Developer

Rahul Hinduja

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Site Researcher - Full Website Media Scraper

Extract all images, videos, and data from any website in one click.

What It Does

🗺️ Discovers all pages via sitemap crawling
📊 Extracts structured data (JSON-LD, meta tags, Open Graph)
🔧 Detects tech stack (Shopify, WordPress, React, etc.)
📷 Downloads all images to Key-Value Store
🎬 Downloads all videos found on pages
📄 Outputs complete research dossier as JSON

Use Cases

Competitor research - Analyze any website's structure and content
B-roll production - Download all media for video production
Market analysis - Extract product data from e-commerce sites
Content inspiration - Study design and tech choices

Input

Field	Type	Default	Description
`startUrl`	String	Required	Website URL to research
`deepCrawl`	Boolean	`true`	Crawl all sitemap pages (up to 50)
`downloadMedia`	Boolean	`true`	Download images and videos
`mediaLimit`	Integer	`100`	Max media files to download

Output

{
  "domain": "example.com",
  "crawled_at": "2024-12-13T12:00:00Z",
  "pages": [
    {
      "url": "https://example.com/products/item",
      "title": "Product Name",
      "description": "...",
      "og_data": { "title": "...", "image": "..." },
      "json_ld": [ { "@type": "Product", ... } ],
      "headings": [ { "level": 1, "text": "..." } ],
      "images": [ { "src": "...", "alt": "..." } ],
      "videos": [ { "src": "...", "type": "video/mp4" } ]
    }
  ],
  "sitemap_urls": ["..."],
  "tech_stack": { "shopify": true, "cloudflare": true },
  "media": {
    "images": [...],
    "videos": [...]
  }
}

Media Files

Downloaded media is saved to the Actor's Key-Value Store:

images/filename.jpg
videos/filename.mp4

Pricing

Pay-per-result: ~$0.01 per page crawled + $0.005 per media file downloaded.

Support

Questions? Open an issue or contact the developer.

What Site

maged120/what-site

simple site lookup for title and description of any site

Maged

5.0

Skool Post Comments Scraper

louisdeconinck/skool-post-comments-scraper

Pull every comment, reply, and user detail from any Skool post in minutes. Fast, reliable, and easy to use. Perfect for community managers, marketers, and researchers who want full visibility without wasting hours.

Louis Deconinck

5.0

Multi site hotel scraper

accomplished_yapok/my-actor

Kween Ash

AI Powered X No Code Scraper

ko_sunam/AI-Powered-X-No-Code-Scraper

🤖 AI Web Scraper: Extract data from any website in 60 seconds - no coding needed! Simply paste a URL, tell the AI what you want, and get clean Excel-ready data. Perfect for SMBs needing competitor prices, leads, or market data. Start free!

Fabian D

Instagram Post Image, Video Downloader & Scraper ✨

scrapearchitect/instagram-post-image-video-downloader-scraper

Download HD images 🖼️, videos🎬, Details Image & Video metadata 📊 & engagement stats ❤️ from any public Instagram post! Get instant Apify storage links 🔗, technical specs ⚙️ & author details 👤 in one click! Perfect for marketers 🎯 & creators! 🚀 Instagram Post Image, Video Downloader & Scraper✨

Scrape Architect

TikTok Subtitles Extractor - Download Captions from Any Video

linen_snack/tiktok-subtitles-extractor---download-captions-from-any-video

Extract and download subtitles and captions from any public TikTok video. Converts TikTok captions to text or SRT format with support for multiple languages. Perfect for content creators, researchers, and accessibility needs. Simply paste a TikTok URL and get accurate transcripts in seconds.

ius iyb

244

YouTube SEO Rocket 2025 – 12 Titles + Description + 60 Tags

ytseo2025/youtube-seo-rocket-2025---12-titles-description-60-tags

Paste any YouTube URL → get 12 viral titles, full SEO description 60 tags 15 hashtags in <2 minutes. Gemini 2.5

Smart Agent

Website Tech Stack Detector

benthepythondev/website-tech-detector

Detect technologies, frameworks, CMS, analytics, hosting, and more used by any website. Perfect for competitive analysis, sales intelligence, and tech research.

ben

Video Download Link Crawler

rodrigo91/video-download-link-crawler

Automatically discover and extract video download links from any website. Crawl through multiple pages, follow custom link patterns, and export results in JSON, CSV, HTML, or XML formats. Perfect for content creators, researchers, and media professionals.

Rodrigo Franco

AI Website Enricher & Metadata Scraper

express_kingfisher/website-details-gather-with-ai

🚀 Instantly turn any URL into rich data. Extract description, tech stack, pricing model, social links, and SEO categories using AI. Perfect for lead generation and market research.