Sitemap Inventory & Diff - URL Extractor with Change Detection

Website Change Monitor & Diff Tracker

ryanclinton/website-change-monitor

Monitor any website for content changes with automatic diff detection. Track pricing pages, competitor sites, ToS updates, and more. Compares snapshots, reports added/removed text, and supports CSS selector targeting for precise monitoring.

Site Governance Page Scraper

taroyamada/site-governance-monitor

Track deployment regressions and structural drift across your website. Automate robots.txt, sitemap, and schema checks immediately after code pushes.

Sitemap Generator — Full-Site URL Discovery & Crawling

junipr/sitemap-generator

Generate XML sitemaps by crawling websites. Link following, robots.txt respect, configurable depth/limits. Valid XML with lastmod, changefreq, priority. URL inventory with status codes. Ideal for SEO and migrations.

🗺️ Sitemap Scraper & Analyzer

taroyamada/sitemap-analyzer

Extract thousands of URLs from complex nested XML sitemaps to audit website structure, HTTP status codes, and indexability for technical SEO.

Sitemap & URL Discovery - Find All URLs on Any Site

santamaria-automations/sitemap-url-discovery

Discover every URL on any website by parsing sitemap.xml, robots.txt, and sitemap indexes. Extract URLs with last modified dates, change frequency, and priority. Perfect for SEO audits, content analysis, crawling preparation, and site mapping.

SaaS Competitive Intelligence

ryanclinton/saas-competitive-intel

Automatically monitor and analyze competitor SaaS websites to extract pricing plans, job openings, team size, tech stack, and social media presence. Enter a list of competitor URLs and get structured competitive intelligence data back in JSON, CSV, or Excel format — no manual research required.

Point it at a domain. Get the full URL inventory from sitemap.xml + robots.txt, every lastmod date, and a clean JSON feed for SEO audits, content tracking, and change detection.

Domain Age Checker

automation-lab/domain-age-checker

Check domain age and registration dates in bulk using RDAP — the modern WHOIS replacement. Returns registration date, expiration date, registrar, nameservers, and age in days/years. Ideal for SEO analysis, fraud detection, and domain research.

Tech Stack Detector

automation-lab/tech-stack-detector

Affordable BuiltWith and Wappalyzer alternative. Detect 45+ technologies on any website — JavaScript frameworks, CMS, analytics, CDN, and hosting — from a single HTTP request. Ideal for bulk lead qualification, competitive analysis, and technology market research.

ForRentUniversity.com [$1.25💰] Scraper [Emails included]

memo23/forrentuniversity-scraper

Extract comprehensive student housing data: floor plans, pricing, amenities, reviews, walkability scores, nearby schools, transit info, virtual tours, property photos, management contacts, and detailed location data from ForRentUniversity.com listings

Font Detector

automation-lab/font-detector

This actor detects web fonts used on web pages. It identifies Google Fonts, Adobe Fonts (Typekit), custom @font-face declarations, and font-family CSS properties. It parses inline styles, external stylesheets, and font preloading links.