Sitemap Extractor — All URLs from sitemap.xml · $0.30/1k

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Sitemap URL Extractor: All Pages of Any Website

spellzcode/sitemap-url-extractor

List every page a website declares in its sitemaps. Finds the sitemaps automatically from robots.txt, follows sitemap indexes and gzipped files, and returns each address with its last-modified date. Filter by address and by modification date.

Get every page URL of a website from its sitemaps. Auto-discovers sitemaps via robots.txt, follows nested sitemap indexes, reads .gz and .txt sitemaps, and filters by regex or lastmod date. No browser, no proxies, fast and cheap.

Extract and parse XML sitemaps from any website. Discovers sitemaps via robots.txt and common paths. Outputs structured URL data with metadata.

Sitemap URL Extractor

gifted_wagon/sitemap-url-inventory

Traverse public sitemap indexes into a deduplicated URL inventory with source sitemap, lastmod, changefreq, priority, media counts, and partial-failure evidence.

Extract and download every image from any website: img, srcset, lazy-loaded, og:image, JSON-LD product images and CSS backgrounds, with width, height, format, file size and alt text. Filter by size, crawl whole sites. Export JSON, CSV, Excel.

Search jobs straight from European employers' career sites on Workday, Greenhouse, Lever, Ashby, Workable, Recruitee, Personio and Teamtailor. Built-in EU employer directory, so no company list is needed. Filter by keyword, country, remote and date. One clean schema; new-jobs-only mode.