Sitemap URL Extractor: Get Every Page URL with lastmod, hreflang & Images

Extract all URLs from any website's XML sitemaps in seconds. Give it a domain and it finds the sitemaps for you (robots.txt Sitemap: lines, /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml), follows sitemap indexes recursively, and reads gzip (.xml.gz) and plain-text sitemaps.

What you get for each URL

url, lastmod, changefreq, priority, hreflang alternates, image count, video flag, news title, and the source sitemap. A per-site summary records how the sitemaps were discovered, how many were read, and any errors.

Filters

• includePattern / excludePattern: regex filters (for example, only /blog/ or /products/)
• modifiedAfter: only pages changed since a date, which is great for monitoring new or updated content on a schedule
• maxUrlsPerSite: cap the volume and the cost

Use cases

Crawl planning (feed URLs into other Actors), SEO audits and indexation checks, competitor content monitoring, migration URL inventories, finding all product or blog pages, and building RAG and LLM ingestion lists.

Input example

{ "startUrls": ["https://crawlee.dev", "https://apify.com/sitemap.xml"], "maxUrlsPerSite": 1000, "includePattern": "/blog/", "modifiedAfter": "2026-01-01" }

Output example

{ "site": "https://crawlee.dev", "url": "https://crawlee.dev/blog", "lastmod": null, "changefreq": "weekly", "priority": 0.5, "alternates": [], "imageCount": 0, "hasVideo": false, "sitemap": "https://crawlee.dev/sitemap.xml" }

Pricing (pay per event)

$0.0003 per URL extracted ($0.30 per 1,000 URLs). You pay only for URLs saved after your filters, and duplicates are removed for free.

FAQ

The site has no sitemap? You get zero results and pay nothing. The run log and the SUMMARY-<host> record say so. Does it crawl pages? No. It only reads the sitemap files the site publishes for crawlers.