Sitemap URL Extractor avatar

Sitemap URL Extractor

Under maintenance

Pricing

from $5.00 / 1,000 url extracteds

Go to Apify Store
Sitemap URL Extractor

Sitemap URL Extractor

Under maintenance

Extract every URL from any website's sitemap, including nested sitemap indexes (recursive). Auto-discovers sitemaps from robots.txt. Returns URLs with lastmod, changefreq, priority.

Pricing

from $5.00 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Mehmet Kut

Mehmet Kut

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

20 days ago

Last modified

Share

Extract every URL from any website's sitemap — including nested sitemap indexes, expanded recursively. Just give it a domain and it auto-discovers sitemaps from robots.txt.

Perfect as the first step in any large-scale scraping or SEO project: get the complete URL inventory of a site, then feed those URLs into your scraper of choice.

🎯 What it does

  • Auto-discovers sitemaps from robots.txt (or falls back to /sitemap.xml)
  • Recursively expands sitemap index files into their child sitemaps
  • Extracts every URL with lastmod, changefreq, and priority
  • Handles huge sitemaps (100,000+ URLs) with configurable limits

💡 Use cases

  • Seed URL lists for large scraping jobs
  • Site inventory / content audits — see every published page
  • Change monitoring — track lastmod to find recently updated pages
  • SEO analysis — audit priority & changefreq configuration

📥 Input

FieldTypeDescription
startUrlsarrayWebsite domains or direct sitemap URLs
maxSitemapsintegerMax sitemap files to fetch (default 200)
maxUrlsintegerStop after this many URLs (default 100,000)
useProxybooleanRoute via Apify Proxy (default true)

Example input

{
"startUrls": ["https://example.com"],
"maxUrls": 50000
}

You can pass either a domain (https://example.com → auto-discovers sitemaps) or a direct sitemap URL (https://example.com/sitemap.xml).

📤 Output

{
"url": "https://example.com/some-page",
"lastmod": "2026-06-01",
"changefreq": "weekly",
"priority": "0.8",
"sourceSitemap": "https://example.com/sitemap/pages.xml"
}

🔗 Tip

Chain this with the SEO Meta & Schema Extractor to run a full-site SEO audit: extract all URLs here, then extract metadata from each.