Sitemap URL Extractor: All Page URLs, lastmod & Priority avatar

Sitemap URL Extractor: All Page URLs, lastmod & Priority

Pricing

$0.30 / 1,000 url results

Go to Apify Store
Sitemap URL Extractor: All Page URLs, lastmod & Priority

Sitemap URL Extractor: All Page URLs, lastmod & Priority

Extract every URL from any website's XML sitemaps. Auto-discovers sitemaps via robots.txt and common paths, follows nested sitemap indexes, supports .gz and text sitemaps, regex filters. Returns lastmod, changefreq, priority, hreflang alternates and image counts.

Pricing

$0.30 / 1,000 url results

Rating

0.0

(0)

Developer

Hansol Jung

Hansol Jung

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

8 days ago

Last modified

Share

Get a complete list of a website's page URLs from its XML sitemaps in seconds. Give it a homepage and it finds the sitemaps for you (robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml…), follows nested sitemap indexes, unpacks .xml.gz, reads plain-text sitemaps, and returns one clean row per URL.

Use cases

  • SEO audits & migrations: export every indexable URL with lastmod to compare before/after a redesign.
  • Crawler seeding: feed URLs to Website Content Crawler, screenshot or price-monitoring actors instead of blind crawling.
  • Content monitoring: schedule it and diff lastmod to detect new or updated pages (blog posts, products, docs).
  • Competitor research: count products, categories or articles a competitor publishes.

Output fields

url, lastmod, changefreq, priority, imageCount, alternates (hreflang), sitemapUrl, domain, startUrl, scrapedAt

{
"url": "https://example.com/blog/post-1",
"lastmod": "2026-09-30",
"changefreq": "weekly",
"priority": 0.8,
"imageCount": 2,
"alternates": [{"hreflang": "de", "href": "https://example.com/de/blog/post-1"}],
"sitemapUrl": "https://example.com/post-sitemap.xml",
"domain": "example.com"
}

Input

FieldDescription
startUrlsHomepages (auto-discovery) or direct sitemap URLs
maxUrlsHard cap on total URLs (and cost)
maxSitemapsMax sitemap files downloaded per site
includePatterns / excludePatternsRegex filters, e.g. /blog/

Pricing

Pay-per-event: $0.0003 per URL (10,000 URLs = $3). No start fee. Duplicates are removed before charging.

Notes

  • Fast HTTP-only (no browser), so runs are cheap and quick.
  • Reads only public sitemap files that site owners publish for crawlers. No login, no personal data.
  • If a site has no sitemap, the run logs a warning and returns no rows for that site (you are not charged).