Sitemap URL Extractor (XML, Index, GZ) avatar

Sitemap URL Extractor (XML, Index, GZ)

Pricing

$0.50 / 1,000 url extracteds

Go to Apify Store
Sitemap URL Extractor (XML, Index, GZ)

Sitemap URL Extractor (XML, Index, GZ)

Extract every URL from a website's XML sitemaps with lastmod, changefreq and priority. Finds sitemaps via robots.txt, follows sitemap indexes and reads .xml.gz files.

Pricing

$0.50 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Proper Ecosystem Tools

Proper Ecosystem Tools

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 days ago

Last modified

Security

Limited permissions

Share

Get every URL a website lists in its XML sitemaps, with lastmod, changefreq, and priority. Just enter a domain: the Actor finds the sitemaps through robots.txt, follows sitemap indexes, and reads gzip-compressed files.

Features

  • Auto-discovery via robots.txt Sitemap: lines, with /sitemap.xml and /sitemap_index.xml as fallbacks
  • Follows nested sitemap indexes
  • Reads .xml.gz files
  • Caps per site for URLs and sitemap files
  • Very cheap: $0.50 per 1,000 URLs

Input

FieldDescription
urlsA domain (sitemaps are found via robots.txt) or a direct sitemap URL.
maxUrlsStop after this many URLs per site.
maxSitemapsStop after reading this many sitemap files per site.

Output (illustrative example)

{
"site": "example.com",
"sitemap": "https://www.example.com/sitemap-posts.xml",
"url": "https://www.example.com/blog/post-1",
"lastmod": "2025-01-15",
"changefreq": "weekly",
"priority": 0.8
}

Pricing

Pay per event: url extracted. Rows that fail with an error are free. Set a maximum charge per run to cap spend.

Use cases

  • Feed URLs into SEO audits, status checks, or scrapers
  • Track new and updated pages on competitor sites
  • Content inventories and migration planning
  • Count indexed-intended pages

Works with the Apify API, schedules, webhooks, Make, Zapier, n8n, and AI agents via MCP.