Sitemap URL Extractor & Monitor — Recursive, lastmod, changefreq & priority

Extract every URL from any website's sitemaps — with lastmod, changefreq and priority — into clean JSON, CSV or Excel. Follows sitemap indexes recursively, discovers sitemaps from robots.txt, handles gzipped sitemaps, and can return only URLs changed since a date so you can monitor a site for new and updated pages. No key, no login. Fast and reliable.

Great for site audits, crawl seeding, SEO monitoring, content-change alerts and migrations.

What does Sitemap URL Extractor do?

It reads a site's sitemaps and returns one clean record per URL — the page location plus its lastmod, changefreq, priority and the source sitemap it came from. It follows sitemap-index files recursively, discovers sitemaps from robots.txt, reads gzipped sitemaps, and can filter to only URLs changed since a date.

What you get

• 🔗 All URLs — every <loc> with lastmod, changefreq, priority and its source sitemap
• 🌲 Recursive — automatically follows sitemap-index → child sitemaps
• 🤖 Auto-discovery — finds sitemaps from robots.txt; falls back to /sitemap.xml
• 🗜️ Gzip — reads .xml.gz sitemaps
• 🕒 Monitor mode — changedSince returns only URLs modified on/after a date
• 📥 Scales — walk indexes with millions of URLs, capped by your limits

Output schema

Field	Type	Description
url	string (URL)	The page URL from the sitemap <loc>.
lastmod	string	Last-modified date reported for the URL.
changefreq	string	Suggested crawl frequency (e.g. weekly, daily).
priority	string	Relative priority of the URL (0.0–1.0).
sourceSitemap	string (URL)	The sitemap file the URL was found in.

Use cases

• Site audits — get a full inventory of a site's indexable URLs.
• Crawl seeding — feed the URL list into a crawler or scraper.
• SEO monitoring — track which pages change and how often.
• Content-change alerts — use changedSince to catch new or updated pages.
• Migrations — compare URL sets before and after a site move.
• Coverage checks — verify every important page is in the sitemap.

How to extract sitemap URLs

1. Add the Sitemap URL Extractor & Monitor to your Apify account.
2. Add a site URL (sitemaps discovered automatically) or a direct sitemap URL to startUrls.
3. Set maxUrls, maxSitemaps and, optionally, changedSince.
4. Click Run.
5. Export the results as JSON, CSV or Excel, or pull them via the Apify API.

Input

{
  "startUrls": ["https://www.apify.com"],
  "maxUrls": 20000,
  "changedSince": "2026-07-01"
}

Pass a site URL (sitemaps discovered automatically) or a direct sitemap URL (.xml or .xml.gz).

Field	Description
startUrls	Site URLs or direct sitemap URLs.
maxUrls	Max URLs to extract.
maxSitemaps	Max sitemap files to fetch.
changedSince	Only return URLs with lastmod on/after this date.

Output

{
  "url": "https://www.apify.com/pricing",
  "lastmod": "2026-07-18",
  "changefreq": "weekly",
  "priority": 0.8,
  "sourceSitemap": "https://www.apify.com/sitemap.xml"
}

Need more site data?

• Website Content Crawler Pro — turn pages into clean text
• Domain Inspector — DNS & domain intelligence
• URL Checker — status codes & redirects

FAQ

Do I need to know the sitemap URL? No — pass the site's homepage and the Actor finds sitemaps via robots.txt and /sitemap.xml.

How many URLs can I extract? As many as the site publishes; set maxUrls and maxSitemaps to cap the run.

Does it follow sitemap index files? Yes, recursively, up to your maxSitemaps limit.

Can I monitor a site for changes? Yes — set changedSince to only get URLs modified since that date.

What export formats are supported? JSON, CSV, Excel and XML, plus the Apify API.

Can I integrate it with other tools? The Sitemap URL Extractor & Monitor can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. It works with Make, Zapier, Slack, Airbyte, GitHub, Google Drive and many more, plus the Apify API, JavaScript/Python clients and MCP. Or use webhooks to trigger an action whenever a run finishes.

How does billing work? You pay only per URL extracted — cheap per item, cheapest in its class.

Related Actors

• Website Content Crawler Pro — turn pages into clean text
• Domain Inspector — DNS & domain intelligence
• URL Checker — status codes & redirects

Notes

Original clean-room implementation. Reads public sitemaps and robots.txt only. You are responsible for how you use the data.