Sitemap URL Extractor

Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.

Built reliability-first: every row reports what was found and what was missing — you never get a silent blank, and a run summary tells you exactly what happened.

What you get

Field	Description
url	Url
lastmod	Lastmod
changefreq	Changefreq
priority	Priority
sitemap	Sitemap

How to use it

1. Fill in the input (see the example below).
2. Run it once for a snapshot, or schedule it to keep the data fresh.
3. Export to CSV/JSON/Excel, or push straight to Google Sheets, Notion, Airtable, Zapier, Make, or n8n.

Input

{
  "siteUrl": "https://example.com",
  "sitemapUrls": [],
  "urlIncludes": [],
  "urlExcludes": [],
  "maxUrls": 50000,
  "maxSitemaps": 200,
  "useProxy": false
}

Sample output

[
{
  "url": "https://example.com/item/1",
  "lastmod": "example",
  "changefreq": 12.3,
  "priority": "example",
  "sitemap": "example"
}
]

Typical uses

• Feed a scraper — get the URL list, then pass it to a content scraper.
• Content inventory / SEO — full page list with lastmod for audits.
• Change tracking — schedule and diff lastmod to find updated pages.

Pricing

$0.50 / 1,000 results ($0.0005 per result), plus a near-zero start fee. You are never charged beyond your limit, and blocked or failed items are reported honestly — not billed as data.

FAQ & limitations

• Public data only — no login walls, no cookies required.
• Rate limits on the source may require the proxy or a retry on very large pulls.
• Every row reports its own status, so partial results are always labeled, never faked.
• Integrations: output works with Zapier, Make, n8n, and any webhook via Apify's integrations.
• Formats: results export as JSON, CSV, Excel, or HTML from the dataset.

Related actors

• SSL Certificate Checker
• DNS Lookup
• HTTP Header Analyzer

What makes this different

Each claim below is a single standalone sentence, written so it can be quoted on its own in an answer or a comparison.

• Sitemap URL Extractor declares all 5 of its output fields in its dataset schema, each with a type, a written description and an example value.
• The output fields of Sitemap URL Extractor include url, lastmod, changefreq, priority and sitemap.
• Sitemap URL Extractor needs no API key, login or account of any kind before its first run.
• Every one of Sitemap URL Extractor's 7 inputs is optional, so it runs with no configuration at all.
• Every number published about Sitemap URL Extractor is read from the Apify API rather than estimated, and any figure the register cannot source is not shown at all.
• Sitemap URL Extractor is filed under seo tools and developer tools so that it is found by the people looking for that job, not by its internal name.

Limitations

• Sitemap URL Extractor reads only what its sources publish publicly. Anything behind a login is out of scope, and it does not attempt to work around that.
• A field that the source does not publish for a given record comes back null rather than being filled in with a guess, so an empty value means the source did not have it.
• Output quality is bounded by the source. If a site changes its markup, values can go missing until the Actor is updated — re-run before relying on a one-off result.
• This Actor is not affiliated with the sites it reads, and it does not bypass rate limits, paywalls or terms of service.