Sitemap URL Extractor avatar

Sitemap URL Extractor

Under maintenance

Pricing

from $0.50 / 1,000 results

Go to Apify Store
Sitemap URL Extractor

Sitemap URL Extractor

Under maintenance

Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.

Pricing

from $0.50 / 1,000 results

Rating

0.0

(0)

Developer

alaudin burki

alaudin burki

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.

Built reliability-first: every row reports what was found and what was missing — you never get a silent blank, and a run summary tells you exactly what happened.

What you get

FieldDescription
urlUrl
lastmodLastmod
changefreqChangefreq
priorityPriority
sitemapSitemap

How to use it

  1. Fill in the input (see the example below).
  2. Run it once for a snapshot, or schedule it to keep the data fresh.
  3. Export to CSV/JSON/Excel, or push straight to Google Sheets, Notion, Airtable, Zapier, Make, or n8n.

Input

{
"siteUrl": "https://example.com",
"sitemapUrls": [],
"urlIncludes": [],
"urlExcludes": [],
"maxUrls": 50000,
"maxSitemaps": 200,
"useProxy": false
}

Sample output

[
{
"url": "https://example.com/item/1",
"lastmod": "example",
"changefreq": 12.3,
"priority": "example",
"sitemap": "example"
}
]

Typical uses

  • Feed a scraper — get the URL list, then pass it to a content scraper.
  • Content inventory / SEO — full page list with lastmod for audits.
  • Change tracking — schedule and diff lastmod to find updated pages.

Pricing

$0.50 / 1,000 results ($0.0005 per result), plus a near-zero start fee. You are never charged beyond your limit, and blocked or failed items are reported honestly — not billed as data.

FAQ & limitations

  • Reads XML sitemaps (and .gz); it doesn't crawl the site if no sitemap exists (it says so).
  • Sitemaps behind auth or bot protection are reported in SUMMARY.problems, not silently dropped — enable the proxy if needed.
  • Very large sitemap-index sites are bounded by maxSitemaps/maxUrls (the cap is reported).
  • Integrations: output works with Zapier, Make, n8n, and any webhook via Apify's integrations.
  • Formats: results export as JSON, CSV, Excel, or HTML from the dataset.
  • SSL Certificate Checker
  • DNS Lookup
  • HTTP Header Analyzer