Sitemap URL Extractor
Under maintenancePricing
from $0.50 / 1,000 results
Sitemap URL Extractor
Under maintenanceExtract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.
Pricing
from $0.50 / 1,000 results
Rating
0.0
(0)
Developer
alaudin burki
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Share
Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.
Built reliability-first: every row reports what was found and what was missing — you never get a silent blank, and a run summary tells you exactly what happened.
What you get
| Field | Description |
|---|---|
url | Url |
lastmod | Lastmod |
changefreq | Changefreq |
priority | Priority |
sitemap | Sitemap |
How to use it
- Fill in the input (see the example below).
- Run it once for a snapshot, or schedule it to keep the data fresh.
- Export to CSV/JSON/Excel, or push straight to Google Sheets, Notion, Airtable, Zapier, Make, or n8n.
Input
{"siteUrl": "https://example.com","sitemapUrls": [],"urlIncludes": [],"urlExcludes": [],"maxUrls": 50000,"maxSitemaps": 200,"useProxy": false}
Sample output
[{"url": "https://example.com/item/1","lastmod": "example","changefreq": 12.3,"priority": "example","sitemap": "example"}]
Typical uses
- Feed a scraper — get the URL list, then pass it to a content scraper.
- Content inventory / SEO — full page list with lastmod for audits.
- Change tracking — schedule and diff
lastmodto find updated pages.
Pricing
$0.50 / 1,000 results ($0.0005 per result), plus a near-zero start fee. You are never charged beyond your limit, and blocked or
failed items are reported honestly — not billed as data.
FAQ & limitations
- Reads XML sitemaps (and
.gz); it doesn't crawl the site if no sitemap exists (it says so). - Sitemaps behind auth or bot protection are reported in
SUMMARY.problems, not silently dropped — enable the proxy if needed. - Very large sitemap-index sites are bounded by
maxSitemaps/maxUrls(the cap is reported). - Integrations: output works with Zapier, Make, n8n, and any webhook via Apify's integrations.
- Formats: results export as JSON, CSV, Excel, or HTML from the dataset.
Related actors
- SSL Certificate Checker
- DNS Lookup
- HTTP Header Analyzer