Sitemap URL Extractor - Get All URLs from sitemap.xml
Pricing
Pay per event
Sitemap URL Extractor - Get All URLs from sitemap.xml
Extract every URL from a website's XML sitemaps. Auto-finds sitemaps via robots.txt, follows sitemap index files, reads .xml.gz, returns lastmod, changefreq, priority, hreflang and image counts. Fast, no browser, cheap per URL.
Pricing
Pay per event
Rating
0.0
(0)
Developer
凡 方
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
10 days ago
Last modified
Categories
Security
Limited permissionsShare
What does Sitemap URL Extractor do?
Sitemap URL Extractor gets all URLs from a website's sitemap.xml in seconds. Enter a homepage and it automatically finds the sitemaps in robots.txt (or at /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml), follows sitemap index files, unpacks gzipped .xml.gz sitemaps, and returns one clean row per page URL with lastmod, changefreq, priority, hreflang alternates and image counts.
Use it as a sitemap scraper / sitemap parser API to list every page of a site before crawling, to feed URLs into other Actors (like Webpage to Markdown), or to monitor which pages were added or updated.
Why use it?
- 🔍 Automatic sitemap discovery – robots.txt
Sitemap:lines plus the common default locations, including WordPress, Shopify, Yoast and Next.js sitemaps. - 🗂️ Sitemap index support – recursively follows nested sitemap indexes (news, image, video, product, blog sitemaps).
- 🗜️
.xml,.xml.gzand.txtsitemaps – handles compressed and plain-text sitemaps and tolerates broken XML. - 🎯 Include / exclude regex filters – e.g. only
/blog/or/products/URLs. Filtered URLs are free. - ⚡ Fast and cheap – plain HTTP, no browser: 10,000 URLs in about 6 seconds.
- 📊 Summary per site – which sitemaps were found and parsed, and which failed, in the
SUMMARYrecord.
How to use it
- Add website homepages (e.g.
https://apify.com) or direct sitemap URLs to URLs. - Optionally set Max URLs per site and an include / exclude pattern.
- Click Start and export the URL list as JSON, CSV, Excel or via the API.
Input example
{"startUrls": [{ "url": "https://apify.com" }],"maxUrlsPerSite": 10000,"includePattern": "/blog/"}
Output example
{"url": "https://apify.com/blog/web-scraping-guide","lastmod": "2026-10-01","changefreq": "weekly","priority": 0.8,"imageCount": 1,"alternates": [{ "hreflang": "de", "href": "https://example.com/de/page" }],"sitemapUrl": "https://apify.com/sitemap/blog.xml","site": "https://apify.com"}
How much does it cost?
This Actor uses pay-per-event (PPE) pricing: you pay only for results, and the Apify platform compute it uses is already included.
| Event | Price | Per 1,000 |
|---|---|---|
| URL extracted | $0.0002 per URL | $0.20 per 1,000 URLs |
| Actor start | $0.0005 per run | – |
Duplicate URLs and URLs removed by your include/exclude filters are not charged. Use Max URLs per site to cap the cost. For example, 1,000 URLs cost about $0.20. The Actor start fee is charged once per run (one event per GB of memory; the default memory setting counts as one). You can set a maximum cost per run in the run options and the Actor stops cleanly when it is reached. Apify's free plan includes $5 of monthly credit, enough to try it at no cost.
Use cases
- SEO audits – count indexable pages, find stale
lastmoddates, check hreflang coverage. - Crawl seeding – get a full URL list before scraping, instead of crawling link by link.
- Content monitoring – schedule daily runs and compare
lastmodto detect new or updated pages on competitor sites. - AI / RAG ingestion – list every docs page, then convert them with Webpage to Markdown.
FAQ
What if a site has no sitemap? The run summary lists it under "No sitemap found". You can then crawl it with a link crawler instead.
Can I pass a sitemap URL directly? Yes – any URL ending in .xml, .xml.gz or .txt is parsed directly.
Can I use it from the API, Make, Zapier or an AI agent? Yes. Call it through the Apify API, integrations or the Apify MCP server.
Other tools by Digital-Tools
- Webpage to Markdown for LLMs & RAG – Convert any web page URL into clean, LLM-ready Markdown.
- URL Metadata & Open Graph Link Preview Extractor – Get title, description, preview image, favicon, canonical URL, Open Graph, Twitter Card, RSS feeds and JSON-LD schema from any list of URLs.
- Broken Link Checker - Find 404s & Dead Links – Crawl a website and check every internal and external link for 404s, 5xx errors, timeouts and redirects.
- Chinese Simplified/Traditional Converter & Pinyin Toolkit – Bulk convert Simplified ↔ Traditional Chinese (Taiwan, Hong Kong variants with phrase conversion), generate pinyin with tones or initials, segment Chinese words and extract keywords.
- RSS & Atom Feed Reader - Parse Any Feed to JSON – Read RSS, Atom and RDF feeds in bulk and get clean JSON: title, link, date, author, categories, summary, full content, images and podcast enclosures.
- SSL Certificate & DNS Checker - Bulk Domain Expiry Monitor – Check SSL/TLS certificates and DNS records for many domains at once: expiry date, days left, issuer, SANs, TLS version, validity, plus A, AAAA, CNAME, MX, NS, TXT, CAA, SOA, SPF and DMARC.
- PDF, Word, PowerPoint & Excel to Text Extractor – Extract text from PDF, DOCX, PPTX and XLSX files by URL.
Questions or feature requests? Open an issue in the Issues tab.