Sitemap URL Extractor: Every Page URL on Any Website
Pricing
$0.40 / 1,000 urls
Sitemap URL Extractor: Every Page URL on Any Website
Get every page URL a website lists in its sitemaps, with last-modified dates. Finds sitemaps automatically (robots.txt, sitemap indexes, .gz), filters by URL text or recent changes. For SEO audits, content inventories, and feeding crawlers or AI. $0.40 per 1,000 URLs.
Pricing
$0.40 / 1,000 urls
Rating
0.0
(0)
Developer
Jackson Kramer
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
10 hours ago
Last modified
Categories
Share
Get the full list of pages a website publishes in its sitemaps, with last-modified dates, in seconds. Give it a domain. It finds the sitemaps itself (robots.txt, sitemap indexes, WordPress, .xml.gz), follows every nested sitemap, removes duplicates, and returns clean rows.
- Just type the domain:
duolingo.com,shopify.com. Or paste a direct sitemap link. - Nested indexes and gzip handled automatically
- Filters: only URLs containing
/blog/, skip/tag/, or only pages changed in the last N days. You pay only for URLs you keep. - Fast and light: reads the sitemap files websites publish for exactly this purpose. No page crawling, no proxies.
Sample output (real, duolingo.com, Oct 2026)
In one run: duolingo.com returned 103 URLs from 4 sitemaps, and shopify.com's blog filter (/blog/) returned 10 URLs changed this week.
How to use
- Add websites: domains, homepages, or sitemap links.
- Optional: only URLs containing / skip URLs containing, modified within N days, max URLs per website.
- Run, then export from the Dataset tab (JSON, CSV, Excel, or API).
Sample input
Pricing
- $0.0004 per URL ($0.40 per 1,000 URLs)
- No start fee. Sites without a sitemap cost nothing, and URLs removed by your filters cost nothing.
Who it's for
- SEO audits: compare what's in the sitemap with what's indexed and find orphan or stale pages
- Content inventories and migrations: a full page list before a redesign
- Competitor monitoring: schedule it with "modified within 1 day" to see what a competitor publishes or updates
- Crawlers, RAG, and AI agents: a clean list of URLs to fetch, without crawling blindly
- Developers: feed URLs into other Apify Actors (e.g. a content crawler)
FAQ
What if a site has no sitemap? You'll get an error row and no charge. Does it visit every page? No. It only reads the sitemap files, which is why it's fast and cheap. Use the URLs as input to a crawler if you need page content. Huge sites? Use "max URLs per website" to cap cost. Large news sites can list millions of URLs.
