Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages
Pricing
from $0.36 / 1,000 urls
Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages
Sitemap parser and sitemap extractor: export every URL of a website to CSV or JSON from robots.txt and all nested sitemaps (gz included), with lastmod dates. Monitor mode returns only pages that are new or updated since your last run, to track competitors' new pages.
Pricing
from $0.36 / 1,000 urls
Rating
0.0
(0)
Developer
Data Done Right
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
13 days ago
Last modified
Security
Limited permissionsShare
This sitemap parser and extractor gets every URL of a website from its sitemaps in seconds, and tells you when competitors publish new pages. Give it a website or a sitemap URL, then export the URL list to CSV, Excel or JSON from the Apify dataset.
Sitemap to CSV: how to export a sitemap
Paste a website or sitemap URL, run, then download the sitemap to CSV, Excel or JSON from the dataset. Each row is one URL with its lastmod date, so you can open the whole sitemap in a spreadsheet.
What data can you extract from a sitemap
- Automatic discovery: finds sitemaps through
robots.txt, then/sitemap.xml,/sitemap_index.xml,/wp-sitemap.xmland similar. - Every sitemap format: nested indexes,
.xml.gz, plain-text sitemaps, image counts, and even slightly broken XML. - Lastmod, changefreq and priority for each URL.
- Monitor mode: only pages that are new (or updated) since your last run. Schedule it daily to see a competitor's new product pages, blog posts, landing pages, docs or job pages the day they go live.
- Filters: include and exclude patterns (
/blog/,re:/p/\d+$), plus "modified after" a date. - No duplicates, even when a URL is listed in several sitemaps.
How to extract all URLs from a sitemap
- Enter one or more Websites, or exact sitemap URLs in Or exact sitemap URLs.
- Optionally filter with Only URLs containing / Skip URLs containing, or Only pages modified after a date.
- Run it and download the URL list. For monitoring, set Mode to "Only new or updated pages since last run" and schedule a daily run.
Output
{"site": "https://theverge.com", "url": "https://www.theverge.com/tech/1013025/...", "lastmod": "2026-10-18T14:02:11Z","sitemap": "https://www.theverge.com/sitemaps/entries/2026/10", "change": "new"}
Use cases
- SEO: full URL inventories, indexation audits, migration checks.
- Competitive intelligence: new products, pricing pages and content as they launch.
- Crawling: a clean URL list to feed any other scraper or AI crawler.
How much does it cost
Pay per event: a tiny fee per URL returned. In monitor mode you only pay for the new or changed pages.
FAQ
How does a sitemap extractor work?
It finds a site's sitemaps (from robots.txt or common locations such as /sitemap.xml), follows nested sitemap indexes, and returns every listed URL with its lastmod date.
How do I find a website's sitemap?
You do not have to. Enter the website and the Actor checks robots.txt, /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml and similar paths. If you already know the sitemap URL, paste it instead.
Does it work with WordPress sitemaps and .xml.gz files?
Yes. WordPress sitemaps (/wp-sitemap.xml), nested indexes, compressed .xml.gz sitemaps and plain-text sitemaps are supported.
Can it find pages that are not in a sitemap?
No. It only returns URLs the site lists in its sitemaps. It does not crawl links.
How do I get only new pages from a competitor?
Set Mode to "Only new or updated pages since last run" (or "Only new pages") and schedule it. Each run returns the pages that are new or updated since the last run. The first monitored run saves the baseline (see Return everything on the first monitored run if you want the full list on that first run).
Do I need a login or API key?
No.
Related tools
- Competitor Monitoring: new pages plus new jobs, ads and news per competitor.
- Company Enrichment API: includes site size from the sitemap, plus socials and tech stack.
- Google Sheets Import & Export: send the URL list to a Google Sheet.