Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages avatar

Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages

Pricing

from $0.36 / 1,000 urls

Go to Apify Store
Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages

Sitemap Parser & Extractor: Sitemap to CSV, URLs & New Pages

Sitemap parser and sitemap extractor: export every URL of a website to CSV or JSON from robots.txt and all nested sitemaps (gz included), with lastmod dates. Monitor mode returns only pages that are new or updated since your last run, to track competitors' new pages.

Pricing

from $0.36 / 1,000 urls

Rating

0.0

(0)

Developer

Data Done Right

Data Done Right

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

13 days ago

Last modified

Security

Limited permissions

Share

This sitemap parser and extractor gets every URL of a website from its sitemaps in seconds, and tells you when competitors publish new pages. Give it a website or a sitemap URL, then export the URL list to CSV, Excel or JSON from the Apify dataset.

Sitemap to CSV: how to export a sitemap

Paste a website or sitemap URL, run, then download the sitemap to CSV, Excel or JSON from the dataset. Each row is one URL with its lastmod date, so you can open the whole sitemap in a spreadsheet.

What data can you extract from a sitemap

  • Automatic discovery: finds sitemaps through robots.txt, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml and similar.
  • Every sitemap format: nested indexes, .xml.gz, plain-text sitemaps, image counts, and even slightly broken XML.
  • Lastmod, changefreq and priority for each URL.
  • Monitor mode: only pages that are new (or updated) since your last run. Schedule it daily to see a competitor's new product pages, blog posts, landing pages, docs or job pages the day they go live.
  • Filters: include and exclude patterns (/blog/, re:/p/\d+$), plus "modified after" a date.
  • No duplicates, even when a URL is listed in several sitemaps.

How to extract all URLs from a sitemap

  1. Enter one or more Websites, or exact sitemap URLs in Or exact sitemap URLs.
  2. Optionally filter with Only URLs containing / Skip URLs containing, or Only pages modified after a date.
  3. Run it and download the URL list. For monitoring, set Mode to "Only new or updated pages since last run" and schedule a daily run.

Output

{"site": "https://theverge.com", "url": "https://www.theverge.com/tech/1013025/...", "lastmod": "2026-10-18T14:02:11Z",
"sitemap": "https://www.theverge.com/sitemaps/entries/2026/10", "change": "new"}

Use cases

  • SEO: full URL inventories, indexation audits, migration checks.
  • Competitive intelligence: new products, pricing pages and content as they launch.
  • Crawling: a clean URL list to feed any other scraper or AI crawler.

How much does it cost

Pay per event: a tiny fee per URL returned. In monitor mode you only pay for the new or changed pages.

FAQ

How does a sitemap extractor work?

It finds a site's sitemaps (from robots.txt or common locations such as /sitemap.xml), follows nested sitemap indexes, and returns every listed URL with its lastmod date.

How do I find a website's sitemap?

You do not have to. Enter the website and the Actor checks robots.txt, /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml and similar paths. If you already know the sitemap URL, paste it instead.

Does it work with WordPress sitemaps and .xml.gz files?

Yes. WordPress sitemaps (/wp-sitemap.xml), nested indexes, compressed .xml.gz sitemaps and plain-text sitemaps are supported.

Can it find pages that are not in a sitemap?

No. It only returns URLs the site lists in its sitemaps. It does not crawl links.

How do I get only new pages from a competitor?

Set Mode to "Only new or updated pages since last run" (or "Only new pages") and schedule it. Each run returns the pages that are new or updated since the last run. The first monitored run saves the baseline (see Return everything on the first monitored run if you want the full list on that first run).

Do I need a login or API key?

No.

  • Competitor Monitoring: new pages plus new jobs, ads and news per competitor.
  • Company Enrichment API: includes site size from the sitemap, plus socials and tech stack.
  • Google Sheets Import & Export: send the URL list to a Google Sheet.