Pricing

from $0.50 / 1,000 urls

Try for free

Go to Apify Store

Sitemap URL Extractor - every page of any site

Try for free

Input: any website URL. Output: every page the site lists in its sitemap, with last-modified date, change frequency and priority. Sitemap indexes are followed automatically. Use when you need a complete URL inventory of a site without crawling it.

Pricing

from $0.50 / 1,000 urls

Rating

0.0

(0)

Developer

Alexandre de La Fayette

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

Sitemap URL Extractor

Get every page a website publishes, straight from its sitemap. No crawling.

Point it at a domain. It finds the sitemap the way a search engine does — robots.txt first, then the conventional paths — follows sitemap indexes, and returns the full URL inventory.

Why not crawl?

A crawler visits thousands of pages to discover what exists. A sitemap is that list, published by the site for exactly this purpose. Reading it is faster, cheaper, complete, and cannot break on a redesign.

What you get

Field	Description
`url`	The page URL
`lastModified`	`lastmod` from the sitemap, where declared
`changeFrequency`	`changefreq` hint
`priority`	`priority` value, 0.0–1.0
`sourceDomain`	Site the URL belongs to
`sitemapUrl`	Which sitemap it came from
`scrapedAt`	Collection time

Input

{
  "sites": ["apify.com", "vercel.com"],
  "urlContains": "/blog/",
  "modifiedAfter": "2026-01-01",
  "maxUrlsPerSite": 1000
}

Option	Default	What it does
`sites`	required	Domains or direct sitemap URLs — both work
`urlContains`	empty	Keep only URLs containing this, e.g. `/blog/`
`modifiedAfter`	empty	Keep only pages modified on or after this date
`maxUrlsPerSite`	1000	Cap per site

Sitemap indexes are followed automatically (up to 25 child sitemaps), and duplicate URLs across overlapping sitemaps are removed.

Who this is for

SEO teams auditing indexable pages, or finding pages missing from a sitemap
Content teams inventorying every article on a site with urlContains: "/blog/"
Migration planning — a complete URL list before moving a site
Competitive research — see a competitor's full content footprint and publishing cadence via lastModified
Feeding a crawler a precise URL list instead of letting it discover blindly

Pairs with our RSS Feed Finder & Reader: that one gives you a site's recent articles, this one gives you everything it has ever published.

Honest limits

A sitemap is what the site chooses to declare. Pages excluded from it will not appear — this is an inventory of the published sitemap, not a guarantee of every page in existence.
lastModified, changeFrequency and priority are optional in the standard, and many sites omit them. Empty values mean the site did not declare them.
Sites with no sitemap return no sitemap found. That costs you nothing.
Very large sitemap indexes are followed to 25 children to keep runs bounded.

Pricing

Pay per event. Charged per URL returned. A site with no sitemap costs nothing.

Changelog

1.0 — First release. robots.txt discovery, sitemap index following, filters and dedup.

Sitemap URL Extractor

receptional_blender/sitemap-url-extractor

Give it any website or sitemap URL and get back every page URL. It reads robots.txt and sitemap.xml, follows nested sitemap indexes, and returns each URL with its last-modified date, change frequency and priority as clean JSON. No key, login or proxy required.

Assia Fadli

Sitemap & URL Discovery - Find All URLs on Any Site

santamaria-automations/sitemap-url-discovery

Discover every URL on any website by parsing sitemap.xml, robots.txt, and sitemap indexes. Extract URLs with last modified dates, change frequency, and priority. Perfect for SEO audits, content analysis, crawling preparation, and site mapping.

NanoScrape

Sitemap & URL Extractor — Get Every URL of a Website

dataquarry/sitemap-url-extractor

Get every URL of a website: parses sitemap.xml and sitemap-indexes (discovered via robots.txt or the default location), with a same-site crawl fallback when there's no sitemap. Returns each URL + lastmod. No API key.

Daniel Brenner

Sitemap URL Extractor

ninhothedev/sitemap-url-extractor

$0.5/1K 🔥 Fast sitemap URL extractor! Every URL from any site's sitemap.xml & robots.txt — with lastmod & priority. JSON, CSV, Excel or API in seconds. Paste sites & pull thousands of URLs for SEO & crawling ⚡

ninhothedev

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Shopify Sitemap Product URL Inventory

egeusta/sitemap-intelligence

Get a complete, ready-to-use URL inventory for any Shopify or public site in minutes. Pull every product, collection, blog, and page URL from its sitemap, with lastmod dates, source evidence, and per-site totals - built for scraping pipelines and SEO audits.

Ege Usta

Sitemap URL Discovery — XML Sitemap & robots.txt API

accountable_eel/sitemap-url-discovery

Discover every URL a website's own XML sitemap declares, starting from robots.txt's Sitemap: directive and following sitemap indexes automatically. No key, no page crawling — charged only when a working sitemap is found.

Adrian Voss

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap Parser

blaspat/sitemap-parser

Parse any XML sitemap — extract all URLs with last modified dates, change frequency, and priority. Handles sitemap indexes recursively. Perfect for SEO auditing, migration planning, and content monitoring

Blasius Patrick