Sitemap URL Extractor: All Website URLs + New Page Alerts

Get every URL of a website from its XML sitemaps in one run. Give it a domain and the Actor finds the sitemaps itself (robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml and more), follows sitemap indexes and .xml.gz files, and returns each page URL with lastmod, changefreq, priority, images, hreflang alternates and Google News tags. Schedule it with only new URLs to get alerts for new pages, new products or new articles on any website.

$0.20 per 1,000 URLs. Filtered, duplicate, off-site and already-seen URLs are free.

What you get for each URL

Field	Example
url	https://blog.apify.com/
lastmod, lastmodIso	2026-10-22T09:45:12.067Z (raw), 2026-10-22T09:45:12Z (normalised UTC)
changefreq, priority	daily, 0.8
imageCount, images	image URLs from image sitemaps
alternates	hreflang language versions: [{"hreflang": "de", "url": "https://.../de/"}]
news	Google News sitemap title, publication date, publication name, language
videoCount	videos tagged in a video sitemap
sitemapUrl, sitemapType, site	the sitemap file the URL came from (urlset, text, rss, atom)
statusCode, finalUrl, redirected, ok	optional HTTP status check: find 404s and redirects in your sitemap

A summary per site (how the sitemap was found, sitemaps read, URLs listed/saved/filtered, errors, broken URLs) is saved to the OUTPUT record.

Use cases

• SEO audits and site migrations: a full URL inventory with lastmod dates; check status codes to find 404s and redirects your sitemap still lists.
• New page monitoring: schedule daily with onlyNew to see every new blog post, product, job or landing page a competitor publishes.
• Content and news tracking: news sitemaps give fresh article URLs with titles and publication dates within minutes.
• Crawl seeding: feed the URL list into a crawler or into an LLM / RAG pipeline (e.g. a page-to-Markdown Actor) instead of crawling the whole site.
• E-commerce: list all product URLs of a shop, filter with /products/*, and track new ones.
• International SEO: hreflang alternates for every URL in one table.

Input examples

All URLs of a site (the sitemap is found automatically):

{ "startUrls": [{ "url": "https://blog.apify.com" }], "maxUrlsPerSite": 0 }

Only blog posts modified in the last 7 days, several sites:

{ "startUrls": [{ "url": "https://site-a.com" }, { "url": "https://site-b.com/sitemap_index.xml" }], "includePatterns": ["/blog/*"], "lastmodFrom": "7 days" }

Daily new-page alerts (schedule it):

{ "startUrls": [{ "url": "https://competitor.com" }], "onlyNew": true, "stateKey": "competitor", "maxUrlsPerSite": 0 }

The first run returns every URL and remembers them; later runs return only URLs that are new since then.

Find broken URLs in your sitemap:

{ "startUrls": [{ "url": "https://your-site.com" }], "checkStatus": true, "maxUrlsPerSite": 0 }

Supported sitemap formats

XML sitemaps and sitemap indexes (any depth), gzip (.xml.gz), plain-text sitemaps (one URL per line), RSS 2.0 and Atom feeds used as sitemaps, image / video / news / hreflang (xhtml:link) extensions, W3C and RFC 822 dates, relative URLs.

Pricing

Pay per event: $0.0002 per URL saved + $0.0003 per run start. 1,000 URLs cost $0.20; 100,000 URLs cost $20. Optional status check: $0.0005 per URL checked. Set Maximum cost per run and the Actor stops exactly there.

Good to know

• Sitemaps and robots.txt are published by site owners for crawlers, so this is their intended use. Only page URLs and the metadata in the sitemap are returned; no page content and no personal data.
• Status checks use one HEAD request per URL, a few in parallel, and skip URLs disallowed by the site's robots.txt (those are not charged).
• A site without any sitemap is reported in the summary and costs nothing beyond the run start.
• maxSitemapsPerSite (default 500) protects you from giant sitemap trees; raise it for big shops.

FAQ

How is this different from crawling? A crawler follows links page by page; a sitemap lists the pages the owner wants indexed, including ones with no internal links, in seconds and for a fraction of the cost. What if a site has no sitemap? The summary says so. Use a crawler for those sites. Can I export to CSV/Excel or Google Sheets? Yes, from the dataset tab, or via the Apify API and integrations.

Found a problem or need a field? Open an issue on the Actor page and we'll fix it fast.