Pricing

Pay per event

Try for free

Go to Apify Store

Sitemap URL Extractor & New Page Monitor

Try for free

Pull every URL, lastmod and priority from any site's XML sitemaps (robots.txt discovery, indexes, .gz). Input: domains. Output (JSON/CSV): one row per item with domain, url, lastmod, changefreq, priority, sitemap, status, previousLastmod.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Jeremy Yarbrough

Actor stats

Bookmarked

Total users

Monthly active users

4 hours ago

Last modified

Use cases

Track competitor product launches, landing pages, pricing pages and blog posts
Get alerts when a news site or blog publishes
SEO audits: count indexed URLs and find stale sections
Feed new URLs into another scraper

How it works

It reads robots.txt for Sitemap: lines, falling back to /sitemap.xml and /sitemap_index.xml. It follows sitemap indexes, handles gzip, and filters by an optional regex. It never downloads page HTML.

Input

domains, urlFilter, maxUrlsPerDomain, monitorMode, outputMode (all or changesOnly).

Output

One row per URL: domain, url, lastmod, changefreq, priority, sitemap, status (current/new/modified/removed). A per-domain summary is saved to the RUN_SUMMARY key-value record.

Pricing

Pay per result. See the Pricing tab. Please respect each site's terms of use.

Pipeline recipe: sitemap-monitor → link-auditor → seo-page-audit: list every URL, find broken links and redirects, then audit titles, meta and schema.

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Parse XML website sitemaps and extract URLs for SEO crawls, audits, migrations, and RAG indexing. Auto-discovers sitemap files from robots.txt, follows nested indexes, and exports URL, lastmod, priority, changefreq, and image metadata.

Ava Torres

Sitemap Change Detector

tri_angle/sitemap-change-detector

Identify and monitor sitemaps for specified websites. Retrieve only the new, updated, or removed URLs since the last crawl.

Tri⟁angle

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap Extractor

cerebral_aluminum/sitemap-extractor

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Benny

Sitemap URL Harvester

mahogany_songbird/sitemap-url-harvester

Collect URLs from XML sitemaps for SEO and crawling.

Britton Furness

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Sitemap & URL Extractor — Get Every URL of a Website

dataquarry/sitemap-url-extractor

Get every URL of a website: parses sitemap.xml and sitemap-indexes (discovered via robots.txt or the default location), with a same-site crawl fallback when there's no sitemap. Returns each URL + lastmod. No API key.

Daniel Brenner

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.