Sitemap Extractor — Every URL with Dates, Images & hreflang

Get every URL from a website's sitemaps as clean data: last-modified date, change frequency, priority, image links, hreflang language versions and Google News tags. Finds the sitemaps through robots.txt; follows sitemap indexes and gzipped files.

Price: $0.20 per 1,000 URLs on the Free plan, from $0.14 per 1,000 on higher Apify plans. You pay only for URLs delivered.

Run it now — the Input tab is prefilled, one click starts a run.

URL	Site	Last modified	Change freq	Priority	Images
allbirds.com/products/mens-wool-runners	allbirds.com	2026-10-20	daily	-	1
allbirds.com/products/mens-wool-runners-natural…	allbirds.com	2026-10-20	daily	-	1
allbirds.com/products/womens-wool-runners-natur…	allbirds.com	2026-10-20	daily	-	1

Sample rows from a live run on 2026-10-20; every record has more fields.

Get every URL listed in a website's sitemaps — with last-modified date, change frequency, priority, images, hreflang language versions and Google News tags. Give a website and its sitemaps are found through robots.txt; nested sitemap indexes and gzipped .xml.gz files are followed.

Why this one

• 🧭 Finds the sitemaps for you. From robots.txt (the BBC lists 39, the New York Times 25), or /sitemap.xml and /sitemap_index.xml when robots.txt names none.
• 🪆 Follows everything. Sitemap indexes inside indexes, gzipped sitemaps (recognised by their bytes, whatever the server calls them), and plain-text sitemaps.
• 🏷️ All the tags. lastmod, changefreq, priority, image links, hreflang alternates, and news titles and dates.
• 🧾 Honest results. A sitemap that fails is reported; the others are still delivered. A website without a sitemap comes back as a free record saying so. In a live test run, 40,770 URLs from five websites were delivered in one run.
• 💸 You pay only for URLs delivered. Filters — URL contains, URL excludes, changed since — skip URLs for free.

What you get

For every URL:

Field	What it is
url	the page
lastmod, changefreq, priority	as the sitemap gives them
images	image links listed for the page
alternates	language versions: hreflang and url
news	for news sitemaps: title, publicationDate, publication
sitemap, site, input	which sitemap file and website it came from
scrapedAt, status, error	when it was read, and why a website gave nothing

Example

A real record from a live run, 24 September 2026:

{
  "site": "https://www.allbirds.com",
  "sitemap": "https://www.allbirds.com/sitemap_products_1.xml?from=1878194389061&to=7369944137808",
  "url": "https://www.allbirds.com/products/mens-wool-runners-natural-white",
  "lastmod": "2026-09-24T09:26:42-07:00",
  "changefreq": "daily",
  "images": ["https://cdn.shopify.com/s/files/1/1104/4168/files/Allbirds_WL_RN_SF_PDP_Natural_White_LAT_5a1e9e6b-9fa1-47d5-a34e-0ab02a0d2e2e.png?v=1751143945"],
  "alternates": [],
  "news": null,
  "status": "OK"
}

How to use it

1. Add Websites or sitemaps, one per line: example.com, or a sitemap link.
2. Optionally keep only URLs containing some text (/products/, /blog/), skip others, or keep only URLs changed since a date.
3. Set Max URLs per website.
4. Press Start, and download the results from the Output tab as JSON, CSV or Excel.

To catch new and changed pages, schedule it daily with Changed since set to yesterday.

You can also call it from the Apify API, from Make, Zapier or n8n, or from an AI agent through the Apify MCP server.

Pricing

You are charged per URL delivered — see the price on this page. Websites without sitemaps and URLs your filters skip are free.

FAQ

Does it crawl the website? No. It reads what the sitemaps list, which is fast and gentle on the site. For pages missing from the sitemaps, use a crawler.

Why do some URLs have no lastmod? The sitemap does not give one. They are kept when you filter by Changed since.

Like it? A short review on the Store page helps other people find this Actor. Something missing or broken? Tell us on the Issues tab — we read every one.

Related Actors

• Website Tech Stack Detector — CMS, Frameworks, Analytics & More — Detect the CMS, frameworks, analytics and hosting behind any website
• Domain Checker — WHOIS, DNS, SSL & Expiry Dates in Bulk — Bulk WHOIS, DNS, SSL and expiry checks for many domains
• Domain Authority & Website Rank Checker API — Bulk Open Data — Bulk domain authority score and website rank on open data
• RSS & Atom Feed Reader — Any Feed or Website, One Clean List — Read any RSS, Atom or JSON feed, or find a site’s feed
• PDF Text Extractor & Scraper — Pages & Metadata, Any Link — Text, page counts and metadata from PDFs at public links