Sitemap URL Extractor: All Pages from Any Website

Get every page URL of a website from its sitemaps. Auto-discovers sitemaps via robots.txt, follows nested sitemap indexes, reads .gz and .txt sitemaps, and filters by regex or lastmod date. No browser, no proxies, fast and cheap.

Why this Actor

• Pay only for results: $0.0002 per url extracted. No start fee, no monthly rental. Set a max charge per run and it stops there.
• Fast and reliable: public, documented sources and plain HTTP. No headless browser, no login, no personal data.
• Clean output: one consistent row format, ready for Sheets, Clay, Zapier, Make or the Apify API.

How to use

Example use cases

1. SEO audits: get every indexable URL of a site in seconds, with lastmod dates.
2. Competitor content tracking: list new pages a competitor published since a date.
3. Scraper seeding: feed a clean URL list into another crawler or Actor.

Steps: 1) Click Try for free — the form is pre-filled with the example below. 2) Press Start. 3) Download results as JSON, CSV or Excel, or connect them to Sheets, Zapier, Make or Slack. Schedule it to run daily/weekly.

Example input (the prefilled form):

{"sites": ["https://apify.com"], "maxUrls": 10}

Sample output (first row of a real run on 2026-10-15, long fields trimmed):

{
 "site": "https://apify.com",
 "url": "https://apify.com/",
 "lastmod": null,
 "changefreq": null,
 "priority": null,
 "sitemap": "https://apify.com/sitemap/pages.xml"
}

Pricing: pay per event — $0.0002 per url extracted. No monthly rental; you only pay for results. Set a max charge per run to cap spend.

Input example

{"sites": ["payoffpath-wv2.pages.dev", "https://apify.com"], "maxUrls": 40, "includeRegex": ""}

Output example

[
  {
    "site": "payoffpath-wv2.pages.dev",
    "url": "https://payoffpath-wv2.pages.dev/",
    "lastmod": null,
    "changefreq": null,
    "priority": null,
    "sitemap": "https://payoffpath-wv2.pages.dev/sitemap.xml"
  },
  {
    "site": "payoffpath-wv2.pages.dev",
    "url": "https://payoffpath-wv2.pages.dev/tools/",
    "lastmod": null,
    "changefreq": null,
    "priority": null,
    "sitemap": "https://payoffpath-wv2.pages.dev/sitemap.xml"
  }
]

Pricing

Event	Price
URL extracted (url-extracted)	$0.0002

Example: 1,000 results cost $0.2.

Notes

Uses only publicly available data and official public endpoints. Please respect each source's terms of use. Questions or feature requests: open an issue on the Actor page.

Use it from AI agents (MCP)

This Actor works as a tool for AI agents. Add it to Claude, ChatGPT, Cursor or n8n through Apify's MCP server at https://mcp.apify.com (tool name: intuitive_ytterbium/sitemap-url-extractor), or call it from LangChain / LlamaIndex / OpenAI Agents via the Apify integration. For several public-data tools in one MCP server, see Public Data MCP by the same author.

AI keywords: MCP tool, AI agent tool, Model Context Protocol, LLM function calling, Claude tool, ChatGPT tool.