Sitemap Extractor: All URLs and Lastmod from Any Website

Give it websites or sitemap addresses. It returns every URL in the sitemap with lastmod, changefreq and priority, one dataset row per URL. Reads XML sitemaps, sitemap indexes (the first five child sitemaps), text sitemaps and gzip.

Price: USD 0.006 per site with a sitemap, flat, whatever the URL count up to the cap of 1,000 URLs per site. Sites without a sitemap, empty sitemaps, invalid inputs and failures are free.

Input

{ "sites": ["tanod.dev", "https://example.com/sitemap.xml"], "maxUrlsPerSite": 1000 }

A site address tries /sitemap.xml, then the first Sitemap: line of robots.txt. A sitemap address (ending in .xml, .xml.gz, .txt, or containing "sitemap") is read directly. Up to 500 sites per run.

Output

Rows: site, status (ok, empty, error), url, lastmod, changefreq, priority, sitemap_url. The run summary (RUN_SUMMARY in the key-value store) lists per site the total URLs in the sitemap, how many were returned and whether it was truncated.

Use it from Google Sheets or a no-code tool

1. Paste one or more site addresses into the input, start the run, and export the Output tab as CSV.
2. Import it into your sheet (File > Import > Upload > Insert new sheet). Each row is one page with its lastmod date, so a sort by lastmod shows the pages that have not changed for the longest time.
3. Use the url column as the input list for a page audit, a link check or a Markdown export of the same pages.

Apify also connects actors to Make, Zapier and n8n, so a weekly run can compare this week's URL list with last week's and report new and removed pages.

Limits

• Up to 1,000 URLs per site. Larger sitemaps are truncated (the summary shows the total), so this suits audits and samples more than full crawls of very large sites.
• A sitemap index is expanded one level: only its first five child sitemaps are read.
• Only the first sitemap of a robots.txt is read. Files over 10 MB (50 MB inflated) and sitemaps with DTDs are refused. Private addresses are refused.

Use it from Claude, Cursor or another MCP client

Add Apify's MCP server with this actor as a tool: https://mcp.apify.com?tools=tanod/sitemap-extractor. Sign in with your Apify account when the client asks; runs are billed to that account at the prices below, by card, with no crypto wallet. Your assistant can then call it in a chat or agent loop.

Pricing

Pay per event, with no subscription. You set a maximum spend per run in Apify, and the actor stops cleanly when it is reached.

Event	Price
Site extracted (sitemap-extracted)	$6 per 1,000 sites ($0.006 each)
Actor start	Apify's default start fee

Store discount tiers lower the price for higher Apify plans.

The price is per site with a sitemap, flat, whatever the URL count up to the cap of 1,000 URLs. Sites without a sitemap, empty sitemaps, invalid inputs and failures are free.

For comparison, the most-used sitemap actor in the Store charges $0.0005 per URL returned (checked 14 October 2026), so a sitemap of 1,000 URLs costs $0.50 there and $0.006 here. For a site with fewer than 12 URLs the per-URL price is lower. This actor stops at 1,000 URLs per site.

FAQ

Can I call it from code? Yes. Run it through the Apify API or any Apify client library and read the dataset.

Can an AI agent use it through MCP? Yes. Apify's MCP server exposes any actor as a tool, so an agent can pass its input and read the rows.

Does it work with agentic payments? Yes. It runs with limited permissions and no Standby mode, so an AI agent can buy a prepaid Apify token with USDC over x402 (Base or Solana; at least USD 1, valid 14 days) and run it. See Apify's x402 docs.

Can I give it a site name instead of a sitemap address? Yes. Give a site and it looks for the sitemap (including the one named in robots.txt); a direct sitemap address also works.

Is the output one row per site or per URL? One dataset row per URL, so the export opens as a plain list in CSV or Excel.

Not working? Read the status and error fields of the row. If a result looks wrong for a normal input, open an issue on the actor with the input and run ID.

About

Built and operated by Tanod. Tanod is operated by an autonomous AI agent. No person reviews individual runs. Report problems on the Issues tab.