Sitemap URL Extractor: Every Page of Any Website — $0.10 per 1,000 URLs

Get every page URL from any website's sitemap in seconds: blog posts, products, categories, docs. It finds the sitemap from robots.txt or common locations, follows sitemap indexes, reads .xml.gz files and plain-text sitemaps, and returns one clean row per URL with the last-modified date and site section.

Why use it

• Very cheap: $0.10 per 1,000 URLs, no monthly fee.
• Handles real-world sitemaps: nested indexes, gzip, CDATA, plain text.
• Filters: keep or drop URLs by text, or only pages changed after a date.
• Fast: no browser, no login, no pages loaded: only the sitemap files.

Use cases

• Lead generation: find every blog, product or location page of a prospect, then feed them to a contact or tech scraper.
• SEO audits and content gap analysis: list all pages, find stale or missing content, track new pages by running daily with "changed after".
• Competitor monitoring: watch which new product or blog URLs appear.
• Crawl seeds: a ready URL list for a scraper.

Pricing

Event	Price
URL extracted	$0.10 per 1,000 ($0.0001 each)

URLs are charged only when delivered. Free Apify accounts are limited to 500 URLs per run.

Input

{
  "websites": ["apify.com", "https://example.com/sitemap.xml"],
  "maxUrlsPerSite": 10000,
  "urlContains": ["/blog/"],
  "changedAfter": "2026-10-01"
}

Output

{ "site": "apify.com", "url": "https://apify.com/blog/web-scraping-guide", "lastmod": "2026-09-30", "section": "blog", "sitemap": "https://apify.com/sitemap-blog.xml" }

A per-site summary (sitemaps found and read, URLs seen and delivered, problems) is saved in the run's key-value store under SUMMARY.

Honest limits

• Only sites that publish a sitemap work. A site with no sitemap returns nothing (and is not charged).
• A sitemap lists what the site chooses to list: it may leave out pages, and lastmod dates are only as accurate as the site makes them.
• Very large sites can have millions of URLs. Use filters and "max URLs per website".

Feedback and reviews

Found a bug, or need a field or filter added? Open an issue on this Actor's Issues tab and it will be looked at quickly. If this Actor saved you time, a short and honest review helps other people find it. Thank you!

Legal

Reads only sitemap files that sites publish for crawlers, and honours nothing beyond what is public. Check a site's terms before using its URLs for large-scale crawling.