Pricing

$1.00 / 1,000 url extracteds

Sitemap URL Extractor — all URLs + lastmod, no crawl [$1/1K]

Give it a domain, get every URL in its sitemap with lastmod, changefreq and priority. Reads sitemap.xml and robots.txt only — no crawling, no blocks.

Pricing

$1.00 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Juan Rodriguez

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Sitemap URL Extractor

Give it any website. Get back every URL that site publishes in its sitemap, with the lastmod, changefreq and priority values the site declares — without crawling a single page.

It reads robots.txt, /sitemap.xml and /sitemap.txt, follows nested sitemap index files, and streams the results into a dataset you can export as JSON, CSV or Excel.

Example output

Real items from real runs — not mock data.

From https://crawlee.dev:

{
    "url": "https://crawlee.dev/blog",
    "lastModified": null,
    "changeFrequency": "weekly",
    "priority": 0.5,
    "sourceSitemap": "https://crawlee.dev/sitemap.xml"
}

From https://www.sitemaps.org:

{
    "url": "https://www.sitemaps.org/",
    "lastModified": "2016-11-21T00:00:00.000Z",
    "changeFrequency": null,
    "priority": null,
    "sourceSitemap": "https://www.sitemaps.org/sitemap.xml"
}

Both shapes have the same five keys. Fields the site does not declare come back as null — never missing, so your CSV columns stay stable across runs.

Fields

Field	Type	Description
`url`	string	The page URL, exactly as declared in the sitemap.
`lastModified`	string \| null	`<lastmod>` as an ISO 8601 timestamp.
`changeFrequency`	string \| null	`<changefreq>`: `always`, `hourly`, `daily`, `weekly`, `monthly`, `yearly` or `never`.
`priority`	number \| null	`<priority>`, between 0.0 and 1.0.
`sourceSitemap`	string	Which sitemap file this URL came from. Useful on sites with dozens of them.

Input

One field. No options to get wrong.

Field	Type	Required	Description
`siteUrl`	string	yes	Any URL of the site. The homepage is fine — the path is ignored. `example.com` works too.

Pricing

$1.00 per 1,000 URLs ($0.001 per URL), pay-per-event.

You are charged once per URL delivered to the dataset. If the Actor finds no sitemap, or the sitemaps contain no URLs, the run fails and you are charged nothing — there is no charge for attempts, only for results.

Typical costs, measured on real runs:

Site	URLs returned	Cost
`www.sitemaps.org`	84	$0.08
`crawlee.dev`	4,782	$4.78
`webflow.com`	124,094	$124.09

Set a maximum cost per run in the run options before starting a large site if you want a hard cap.

Limitations

Written down on purpose, so you know before you pay:

No sitemap, no results. If a site publishes no sitemap, this Actor fails with a clear message instead of falling back to crawling. It is a sitemap reader, not a crawler.
It returns what the sitemap declares, not what exists. URLs are not visited or verified. A sitemap can list dead pages, and many do.
lastmod, changefreq and priority are optional in the sitemap spec and most sites omit at least one. They come back as null. Nothing is inferred or guessed.
Sub-sitemaps on other hostnames are followed. Plenty of sites host theirs on a CDN, so results may include hostnames other than the one you typed. Check sourceSitemap if that matters to you.
Nested sitemap indexes are followed 5 levels deep. Deeper nesting than that is ignored.
Very large sites need memory. Above ~500,000 URLs, raise the run's memory from the default 512 MB.
Sitemaps are a public, opt-in file. This Actor reads nothing else: no logins, no personal data.

Google Maps Scraper | $1/1k Places

santamaria-automations/google-maps-scraper

Scrape Google Maps for $1/1k places: 30+ fields, reviews, photos, hours, GPS. Enrich every result with 20+ optional add-ons: emails, phones, socials, LinkedIn, SSL, tech stack, SEO, AI contacts, jobs & icebreakers. All merged into ONE row per business. No dataset joins. MCP-ready for AI agents.

NanoScrape

788

5.0

(3)

Sitemap Analyzer — URL Counts, Issues & robots.txt

eliai/sitemap-analyzer

Analyze any XML sitemap in one call: auto-discovery via robots.txt, URL counts, sitemapindex vs urlset detection, size, lastmod and HTTPS issue flags. $0.02 per site analyzed — flat, no per-URL charges.

Anthony Snider

Sitemap URL Extractor

mikolabs/sitemap-url-extractor

Extract every URL and its metadata from any sitemap.xml in seconds. Paste one or more sitemap URLs, run the Actor, and get a clean, structured dataset with url, lastmod, changefreq, priority, and more — ready to export as CSV, JSON, or Excel.

Mikolabs

Sitemap URL Extractor — Priced per Sitemap, Not per URL

eliai/sitemap-url-extractor

Extract every URL from sitemap.xml, sitemap indexes (recursive), or a bare domain via robots.txt. Returns loc, lastmod, changefreq, priority. Priced per FILE, not per URL: $0.005 per sitemap parsed plus $0.015 per 1,000 URLs, so a 5,000-URL sitemap costs $0.08. Failures never charged.

Anthony Snider

Sitemap URL Extractor

ninhothedev/sitemap-url-extractor

$0.5/1K 🔥 Fast sitemap URL extractor! Every URL from any site's sitemap.xml & robots.txt — with lastmod & priority. JSON, CSV, Excel or API in seconds. Paste sites & pull thousands of URLs for SEO & crawling ⚡

ninhothedev

Sitemap Walker Pro — Recursive URL Discovery

jungle_synthesizer/sitemap-url-extractor-pro

Walk sitemaps and sitemap-index trees recursively. robots.txt fallback. Include/exclude globs/regex, lastmodSince filter, priorityMin filter, optional chunked output. Per-URL rows with image / video / news / hreflang metadata. Pure HTTP, no browser.

BowTiedRaccoon

SITEMAP INTELLIGENCE — every URL a site publishes, sorted

egeusta/sitemap-intelligence

Extract every URL from XML and gzipped sitemaps, classify products, categories, blog posts, and pages, and get per-site totals with lastmod metadata—ideal for SEO audits, migrations, and catalog intelligence.

Ege

Website URL Extractor - Get All Site URLs

lofomachines/urls-extractor

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

Lofomachines

207

5.0

(1)

Bulk URL Status Checker - Redirect & Broken Link Audit

webdata_labs/bulk-url-status-checker

[💵 $1.00 / 1K] Check URLs in bulk for HTTP status codes, broken links, redirects, response times, final URLs, and redirect chains. Built for SEO audits, migrations, QA, and monitoring. CSV/JSON.

WebData Labs

Web Page → Markdown Converter (Trafilatura, LLM-ready)

gochujang/web-to-markdown

Convert any URL to clean Markdown plus structured metadata (title, author, date, lang, image, tags). Uses trafilatura — the same library Common Crawl uses. LLM-ready output. Batch up to 500 URLs. $0.005 per URL.

Hojun Lee

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.