Pricing

from $0.70 / 1,000 urls

Try for free

Go to Apify Store

Sitemap URL Extractor – All URLs & Lastmod Filter

Try for free

Get every URL from a website's sitemap.xml, including indexes, gzip and robots.txt. Filter by lastmod and pay only for the URLs you keep: $1 per 1,000 URLs.

Pricing

from $0.70 / 1,000 urls

Rating

0.0

(0)

Developer

Martin Varela

Actor stats

Bookmarked

Total users

Monthly active users

an hour ago

Last modified

Categories

SEO tools

Developer tools

Agents

Websites or sitemap URLs

startUrls

Required

Domains (https://example.com), specific sitemap URLs (https://example.com/sitemap.xml) or robots.txt URLs. For domains the Actor discovers sitemaps automatically.

Type:array

Maximum URLs

maxUrls

Optional

Stop after this many unique URLs across all inputs. You pay per URL returned.

Type:integer

Minimum:1

Maximum:10000000

Default:1000

Discover sitemaps from robots.txt

discoverViaRobotsTxt

Optional

Read Sitemap: lines from robots.txt before trying common paths.

Type:boolean

Default:true

Try common sitemap paths

tryCommonPaths

Optional

Also check /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml and similar when robots.txt has no Sitemap line.

Type:boolean

Default:true

Include only URLs matching (regex)

includeUrlPatterns

Optional

Keep only URLs matching at least one pattern, e.g. "/blog/".

Type:array

Default:

[]

Exclude URLs matching (regex)

excludeUrlPatterns

Optional

Drop URLs matching any of these patterns.

Type:array

Default:

[]

Include image URLs (image sitemap extension)

includeImages

Optional

Add an images array when the sitemap lists images for a URL.

Type:boolean

Default:false

Include hreflang alternates

includeAlternates

Optional

Add an alternates array with hreflang links when the sitemap has them.

Type:boolean

Default:false

Only URLs modified since (YYYY-MM-DD)

lastmodSince

Optional

URLs older than this date are not returned and are not charged. URLs without lastmod are kept unless 'Drop URLs without lastmod' is checked.

Type:string

Drop URLs without lastmod when filtering by date

dropUrlsWithoutLastmod

Optional

Use together with the date filter. Undated URLs are omitted and not charged.

Type:boolean

Default:false

Maximum sitemap index depth

maxSitemapDepth

Optional

How many levels of sitemap index to follow. 1 reads the root sitemap only.

Type:integer

Minimum:1

Maximum:10

Default:5

Proxy

proxyConfiguration

Optional

Not needed for most sites. Residential proxies are not used.

Type:object

Default:

{
  "useApifyProxy": false
}

Sitemap URL Extractor

evolve-data/sitemap-url-extractor

Extract every URL from any website's sitemaps: auto-discovers sitemaps, follows indexes, supports .gz, text, RSS and Atom. Filter by pattern or lastmod date, and optionally check each URL's HTTP status.

Ahmed Zaky

Website URL Extractor - Get All Site URLs

lofomachines/urls-extractor

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

Lofomachines

226

5.0

(1)

Sitemap Extractor

cerebral_aluminum/sitemap-extractor

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Benny

Best Damn Sitemap URL Extractor

josh99smith/sitemap-url-extractor

Extract every URL from a website's XML sitemaps, including sitemap indexes, gzip files and robots.txt discovery, with lastmod, priority and hreflang. Give it a domain, get the whole map back, at a tiny price per URL.

Joshua Smith

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap to URL Crawler — Extract Sitemap.xml URLs

logiover/sitemap-to-url-crawler

Extract all URLs from any sitemap.xml recursively. Export sitemap URLs to CSV/JSON for RAG pipelines, SEO audits, and LLM training datasets.

Logiover

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Parse XML website sitemaps and extract URLs for SEO crawls, audits, migrations, and RAG indexing. Auto-discovers sitemap files from robots.txt, follows nested indexes, and exports URL, lastmod, priority, changefreq, and image metadata.

Ava Torres

Sitemap URL Finder

thescrapelab/sitemap-target-url-extractor

Find and export URLs from any website’s robots.txt and sitemaps. Enter a domain or website URL, optionally filter matching URLs by text, and get clean dataset rows with the URL, domain, path, source sitemap, and match details.

Inus Grobler

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

codescraper/website-metadata-extractor

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

CodeScraper

111

5.0

(2)

Tech Stack Detector

automation-lab/tech-stack-detector

Affordable BuiltWith and Wappalyzer alternative. Detect 45+ technologies on any website — JavaScript frameworks, CMS, analytics, CDN, and hosting — from a single HTTP request. Ideal for bulk lead qualification, competitive analysis, and technology market research.

Automation Lab

363

Bulk Website Contact Extractor & Email Finder

harvestlab/contact-extractor

Bulk-enrich company domains with public emails, phones, social profiles, contact pages, addresses, and tech-stack signals. Export CRM-ready lead records with optional email verification and role labels.