Sitemap URL Extractor: all URLs from any website
Pricing
from $0.18 / 1,000 urls
Sitemap URL Extractor: all URLs from any website
List every URL of a website from its sitemaps: finds sitemaps via robots.txt, follows sitemap indexes and .gz files, returns URL, lastmod, changefreq, priority and image count. Include/exclude filters. $0.25 per 1,000 URLs.
Pricing
from $0.18 / 1,000 urls
Rating
0.0
(0)
Developer
Actor Factory
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
4 hours ago
Last modified
Categories
Share
Sitemap URL Extractor — all URLs of any website
For SEO specialists, site-migration teams and developers who need every URL of a website. Get the complete list of URLs published in its sitemaps — no crawling. $0.25 per 1,000 URLs.
Use cases
-
SEO audit and content inventory of a whole site
-
Pre-migration URL list (feed it to the URL Status Checker to verify redirects)
-
Change monitoring via
lastmod -
Seed list for other crawlers or RAG ingestion
-
Automatic discovery via
robots.txt(falls back to/sitemap.xmland/sitemap_index.xml) -
Follows sitemap indexes and gzipped sitemaps
-
Fields:
url,lastmod,changefreq,priority, number of images, source sitemap -
Include / exclude URLs by regular expression; cap URLs per site
-
Reads sitemaps only (files published for crawlers) — it does not crawl pages
-
Safe by design: hosts that resolve to internal addresses (localhost, private ranges, link-local such as 169.254.169.254) are never contacted, including redirect targets; such sites are reported as
blocked_private_addressand not charged
Input
Output
A per-site summary (sitemap files read, URLs found) is saved as SUMMARY. Sites without a sitemap are reported as
no_sitemap_found (or blocked_private_address).
More tools from the same developer
- Website Screenshot API — screenshots and PDFs of web pages: full page, mobile, element, no cookie banners
- SERP Analyzer — rankings, share of voice and People Also Ask from Google Search scraper datasets
- Dataset Merge & Dedup — merge Apify datasets and remove duplicates by the fields you choose
