Pricing

from $1.50 / 1,000 url extracteds

Try for free

Go to Apify Store

XML Sitemap Scraper & Shopify URL Inventory

Try for free

Extract and classify URLs from XML and gzip sitemaps. Discover product, category, blog and page URLs with last-modified dates and source sitemap evidence. Export a URL inventory for catalog scraping, migrations and SEO audits.

Pricing

from $1.50 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Scopras Data Labs

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Changelog

0.1 — unreleased

First public build.

Every URL from a site's sitemaps, with lastmod paired to its URL.
Classification into product / category / blog / page / other, trusting the site's own sitemap filing before falling back to path shape.
Gzipped sitemaps are read rather than skipped — which is where large catalogues actually live.
One free summary row per site with the totals by kind.
includeTypes filters while reading, so a narrowed run spends its budget on what was asked for.
Two request budgets per site: how many sitemaps to read, plus an allowance for unreachable ones, so a site with hundreds of dead sitemap entries cannot run up the bill.

Deliberately not included: live status checking of every URL. At the engine's per-host delay that turns a 10,000-URL run into a two-hour one, and bulk-url-status-checker already does that job well. This actor reports what a site publishes about itself.

Sitemap Extractor

smorgi_apps/sitemap-extractor

Smorgi Apps

Sitemap & robots.txt Extractor - All Site URLs

antishock/sitemap-robots-url-extractor

Extract every URL a website publishes. Reads robots.txt, discovers sitemaps, walks sitemap indexes recursively and returns URL, path, last modified date, change frequency, priority and hreflang. Optional robots.txt rule parsing. For SEO audits, content inventory and migration planning.

Ryan Zinburg

XML Sitemap URL Extractor

devilscrapes/xml-sitemap-url-extractor

Turn any site's sitemap.xml, sitemap index, or robots.txt Sitemap directive into a clean URL dataset with loc, lastmod, changefreq and priority per row. Recursively expands sitemap indexes (bounded depth), follows redirects, and decompresses .xml.gz automatically.

DevilScrapes

Sitemap URL Extractor — Nested Indexes, Gzip & lastmod

relevate/sitemap-urls

Turn any website into a clean list of its URLs. Finds the sitemap from robots.txt, follows nested sitemap indexes, unpacks .xml.gz, reads RSS/Atom feeds, and can return only pages changed since a date — the cheap way to re-crawl just what is new.

Relevate

Sitemap URL Extractor

datalantern/sitemap-extractor

Extract every URL from any website's XML sitemaps, including sitemap indexes, gzip sitemaps, and robots.txt discovery. Returns lastmod, changefreq, and priority.

Data Lantern

Sitemap URL Extractor

palgenius/sitemap-url-extractor

Extract every URL from a website's sitemaps: indexes, .gz, plain-text and RSS/Atom, with lastmod filtering.

Ali Alsaidi

Sitemap XML URL Extractor

automation-lab/sitemap-xml-url-extractor

Extract deduplicated URLs and metadata from public XML sitemaps and nested sitemap indexes for crawl planning, migrations, and content audits.

Automation Lab

Sitemap Extractor - Hardened URL Inventory

8tp/sitemap-url-extractor-coverage-api

Extract URL inventories from public HTTPS sitemap XML and gzip files with robots.txt discovery, bounded index traversal, and machine-readable coverage receipts. No page crawling, login, browser, proxy, or private-network access.

Hunter M.

Sitemap Indexability & Change Monitor

produkdigitalali/sitemap-indexability-change-monitor

Audit XML sitemap URLs for HTTP status, robots directives, canonical targets, indexability, and added, removed, or changed pages across repeat runs.

ProdukDigitalAli

XML Sitemap Validator

automation-lab/xml-sitemap-validator

Validate public XML sitemaps and sitemap indexes. Export syntax, nesting, duplicate and malformed locations, page HTTP status, redirects, response times, and aggregate health records.

Automation Lab