Pricing

from $1.00 / 1,000 results

Try for free

Go to Apify Store

Sitemap URL Extractor: sitemap.xml, index and gzip

Try for free

Extract every page URL from the sitemap.xml of any website, in bulk. Give the Actor a domain and it finds the sitemaps through robots.txt, follows sitemap indexes recursively, reads .xml.gz files, removes duplicates and returns one clean row per URL with lastmod, changefreq, priority and the...

Pricing

from $1.00 / 1,000 results

Rating

0.0

(0)

Developer

Yoann TUQUET

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Sitemap URL Extractor: sitemap.xml, index and gzip API

Below, you can find a list of relevant HTTP API endpoints for calling the Sitemap URL Extractor: sitemap.xml, index and gzip Actor. For this, you’ll need an Apify account. Replace <YOUR_API_TOKEN> in the URLs with your Apify API token, which you can find under API & Integrations in Apify Console. For details, see the API reference.

Run Actor

POST
https://api.apify.com/v2/actors/obligate_castle~robust-sitemap-extractor/runs?token=<YOUR_API_TOKEN>

Note: By adding the method=POST query parameter, this API endpoint can be called using a GET request and thus used in third-party webhooks. Please refer to our Run Actor API documentation.

Run Actor synchronously and get dataset items

POST
https://api.apify.com/v2/actors/obligate_castle~robust-sitemap-extractor/run-sync-get-dataset-items?token=<YOUR_API_TOKEN>

Note: This endpoint supports both POST and GET request methods. However, only the POST method allows you to pass input data. For more information, please refer to our Run Actor synchronously and get dataset items API documentation.

Get Actor

GET
https://api.apify.com/v2/actors/obligate_castle~robust-sitemap-extractor?token=<YOUR_API_TOKEN>

For more information, please refer to our Get Actor API documentation.

Actors can be used to scrape web pages, extract data, or automate browser tasks. Use the Sitemap URL Extractor: sitemap.xml, index and gzip API programmatically via the Apify API.

You can choose from:

Sitemap URL Extractor: sitemap.xml, index and gzip API in Python

Sitemap URL Extractor: sitemap.xml, index and gzip API in JavaScript

Sitemap URL Extractor: sitemap.xml, index and gzip API through CLI

Sitemap URL Extractor: sitemap.xml, index and gzip OpenAPI definition

You can start Sitemap URL Extractor: sitemap.xml, index and gzip with the Apify API by sending an HTTP POST request to the Run Actorendpoint. An Actor’s input and its content type can be passed as a payload of the POST request, and additional options can be specified using URL query parameters. The Sitemap URL Extractor: sitemap.xml, index and gzip is identified within the API by its ID, which is the creator’s username and the name of the Actor.

When the Sitemap URL Extractor: sitemap.xml, index and gzip run finishes you can list the data from its default dataset(storage) via the API or you can preview the data directly on Apify Console.

XML Sitemap URL Extractor

devilscrapes/xml-sitemap-url-extractor

Turn any site's sitemap.xml, sitemap index, or robots.txt Sitemap directive into a clean URL dataset with loc, lastmod, changefreq and priority per row. Recursively expands sitemap indexes (bounded depth), follows redirects, and decompresses .xml.gz automatically.

DevilScrapes

Sitemap URL Extractor & Change Monitor

webdatatools/sitemap-extractor

Sitemap URL extractor that reads robots.txt, sitemap indexes, .xml.gz and plain-text sitemaps and returns one row per URL with lastmod, changefreq, priority — plus a new/removed diff between runs.

Murat Uzun

Sitemap URL Extractor

leorochasantos/sitemap-extractor

Extract every URL from any XML sitemap — support sitemap indexes, gzip, robots.txt discovery, and metadata extraction. Returns clean structured output: one URL per row.

Leonardo Santos

Sitemap URL Extractor & Auditor (index-aware, status checks)

plotbench/sitemap-url-auditor

Extract every URL from XML sitemaps — sitemap-index and gzip aware — with lastmod/changefreq/priority, plus optional robots-respecting HTTP status checks for broken pages. No API key, no code — export CSV/JSON/Excel or pipe to Sheets, Zapier, Make, n8n.

Plotbench Studio

Sitemap Extractor & URL Change Monitor

automa-flow/sitemap-extractor-monitor

Extract every URL from XML, gzip, text and nested sitemaps, with robots.txt discovery. Compare repeat checks for added URLs, publisher lastmod updates and confirmed removals. An incomplete sitemap tree never produces false removals. Export for SEO audits and incremental crawlers.

Vadim Bezrukov

Sitemap URL Extractor

rowfeed/sitemap-url-extractor

Extract every URL from any site's sitemaps: robots.txt discovery, sitemap-index recursion, gzip, plain-text and RSS/Atom sitemaps, lastmod/regex filters. Plain HTTP, no browser, no proxies.

Rowfeed

Sitemap URL Extractor: robots.txt, gzip, Changes

succinct_glider/sitemap-urls

Extract every URL from a website's XML sitemaps: found through robots.txt, sitemap indexes and .gz files followed, lastmod and date filters, URL patterns, and new, changed or removed URLs since your last run. Reads sitemap files only, never the pages.

Alexandre Bobichon

XML Sitemap URL Extractor & Checker

scrapesignal_labs/sitemap-url-extractor

Extract URLs from XML sitemaps, sitemap indexes, robots.txt, and gzip files. Filter pages and optionally check HTTP status codes for SEO audits.

ScrapeSignal Labs

Sitemap URL Extractor — All Page URLs from a Website

power_on/sitemap-url-list

Input: domains or sitemap URLs. Output: one row per page URL with its lastmod, changefreq and priority, plus a report row per sitemap file read. Finds sitemaps via robots.txt, follows nested indexes, unpacks gzip. Filter by URL pattern or by date. Hard cap of 25,000 URLs per run.

Power On Labs

Sitemap Finder · URLs from Any XML

corent1robert/sitemap-detector

Find and crawl XML sitemaps from any website. Follows sitemap indexes, handles gzip, and exports every page URL with source file and lastmod into a clean dataset. No config needed.