Pricing

Pay per event

Try for free

Go to Apify Store

Sitemap Extractor & Scraper - All Page URLs of a Site

Try for free

Sitemap scraper and URL extractor: give it a website or sitemap.xml and get every page URL with lastmod, changefreq and priority. Finds sitemaps via robots.txt, follows sitemap indexes, reads .xml.gz and text sitemaps, survives broken XML. Plain HTTP, no browser. $0.30 per 1,000 URLs.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Data Gleaner

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

SEO tools

Developer tools

Automation

Features

You can access the Sitemap Extractor & Scraper - All Page URLs of a Site programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "websites": ["https://keencrest-guides.web.app"],
10    "maxUrlsPerSite": 100,
11    "proxyConfiguration": { "useApifyProxy": False },
12}
13
14# Run the Actor and wait for it to finish
15run = client.actor("datagleaner/sitemap-extractor").call(run_input=run_input)
16
17# Fetch and print Actor results from the run's dataset (if there are any)
18print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
19for item in client.dataset(run.default_dataset_id).iterate_items():
20    print(item)
21
22# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Sitemap URL Extractor: List All Page URLs of Any Site API in Python

The Apify API client for Python is the official library that allows you to use Sitemap Extractor & Scraper - All Page URLs of a Site API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Sitemap Extractor & Scraper - All Page URLs of a Site API in JavaScript

Sitemap Extractor & Scraper - All Page URLs of a Site API through CLI

Sitemap Extractor & Scraper - All Page URLs of a Site OpenAPI definition

Sitemap Extractor & Scraper - All Page URLs of a Site API

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

XML Sitemap URL Extractor

andok/sitemap-extractor

Recursively crawl and extract every single URL from a website’s sitemap.xml. Automate your SEO audits and scraping queues.

Andok

Sitemap URL Extractor

mikolabs/sitemap-url-extractor

Extract every URL and its metadata from any sitemap.xml in seconds. Paste one or more sitemap URLs, run the Actor, and get a clean, structured dataset with url, lastmod, changefreq, priority, and more — ready to export as CSV, JSON, or Excel.

Mikolabs

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Seemu Scraping

Sitemap URL Extractor — all URLs + lastmod, no crawl [$1/1K]

rojackdj/sitemap-url-extractor

Give it a domain, get every URL in its sitemap with lastmod, changefreq and priority. Reads sitemap.xml and robots.txt only — no crawling, no blocks.

Juan Rodriguez

Sitemap URL Extractor

bgfc97/sitemap-url-extractor

Fetch sitemap.xml (including sitemap-index files with child sitemaps) and extract every URL with its lastmod date. For crawling setup, SEO audits and site migration. No key, no proxy.

Bruno

Sitemap Extractor — All URLs from sitemap.xml · $0.30/1k

tidydata/sitemap-url-extractor

Sitemap scraper and sitemap.xml parser: extract every URL from any website's sitemap. Finds sitemaps via robots.txt, follows sitemap indexes and .gz files, returns lastmod, priority and change frequency. $0.30 per 1,000 URLs.

tidydata

Sitemap URL Extractor & Validator

helveticlabs/sitemap-extractor

Get every URL a website lists in its sitemaps, with last-modified dates. Finds sitemaps through robots.txt, reads sitemap indexes and .gz files, and reports invalid or oversized sitemaps.

Helvetic Labs

Sitemap URL Extractor & New Page Monitor

open-data-tools/sitemap-extractor

Sitemap extractor and sitemap URL scraper: get every URL from a website's XML sitemaps (robots.txt discovery, sitemap indexes, .gz, text, RSS/Atom) with lastmod, hreflang and images. Optional 404 and redirect check, and a monitor mode that returns only new pages. No start fee.

Open Data Tools