Pricing

Pay per event

Sitemap Walker Pro — Recursive URL Discovery

Walk sitemaps and sitemap-index trees recursively. robots.txt fallback. Include/exclude globs/regex, lastmodSince filter, priorityMin filter, optional chunked output. Per-URL rows with image / video / news / hreflang metadata. Pure HTTP, no browser.

Pricing

Pay per event

Rating

0.0

(0)

Developer

BowTiedRaccoon

Actor stats

Bookmarked

Total users

Monthly active users

12 days ago

Last modified

Categories

SEO tools

Developer tools

You can access the Sitemap Walker Pro — Recursive URL Discovery programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "sp_intended_usage": "Describe your intended use...",
10    "sp_improvement_suggestions": "Share your suggestions here...",
11    "sp_contact": "Share your email here...",
12    "seeds": ["https://www.apify.com/sitemap.xml"],
13    "fallbackToRobotsTxt": True,
14    "recurseSitemapIndex": True,
15    "maxItems": 15,
16}
17
18# Run the Actor and wait for it to finish
19run = client.actor("jungle_synthesizer/sitemap-url-extractor-pro").call(run_input=run_input)
20
21# Fetch and print Actor results from the run's dataset (if there are any)
22print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
23for item in client.dataset(run["defaultDatasetId"]).iterate_items():
24    print(item)
25
26# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Sitemap Walker Pro — Recursive URL Discovery API in Python

The Apify API client for Python is the official library that allows you to use Sitemap Walker Pro — Recursive URL Discovery API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Sitemap Walker Pro — Recursive URL Discovery API in JavaScript

Sitemap Walker Pro — Recursive URL Discovery API through CLI

Sitemap Walker Pro — Recursive URL Discovery OpenAPI definition

Sitemap Walker Pro — Recursive URL Discovery API

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Sitemap URL Extractor

wiry_kingdom/sitemap-url-extractor

Extract every URL from any website's sitemap.xml with lastmod, changefreq, priority. Recursively expands sitemap index files, reads robots.txt, handles gzipped sitemaps. SEO audits, content migration, site inventory, competitor research.

Mohieldin Mohamed

Sitemap Crawler - XML Sitemap URL Extractor

miccho27/sitemap-crawler

Extract all URLs from XML sitemaps (including sitemap index) and optionally audit each page

Tatsuya Mizuno

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

210

1.0

Fast Sitemap Generator

eunit/sitemap-generator

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.

Emmanuel Uchenna

5.0

Sitemap URL Extractor & Parser

pink_comic/sitemap-url-extractor

Extract all URLs from XML sitemaps. Auto-discovers sitemaps via robots.txt. Handles nested sitemap indexes. Returns URL, last modified date, change frequency, priority, and image metadata. For SEO audits, content migration, and competitive analysis. No API key needed.

Ava Torres

Sitemap Generator

datawinder/sitemap-generator

Automatically crawl a website and generate an SEO-ready sitemap in XML, HTML, or TXT format. Supports crawl depth limits, URL include/exclude patterns, and optional merging with an existing sitemap.xml. Ideal for SEO audits, site migrations, and automation.