Pricing

from $0.16 / 1,000 url extracteds

Try for free

Go to Apify Store

Sitemap Extractor: Get All URLs of Any Website (sitemap.xml)

Try for free

Sitemap URLs extractor: list every URL of any website from its sitemap.xml, found via robots.txt, sitemap indexes and .xml.gz, with lastmod dates, include/exclude filters and new-page detection between runs. Callable by AI agents via MCP. $0.20 per 1,000 URLs.

Pricing

from $0.16 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Datawright Labs

Actor stats

Bookmarked

Total users

Monthly active users

14 days ago

Last modified

Sitemap Extractor: List All Pages & URLs of a Website API

Below, you can find a list of relevant HTTP API endpoints for calling the Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) Actor. For this, you’ll need an Apify account. Replace <YOUR_API_TOKEN> in the URLs with your Apify API token, which you can find under API & Integrations in Apify Console. For details, see the API reference.

Run Actor

POST
https://api.apify.com/v2/actors/datawright-labs~sitemap-url-extractor/runs?token=<YOUR_API_TOKEN>

Note: By adding the method=POST query parameter, this API endpoint can be called using a GET request and thus used in third-party webhooks. Please refer to our Run Actor API documentation.

Run Actor synchronously and get dataset items

POST
https://api.apify.com/v2/actors/datawright-labs~sitemap-url-extractor/run-sync-get-dataset-items?token=<YOUR_API_TOKEN>

Note: This endpoint supports both POST and GET request methods. However, only the POST method allows you to pass input data. For more information, please refer to our Run Actor synchronously and get dataset items API documentation.

Get Actor

GET
https://api.apify.com/v2/actors/datawright-labs~sitemap-url-extractor?token=<YOUR_API_TOKEN>

For more information, please refer to our Get Actor API documentation.

Actors can be used to scrape web pages, extract data, or automate browser tasks. Use the Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) API programmatically via the Apify API.

You can choose from:

Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) API in Python

Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) API in JavaScript

Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) API through CLI

Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) OpenAPI definition

You can start Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) with the Apify API by sending an HTTP POST request to the Run Actorendpoint. An Actor’s input and its content type can be passed as a payload of the POST request, and additional options can be specified using URL query parameters. The Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) is identified within the API by its ID, which is the creator’s username and the name of the Actor.

When the Sitemap Extractor: Get All URLs of Any Website (sitemap.xml) run finishes you can list the data from its default dataset(storage) via the API or you can preview the data directly on Apify Console.

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

App Store Top Charts & iOS Rank Tracker (Top Free, Paid)

datawright-labs/app-store-top-charts

App Store charts for any country and category: Apple top free, top paid and top grossing iPhone and iPad apps, up to 100 ranks each, with ratings, price, developer and daily rank changes and movers. Callable by AI agents via MCP. $0.10 per top-100 chart.

Datawright Labs

Sitemap & URL Extractor — Get Every URL of a Website

dataquarry/sitemap-url-extractor

Get every URL of a website: parses sitemap.xml and sitemap-indexes (discovered via robots.txt or the default location), with a same-site crawl fallback when there's no sitemap. Returns each URL + lastmod. No API key.

Daniel Brenner

Sitemap Extractor – All URLs from sitemap.xml + Status Check

gazidev/sitemap-url-extractor

Extract every URL from any website's sitemap.xml: auto-discovery via robots.txt, nested sitemap indexes, .xml.gz, image/news/video/hreflang tags and lastmod. Filter by date or glob, get only new URLs, and optionally check HTTP status, redirects and canonical per URL.

Cemal Atakli

Sitemap URL Extractor — Robots.txt & Sitemap.xml Parser

tarnlight/sitemap-url-extractor

Extracts the URLs a website lists in its XML sitemaps (sitemap indexes, gzip and text sitemaps, robots.txt discovery), up to your Max URLs cap, with filters and a clear per-site report.

Tarnlight

Sitemap URL Finder

thescrapelab/sitemap-target-url-extractor

Find useful URLs from robots.txt and sitemaps, then output deduplicated URL inventory rows with source sitemap, domain, path, filter, and crawl summary data for SEO and scraping workflows.

Inus Grobler

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Website URL Extractor - Get All Site URLs

lofomachines/urls-extractor

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

Lofomachines

240

5.0

(1)

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...