Pricing

from $0.10 / 1,000 url extracteds

Sitemap URL Extractor — Get All URLs From Any Website

Extract every URL from any website's XML sitemaps. Handles sitemap indexes, robots.txt discovery, URL filtering. Great for SEO audits.

Pricing

from $0.10 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Q Services

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Categories

SEO tools

Developer tools

Sites ou sitemaps

startUrls

Required

URL d'un sitemap.xml, ou simplement la page d'accueil d'un site (l'Actor découvre alors les sitemaps via robots.txt). Les sitemap index sont suivis récursivement.

Type:array

Default:

[
  "https://blog.apify.com/sitemap.xml"
]

Filtre d'URL (optionnel)

urlIncludes

Optional

Si renseigné, seules les URLs contenant ce texte sont retournées. Exemple : "/blog/" ou "produit".

Type:string

Default:

Nombre maximum d'URLs

maxResults

Optional

L'Actor s'arrête (et arrête de facturer) une fois ce nombre atteint.

Type:integer

Minimum:1

Maximum:500000

Default:1000

Proxy

proxyConfiguration

Optional

Configuration proxy. Le proxy Apify par défaut convient dans la plupart des cas.

Type:object

Default:

{
  "useApifyProxy": true
}

Sitemap URL Extractor

lnlenost/sitemap-url-extractor

Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.

Niccolò Salerno

Sitemap URL Extractor

blazing_stake/sitemap-url-extractor

Extract every URL from any website's sitemap, including nested sitemap indexes (recursive). Auto-discovers sitemaps from robots.txt. Returns URLs with lastmod, changefreq, priority.

Mehmet Kut

Sitemap & SEO URL Extractor - Bulk Website URL Finder

pear_fight/sitemap-seo-url-extractor-bulk-website-url-finder

Discover and extract every URL from any website's sitemaps. Automatically finds sitemaps via robots.txt, follows sitemap indexes, and returns each URL with last-modified date, change frequency and priority. Ideal for SEO audits, site migration and content inventory. Export to JSON, CSV, Excel.

Harald

Sitemap URL Extractor

aetheragent/sitemap-extractor

Extract all URLs from any website's sitemap.xml. Parse robots.txt to find sitemap locations, follow sitemap indexes, and return a complete list of all discovered URLs. Essential for SEO audits, web crawlers, and site migration planning.

Grant Mitchell

Sitemap URL Extractor

automationagents/web-sitemap

Extract every URL from a website via sitemap.xml, robots.txt, or crawl discovery. Feed clean URL lists straight into your scrapers.

Alex Jordan

Sitemap Extractor

cerebral_aluminum/sitemap-extractor

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Benny

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap & URL Extractor — Get Every URL of a Website

dataquarry/sitemap-url-extractor

Get every URL of a website: parses sitemap.xml and sitemap-indexes (discovered via robots.txt or the default location), with a same-site crawl fallback when there's no sitemap. Returns each URL + lastmod. No API key.

Daniel Brenner

Sitemap & URL Discovery - Find All URLs on Any Site

santamaria-automations/sitemap-url-discovery

Discover every URL on any website by parsing sitemap.xml, robots.txt, and sitemap indexes. Extract URLs with last modified dates, change frequency, and priority. Perfect for SEO audits, content analysis, crawling preparation, and site mapping.

NanoScrape

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.