Pricing

Pay per usage

Go to Apify Store

Sitemap Extractor

Try for free

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Benny

Actor stats

Bookmarked

Total users

Monthly active users

19 hours ago

Last modified

Sitemap URL Extractor

Give it websites. Get back every URL from their sitemap.

What it does

Checks common sitemap locations (/sitemap.xml, /wp-sitemap.xml, etc.)
Reads robots.txt for sitemap declarations
Follows sitemap indexes to sub-sitemaps
Deduplicates and categorizes URLs (pages, images, PDFs)

Input

{
  "websites": ["https://stripe.com", "https://github.com"],
  "maxUrls": 10000
}

Output

{
  "website": "https://stripe.com",
  "domain": "stripe.com",
  "totalUrls": 847,
  "pages": 612,
  "images": 235,
  "pdfs": 0,
  "urls": ["https://stripe.com/payments", "..."],
  "imageUrls": ["..."],
  "pdfUrls": []
}

Use cases

SEO audits: know every URL a site has indexed
Competitive analysis: map a competitor's content
Migration planning: get a full URL inventory before redesigning
Content analysis: understand site structure

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a website link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

One Scales

390

5.0

(2)

Sitemap to URL Crawler

logiover/sitemap-to-url-crawler

nstantly extract all public URLs from any website's sitemap.xml recursively. Handles nested sitemap indexes automatically. The fastest & cheapest way to build URL lists for RAG pipelines, LLM training, and SEO audits. Zero-config & blazing fast.

Logiover

Sitemap Url Extractor

consummate_mandala/sitemap-url-extractor

Donny Nguyen

Extract Sitemap Parser Url — URLs, Structure & Metadata

tropical_quince/sitemap-parser-url-extractor

Extract sitemap parser url data at scale with this powerful Apify actor. Extracts urls, structure & metadata with automatic pagination and proxy rotation. Perfect for market research, competitive intelligence, and data-driven decision making.

Donny Nguyen

Internal Links Scraper

mysteriousshadow/internal-links-scraper

When given a sitemap of a website, this scraper will go through every page listed on the sitemap and find all the internal links. Useful for SEO, finding orphaned pages, and visualizing internal linking structure.

Mysterious Shadow

104

Open Graph Scraper

consummate_mandala/open-graph-scraper

Donny Nguyen

Shopify Scraper

pocesar/shopify-scraper

Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc.

Paulo Cesar

2.1K

1.0

(1)

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

223

5.0

(1)

Google Keyword Suggestions by URL Scraper

powerai/google-keywords-suggest-by-url-scraper

Scrape Google keyword suggestions based on a specific URL using our API wrapper service

PowerAI

5.0

(1)

Faire Product Details Scraper

e-commerce/faire-product-details-scraper

Use this scraper to collect data from the Faire marketplace. Extract detailed product information, including prices, descriptions, images, and in-stock availability. Download the data in multiple structured formats for easy analysis and integration.

E Commerce