Pricing

from $80.00 / 1,000 successful crawling of a pages

Try for free

Go to Apify Store

Fast Sitemap Generator

Try for free

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.

Pricing

from $80.00 / 1,000 successful crawling of a pages

Rating

5.0

(1)

Developer

Emmanuel Uchenna

Actor stats

Bookmarked

Total users

Monthly active users

8 days ago

Last modified

Categories

Developer tools

SEO tools

Start URLs

startUrls

Required

List of URLs where the crawler will start. These should be the main pages of your website.

Type:array

Max Crawl Depth

maxCrawlDepth

Optional

Maximum depth of links to follow from start URLs. Depth 0 means only start URLs, depth 1 includes pages linked from start URLs, etc.

Type:integer

Default:3

Max Pages Per Crawl

maxPagesPerCrawl

Optional

Maximum number of pages to crawl. Use this to limit the scope of large websites.

Type:integer

Default:1000

Include URL Patterns

includePatterns

Optional

Regular expression patterns for URLs to include. If empty, all URLs from the same domain are included.

Type:array

Default:

[]

Exclude URL Patterns

excludePatterns

Optional

Regular expression patterns for URLs to exclude. Useful for filtering out admin pages, login pages, etc.

Type:array

Default:

[
  ".*/admin/.*",
  ".*/login.*",
  ".*/wp-admin/.*"
]

Sitemap Formats

sitemapFormats

Optional

Select which sitemap formats to generate

Type:string[]

Default:

[
  "xml"
]

Respect robots.txt

respectRobotsTxt

Optional

Whether to respect the website's robots.txt file

Type:boolean

Default:true

Change Frequency

changefreq

Optional

How frequently the page is likely to change. This is used in the XML sitemap.

Type:string

Default:weekly

Options:

alwayshourlydailyweeklymonthlyyearlynever

Default Priority

defaultPriority

Optional

Default priority for pages (0.0 to 1.0). The homepage automatically gets 1.0, and priority decreases with depth.

Type:number

Minimum:0

Maximum:1

Default:0.5

Include Images

includeImages

Optional

Include image URLs in the XML sitemap

Type:boolean

Default:false

Sitemap Generator

datawinder/sitemap-generator

Automatically crawl a website and generate an SEO-ready sitemap in XML, HTML, or TXT format. Supports crawl depth limits, URL include/exclude patterns, and optional merging with an existing sitemap.xml. Ideal for SEO audits, site migrations, and automation.

DatawinderLabs

Sitemap Generator

gentle_cloud/sitemap-generator

Crawl websites and generate XML sitemaps with configurable depth and page limits. Discover all pages, extract metadata, and output a ready-to-use sitemap.xml.

Monkey Coder

Sitemap URL Extractor — robots.txt + sitemap.xml Crawl

v0iddo/sitemap-url-extractor

Discover every URL a site exposes via its public sitemap chain. Reads robots.txt, follows Sitemap declarations, recursively descends sitemap-index files, extracts URLs with lastmod, changefreq, priority.

vøiddo

Robots.txt & Sitemap Extractor by Domain

technicaldost/robots-sitemap-extractor

Fetch and parse robots.txt and XML sitemaps for any domain. Extract allowed and disallowed paths, sitemap URLs and every listed page. Great for SEO audits and crawl planning. JSON output.

Technical Dost Solutions

Sitemap URL Extractor

lnlenost/sitemap-url-extractor

Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.

Niccolò Salerno

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

210

1.0

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Stas Persiianenko

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.