Sitemap Generator
Pricing
from $0.01 / 1,000 results
Sitemap Generator
Generate XML sitemaps by crawling any website. Discover all pages, images, & videos with configurable crawl depth, URL filters, & multiple output formats. Full Site Crawling ,Image Sitemap, Video Sitemap, Multiple Output Formats, URL Filtering, Configurable Depth, Last Modified, Webhook Integration
Pricing
from $0.01 / 1,000 results
Rating
0.0
(0)
Developer
The Howlers
Actor stats
0
Bookmarked
12
Total users
1
Monthly active users
7 days ago
Last modified
Categories
Share
Generate XML sitemaps by crawling any website. Discover all pages, images, and videos with configurable crawl depth, URL filters, and output formats. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).
Quick Start
Test with Demo Mode (free, no API key needed)
{"demoMode": true,"startUrl": "https://example.com","urlPatterns": "https://example.com"}
Run with real data
{"demoMode": false,"startUrl": "https://example.com","maxPages": 1000,"maxDepth": 10,"includeImages": true,"includeVideos": false,"includeLastmod": true,"respectRobotsTxt": true,"urlPatterns": [],"excludePatterns": ["\\.(jpg|jpeg|png|gif|svg|webp|pdf|zip|exe)$","/cdn-cgi/","\\?","#"],"outputFormat": "xml","changefreq": "weekly","priority": 0.5}
Input Parameters
| Parameter | Type | Default | Required | Description |
|---|---|---|---|---|
startUrl | string | - | No | The website URL to crawl and generate a sitemap for |
maxPages | integer | 1000 | No | Maximum number of pages to crawl (0 = unlimited) |
maxDepth | integer | 10 | No | Maximum link depth from start URL (0 = only start page) |
includeImages | boolean | true | No | Include image URLs in the sitemap (creates image sitemap extension) |
includeVideos | boolean | false | No | Include video URLs in the sitemap (creates video sitemap extension) |
includeLastmod | boolean | true | No | Try to detect last modified dates from HTTP headers or meta tags |
respectRobotsTxt | boolean | true | No | Follow robots.txt rules when crawling |
urlPatterns | array | [] | No | Only include URLs matching these patterns (regex). Leave empty to include all. |
excludePatterns | array | `["\.(jpg | jpeg | png |
outputFormat | string | "xml" | No | Format of the generated sitemap |
changefreq | string | "weekly" | No | Default change frequency for all URLs |
priority | number | 0.5 | No | Default priority for all URLs (0.0 to 1.0) |
webhookUrl | string | - | No | URL to receive a POST request when sitemap generation is complete |
demoMode | boolean | true | No | Run with sample data instead of actual crawling (for testing) |
Pricing
This actor uses pay-per-event billing:
| Event | Description | Price |
|---|---|---|
| URL Discovered | Each URL discovered during crawl | $0.01 |
Demo mode is free -- no charges for sample data.
Troubleshooting
"API error 429" or "Rate limit"
Too many requests. Wait a minute and try again, or reduce the number of items per run.
No results or empty dataset
Check the run log for error messages. Common causes:
- Invalid input format (check the examples above)
- The target data doesn't exist or is too small to track
How do I test without an API key?
Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.
Built by John Rippy | Actor Arsenal