Sitemap Generator
Pricing
from $0.01 / 1,000 results
Sitemap Generator
Generate XML sitemaps by crawling any website. Discover all pages, images, & videos with configurable crawl depth, URL filters, & multiple output formats. Full Site Crawling ,Image Sitemap, Video Sitemap, Multiple Output Formats, URL Filtering, Configurable Depth, Last Modified, Webhook Integration
Pricing
from $0.01 / 1,000 results
Rating
0.0
(0)
Developer
The Howlers
Maintained by CommunityActor stats
0
Bookmarked
19
Total users
0
Monthly active users
18 days ago
Last modified
Categories
Features
Share
Generate XML sitemaps by crawling any website. Discover all pages, images, and videos with configurable crawl depth, URL filters, and output formats. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).
Note: Demo Mode is off by default, so runs fetch real data. Set demoMode to true to get free sample data instead.
Quick Start
Test with Demo Mode (free, no API key needed)
{"demoMode": true,"startUrl": "https://example.com","urlPatterns": "https://example.com"}
Run with real data
{"demoMode": false,"startUrl": "https://example.com","maxPages": 1000,"maxDepth": 10,"includeImages": true,"includeVideos": false,"includeLastmod": true,"respectRobotsTxt": true,"urlPatterns": [],"excludePatterns": ["\\.(jpg|jpeg|png|gif|svg|webp|pdf|zip|exe)$","/cdn-cgi/","\\?","#"],"outputFormat": "xml","changefreq": "weekly","priority": 0.5}
Input Parameters
| Parameter | Type | Default | Required | Description |
|---|---|---|---|---|
startUrl | string | - | No | The website URL to crawl and generate a sitemap for |
maxPages | integer | 1000 | No | Maximum number of pages to crawl (0 = unlimited) |
maxDepth | integer | 10 | No | Maximum link depth from start URL (0 = only start page) |
includeImages | boolean | true | No | Include image URLs in the sitemap (creates image sitemap extension) |
includeVideos | boolean | false | No | Include video URLs in the sitemap (creates video sitemap extension) |
includeLastmod | boolean | true | No | Try to detect last modified dates from HTTP headers or meta tags |
respectRobotsTxt | boolean | true | No | Follow robots.txt rules when crawling |
urlPatterns | array | [] | No | Only include URLs matching these patterns (regex). Leave empty to include all. |
excludePatterns | array | `["\.(jpg | jpeg | png |
outputFormat | string | "xml" | No | Format of the generated sitemap |
changefreq | string | "weekly" | No | Default change frequency for all URLs |
priority | number | 0.5 | No | Default priority for all URLs (0.0 to 1.0) |
webhookUrl | string | - | No | URL to receive a POST request when sitemap generation is complete |
demoMode | boolean | false | No | Run with sample data instead of actual crawling (for testing) |
Pricing
This actor uses pay-per-event billing:
| Event | When it is charged | Price |
|---|---|---|
| Actor start | Once when the run starts, one event per GB of memory (minimum one). At the default 4 GB of memory a run starts at $0.40 | $0.10 per GB |
| Page Crawled | Per page crawled | $0.005 |
| Result | Each item written to the default dataset | $0.00001 |
Demo mode is free -- no charges for sample data.
Troubleshooting
"API error 429" or "Rate limit"
Too many requests. Wait a minute and try again, or reduce the number of items per run.
No results or empty dataset
Check the run log for error messages. Common causes:
- Invalid input format (check the examples above)
- The target data doesn't exist or is too small to track
How do I test without an API key?
Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.
Built by John Rippy | Actor Arsenal