# Changelog of Robots.txt & Sitemap Analyzer (`automation-lab/robots-sitemap-analyzer`) Actor

- **URL**: https://apify.com/automation-lab/robots-sitemap-analyzer/changelog.md
- **Full Actor documentation**: https://apify.com/automation-lab/robots-sitemap-analyzer.md

## Changelog

### 2026-09-14

*Fixes*

- Sitemap indexes are now traversed recursively with bounded, deduplicated child fetching, so totals count descendant pages instead of child sitemap files.
- Sitemap diagnostics now show each fetched file's depth, child count, and truncation status.

### 2026-03-01

*Features*

- Introduced Robots.txt & Sitemap Analyzer for bulk crawl-rule parsing, sitemap discovery, sitemap type detection, URL counts, crawl delays, and raw robots.txt output.