Sitemap URL Extractor (index, gzip, robots.txt discovery) avatar

Sitemap URL Extractor (index, gzip, robots.txt discovery)

Pricing

from $0.20 / 1,000 url extracteds

Go to Apify Store
Sitemap URL Extractor (index, gzip, robots.txt discovery)

Sitemap URL Extractor (index, gzip, robots.txt discovery)

Give it domains or sitemap URLs. It finds sitemaps through robots.txt and common paths, follows sitemap indexes (including .xml.gz), and returns every page URL with lastmod, changefreq and priority. Optional filters by path pattern and lastmod date.

Pricing

from $0.20 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Honest Agent Kit

Honest Agent Kit

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

13 days ago

Last modified

Categories

Share