Sitemap Extractor & Website URL Finder (no sitemap needed) avatar

Sitemap Extractor & Website URL Finder (no sitemap needed)

Pricing

from $0.20 / 1,000 url extracteds

Go to Apify Store
Sitemap Extractor & Website URL Finder (no sitemap needed)

Sitemap Extractor & Website URL Finder (no sitemap needed)

Get every URL of a website: reads robots.txt, nested sitemap indexes, .xml.gz and text sitemaps, then RSS/Atom feeds, and falls back to a light crawl when there is no sitemap. URL, lastmod, changefreq, priority, source. Filters by URL pattern and date. Failed sites are free.

Pricing

from $0.20 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Datakiln

Datakiln

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

10 days ago

Last modified

Categories

Share