Go to example tasks
List every URL a website publishes - from its sitemap
Created by
Shun Furu
Every page a site declares in robots.txt and its sitemaps, with last-modified dates. Expands sitemap indexes. Never crawls.
Sitemap URL Extractor — every URL, $0.0002/URLplainapi/sitemap-xml-url-list-extractor
Site
URL
Last modified
Change frequency
+2 fieldsTextNumberBooleanListObject
Input
Sites:https://docs.apify.com
Output fields
Site
URL
Last modified
Change frequency
Priority
Declared in
Sign up on Apify01
Create your Apify account to access the Sitemap URL Extractor — every URL, $0.0002/URL.
Start the run02
The Actor will start running based on the input automatically.
Receive the output03
Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.
Integrate into your workflow04
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.
