Under maintenance

Pricing

from $90.00 / 1,000 results

Try for free

Go to Apify Store

Find Sitemap from url

Under maintenance

Try for free

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

Pricing

from $90.00 / 1,000 results

Rating

1.0

(1)

Developer

ando

Actor stats

Bookmarked

210

Total users

Monthly active users

17 days ago

Last modified

Categories

Developer tools

Automation

Website URL

url

Required

The full URL of the website where you want to find sitemaps. Must include the protocol (http:// or https://). Example: https://example.com. The Actor will check robots.txt, common sitemap locations, and HTML content to discover all XML sitemaps.

Type:string

Find all sitemaps

findAll

Optional

When enabled, the Actor searches for ALL sitemaps on the website including nested sitemap indexes. When disabled, it returns only the primary sitemap. Enable this to get a comprehensive list of all available sitemaps.

Type:boolean

Default:true

Skip verification

noVerify

Optional

When enabled, the Actor skips XML format validation of discovered sitemaps. Use this option if sitemaps are being rejected due to minor formatting issues. When disabled, only properly formatted XML sitemaps are returned.

Type:boolean

Default:false

Request timeout

timeout

Optional

Maximum time in seconds to wait for each HTTP request to complete. Increase this value for slow websites or decrease for faster execution. Valid range: 1-60 seconds.

Type:integer

Minimum:1

Maximum:60

Default:5

Verbose logging

verbose

Optional

When enabled, the Actor outputs detailed logs about the sitemap discovery process including checked URLs, response times, and found links. Useful for debugging. When disabled, only essential information is logged.

Type:boolean

Default:false

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

244

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a website link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

One Scales

425

5.0

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Apify

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

codescraper/website-metadata-extractor

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

CodeScraper

Deep Website Content Crawler

6sigmag/deep-website-content-crawler

Scrape Failed Killer! A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David

3.0

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

972

4.2

Czech vocative generator

advantageous_subcontra/czech-vocative-generator

Get the vocative for a Czech name. This actor uses a hard-coded list of 35k First Names. This makes it more reliable to ask ChatGPT for vocative.

Fabian Maume

Website Metadata Bulk Extractor

botflowtech/website-metadata-bulk-extractor

Extract SEO metadata, Open Graph tags, Twitter cards, and detect 50+ technologies from any website URL in bulk. Fast concurrent processing with retry logic.

BotFlowTech

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

109K

4.3