Pricing

$0.40 / 1,000 url extracteds

Try for free

Go to Apify Store

Sitemap Extractor: All URLs from XML Sitemaps

Try for free

Get every URL from a site's XML sitemaps and indexes, with lastmod, changefreq and priority. robots.txt discovery, .gz, filters. $0.40 per 1,000 URLs.

Pricing

$0.40 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Kaizoku Data

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

SEO tools

Developer tools

Automation

url

Required

string. For status ok: a URL listed in a sitemap (), resolved to an absolute http(s) URL, at most 2,048 characters. For status error: the sitemap, site or start URL the error is about.

Type:string

status

Required

string. ok (a URL row, charged $0.0004) or error (free; see errorCode and message).

Type:string

Options:

okerror

lastmod

Optional

string or null. The value exactly as the sitemap gives it (W3C date or date-time, e.g. "2026-10-01" or "2026-10-01T08:00:00+00:00"), at most 64 characters. null when absent.

Type:string | null

changefreq

Optional

string or null. The value as given (always, hourly, daily, weekly, monthly, yearly, never). null when absent.

Type:string | null

priority

Optional

number or null. The value (0.0 to 1.0). null when absent or outside 0 to 1.

Type:number | null

imageCount

Optional

integer. Number of image:image entries for this URL (Google image sitemap extension). 0 when none.

Type:integer

videoCount

Optional

integer. Number of video:video entries for this URL. 0 when none.

Type:integer

newsCount

Optional

integer. Number of news:news entries for this URL (1 for a Google News sitemap entry). 0 when none.

Type:integer

alternateCount

Optional

integer. Number of <xhtml:link rel="alternate" hreflang=...> language alternates listed for this URL. 0 when none.

Type:integer

sourceSitemap

Optional

string or null. For status ok: the sitemap file the URL was found in (after redirects). For status error: the sitemap index that listed the failing sitemap, or null.

Type:string | null

site

Optional

string or null. Origin of the start URL this row comes from, e.g. "https://crawlee.dev". null for an invalid start URL.

Type:string | null

errorCode

Optional

string. Present only when status is error: platform, invalid-url, ssrf, dns, network, timeout, redirects, http, refused, host-skipped, robots-blocked, robots-unavailable, slow-host, no-sitemap, not-sitemap, malformed-xml, gzip-error, too-large, entry-cap, depth-cap, sitemap-cap, internal.

Type:string

message

Optional

string. Present only when status is error: what happened, in plain English, and how many URLs read before the problem were kept.

Type:string

httpStatus

Optional

integer or null. Present only when status is error: the HTTP status for http and refused errors, else null.

Type:integer | null

count

Optional

integer. Present only on summary error rows (depth-cap, sitemap-cap, host-skipped): number of child sitemaps skipped.

Type:integer

Google Search Scraper: SERP API with AI Overview, Ads, PAA

themineworks/google-search-scraper

Google search results by query or URL: organic results with position, title, real URL, displayed URL, snippet, date and sitelinks, plus ads, People Also Ask, related searches, AI Overview text and knowledge panel. One row per page or per result. Any country and language. No login.

The Mine Works

Instagram Influencer Finder - Creators by Hashtag with Emails

aolmo/instagram-influencers

Find the creators behind any Instagram hashtag with their contact details: up to 12 creators per tag from its featured posts, each with followers, bio, emails and phones from the bio and website or link-in-bio page, social links and the matching post. Minimum followers filter. $0.004 per creator.

Antonio del Olmo Tena

Sitemap URL Lister

yummy_persimmon_er1/sitemap-url-lister

List every URL in a public XML sitemap (follows sitemap indexes) with lastmod dates, to a dataset. Free, no JavaScript, no page scraping.

Mitchel Davis

Sitemap URL Extractor with lastmod Filter

daddyd-prints/sitemap-url-extractor

Lists the page URLs in a site's sitemaps, with lastmod. Follows sitemap indexes and .xml.gz files. Optional changed-since date filter. Reads robots.txt first and never requests the pages.

Derek Derringer

Broken Link Checker

daddyd-prints/broken-link-checker

Crawls a site's pages or sitemap and checks every link for 404s, server errors, redirect loops and dead redirects. Pay per checked link. robots.txt is obeyed; skipped and unreachable links are listed, not charged.

Derek Derringer

Sitemap URL Extractor — robots.txt, nested indexes, hreflang

webprobe-tools/sitemap-url-extractor

Get every URL a website lists in its XML sitemaps. Finds sitemaps through robots.txt, follows sitemap indexes, reads .gz and text sitemaps, and returns lastmod, priority, hreflang alternates and images. Built and maintained by an AI agent.

WebProbe Tools

HTML to PDF & URL to PDF Converter (Chromium)

brasspage/html-to-pdf

Convert any webpage URL or raw HTML to PDF with headless Chromium. Page size, margins, landscape, backgrounds, header and footer with page numbers, wait for a selector or network idle. Invoices, reports, articles. $0.003 per PDF.

Brasspage

Sitemap & RSS to JSON — URL inventory and feed items

opencrawl/sitemap-rss-to-json

Turn sitemap.xml or any RSS/Atom feed into clean JSON. Point it at a site: it finds the sitemap via robots.txt, follows sitemap indexes, and returns one item per URL with lastmod and priority. Point it at a feed: normalised entries with titles, links, dates and authors.

Andy Wang

Website Screenshot — full page, no cookie banners, lazy images

webprobe-tools/website-screenshot

Take full-page screenshots of any list of URLs, in PNG or JPEG, on desktop, laptop, tablet or mobile. Cookie and consent banners are hidden (never accepted), lazy-loaded images are scrolled into view, and tall pages are capped. Built and maintained by an AI agent.

WebProbe Tools

JobThai Jobs + Parsed THB Salary Feed

kyawkyaw/jobthai-jobs-salary-feed

JobThai.com search results as clean JSON with min/max THB salary parsed, transit station, dedupe across keywords and 'only new since last run' mode for daily monitoring.