Pricing

from $5.00 / 1,000 url records

Website URL Crawler, Link Extractor & Sitemap Audit

Crawl public websites and extract URLs, parent links, anchor text, depth, status codes, redirects, canonicals, indexability, and sitemap gaps. Static and JavaScript pages. $0.005 per useful URL; failed and diagnostic rows are free.

Pricing

from $5.00 / 1,000 url records

Rating

0.0

(0)

Developer

Nick

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract all URLs with full hierarchy — depth, parent URL, and anchor text. Supports static and JavaScript-rendered sites. Configurable depth and domain filtering.

Maged

195

Website URL Crawler & Link Extractor

maximedupre/website-url-crawler

Crawl public websites and collect URLs from rendered navigation and sitemaps. Export a link map with source pages, depth, anchor text, HTTP facts, crawl status, and available sitemap metadata.

Maxime Dupré

Website Link Crawler

searchshark/website-backlink-crawler

Crawl websites and audit internal and external links. Find broken links, redirects, HTTP status codes, anchor text, follow/nofollow links, canonical URLs, and crawl depth for SEO audits and website maintenance.

SearchShark Tools

Sitemap Indexability & AI Crawler Audit API

dobus/sitemap-indexability-ai-crawler-audit

Audit sitemap URLs, robots.txt, HTTP status, canonical/noindex signals, and AI crawler access as structured JSON for technical SEO and agents.

Afonso Fernandes

Sitemap Extractor

smorgi_apps/sitemap-extractor

Smorgi Apps

Website SEO Audit Crawler — $0.50/1K

scrapesignal_labs/website-seo-audit

Crawl websites and export a clear on-page SEO score for every page. Find missing titles, descriptions, headings, canonicals, image alt text, indexability, structured data, and internal-link gaps.

ScrapeSignal Labs

Sitemap Sniffer

maximedupre/sitemap-sniffer

Find sitemap files from website roots, domains, robots.txt, and direct sitemap URLs. Export sitemap metadata, URL counts, nested index depth, and optional URL inventory rows.

Maxime Dupré

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap URL Extractor — Every URL in a sitemap.xml as JSON

eliai/sitemap-url-extractor

Get every URL out of a sitemap.xml, a sitemap index (followed recursively), or a bare domain via robots.txt. Returns loc, lastmod, changefreq and priority per URL. Priced per FILE, not per URL: $0.005 per sitemap plus $0.015 per 1,000 URLs. Failures never charged.