Sitemap Extractor API: All URLs, Lastmod, Sitemap Index

Sitemap Extractor – All URLs from sitemap.xml + Status Check

gazidev/sitemap-url-extractor

Extract every URL from any website's sitemap.xml: auto-discovery via robots.txt, nested sitemap indexes, .xml.gz, image/news/video/hreflang tags and lastmod. Filter by date or glob, get only new URLs, and optionally check HTTP status, redirects and canonical per URL.

Google Search API (from $0.17 / 1,000 pages)

serpdata/google-search-api

Google search results as JSON from $0.17 per 1,000 result pages of up to 10 results. Rich mode adds People Also Ask, top stories, local pack, shopping and videos at no extra cost. Batch runs or a live HTTP API.

Analyze up to 1,000 keywords in one run with no start fee. Interest over time, 5-term comparisons, rising related queries & topics, interest by region, YouTube/News/Shopping search trends and real-time trending searches.

For any list of websites: how often they publish (posts per month over the last 12 months from sitemaps), last publish date, trend, and a status like active, slowing or went quiet. Find companies that stopped blogging, benchmark competitors, schedule weekly.

Extract every URL from any website's sitemaps (index, gzip, news, image, hreflang, RSS and text) and get new, updated and removed pages since the last run. Optional HTTP status check and a sitemap health report with SEO issues.

Sitemap URL Extractor - All Pages from Any Website, $0.20/1K

plotpointtech/sitemap-url-extractor

Get every page URL of any website from its sitemaps: auto-finds robots.txt and CMS sitemaps, follows indexes and .gz, adds lastmod, images, video, news and hreflang. Date and pattern filters, optional status check. $0.20 per 1,000 URLs.

Competitor Keywords: Any Domain's Ranked Keywords & Traffic

zaiq/competitor-keywords

Every keyword a competitor ranks for on Google: position, page, estimated traffic, traffic value, volume, CPC and difficulty, in 92 countries. Add your own domain to see the keywords they have and you don't. No Semrush or Ahrefs account.

Website Health Audit: SEO & Broken Link Checker

sitehealth-tools/website-health-audit

Crawl your website and get one prioritized fix list: broken links, missing titles and meta descriptions, H1s, image alt text, redirects, slow pages, mixed content, sitemap, robots.txt, llms.txt, security headers and AI-crawler access. HTML report, CSV and JSON.

Sitemap & Robots.txt Analyzer - AI Crawler Check 💰$10/1k

flyingnimbus/sitemap-robots-analyzer

Audit any website's robots.txt and sitemaps in seconds: which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked, how many URLs are listed, how fresh they are, and which technical SEO issues to fix.

Every URL from a website's XML sitemaps (robots.txt discovery, indexes, .gz) with lastmod, images, hreflang and news tags. Optional HTTP status check. $0.20 per 1,000 URLs; sites without a sitemap are free.