Pricing

$3.00/month + usage

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

Pricing

$3.00/month + usage

Rating

0.0

(0)

Developer

CodeScraper

Actor stats

Bookmarked

Total users

Monthly active users

6.9 hours

Issues response

3 months ago

Last modified

Website Metadata Extractor & SEO Scraper API through CLI

The Apify CLI is the official tool that allows you to use Website Metadata Extractor(sitemap, socialLinks, robotsTxt) locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Website Metadata Extractor(sitemap, socialLinks, robotsTxt) API in Python

Website Metadata Extractor(sitemap, socialLinks, robotsTxt) API in JavaScript

Website Metadata Extractor(sitemap, socialLinks, robotsTxt) OpenAPI definition

Website Metadata Extractor(sitemap, socialLinks, robotsTxt) API

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a website link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

One Scales

425

5.0

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

210

1.0

Metadata Extractor

jancurn/extract-metadata

A small efficient actor that loads a web page, parses its HTML using Cheerio library and extracts the following meta-data from the <HEAD> tag, such as page title, description, author etc.

Jan Čurn

1.3K

Website Metadata Bulk Extractor

botflowtech/website-metadata-bulk-extractor

Extract SEO metadata, Open Graph tags, Twitter cards, and detect 50+ technologies from any website URL in bulk. Fast concurrent processing with retry logic.

BotFlowTech

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

244

Simple SEO Data Extractor

onescales/simple-seo-data-extractor

Grab SEO data from any webpage / URL and export the URL, Title Tag, Meta Description, Meta Keywords, Status Code, H1, H2, Canonical Tag and Meta Robots easily. Run the scraper for 1-100,000 pages. Run one time or on schedule or via API and Get an SEO Report for Any Site.

One Scales

419

5.0

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Apify

Startup Investors Data Scraper

johnvc/startup-investors-data-scraper

10,469 investment firms at your fingertips (as of Dec 2025). The most comprehensive startup investor firm database for finding funding and customers. Access detailed firm profiles to accelerate your startup's growth, find customers, and conduct comprehensive market research.

John

301

1.9

Local Business Lead Finder

solutionssmart/local-business-lead-finder

Discover, extract, and enrich local business leads from Google Maps. Find businesses by keyword and location, collect contact details, emails, and social profiles, and export clean, deduplicated data. Built for automation, CRMs, and recurring lead generation workflows.