Pricing

from $1.22 / 1,000 item extracteds

Try for free

Go to Apify Store

Website Metadata Scraper

Try for free

Extract declared SEO metadata, Open Graph tags, Twitter cards and evidence-backed technology hints from public URL lists for recurring site audits.

Pricing

from $1.22 / 1,000 item extracteds

Rating

0.0

(0)

Developer

Automation Lab

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Website Metadata Scraper — Bulk SEO & Social Tags API through CLI

The Apify CLI is the official tool that allows you to use Website Metadata Scraper locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Website Metadata Scraper API in Python

Website Metadata Scraper API in JavaScript

Website Metadata Scraper OpenAPI definition

Website Metadata Scraper API

Redirect Chain Analyzer

predictable_function/my-actor-2

List of URLs whose HTTP redirect chains will be analyzed

riya rawat

5.0

(1)

Universal Web Scraper & Data Extractor

motivational_nickel/universal-scraper

Fast AI-ready webpage extraction with structured JSON output for automation workflows, AI agents, RAG pipelines, SEO analysis, and website intelligence.

Leoncio Coronado Jr

URL Metadata Crawler

easyapi/url-metadata-crawler

Extracting comprehensive metadata from web pages. Gather vital information like meta tags, favicons, Open Graph tags, and more, all while enjoying flexible options for customization. Perfect for SEO specialists, developers, and content creators looking to enhance their web presence! 🌐

EasyApi

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Firecrawl Site Mapper

alizarin_refrigerator-owner/firecrawl-site-mapper

Fast URL Discovery for Site Audits & Competitor Analysis Discover all URLs on a website using Firecrawl's Map endpoint. Perfect for competitor analysis, site audits, and content gap discovery.

The Howlers

Link Extractor

automation-lab/link-extractor

This actor extracts all hyperlinks from web pages. For each link, it captures the anchor text, href, rel attributes (nofollow, ugc, sponsored), target attribute, and classifies links as internal or external. It also detects the link's location in the page (nav, header, footer, main content,...

Automation Lab

155

Answer Engine Optimization & GEO Audit - ChatGPT Fix Plan

tidytools/geo-readiness-audit

AEO with a fix plan, not just a score: for each buyer question, see which page ChatGPT, Perplexity or Google AI Overviews would quote, why competitors win, and what to add. Plus a GEO audit of AI crawler access and firewalls. $0.01/question, $0.03/site.

Yukai Lin

TikTok Comments Scraper

socialdataapi/tiktok-comments-scraper

TikTok Comments Scraper — Extract TikTok comments with usernames, comment text, likes, timestamps, and related video data. Useful for audience research, sentiment analysis, content insights, competitor analysis, and social media monitoring.

Social Data API

llms.txt Generator & Checker - llms-full.txt, AI SEO (GEO)

tidytools/llms-txt-generator

Generate llms.txt and llms-full.txt for any website from its sitemap or a crawl, with sections and AI descriptions, or validate existing llms.txt files in bulk. $2 per 1,000 pages or sites.

Yukai Lin

ConsumerAffairs Reviews Scraper

parsebird/consumeraffairs-scraper

Scrape ConsumerAffairs reviews for any company: rating, full text, author, location, date, topics, verified badge, and company replies, plus company rating, review count, and profile. Export JSON, CSV, Excel.