Pricing

Pay per usage

Try for free

Go to Apify Store

Website Agent-Readiness & Metadata Audit

Try for free

Bulk-audit URLs: title, meta, canonical, Open Graph, JSON-LD types, emails, social links, robots.txt, sitemap, llms.txt and a 0-100 agent-readiness score.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Survivor Agent

Actor stats

Bookmarked

Total users

Monthly active users

8 days ago

Last modified

Website Agent-Readiness & Metadata Audit (Apify Actor)

Input a list of URLs; get per URL: title, meta description, canonical, Open Graph, JSON-LD types, public emails, social links, robots.txt/sitemap/llms.txt presence, AI-crawler blocking, and a 0-100 agent-readiness score. Suggested pay-per-result: $0.005 per URL.

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Redirect Chain Analyzer

predictable_function/my-actor-2

List of URLs whose HTTP redirect chains will be analyzed

riya rawat

5.0

(1)

Open Graph & Meta Tag Extractor

bgfc97/opengraph-meta-extractor

Extract link-preview metadata from any URL in bulk: Open Graph, Twitter Card, title, meta description, canonical, favicon and language. Perfect for building preview cards, SEO audits and social sharing tools. No API key, no proxy - just paste URLs.

Bruno

Website SEO, Accessibility & AI Readiness Auditor

feeng/website-seo-ai-readiness-auditor

🔎 Crawl websites and turn technical SEO, accessibility, security, performance, broken-link, structured-data, robots.txt, llms.txt, and AI crawler signals into prioritized 0–100 audit scores and client-ready reports.

Daniel S.

Schema.Org Json Ld Extractor

sync-network/schema-org-json-ld-extractor

Extract Schema.org JSON-LD structured data from any website. Fast, lightweight HTTP-based scraper that pulls all JSON-LD scripts - perfect for SEO analysis, product data extraction, and AI/RAG pipelines. No browser overhead.

Alam

URL Metadata Crawler

easyapi/url-metadata-crawler

Extracting comprehensive metadata from web pages. Gather vital information like meta tags, favicons, Open Graph tags, and more, all while enjoying flexible options for customization. Perfect for SEO specialists, developers, and content creators looking to enhance their web presence! 🌐

EasyApi

Page Metadata Extractor API: OpenGraph, JSON-LD, Feeds

tudorlane/page-metadata-extract

Get a web page's title, description, OpenGraph and Twitter card, schema.org JSON-LD, RSS feeds, favicon, canonical URL, contact emails/phones and social links in one call. Respects robots.txt.

Tudor Lane

GEO Site Audit - AI Readiness Checker

dltik/geo-site-audit

Audit your website for AI crawler accessibility: robots.txt (GPTBot, ClaudeBot, Perplexity), llms.txt, sitemap, Schema.org, meta tags, content extractability, TTFB. Get an AI-readiness score 0-100 with prioritized recommendations.

Walid

5.0

(1)

Gemini Search Scraper: Gemini Answers, Citations & Sources

plainrows/gemini-search-scraper

Gemini scraper and MCP tool: send prompts, get Google Gemini's answers as JSON: markdown text, the sources Gemini cites (URL, domain, title), cited domains, model. No account, no browser. $0.008 per answer, plus $0.001 per run; empty or failed answers are free.

PlainRows

Website SEO Audit Crawler – Broken Links, Schema & llms.txt

openharvest/website-seo-audit

Website SEO audit crawler: on-page issues (title, meta description, H1, canonical, hreflang, noindex), broken internal and external links, schema.org JSON-LD errors, sitemap and robots.txt checks, AI-crawler rules (GPTBot, ClaudeBot…) and llms.txt. One row per page plus a site summary.