URL Metadata for AI Agents (Open Graph, JSON-LD, SEO tags)

Give it page URLs and get each page's title, description, Open Graph, Twitter card, JSON-LD and hreflang back as data, for AI agents that need to know what a URL is about without reading the whole page. You get one dataset item per page, with its canonical URL, language, robots and favicon too: for link previews, SEO checks and structured data.

• Reads public URLs only, and respects robots.txt for every page and every redirect. It identifies itself as FrameskimFetch.
• Reads the page's <head> and its JSON-LD scripts; no JavaScript is run.
• Charged per page delivered; pages that fail, are not HTML, have no metadata or are not allowed by robots.txt are free.

More: URL Metadata on frameskim.dev

What you get

{
  "url": "https://example.com/",
  "status": 200,
  "title": "Example",
  "description": "An example page.",
  "canonical": "https://example.com/",
  "lang": "en",
  "robots": "index, follow",
  "favicon": "https://example.com/favicon.ico",
  "openGraph": {"title": "Example", "image": "https://example.com/og.png"},
  "twitter": {"card": "summary_large_image"},
  "jsonLd": [{"@context": "https://schema.org", "@type": "Organization", "name": "Example"}],
  "hreflang": [{"lang": "es", "url": "https://example.com/es/"}],
  "truncated": false
}

• url is the final URL after redirects; every URL in the item is absolute.
• A missing field is null, or empty for openGraph, twitter, jsonLd and hreflang. Without a favicon link, favicon is the host's /favicon.ico.
• jsonLd keeps every valid JSON-LD object (a list is flattened) up to 100,000 characters; truncated is true when some were left out or the page passed 3 MB and was cut.
• A page that could not be delivered has url and error, with the reason, and is not charged. A page with no title, description or Open Graph is one of them.
• The run's status message says how many pages were delivered and failed, and why the run stopped early, if it did.
• If nothing is delivered, the run still ends as succeeded: each page that failed is in the dataset with its error, the status message gives the first reason, and nothing was charged.

Input

Field	What it does
urls	From 1 to 100 URLs of HTML pages. A repeated URL is read once.

Limits

• 3 MB and 10 s per page, five pages at a time, no retry.
• Set a maximum charge per run to cap spending: the run stops before a page that would pass it.

Pricing

This actor bills one event, nothing else:

• page: one per page whose metadata is delivered.

Pages that fail, are not HTML, have no title, description or Open Graph, or are not allowed by robots.txt are not charged, and pages not started when the run stops are not fetched or charged. Each page stays charged once delivered, even if the run later stops or fails. If no page is delivered, the run still ends as succeeded and nothing was charged. The run never charges more than the maximum you set: it stops before a page that would not fit. Current prices are on the Pricing tab.

Site owners

To keep your pages out, disallow FrameskimFetch in your robots.txt (the other Frameskim actors that fetch pages, such as Web Search & Page Markdown for AI Agents, also use or honor that user agent, so the rule stops them too). Each run reads a host's robots.txt once, so a run already in progress may not see the change; runs that start after it read the new file. Rights holders and people whose personal data appears in a page's metadata can also write to support@frameskim.dev. Neither a robots.txt rule nor a request removes metadata from datasets that users already hold.

Terms and privacy

URL Metadata for AI Agents is operated by Emttn LLC and is not affiliated with, endorsed by or sponsored by the sites it reads, or by X Corp (Twitter is a trademark of X Corp). You need a lawful basis to fetch each page you list and to use its metadata, and you are responsible for following each site's terms, copyright and privacy law; a public page or a robots.txt allow is not a license to its content. The metadata is what each page declares about itself and may be incomplete or inaccurate. Terms: https://frameskim.dev/terms. Privacy: https://frameskim.dev/privacy. Questions: support@frameskim.dev.

Support

Every error says what was wrong. For anything else, see https://frameskim.dev/terms.