Web Content & URL Tools MCP Server avatar

Web Content & URL Tools MCP Server

Pricing

Pay per event + usage

Go to Apify Store
Web Content & URL Tools MCP Server

Web Content & URL Tools MCP Server

MCP server for AI agents: web pages to Markdown, metadata and structured data, tech stack, redirects, SSL, security headers, robots.txt, sitemaps, feeds, domains and SEO — plus cron, regex, color, unicode and time zone tools and Hyperliquid perpetuals data.

Pricing

Pay per event + usage

Rating

0.0

(0)

Developer

Avalon

Avalon

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

6 hours ago

Last modified

Share

Give your AI agent twenty-six fast, reliable tools through one MCP server. Read any page as clean Markdown, pull its metadata or structure, find out what it is built with, and check links, certificates, security headers, robots.txt, sitemaps, domains, SEO, broken links and feeds — plus email authentication (SPF, DMARC, DKIM, MTA-STS) and single sign-on (SAML, OpenID Connect) health — without running a browser. It also includes everyday developer utilities and Hyperliquid perpetuals market data.

Tools

ToolWhat it returnsPrice
to_markdownClean, LLM-ready Markdown of the main content (menus, ads and footers removed), word and character counts, language$0.003
get_metadataTitle, description, preview image, site name, canonical URL, favicon, author, publish time, Open Graph / Twitter tags$0.003
extract_structureHeading outline, links (internal/external), images, tables and JSON-LD$0.003
detect_technologiesCMS, framework, e-commerce platform, CDN, analytics and payment tools, with evidence$0.003
trace_redirectsEvery redirect hop (HTTP and meta refresh) to the final URL — expands short links$0.001
check_sslCertificate issuer, expiry, days remaining, SANs, and whether browsers trust it (with the reason)$0.001
grade_security_headersA+ to F grade for eight security headers, information leaks and insecure cookies$0.001
parse_robotsrobots.txt rules per user agent, sitemaps, and whether a given path may be crawled$0.001
parse_sitemapURLs from a sitemap or sitemap index (auto-discovered from a site URL, gzip supported)$0.001
lookup_domainWHOIS (RDAP) registrar, created/expiry dates, domain age, nameservers, DNS records, MX/SPF/DMARC$0.001
audit_seoOn-page SEO score and grade with prioritised issues and fixes$0.003
check_broken_linksUp to 100 links checked: broken, redirected and bot-blocked reported separately$0.003
read_feedRSS, Atom or RDF feed as JSON (auto-discovered from a website URL)$0.001
check_email_domainMX, SPF (10-lookup limit), DMARC, DKIM, MTA-STS, TLS-RPT and BIMI graded pass/warn/fail with fixes and a 0-100 score$0.003
analyze_saml_metadataSAML metadata (XML or URL): entity ID, IdP/SP endpoints and bindings, NameID formats, signing certificate expiry and issues$0.001
check_oidc_providerOpenID Connect discovery and JWKS: issuer match, HTTPS, PKCE S256, ID token algorithms, key sizes and certificate expiry$0.001

Developer tools

ToolWhat it returnsPrice
parse_cronValid or not, plain-English explanation, previous and next run times in any time zone$0.001
test_regexEvery match with positions and groups, plus find-and-replace; runaway patterns stop in 0.1 s$0.001
convert_colorHEX, RGB, HSL, HSV, CMYK, best text color, contrast and palettes$0.001
check_color_contrastWCAG 2 contrast ratio with AA/AAA pass/fail$0.001
inspect_unicodePer-character code point, name and bytes; grapheme count; normalization forms$0.001
convert_timezoneOne time in many IANA zones with offsets, abbreviations and DST$0.001
list_timezonesIANA time zone names, optionally by region$0.001

Hyperliquid perpetuals

ToolWhat it returnsPrice
hyperliquid_marketsMark/oracle price, 24h change, hourly and annualized funding, open interest, volume$0.001
hyperliquid_funding_historyHourly funding history (up to 30 days) with average and annualized rate$0.001
hyperliquid_candlesOHLCV candles from 1 minute to 1 week$0.001

Hyperliquid data comes from Hyperliquid's public market data; this server is not affiliated with Hyperliquid and nothing it returns is financial advice.

You only pay for successful calls. Errors (invalid URL, blocked site, timeout) are free and come back with a clear reason.

Connect

Use the Standby URL with your Apify API token in any MCP client (Claude Desktop, Claude Code, Cursor, VS Code and others):

{
"mcpServers": {
"web-content-url-tools": {
"url": "https://avalonai--web-content-url-tools-mcp.apify.actor/mcp",
"headers": { "Authorization": "Bearer <YOUR_APIFY_TOKEN>" }
}
}
}

Good to know

  • Pages are read from the HTML the server sends; sites that build everything in the browser return little text and say so in warning.
  • Some sites block automated access; those calls return target_blocked and are not charged.
  • Only public http/https addresses are fetched; private and internal addresses are refused.
  • Korean platforms (Cafe24, Imweb, Naver, Kakao, Channel.io, Toss Payments) are detected alongside global ones, and Naver Blog posts are read from their inner frame automatically.