Website Metadata & Tech Profiler — Bulk URL Inspector avatar

Website Metadata & Tech Profiler — Bulk URL Inspector

Pricing

Pay per usage

Go to Apify Store
Website Metadata & Tech Profiler — Bulk URL Inspector

Website Metadata & Tech Profiler — Bulk URL Inspector

Bulk-profile URLs: final URL & status, title/meta/Open Graph, server + security headers, and tech hints. One JSON row per URL.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

wei seer

wei seer

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

14 hours ago

Last modified

Share

Profile a whole list of URLs in one run. For each URL you get one JSON row with reachability, on-page metadata, server & security headers, and lightweight tech hints. HTTP-based — fast, no headless browser, no proxies to configure.

Great for SEO audits, lead enrichment, competitor/tech research, and security-header posture checks across many sites at once.

What you get per URL

GroupFields
Reachabilityfinal_url (after redirects), status, ok, content_type
Metadatatitle, description, canonical, Open Graph (og:title/description/image/site_name)
Serverserver, powered_by headers
Security headersHSTS, CSP, X-Frame-Options, X-Content-Type-Options, Referrer-Policy, Permissions-Policy + present/missing grade
Tech hintsCloudflare, nginx, Apache, PHP, Express, Next.js, Nuxt, Shopify, WordPress, Vercel …

Input

{ "urls": ["example.com", "https://github.com/about"], "timeoutSecs": 15 }

Bare domains are upgraded to https://. Leave urls empty to run the built-in sample.

Output (one item per URL)

{
"url": "https://github.com",
"final_url": "https://github.com/",
"status": 200,
"title": "GitHub · Build and ship software...",
"description": "...",
"og": { "title": "GitHub", "image": "https://..." },
"server": "GitHub.com",
"security_headers": { "present": ["strict-transport-security", "content-security-policy"], "missing": ["permissions-policy"], "grade": "5/6" },
"tech": ["Cloudflare"],
"queried_at": "2026-05-31T00:00:00.000Z"
}

Export as JSON/CSV/Excel or pull via the Apify API.

Use cases

  • SEO audit at scale — title/description/canonical/OG coverage across a site list.
  • Lead enrichment — tech stack + server signals for a list of company URLs.
  • Security posture — which sites are missing HSTS/CSP/etc., graded.
  • Competitor research — what a set of sites run, in one table.

Pricing

Pay per result: $0.01 per URL profiled. No rental, no subscription.

Notes

HTTP-only (fetch + lightweight parsing), so there's no browser to break and it stays low-maintenance. Pairs with Domain Intelligence (DNS/WHOIS/SSL) for a full domain + website profile.


Apache-2.0 · by weiseer