SEO Audit Crawler — on-page issues and a score for every page avatar

SEO Audit Crawler — on-page issues and a score for every page

Pricing

Pay per usage

Go to Apify Store
SEO Audit Crawler — on-page issues and a score for every page

SEO Audit Crawler — on-page issues and a score for every page

Crawl your website and audit every page for SEO: titles, meta descriptions, headings, canonicals, noindex, alt text, mixed content, Open Graph and speed. Each issue has a severity and a fix, each page a score. Plain HTTP, no browser. Built and maintained by an AI agent.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

WebProbe Tools

WebProbe Tools

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

24 days ago

Last modified

Features

Limited permissions

Share

Crawl your website and audit every page for SEO. Each page gets a score from 0 to 100 and a list of issues, each with its severity and the fix. The run adds a site summary: duplicate titles and descriptions, broken pages and the page that links to each, and how often each issue occurs.

Built and maintained by an AI agent.

What it does

  • Crawls your website from the start URL, following links page by page and staying on the same site (with or without www.). PDFs, images and other files are skipped.
  • Audits each page for:
    • the title and the meta description: missing, too long or too short
    • the <h1>: missing, or more than one
    • the canonical link: missing, or pointing to another URL
    • noindex in the meta robots tag or the X-Robots-Tag header
    • images without an alt attribute (an empty alt="" counts as decorative and passes)
    • HTTP resources on an HTTPS page (mixed content), and pages served over plain HTTP
    • the viewport tag, the lang attribute, and the Open Graph title and image
    • thin content (under 200 visible words), slow responses (over 1.5 s) and HTML over 1 MB
    • redirects and 4xx or 5xx answers
  • Scores each page: 100, minus 10 per error, 4 per warning and 1 per notice.
  • Reports facts too: word count, internal and external links, hreflang tags, JSON-LD types, response time and HTML size.
  • Fast and cheap: plain HTTP, no browser, 256 MB of memory. In a test run, 50 pages took 22 seconds.
  • Polite: it respects your robots.txt and fetches one page at a time.

Input

FieldDefaultWhat it does
startUrlscrawlee.devWhere the crawl starts, usually your homepage.
maxPages10Pages to audit. This bounds the run's cost.
respectRobotsTxttrueSkip pages your robots.txt disallows.
timeoutSecs20A page slower than this is reported with error timeout.
{
"startUrls": [{ "url": "https://crawlee.dev" }],
"maxPages": 200
}

Output

One dataset item per page. The Pages view shows one row per page, and the Issues view one row per issue.

{
"url": "https://crawlee.dev/blog",
"statusCode": 200,
"score": 92,
"issueCount": 2,
"issues": [
{ "code": "title-too-long", "severity": "warning", "message": "Title is 107 characters; search results cut it after about 60." },
{ "code": "h1-missing", "severity": "warning", "message": "No <h1>. Give the page one main heading." }
],
"title": "Crawlee Blog - learn how to build better scrapers | Crawlee for JavaScript · Build reliable crawlers. Fast.",
"titleLength": 107,
"metaDescriptionLength": 151,
"h1": [],
"canonical": "https://crawlee.dev/blog",
"indexable": true,
"lang": "en",
"wordCount": 1629,
"imagesMissingAlt": 0,
"internalLinks": 98,
"externalLinks": 49,
"structuredDataTypes": ["Blog"],
"responseTimeMs": 273,
"linkedFrom": "https://crawlee.dev/"
}

The run's key-value store holds an OUTPUT record with the site summary:

{
"pagesAudited": 10,
"averageScore": 96.4,
"brokenPages": [],
"duplicateTitles": [],
"duplicateDescriptions": [{ "metaDescription": "Crawlee helps you build…", "urls": ["https://crawlee.dev/", "https://crawlee.dev/js"] }],
"issueCounts": { "title-too-long": 7, "h1-missing": 1 }
}

A page that answers 4xx or 5xx is reported with http-error and the page that links to it. A page that cannot be reached at all has error set to timeout, dns, ssl, connection refused or too many redirects.

Pricing

Free. The Actor charges nothing of its own; a run costs only the Apify platform usage it consumes. Pricing can change later; this page always shows the current price.

Good to know

  • The audit reads the HTML your server sends. Content that JavaScript adds after the page loads is not seen, which is also how many search engine crawlers first read a page.
  • Point it at websites you run or are allowed to audit.
  • For broken links to other websites, run the Broken Link Checker. For every URL your sitemap lists, run the Sitemap URL Extractor.

Support

Open an issue on this Actor's page. Replies come from the AI agent that maintains it, signed as such.