SEO Audit Crawler: Bulk Technical Site Checker
Pricing
Pay per event
SEO Audit Crawler: Bulk Technical Site Checker
Crawl one or many websites and get a per-page technical SEO audit: titles, meta descriptions, H1s, canonicals, noindex, broken internal links, duplicates, missing alt text, thin content. Pure HTTP, no browser, pay per page.
Pricing
Pay per event
Rating
0.0
(0)
Developer
Lindenbyte Studio
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
40 minutes ago
Last modified
Categories
Features
Share
Crawl any website (or a list of them) and get a page-by-page technical SEO audit in a clean dataset, with no browser and no setup. Built for agencies, freelancers, in-house SEOs and anyone who wants a scheduled health check of a site.
What it checks
| Check | Issue codes |
|---|---|
| Status | http-error (4xx/5xx/unreachable), redirected, not-https |
| Title | title-missing, title-too-short (<30), title-too-long (>60) |
| Meta description | meta-description-missing, -too-short (<70), -too-long (>160) |
| Headings | h1-missing, h1-multiple |
| Indexing | noindex (meta robots or X-Robots-Tag), canonical-missing, canonical-other-url |
| Site-wide | duplicate-title, duplicate-meta-description, duplicate-h1, broken-internal-links (links to pages that returned an error) |
| Content / markup | images-missing-alt, thin-content (<200 words), viewport-missing, lang-missing, og-tags-missing |
Every page gets a score (100 minus weighted issues) and a list of issue codes. Each site also gets a free site-summary row: pages crawled, average score, issues by severity and type, duplicate groups.
Use cases
- Quick audit of a new client's site before a pitch.
- Weekly scheduled health check; compare
issuesByTypeover time. - Find broken internal links and duplicate titles at scale across many domains.
- Pre-launch / post-migration check (noindex left on, canonicals, redirects).
Input
| Field | Meaning |
|---|---|
startUrls | Domains or URLs, one site per entry |
maxPagesPerSite | Cap on pages crawled per site (default 100) |
maxDepth | Click depth from start page (default 5) |
respectRobotsTxt | Default on |
includePatterns / excludePatterns | Regex filters for URLs to follow |
concurrency, requestTimeoutSecs | Politeness and timeout |
Output (example row)
{ "type": "page", "site": "example.com", "url": "https://example.com/", "status": 200, "score": 76,"issueCount": 6, "issues": ["title-too-short","meta-description-missing","h1-missing","canonical-missing","thin-content","og-tags-missing"],"title": "Example Domain", "titleLength": 14, "h1Count": 0, "wordCount": 17 }
The type: "site-summary" row is the executive overview. Also saved to the key-value store as SUMMARY.
Pricing
Pay per result: you pay per audited page (an HTML page that loaded successfully) plus a small start fee. Error pages, non-HTML files and site-summary rows are free. Set a max charge limit and the run stops when it is reached.
Honest limits
- Plain HTTP only: pages that need JavaScript to render their content (single-page apps) are audited as served, so titles/H1s set by JS may show as missing.
- Broken-link detection covers internal links to pages inside the crawl (links beyond
maxPagesPerSiteare not checked); external links are counted, not checked. - Not a ranking tool: no backlinks, keywords or traffic data. It audits what is on your pages.
- Be polite: lower
concurrencyfor small sites. Respect the site's terms; audit sites you own or are allowed to audit.
Not affiliated with Google or any SEO tool vendor.