Pricing

from $1.00 / 1,000 pages

Try for free

Go to Apify Store

Internal Link Graph & Orphan-Page Analyzer

Try for free

Build an internal-link graph and identify sitemap orphan candidates.

Pricing

from $1.00 / 1,000 pages

Rating

0.0

(0)

Developer

Danial Maqbool

Actor stats

Bookmarked

Total users

Monthly active users

17 days ago

Last modified

Categories

Start Url

startUrl

Required

Public HTTP(S) website or sitemap URL.

Type:string

Max. length:1000

Example:

https://example.com/

Max Pages

maxPages

Optional

Maximum pages scheduled in this bounded run.

Type:integer

Minimum:1

Maximum:5000

Default:25

Example:

Render Java Script

renderJavaScript

Optional

Opt into Chromium for JavaScript content. More expensive; no access-control bypass.

Type:boolean

Default:false

Example:

false

Respect Robots Txt

respectRobotsTxt

Optional

Honor robots rules and supported crawl delays. Unavailable rules fail closed.

Type:boolean

Default:true

Example:

true

Max Depth

maxDepth

Optional

Maximum followed-link depth. Explicit seeds start at zero.

Type:integer

Minimum:0

Maximum:20

Default:2

Example:

Include Patterns

includePatterns

Optional

Allowed absolute-URL patterns using * as wildcard.

Type:string[]

Max. items:1000

Exclude Patterns

excludePatterns

Optional

Excluded absolute-URL patterns using * as wildcard.

Type:string[]

Max. items:1000

Sitemap Urls

sitemapUrls

Optional

Sitemap Urls. See README for extraction behavior.

Type:string[]

Max. items:1000

Concurrency

concurrency

Optional

Maximum concurrent page handlers. Per-origin delays still apply.

Type:integer

Minimum:1

Maximum:10

Default:3

Example:

Request Delay Ms

requestDelayMs

Optional

Minimum spacing between request starts to the same origin.

Type:integer

Minimum:0

Maximum:60000

Default:250

Timeout Secs

timeoutSecs

Optional

Maximum individual request duration in seconds.

Type:integer

Minimum:5

Maximum:120

Default:30

Example:

Retries

retries

Optional

Retries for page handlers. Access blocks are not retried.

Type:integer

Minimum:0

Maximum:5

Default:2

Example:

Proxy configuration

proxyConfiguration

Optional

Optional Apify or public custom proxy. Direct connections are the default.

Type:object

Default:

{
  "useApifyProxy": false
}

Link Relationship Analyzer

zerobreak/link-relationship-analyzer

Link relationship analyzer that crawls any website and maps all internal and external links, so SEO teams can audit anchor text, find orphaned pages, and see how a site's pages connect.

ZeroBreak

Broken Link Finder

pillowy_travel/broken-link-finder

Finds and analyzes broken links on given web pages

SAHIL KUMAR

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Website Link Graph & Outbound Links Crawler

logiover/website-link-graph-crawler

Extract all links from a website to CSV/JSON. Maps internal & outbound link graph with anchor text + nofollow/rel flags. No API, no login.

Logiover

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

Domain SEO Analyzer — Keywords, Traffic & Gap

cheapapi/domain-seo-analyzer

Get organic traffic, ranked keywords, competitors, top pages, subdomains, keyword gap, rank history and bulk traffic for any domain. No login.

CheapAPI

Bulk SEO Audit - Titles, Meta, Headings, Schema, Links

thirdwatch/seo-data-extractor

Run an SEO audit on hundreds of pages at once. For each URL you get the title, meta description, headings, canonical, Open Graph and Twitter cards, schema markup, image alt-text gaps, internal and external link counts, and word count. The fastest way to check on-page SEO across a whole site.

Thirdwatch

Broken Link Checker — Recursive Site Crawler

accurate_pouch/broken-link-checker

Recursively crawl your website and find every broken link, 404, redirect, and timeout. Checks internal and external links with configurable depth. 100 links free per run.

Manchitt Sanan

Open Graph Batch Validator

mahogany_songbird/open-graph-batch-validator

Validate og:title, og:type, og:image, and og:url across many URLs; reports missing tags.

Britton Furness

Broken Link / URL Status Checker

bgfc97/broken-link-checker

Check many URLs for health: HTTP status, final URL after redirects, response time and a broken/OK flag. For SEO link audits, uptime and QA monitoring. No key, no proxy.