Website Link Graph & Outbound Links Crawler — Link Extractor 🕸️

Extract every link from a website and map its link graph. This link extractor crawls an entire site and exports every internal and outbound link as a graph edge — the source page, the target URL, the anchor text, the link type (internal / subdomain / external) and the rel flags (nofollow, sponsored, ugc). Map a whole site's internal linking and outbound links from a single start URL. No login, no headless browser.

Need to extract all links from a website, run an internal linking SEO audit, analyze outbound / external links, or check nofollow attributes at scale? This actor builds the complete link graph.

---

✨ Key features

• 🕷️ Full-site crawl — start from one URL and follow internal links across the whole domain.
• 🔗 Every link as an edge — source → target with anchor text, for internal and external links.
• 🏷️ Rel & attribute parsing — nofollow, sponsored, ugc flags and target="_blank".
• 🎯 Scope control — export all links, only internal, or only outbound/external links.
• ⚡ Faster & higher-volume than a link checker — it maps the graph without HTTP status checks, so it's ideal for big sites.

💡 Use cases

• Internal-linking SEO audits — see which pages link where and with what anchor text to optimize link equity.
• Outbound / external link analysis — list every external site you link to and which links are nofollow.
• Site-structure mapping — build a link graph for visualization, analysis or crawl-budget optimization.
• Link cleanup & compliance — find sponsored/UGC links that should carry the right rel attributes.
• Anchor-text analysis — audit the anchor text distribution across an entire site.

📦 What you get

One row per link (edge):

Field	Description
sourceUrl	The page the link is on
targetUrl	The link target (absolute URL)
targetDomain	Hostname of the target
anchorText	The clickable text
linkType	internal, subdomain or external
rel	Raw rel attribute
isNofollow / isUgc / isSponsored	Parsed rel flags
opensNewTab	true if target="_blank"
crawledAt	ISO 8601 timestamp

Example output

{
  "sourceUrl": "https://example.com/blog/seo-guide",
  "targetUrl": "https://partner.com/tool",
  "targetDomain": "partner.com",
  "anchorText": "our favorite SEO tool",
  "linkType": "external",
  "rel": "nofollow sponsored",
  "isNofollow": true,
  "isSponsored": true,
  "isUgc": false,
  "opensNewTab": true,
  "crawledAt": "2026-05-25T14:17:17.531Z"
}

🚀 How to use it

1. Click Try for free / Start.
2. Paste one or more website URLs into Start URLs.
3. (Optional) Set Max pages to crawl — 0 for the whole site.
4. (Optional) Choose Which links to export: all / internal / external.
5. Click Save & Start.
6. Export the link graph as JSON, CSV, Excel or via API.

⚙️ Input

Option	Description	Default
startUrls	Websites to crawl	– (required)
maxPagesToCrawl	Max pages per run (0 = whole site)	1000
linkScope	all, internal or external	all
maxConcurrency	Parallel requests	10

Example input

{
  "startUrls": [{ "url": "https://example.com" }],
  "maxPagesToCrawl": 5000,
  "linkScope": "all"
}

🔍 How it works

The crawler follows internal links within the same domain as your Start URLs, and on each page records every <a href> as an edge with its anchor text and rel attributes. URLs are resolved to absolute and de-duplicated per page. Use linkScope to keep only internal or only outbound links. Pure HTTP — fast and cheap.

🧰 Tips & best practices

• Use linkScope: "external" for a pure outbound-link/backlink-target report.
• Use linkScope: "internal" to analyze internal link distribution and orphan-page risk.
• Pivot on targetDomain to see which external domains you link to most.
• Set maxPagesToCrawl to 0 for complete coverage of large sites.

❓ FAQ

What's the difference vs the Broken Link Checker? This actor maps the link graph (anchors, rel, internal/external) without checking HTTP status, so it's faster and produces higher volume. Use the Broken Link Checker when you specifically need to find dead links and status codes.

Does it detect nofollow / sponsored / ugc? Yes — the rel attribute is parsed into boolean flags.

Does it render JavaScript? No — it parses server-rendered HTML for speed and low cost.

How do I crawl the whole site? Set maxPagesToCrawl to 0.

What formats can I export? JSON, CSV, Excel, HTML and a full REST API.

🔗 Related actors by the same author

• Broken Link Checker — crawl a site and find dead links with HTTP status codes.
• Website SEO Audit Crawler — full on-page SEO audit for every page.
• Sitemap to URL Crawler — extract all URLs from any sitemap.xml.
• Website to Markdown & Text Crawler — clean text + Markdown for AI / RAG.

---

Changelog

• 2026-05-25 — Maintenance & reliability pass: pulled the latest source and rebuilt the Actor on the current base image; build verified.

Last reviewed: 2026-05-25.