# Website Link Extractor - All Internal & External Links (`ninhothedev/website-link-extractor`) Actor
$0.5/1K 🔥 Website link extractor! All internal & external links, anchor text, rel & nofollow from any page. No key. JSON, CSV, Excel or API in seconds. Power SEO & crawl prep ⚡
- **URL**: https://apify.com/ninhothedev/website-link-extractor.md
- **Developed by:** [ninhothedev](https://apify.com/ninhothedev) (community)
- **Categories:** SEO tools, Developer tools
- **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $0.50 / 1,000 results
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## Website Link Extractor 🔗
**Extract every link from any web page — internal & external URLs, anchor text, `rel`/`nofollow`/`sponsored`/`ugc`, and link scheme (http/mailto/tel). No API key, no login, no config.**
Point it at any list of page URLs and get back one clean row per `` link: the resolved **absolute URL**, the **anchor text**, the `title` attribute, all **`rel` tokens**, a **nofollow** flag, whether the link is **internal or external**, and its **scheme**. Perfect for SEO link analysis, crawl preparation, and outlink/backlink audits.
---
### ✨ What you get
For every link on every page:
| Field | Description |
|-------|-------------|
| `source_page` | The page the link was found on |
| `url` | Fully resolved **absolute** URL |
| `anchor_text` | Visible clickable text |
| `title_attr` | The anchor's `title` attribute |
| `rel` | List of `rel` tokens (`nofollow`, `sponsored`, `ugc`, `noopener`, …) |
| `nofollow` | `true` if the link is `rel="nofollow"` |
| `target` | The anchor's `target` attribute (e.g. `_blank`) |
| `is_internal` | `true` if same registrable domain as the source page |
| `is_external` | `true` if a different domain |
| `scheme` | `http`, `https`, `mailto`, `tel`, … |
| `category` | `internal` / `external` / `social` / `mailto` / `tel` |
| `source` | Always `link-extractor` |
| `scraped_at` | UTC timestamp of extraction |
Links are resolved to absolute form, deduped by default, and returned one item per link.
---
### 🚀 How to use
1. Paste one or more page **URLs** (e.g. `https://news.ycombinator.com`).
2. (Optional) toggle **Internal links only** or **External links only**.
3. (Optional) turn **dedupe** off to keep repeated links, or raise **maxItems**.
4. Run. Export to **JSON, CSV, Excel, or via API**.
#### Input example
```json
{
"mode": "extract",
"urls": ["https://news.ycombinator.com"],
"internalOnly": false,
"externalOnly": false,
"dedupe": true,
"maxItems": 500
}
````
#### Output example
```json
{
"source_page": "https://news.ycombinator.com",
"url": "https://qwen.ai/blog?id=qwen-image-3.0",
"anchor_text": "Qwen-Image-3.0: Rich Content, Authentic Details",
"title_attr": null,
"rel": [],
"nofollow": false,
"target": null,
"is_internal": false,
"is_external": true,
"scheme": "https",
"category": "external",
"source": "link-extractor",
"scraped_at": "2026-07-21T10:00:00Z"
}
```
***
### 💡 Use cases
- **SEO link analysis** — audit internal linking depth, spot orphan pages, count nofollow vs dofollow.
- **Crawling prep** — build a seed list of URLs to feed into a full crawler.
- **Backlink / outlink audits** — see exactly which external domains a page links to, and how (`sponsored`, `ugc`, `nofollow`).
- **Link datasets** — export structured link graphs for research or reporting.
***
### 💰 Pricing
Pay-as-you-go, roughly **~$0.50 per 1,000 links** extracted (plus Apify platform usage). Cheap enough to run across hundreds of pages; cap spend anytime with `maxItems`.
***
### 🔧 Notes
- Fetches pages with a real Chrome browser fingerprint (`curl_cffi`, `chrome124`) and falls back to a plain HTTP client.
- `javascript:` and pure in-page `#anchor` links are skipped; `mailto:` and `tel:` links are **kept and flagged** by `scheme`/`category`.
- "Internal" compares the **registrable domain**, so `example.com` and `www.example.com` count as the same site.
***
### 🔗 Related actors
- [Broken Link Checker](https://apify.com/ninhothedev/broken-link-checker)
- [Sitemap URL Extractor](https://apify.com/ninhothedev/sitemap-url-extractor)
- [Website Content Crawler](https://apify.com/ninhothedev/website-content-crawler)
- [SEO On-Page Auditor](https://apify.com/ninhothedev/seo-onpage-auditor)
***
**Keywords:** link extractor, extract links from website, internal links, external links, outbound link checker, nofollow checker, anchor text scraper, SEO link analysis, backlink audit, outlink audit, href extractor, crawl seed URLs, link graph, rel sponsored ugc.
# Actor input Schema
## `mode` (type: `string`):
Operation mode. 'extract' takes page URLs and returns one item per link found on each page.
## `urls` (type: `array`):
List of web page URLs to extract links from. Each page is fetched and every anchor is returned as a separate item.
## `internalOnly` (type: `boolean`):
If enabled, keep only links pointing to the same registrable domain as the source page. Mutually exclusive with 'externalOnly'.
## `externalOnly` (type: `boolean`):
If enabled, keep only links pointing to a different domain than the source page. Mutually exclusive with 'internalOnly'.
## `dedupe` (type: `boolean`):
If enabled, collapse repeated links so each unique absolute URL appears only once per source page.
## `maxItems` (type: `integer`):
Maximum number of link items to output across all pages. Use this to cap cost and dataset size.
## Actor input object example
```json
{
"mode": "extract",
"urls": [
"https://news.ycombinator.com"
],
"internalOnly": false,
"externalOnly": false,
"dedupe": true,
"maxItems": 500
}
```
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"urls": [
"https://news.ycombinator.com"
]
};
// Run the Actor and wait for it to finish
const run = await client.actor("ninhothedev/website-link-extractor").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = { "urls": ["https://news.ycombinator.com"] }
# Run the Actor and wait for it to finish
run = client.actor("ninhothedev/website-link-extractor").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"urls": [
"https://news.ycombinator.com"
]
}' |
apify call ninhothedev/website-link-extractor --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=ninhothedev/website-link-extractor",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Website Link Extractor - All Internal & External Links",
"description": "$0.5/1K 🔥 Website link extractor! All internal & external links, anchor text, rel & nofollow from any page. No key. JSON, CSV, Excel or API in seconds. Power SEO & crawl prep ⚡",
"version": "0.1",
"x-build-id": "tCxkK9GvjlLokpX5o"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/ninhothedev~website-link-extractor/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-ninhothedev-website-link-extractor",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/ninhothedev~website-link-extractor/runs": {
"post": {
"operationId": "runs-sync-ninhothedev-website-link-extractor",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/ninhothedev~website-link-extractor/run-sync": {
"post": {
"operationId": "run-sync-ninhothedev-website-link-extractor",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"required": [
"mode",
"urls"
],
"properties": {
"mode": {
"title": "Mode",
"enum": [
"extract"
],
"type": "string",
"description": "Operation mode. 'extract' takes page URLs and returns one item per link found on each page.",
"default": "extract"
},
"urls": {
"title": "Page URLs",
"type": "array",
"description": "List of web page URLs to extract links from. Each page is fetched and every anchor is returned as a separate item.",
"default": [
"https://news.ycombinator.com"
],
"items": {
"type": "string"
}
},
"internalOnly": {
"title": "Internal links only",
"type": "boolean",
"description": "If enabled, keep only links pointing to the same registrable domain as the source page. Mutually exclusive with 'externalOnly'.",
"default": false
},
"externalOnly": {
"title": "External links only",
"type": "boolean",
"description": "If enabled, keep only links pointing to a different domain than the source page. Mutually exclusive with 'internalOnly'.",
"default": false
},
"dedupe": {
"title": "Deduplicate links",
"type": "boolean",
"description": "If enabled, collapse repeated links so each unique absolute URL appears only once per source page.",
"default": true
},
"maxItems": {
"title": "Max items",
"minimum": 1,
"maximum": 5000,
"type": "integer",
"description": "Maximum number of link items to output across all pages. Use this to cap cost and dataset size.",
"default": 500
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```