URL Mapper
Pricing
Pay per event
URL Mapper
Map every link on any website in seconds. URLMapper instantly crawls a single page, returns a complete JSON of internal URLs, supports keyword filtering, and plugs straight into any Apify workflow or API so you can pre-crawl, audit SEO, or feed clean link lists into larger scrapers.
0.0 (0)
Pricing
Pay per event
0
Total users
1
Monthly users
1
Runs succeeded
>99%
Last modified
12 hours ago
URLMapper · Instantly list every link on a website
URLMapper turns a single URL into a clean list of all the pages it can reach in a few seconds.
Point it at any public site and the Actor returns every discovered link in a tidy, ready‑to‑export table.
Add an optional search term to keep only links that contain a specific word or path segment (e.g. docs, blog, product).
Key features
| Feature | Description |
|---|---|
| 🔗 Full‑site link discovery | Generates a complete map of internal URLs from one starting page. |
🔍 Smart filter (search) | Return only the links that match a substring—perfect for isolating sections such as /blog or /docs. |
| ⚡ Fast & lightweight | Typical sites (hundreds of pages) are mapped in seconds. |
| 📥 Simple input | Just give it a url (required) and optional search. |
| 📊 Clean output | Each link is a separate record, ideal for CSV, JSON, Sheets, or direct API use. |
Typical use cases
| Scenario | How URLMapper helps |
|---|---|
| Pre‑crawl planning | Grab all internal URLs and feed only the relevant ones to a heavier scraper. |
| SEO audits | Generate a fresh list of live pages to cross‑check for orphan content or broken links. |
| Content research | Collect every article URL on a blog for sentiment, topic, or trend analysis. |
| Competitive analysis | Snapshot a rival’s entire site structure in moments. |
Input
| Field | Type | Required | Example | Description |
|---|---|---|---|---|
url | string | ✅ | https://example.com | Starting page. |
search | string | ❌ | blog | Return only links that contain this substring (case‑insensitive). |
Output
The Actor pushes one dataset record per link:
Download the dataset in JSON, CSV, XLSX, or view it directly in the Apify Console.
Quick start
-
Run in Apify Console
- Paste the target URL in the Input tab.
- (Optional) Add a
searchterm to narrow the results. - Click Run—your link list appears in the Output tab.
-
Call from code
Tips
- Large sites – If a site contains tens of thousands of pages, consider splitting the task per sub‑section (
search = '/docs',/blog, etc.). - Combining Actors – Use URLMapper first, then feed the resulting dataset to other Apify scrapers via Webhooks or the API.
- Scheduling – Map the same site daily or weekly to track new pages over time.
Need help?
Open an issue in the Actor’s Issues tab or join the Apify Discord community. Happy mapping!
On this page
Share Actor:
