Pricing

from $0.20 / 1,000 results

Try for free

Go to Apify Store

Website URL Extractor - Get All Site URLs

Try for free

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

Pricing

from $0.20 / 1,000 results

Rating

5.0

(1)

Developer

Lofomachines

Actor stats

Bookmarked

184

Total users

Monthly active users

a month ago

Last modified

Categories

Developer tools

SEO tools

Automation

Website URLs

startUrls

Required

List of website URLs to extract all pages from. You can add multiple websites for bulk processing. The scraper will automatically discover and extract all available URLs from each website.

Type:array

Example:

[
  {
    "url": "https://www.theuselesswebindex.com/"
  },
  {
    "url": "https://crawlee.dev"
  }
]

Return All URLs

returnAll

Optional

If enabled, extracts all available URLs regardless of the maxResults setting. When disabled, the maxResults limit will be applied.

Type:boolean

Default:true

Max Results

maxResults

Optional

Maximum number of URLs to extract. This limit is ignored if 'Return All URLs' is enabled. Set to 0 for unlimited (same as enabling 'Return All URLs').

Type:integer

Minimum:0

Default:1000

Keywords Filter

keywords

Optional

Filter URLs to only include those containing all specified keywords. For example, if you add 'blog', only URLs containing 'blog' will be returned (e.g., https://example.com/blog/article). You can add multiple keywords - URLs must contain ALL of them.

Type:string[]

Default:

[]

Example:

[
  "blog",
  "article"
]

Proxy configuration

proxyConfiguration

Optional

Select proxies to be used by the scraper. Recommended for large websites or multiple websites to ensure reliable extraction.

Type:object

Default:

{
  "useApifyProxy": false
}

Website URL Crawler & Link Extractor

maximedupre/website-url-crawler

Crawl JavaScript-rendered websites and export a URL link map. Get source pages, depth, anchor text, link type, HTTP metadata, and crawl status.

Maxime Dupré

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

262

5.0

Link Extractor

automation-lab/link-extractor

This actor extracts all hyperlinks from web pages. For each link, it captures the anchor text, href, rel attributes (nofollow, ugc, sponsored), target attribute, and classifies links as internal or external. It also detects the link's location in the page (nav, header, footer, main content,...

Stas Persiianenko

LLM Visibility Tracker — ChatGPT, Claude, Perplexity, Gemini

khadinakbar/llm-visibility-tracker

Track LLM visibility, ranking, share-of-voice, and citations for any brand across ChatGPT, Claude, Perplexity, and Gemini MCP-ready. $0.090/result.

Khadin Akbar

Pinterest Video Downloader

easyapi/pinterest-video-downloader

Easily download high-quality videos from Pinterest. With batch downloading capabilities and high-speed scraping, you can enrich your video collection effortlessly! 🎥

EasyApi

194

1.0

Lead Enrichment API Multi-Provider B2B Data Enrichment

alizarin_refrigerator-owner/lead-enricher

Enrich your leads w/company & contact data from 10+ enrichment providers. Perfect for sales prospecting, lead scoring, CRM enrichment, and account-based marketing. 10 Provider Integrations: Apollo, Clearbit, ZoomInfo, IPinfo, FullContact, Hunter, Lusha, Snov, RocketReach & People Data Labs

The Howlers

LLM Prompt Response

jakubsuchy/llm-prompt-response

Submits prompts to LLM providers (ChatGPT, Perplexity) via Camoufox anti-detect browser and captures structured responses with sources.

Jakub Suchy

5.0

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract all URLs with full hierarchy — depth, parent URL, and anchor text. Supports static and JavaScript-rendered sites. Configurable depth and domain filtering.

Maged

105

RocketReach Scraper

lexis-solutions/rocketreach-pr-226

Scrape professional contact data from RocketReach.com - including names, emails, phone numbers, company info, and social profiles. Ideal for sales prospecting, recruiting, and lead generation. Fast, structured, and customizable extraction.

Lexis Solutions

335

2.4

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Extract URLs from XML sitemaps and robots.txt for SEO crawls, audits, content migrations, and RAG indexing. Auto-discovers sitemap files, parses nested sitemap indexes, and exports URL, lastmod, priority, changefreq, and image metadata in bulk.