Pricing

from $0.20 / 1,000 results

Try for free

Go to Apify Store

URLs List - Extract ALL website urls

Try for free

Automatically discovers and extracts ALL URLs from any website. Perfect for SEO analysis, content inventory, and bulk URL extraction from multiple websites. Get complete URL lists with metadata including last modified dates and priority levels.

Pricing

from $0.20 / 1,000 results

Rating

5.0

(1)

Developer

Lofomachines

Actor stats

Bookmarked

148

Total users

Monthly active users

3 months ago

Last modified

Categories

Developer tools

SEO tools

Automation

You can access the URLs List - Extract ALL website urls programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrls": [{ "url": "https://www.theuselesswebindex.com/" }],
10    "proxyConfiguration": { "useApifyProxy": True },
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("lofomachines/urls-extractor").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
18for item in client.dataset(run["defaultDatasetId"]).iterate_items():
19    print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

URLs List - Extract ALL website urls API in Python

The Apify API client for Python is the official library that allows you to use URLs List - Extract ALL website urls API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

URLs List - Extract ALL website urls API in JavaScript

URLs List - Extract ALL website urls API through CLI

URLs List - Extract ALL website urls OpenAPI definition

URLs List - Extract ALL website urls API

Link Extractor

automation-lab/link-extractor

This actor extracts all hyperlinks from web pages. For each link, it captures the anchor text, href, rel attributes (nofollow, ugc, sponsored), target attribute, and classifies links as internal or external. It also detects the link's location in the page (nav, header, footer, main content,...

Stas Persiianenko

URL Mapper

marcoet/url-mapper

Map every link on any website in seconds. URLMapper instantly crawls a single page, returns a complete JSON of internal URLs, supports keyword filtering, and plugs straight into any Apify workflow or API so you can pre-crawl, audit SEO, or feed clean link lists into larger scrapers.

Marco Elizalde

4.4

FindLaw Scraper

jungle_synthesizer/findlaw-scraper

Scrape attorney and law firm data from FindLaw Lawyer Directory to generate high-quality, targeted legal industry leads

BowTiedRaccoon

177

Fast Sitemap Generator

eunit/sitemap-generator

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.

Emmanuel Uchenna

5.0

Actor Builder

handleco-app/actor-builder

handleco-app

Google Search Scraper - Most Comprehensive

kaix/google-serp-scraper

🔥 ~$1/1K pages 🔥 Scrape Google into 40+ structured sections: organic results, knowledge panel with cast/ratings/streaming prices, finance with earnings, shopping with filters, AI overview, PAA with answers, perspectives, video key moments, hotels, local pack, flights, lyrics, sports, ads.

Kai

Skool Email Scraper

scrapio/skool-email-scraper

Skool Email Scraper helps you collect emails from Skool creators, coaches, and community owners. Use the data for partnerships, program promotion, and sales outreach. Fast, scalable scraping with clean exports.

Scrapio

Website Tech Profiler

lofomachines/website-tech-profiler

Advanced technology stack scraper and Wappalyzer alternative. Detect frontend frameworks (React, Vue, Angular), backend technologies, CDN, hosting providers, analytics, advertising scripts, API endpoints, and more. Complete techstack analysis for competitive research and lead generation.

Lofomachines

5.0

Website Scraper Search Email, Phone, & Social Media

scraping_solutions/website-scraper-search-email-phone-social-media

Automatically extracts emails, social media links, and phone numbers from any website. Perfect for quickly gathering contact details and online presence data of businesses or professionals.

Scraping Solutions

105

Telegram Keyword Search Scraper

lofomachines/telegram-keyword-search-scraper

The most versatile Telegram scraper. Search message by keyword across all public channels, or scrape any channel's full history by username. No API key needed. 43 countries, 30 languages, real-time streaming.

Lofomachines

309