Pricing

$12.00 / 1,000 results

Go to Store

Get Urls Pro PPR

Try for free

Developed by

Maged

This Apify actor crawls websites, extracts and creates a hierarchy of links, allowing you to visualize the structure of a website. The crawler can be configured to use either standard HTTP requests with BeautifulSoup (fast HTML parsing) or Selenium (for JavaScript-heavy pages)

5.0 (1)

Pricing

$12.00 / 1,000 results

Total users

Monthly users

Runs succeeded

97%

Last modified

12 days ago

Developer tools

Automation

SEO tools

Start URL

startUrlstringRequired

The starting URL to crawl (e.g., https://jamesclear.com/five-step-creative-process)

Use Selenium Browser

useSeleniumbooleanOptional

Use Selenium for JavaScript-heavy pages (slower but more accurate for dynamic content)

Default value of this property is false

Allow Duplicate URLs

allowDuplicatesbooleanOptional

Allow duplicate URLs to be included in the output. If false, each URL will appear only once.

Default value of this property is false

Maximum Crawl Depth

maxDepthintegerOptional

Maximum depth of link recursion

Default value of this property is 3

Maximum Children per Link

maxChildrenPerLinkintegerOptional

Maximum number of children links to follow from each parent link

Default value of this property is 3

Same Domain Only

sameDomainOnlybooleanOptional

Only crawl URLs within the same domain as the start URL

Default value of this property is true

Ignored File Extensions

ignoredExtensionsarrayOptional

File extensions to ignore when crawling

Get Urls Pro

maged120/get-urls-pro

Maged

5.0

Get Urls Rental

maged120/get-urls-rental

scrap links from any website, ppr version: https://apify.com/maged120/get-urls

Maged

5.0

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.5k

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Get Urls

maged120/get-urls

scrap links from any website, now has a RENTAL version https://apify.com/maged120/get-urls-rental

Maged

3.7

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

5.0

Internal Links Scraper

mysteriousshadow/internal-links-scraper

When given a sitemap of a website, this scraper will go through every page listed on the sitemap and find all the internal links. Useful for SEO, finding orphaned pages, and visualizing internal linking structure.

Mysterious Shadow

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

832

4.4

Deep Website Content Crawler

6sigmag/deep-website-content-crawler

Scrape Failed Killer! A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

328

4.1

Html To Markdown Converter 📄

powerful_bachelor/html-to-markdown-converter

📄✨ HTML to Markdown Converter transforms web pages into clean, portable Markdown. Simply input a URL to extract content while preserving structure, formatting, and media elements.🔄 Perfect for content repurposing, documentation, and creating readable, platform-independent text from any webpage! 🚀