Pricing

$8.00/month + usage

Go to Store

Get Urls Pro

Try for free

Developed by

Maged Safwat

This Apify actor crawls websites, extracts and creates a hierarchy of links, allowing you to visualize the structure of a website. The crawler can be configured to use either standard HTTP requests with BeautifulSoup (fast HTML parsing) or Selenium (for JavaScript-heavy pages)

0.0 (0)

Pricing

$8.00/month + usage

Total users

Monthly users

Runs succeeded

>99%

Last modified

a month ago

Automation

Other

SEO tools

Start URL

startUrlstringRequired

The starting URL to crawl (e.g., https://jamesclear.com/five-step-creative-process)

Use Selenium Browser

useSeleniumbooleanOptional

Use Selenium for JavaScript-heavy pages (slower but more accurate for dynamic content)

Default value of this property is false

Allow Duplicate URLs

allowDuplicatesbooleanOptional

Allow duplicate URLs to be included in the output. If false, each URL will appear only once.

Default value of this property is false

Maximum Crawl Depth

maxDepthintegerOptional

Maximum depth of link recursion

Default value of this property is 3

Maximum Children per Link

maxChildrenPerLinkintegerOptional

Maximum number of children links to follow from each parent link

Default value of this property is 3

Same Domain Only

sameDomainOnlybooleanOptional

Only crawl URLs within the same domain as the start URL

Default value of this property is true

Ignored File Extensions

ignoredExtensionsarrayOptional

File extensions to ignore when crawling

Get Urls Pro PPR

maged120/get-urls-pro-ppr

Maged Safwat

Get Urls

maged120/get-urls

scrap links from any website

Maged Safwat

3.0

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Example Website Screenshot Crawler

dz_omar/example-website-screenshot-crawler

Automated website screenshot crawler using Pyppeteer and Apify. This open-source actor captures screenshots from specified URLs, uploads them to the Apify Key-Value Store, and provides easy access to the results, making it ideal for monitoring website changes and archiving web content.

Abdlhakim hefaia

Spyfu (Bulk URLs)

canadesk/spyfu-bulk-urls

Get the most valuable and successful keywords, top ads, domain statistics and top competitors from Spyfu public data. It's fast and costs little.

Canadesk Support

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

821

4.4

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

5.0

🔗✨ Link Extractor Pro: URL to HTML List Downloader

dainty_screw/link-extractor-pro-url-to-html-list-downloader

Maximize productivity with HTML URL List Downloader. Quickly extract, manage, and organize URLs from HTML pages. Ideal for SEO professionals and digital marketers. Streamline your workflow today!