Pricing

$12.00 / 1,000 results

Go to Store

Get Urls Pro PPR

Try for free

Developed by

Maged Safwat

This Apify actor crawls websites, extracts and creates a hierarchy of links, allowing you to visualize the structure of a website. The crawler can be configured to use either standard HTTP requests with BeautifulSoup (fast HTML parsing) or Selenium (for JavaScript-heavy pages)

0.0 (0)

Pricing

$12.00 / 1,000 results

Total users

Monthly users

Runs succeeded

>99%

Last modified

a month ago

Developer tools

Automation

SEO tools

Start URL

startUrlstringRequired

The starting URL to crawl (e.g., https://jamesclear.com/five-step-creative-process)

Use Selenium Browser

useSeleniumbooleanOptional

Use Selenium for JavaScript-heavy pages (slower but more accurate for dynamic content)

Default value of this property is false

Allow Duplicate URLs

allowDuplicatesbooleanOptional

Allow duplicate URLs to be included in the output. If false, each URL will appear only once.

Default value of this property is false

Maximum Crawl Depth

maxDepthintegerOptional

Maximum depth of link recursion

Default value of this property is 3

Maximum Children per Link

maxChildrenPerLinkintegerOptional

Maximum number of children links to follow from each parent link

Default value of this property is 3

Same Domain Only

sameDomainOnlybooleanOptional

Only crawl URLs within the same domain as the start URL

Default value of this property is true

Ignored File Extensions

ignoredExtensionsarrayOptional

File extensions to ignore when crawling

Get Urls Pro

maged120/get-urls-pro

Maged Safwat

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

817

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.4k

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Vanilla JS Scraper

mstephen190/vanilla-js-scraper

Scrape the web using familiar JavaScript methods! Crawls websites using raw HTTP requests, parses the HTML with the JSDOM package, and extracts data from the pages using Node.js code. Supports both recursive crawling and lists of URLs. This actor is a non jQuery alternative to CheerioScraper.

Matthias Stephens

460

Web Crawler

rigelbytes/webcrawler

This web crawler is designed to provide users with complete flexibility by allowing them to use their **own proxies**. The scraper collects all pages from the website and returns extracts the **MetaData**, **Title**, and **Content** of the page in MarkDown.

Rigel Bytes

Haldirams-Apify-Client

saikarna/haldirams-apify-client

**Haldirams-Apify-Client** is a web scraper that extracts product titles, links, and prices from the Haldiram’s website. It uses **BeautifulSoup** for parsing and **HTTPX** for fast, asynchronous requests, ensuring efficient data extraction for analysis, price tracking, or automation. 🚀

Sai Karnati

Website Media Link Scraper

thenetaji/website-media-link-scraper

Extract video, audio, and image links from websites with this efficient web crawler. Uses lightweight HTTP requests to discover media URLs across entire sites without browser overhead. Fast, reliable, and resource-friendly.