30 minutes trial then $10.00/month - No credit card required now

Domain Scraper

ib4ngz/domain-scraper

30 minutes trial then $10.00/month - No credit card required now

This actor scrapes unique domains from a list of provided URLs. It crawls each page, extracts domains, and stores them in a dataset. The actor respects a defined maximum depth and filters domains based on whether they are ICANN-approved and whether private domains are allowed.

Start URLs

startUrlsarrayRequired

URLs to start with.

Maximum Depth

maxDepthintegerOptional

The maximum depth for crawling.

Default value of this property is 1

Allow Private Domains

allowPrivateDomainsbooleanOptional

Whether to allow private domains (default is false).

Default value of this property is false

ICANN Domains Only

isIcannbooleanOptional

Whether to only process ICANN domains (default is true).

Default value of this property is true

Proxy configuration

proxyConfigurationobjectOptional

Select proxies to be used by your crawler.

Minimum Concurrency

minConcurrencyintegerOptional

The minimum number of concurrent requests or pages being processed.

Default value of this property is 1

Maximum Concurrency

maxConcurrencyintegerOptional

The maximum number of concurrent requests or pages being processed.

Default value of this property is 10

Developer

Iqbal R

Actor Metrics

3 monthly users
1 star
>99% runs succeeded
Created in Dec 2024
Modified a day ago

Categories

Automation

Developer tools

SEO tools

Domain.com.au Scraper

scrapemind/Domaincomau-Scraper

Unlock Comprehensive Real Estate Data from Domain.com.au Discover a wealth of information from Domain.com.au's vast property listings. Effortlessly extract detailed descriptions, high-quality images, unique features, and essential property details.

ScrapeMind

Expired Domains Scraper

martin1080p/expired-domains-scraper

The Expired Domains Scraper automates finding valuable expired domains from expireddomains.com, offering filters and sorting by SEO metrics and auction details for efficient domain acquisition.

Martin Fanta

Expired Domains Scraper

ib4ngz/expired-domains-scraper

This actor scrapes expired domain data from expireddomains.net, supporting user authentication with optional multi-factor authentication (MFA). It also allows users to apply filters for targeted domain scraping.

Iqbal R

Advanced Website Domain Name Validator

saswave/advanced-website-domain-name-validator

Advanced domain scraper. Determine if a domain is still valid or has moved. We test multiple scenario before flagging the domain as invalid. Extract technologies stack, social account, emails

SASWAVE

Trustpilot Scraper Company & Reviews

datafactory_isn/trustpilot-company-details-reviews

A comprehensive TrustPilot scraper that extracts company key metrics (Average Score and Total reviews) and detailed user reviews including review title, content, individual rating and review date. Allows customization of the number of reviews to collect with automatic pagination handling.

Datafactory ISN

Godaddy Auctions Scraper

scraper-mind/godaddy-auctions-scraper

Godaddy Auctions Scraper: scrape real-time domain auctions data from GoDaddy.com with our scraper. Export data in JSON or CSV for easy use. Ideal for domain investors, SEOs, and market researchers to uncover valuable opportunities and trends effortlessly.

Scraper Mind

Temu Scraper

mscraper/temu-scraper

Unlock data's potential with Temu Scraper! Rapidly collect product info from Temu, a leading Chinese marketplace, in seconds. Perfect for market research, price tracking, and exploring trends. Turn data into decisions with Temu Scraper.

mscraper

343

Similarweb Speedy Scraper (with full page Screenshot)

karamelo/similarweb-speedy-scraper-with-full-page-screenshot

Powerful Detailed and Fast Scraper for similarweb.com. Scrape comprehensive domain traffic insights, websites comparing data, sitemaps, and trending domains. for any website with detailed information. Includes full page screenshot.

karamelo

Autoscout24 Scraper

ivanvs/autoscout-scraper

Extract data from autoscout24.com for data on thousands of car listings. Scrape car listings, extract descriptions, images, prices, mileage, contact number, addresses, names, engine information, the transmission of the car, and all other listing details.

Ivan Vasiljević

116

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.