Domain Scraper avatar
Domain Scraper

Pricing

$10.00/month + usage

Go to Store
Domain Scraper

Domain Scraper

Developed by

Iqbal R

Maintained by Community

This actor scrapes unique domains from a list of provided URLs. It crawls each page, extracts domains, and stores them in a dataset. The actor respects a defined maximum depth and filters domains based on whether they are ICANN-approved and whether private domains are allowed.

0.0 (0)

Pricing

$10.00/month + usage

1

Monthly users

5

Runs succeeded

97%

Last modified

3 months ago

Start URLs

startUrlsarrayRequired

URLs to start with.

Maximum Depth

maxDepthintegerOptional

The maximum depth for crawling.

Default value of this property is 1

Allow Private Domains

allowPrivateDomainsbooleanOptional

Whether to allow private domains (default is false).

Default value of this property is false

ICANN Domains Only

isIcannbooleanOptional

Whether to only process ICANN domains (default is true).

Default value of this property is true

Crawler Type

crawlerTypeEnumOptional

Select the type of crawler to use.

Value options:

"Crawlee + Cheerio": string"Crawlee + Puppeteer + Chrome": string

Default value of this property is "Crawlee + Cheerio"

Proxy configuration

proxyConfigurationobjectOptional

Select proxies to be used by your crawler.

Minimum Concurrency

minConcurrencyintegerOptional

The minimum number of concurrent requests or pages being processed.

Default value of this property is 1

Maximum Concurrency

maxConcurrencyintegerOptional

The maximum number of concurrent requests or pages being processed.

Default value of this property is 10

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

30 minutes

Price

$10.00