Expired Domains Scraper

This actor scrapes expired domain data from expireddomains.net, supporting user authentication with optional multi-factor authentication (MFA). It also allows users to apply filters for targeted domain scraping.

Features

• User Authentication: Supports secure login with optional Multi-Factor Authentication (MFA) if required.
• Customizable Filters: Allows users to apply multiple filters for domain scraping
• Multi-Page Scraping: Scrapes multiple pages of expired domains with pagination, based on a user-defined depth.
• Proxy Support: Integrates with the Apify Proxy service for rotating proxies, ensuring anonymity and preventing IP blocking.

Input Schema

• username (required): Username for login.
• password (required): Password for login.
• mfaCode: Multi-factor authentication code (if required).
• searchForList (required): The list of expired domain types to search for.
• nextPageDelay: The delay (in milliseconds) before navigating to the next page.
• depth (required): The number of pages to scrape.
• startsWith: The prefix of the domain name to filter by.
• contains: A substring that must be included in the domain name.
• endsWith: The suffix of the domain name to filter by.
• noNumbers: Whether to exclude domains containing numbers.
• lengthMin: The minimum length of the domain name.
• lengthMax: The maximum length of the domain name.
• backlinksMin: The minimum number of backlinks for the domain.
• backlinksMax: The maximum number of backlinks for the domain.
• onlyAvailableDomains: Whether to only include available domains.
• domainsPerPage (required): The number of domains to display per page.
• proxyConfiguration: Select proxies to be used by your crawler.

Dataset Schema

• Domain: The name of the expired domain.
• LE: The length of the domain name.
• BL: The number of backlinks.
• DP: The domain's popularity score.
• WBY: The year the domain was created.
• ABY: The year the domain was archived.
• ACR: Archive entries count.
• MMGR: Majestic's global rank of the domain.
• Dmoz: Whether the domain is listed in DMOZ.
• Reg: Whether the TLD is registered.
• C: Status of the .com domain.
• N: Status of the .net domain.
• O: Status of the .org domain.
• B: Status of the .biz domain.
• I: Status of the .info domain.
• D: Status of the .de domain.
• Add Date: The date the domain was added.
• RDT: Related domains.
• WPL: Count of Wikipedia links.
• Dropped: Number of changes or drops.
• Status: WHOIS status of the domain.

How to Use

1. Set Up the Actor
   Deploy the actor on Apify platform. If you don't have an Apify account, sign up here.

2. Configure Authentication
   Provide your username and password for authentication to access expireddomains.net. If multi-factor authentication (MFA) is enabled, enter the MFA code.

3. Apply Filters
   Use the available filter options such as domain length, backlink count, domain status, and more to target specific domains for scraping.

4. Run the Actor
   Once your filters and credentials are set, click on the Run button to start scraping. The actor will gather the data based on your configuration.

5. View Results
   After the actor has finished, you can view the scraped data in a structured format, such as a table or JSON, depending on your settings.

6. Download or Export Data
   Download the results in your preferred format (e.g., CSV, JSON) for further analysis or use.

Conclusion

This actor is a powerful tool for scraping expired domain data from expireddomains.net, offering seamless user authentication with support for multi-factor authentication (MFA). With its flexible input options, users can apply a wide range of filters to target specific domain attributes, ensuring precise and efficient data retrieval. Whether you are looking for domains with specific keywords, lengths, or backlink profiles, this actor simplifies the process and delivers actionable insights tailored to your needs.