PendingDelete.Domains Crawler

Scrape expiring domain metrics from PendingDelete.Domains — a platform that curates pending-delete and expiring domains with high traffic, strong domain authority, quality backlink profiles, and valuable keyword rankings. This Actor discovers the domains published each day and extracts their public SEO metrics — global rank, monthly visits, domain authority, backlinks, and ranking keywords — without requiring a paid subscription or login.

Run it on demand or schedule it to capture the daily drop list automatically. As an Apify Actor you also get API access, integrations (Make, Zapier, Google Drive, Slack), proxy rotation, and run monitoring out of the box.

Why use the PendingDelete.Domains Crawler?

Expiring domains are a goldmine for SEO practitioners, domain investors, and content site builders. While some carry high direct traffic, many are valuable primarily for their existing backlink profiles and keyword rankings — making them ideal for building authority sites, 301 redirects, or PBNs.

• Daily discovery — automatically finds every domain report published today via the site's sitemap.
• No subscription needed — retrieves publicly accessible metrics that are normally bundled behind a paywall.
• Structured output — clean JSON ready for spreadsheets, databases, or downstream automation.
• Hands-off automation — schedule daily runs and pipe results into your stack.

How it works

1. Discover today's domains via sitemap — the Actor fetches https://pendingdelete.domains/sitemap.xml and extracts the domain report URLs published that day (e.g. https://pendingdelete.domains/domains/minicruzer.com).

2. Scrape each domain report page — for every discovered URL, the Actor visits the page and parses the domain metrics: global rank, monthly visits, domain authority, backlink count, and keyword rankings.

3. Googlebot user-agent required — requests are sent with a User-Agent string containing googlebot to receive the full page content. Without it, the server returns restricted or empty results:

   Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
   

How to use the PendingDelete.Domains Crawler

1. Click Try for free (or open the Actor in your Apify Console).
2. Optionally adjust the input — by default the Actor reads the daily sitemap; you can also provide specific domain report URLs.
3. Click Start and wait for the run to finish.
4. Open the Output / Storage tab and download the dataset as JSON, CSV, Excel, or HTML, or pull it via the API.

Input

Configure the run from the Input tab in the Apify Console or via the API.

Field	Type	Description
startUrls	array	Domain report URLs or sitemap URL(s) to crawl. Defaults to the daily sitemap discovery.
maxRequestsPerCrawl	integer	Maximum number of pages to scrape in a single run (0 = unlimited).
proxyConfiguration	object	Proxy settings used for requests.

Example input:

{
    "startUrls": [
        { "url": "https://pendingdelete.domains/sitemap.xml" }
    ],
    "maxRequestsPerCrawl": 1000
}

Output

Results are stored in a dataset. You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

Example output item:

{
    "domain": "minicruzer.com",
    "global_rank": 482915,
    "monthly_visits": 12400,
    "domain_authority": 34,
    "backlinks": 1820,
    "keywords": 256,
    "crawled_at": "2026-06-09T10:15:00.000Z"
}

Data table

Field	Description
domain	Domain name
global_rank	Global traffic rank
monthly_visits	Estimated monthly visits
domain_authority	Domain authority score
backlinks	Number of backlinks
keywords	Number of ranking keywords
crawled_at	Timestamp of the crawl (ISO 8601)

Pricing / Cost estimation

This Actor runs on the Apify platform and consumes compute units (CU) based on runtime and memory. Because it uses the lightweight CheerioCrawler (HTTP-only, no browser), a typical daily run scraping a few hundred domain pages costs only a small fraction of a compute unit. The Apify Free tier includes monthly usage credits that comfortably cover regular runs.

Tips & advanced options

• Schedule daily runs to capture each day's drop list automatically — the freshest expiring domains are only listed for a short window.
• Limit maxRequestsPerCrawl to cap compute usage during testing.
• Use Apify Proxy if you encounter rate limiting.
• Be a good citizen — keep concurrency reasonable and respect the target site's resources and Terms of Service.

FAQ, disclaimers, and support

Is web scraping legal? Scraping publicly available data is generally legal in many jurisdictions, but you are responsible for how you use the collected data and for complying with the target site's Terms of Service and applicable laws (including GDPR/CCPA where relevant). This Actor only retrieves publicly accessible metrics.

Why do I get empty results? The target server only returns full content when the request includes a googlebot user-agent. This Actor sets it automatically; if the site changes its behavior, results may vary.

Found a bug or have a feature request? Open an issue on the Actor's Issues tab. Custom or extended solutions can be arranged on request.