Common Crawl Index Catalog

August 2026 Index, CC-MAIN-2026-34. The CDX endpoint 503s from this IP — you get the index catalog, not page text.

Live Common Crawl collinfo (Try is CC-MAIN-2026-34). Index catalog, not WARC text — CDX 503s from this IP. $0.01.

Last run

Live row(s). First row: CC-MAIN-2026-34 — August 2026 Index

{
  "title": "CC-MAIN-2026-34 — August 2026 Index",
  "entityName": "CC-MAIN-2026-34 — August 2026 Index",
  "listingName": "CC-MAIN-2026-34 — August 2026 Index",
  "productName": "CC-MAIN-2026-34 — August 2026 Index",
  "sourceUrl": "https://index.commoncrawl.org/CC-MAIN-2026-34-index",
  "sourceName": "Common Crawl collinfo — index catalog, not WARC text (CDX 503 from this IP)"
}

Run it

{
  "maxItems": 10,
  "startUrls": [
    {
      "url": "https://index.commoncrawl.org/collinfo.json"
    }
  ],
  "searchKeywords": [
    "Common Crawl"
  ],
  "sourceMode": "startUrls",
  "outputMode": "buyer-ready-records"
}

What lands in the dataset

• index.commoncrawl.org/collinfo.json
• crawl id + name
• cdx-api URL

Use it when

Export crawl ids, then hit CDX from a network that is not 503’d.

NLP teams who need crawl IDs before they pull WARC elsewhere.

Price

$0.01 / crawl — about $0.10 for a 10-row Try.

Schedule it. A one-off click is not Store revenue.

What you should know

• Not WARC page text — CDX 503s from this IP.
• Catalog of crawls, not a targeted corpus.

FAQ

Is the last-run a fixture? No. If the dataset is empty, the public source failed — we do not invent a row.

Where is the page text? CDX 503s from this IP. This card is the crawl index.