Website Document Index
Pricing
$1.00 / 1,000 document candidates
Website Document Index
Build a finite, source-linked manifest of document-link candidates with optional HEAD response metadata.
Website Document Index
Pricing
$1.00 / 1,000 document candidates
Build a finite, source-linked manifest of document-link candidates with optional HEAD response metadata.
One to ten exact public HTTP(S) index/resource pages on default ports. Omission uses the GNU license index. No crawl, login or document bodies. Duplicate input pages are fetched once.
[ "https://www.gnu.org/licenses/"]Retain at most this many distinct document-link targets across the page list; a lower event budget reduces the limit. Queries stay distinct.
Zero leaves all candidates as hints. A positive value performs up to 20 HEAD-only checks, with no GET fallback or document body reads. Requires verificationHosts.
Exact lowercase hostnames selected from pageUrls, for example www.gnu.org. Empty blocks all verification. No implicit subdomains or external-host checks. Verification redirects must remain on the candidate host.
[]