PDF & Downloadable Resource Collector
Pricing
from $2.00 / 1,000 resources
PDF & Downloadable Resource Collector
Discover public document links and collect lightweight response metadata.
PDF & Downloadable Resource Collector
Pricing
from $2.00 / 1,000 resources
Discover public document links and collect lightweight response metadata.
Public HTTP(S) website or sitemap URL.
Maximum pages scheduled in this bounded run.
Maximum visible resource records returned.
Opt into Chromium for JavaScript content. More expensive; no access-control bypass.
Honor robots rules and supported crawl delays. Unavailable rules fail closed.
Maximum followed-link depth. Explicit seeds start at zero.
Allowed absolute-URL patterns using * as wildcard.
Excluded absolute-URL patterns using * as wildcard.
Allowed Extensions. See README for extraction behavior.
Include External Resources. See README for extraction behavior.
Maximum concurrent page handlers. Per-origin delays still apply.
Minimum spacing between request starts to the same origin.
Maximum individual request duration in seconds.
Retries for page handlers. Access blocks are not retried.