Bulk File Downloader: Download Files from URLs to ZIP
Pricing
from $1.28 / 1,000 files
Bulk file downloader API: download files from URLs, or the PDFs, documents and media linked on web pages, in one run. Dedupe by SHA-256, allow or block extensions, get public links and one URL to ZIP archive. Pay per file.
url
Optional
The URL you gave (or the file URL found on a page).
finalUrl
Optional
Address the file was finally downloaded from, after redirects.
status
Optional
downloaded, duplicate, skipped or failed. Only downloaded files are charged.
reason
Optional
Why a URL was skipped or failed, or a note on a downloaded file (type corrected, stored as .bin). Empty when nothing needs saying.
contentType
Optional
Real type of the file, detected from its bytes when possible (for example application/pdf), else the server's type.
extension
Optional
Extension the file is stored with, from its bytes, the URL or the server (for example pdf, csv, docx). bin when unknown or when a program or web extension was refused.
sizeBytes
Optional
Size of the file in bytes.
sha256
Optional
SHA-256 of the file. Equal hashes mean identical files.
fileUrl
Optional
Public link to the file in the key-value store. For a duplicate, the link to the first copy.
sourcePage
Optional
The pageUrls page this file link was found on (empty for URLs you listed yourself).
fileName
Optional
Sanitised original file name (from Content-Disposition or the URL) with the stored extension. Used inside the ZIP when keepOriginalNames is on.
key
Optional
Record key of the file in the key-value store: sha256 plus extension.
index
Optional
Position of the URL in the processing order, starting at 1.
