Export Apify Datasets to Amazon S3
OptiRefine
Preview an Apify dataset export to Amazon S3 in JSONL format. Generate sample export output and an export manifest without AWS credentials using dry-run mode. Ideal for developers testing cloud backups, data pipelines, and ETL integrations before configuring real S3 storage.
Input
Output fields
Sign up on Apify or log in
The Multi-Cloud Dataset Exporter — S3, R2, B2 & Wasabi Actor is ready to run with the inputs already set for "Export Apify Datasets to Amazon S3". Sign up or log in and you'll land in Apify Console with a copy of this exact task.
Start the "Export Apify Datasets to Amazon S3" task
The Multi-Cloud Dataset Exporter — S3, R2, B2 & Wasabi Actor will start running based on the input automatically. You can also change all the input fields, like sample data, dry run, and more, to match your specific use case.
Receive the "Export Apify Datasets to Amazon S3" output
Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as object key, bucket, rows, and more.
Integrate into your workflow
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Export Apify Datasets to Amazon S3" task via API.
The 'Export Apify Datasets to Amazon S3' task exports dataset content in JSONL format that includes rows, bucket information, and checksums.
The 'dryRun' field indicates whether the task is in preview mode, meaning it generates a manifest without making any actual uploads.
The task generates fields such as object key, bucket name, row count, stored bytes, dry run status, and SHA-256 checksum.
Yes, this task can be scheduled to run automatically in the Apify Console.
Incremental mode in this task allows for append-only updates to named datasets by storing the committed row offset for future runs.