S3 Uploader avatar
S3 Uploader

Pricing

Pay per usage

Go to Store
S3 Uploader

S3 Uploader

apify/s3-uploader

Developed by

Apify

Maintained by Apify

Upload data from an Apify dataset to an Amazon S3 bucket. Providing various filters and transformation options, this Actor allows precise control over data structure, formatting, and upload settings to ensure seamless integration into your data pipeline.

0.0 (0)

Pricing

Pay per usage

0

Monthly users

0

Last modified

5 days ago

Access key ID

accessKeyIdstringRequired

Your AWS access key ID used for authorization of the upload. You can get it from AWS Console -> IAM -> Users -> Create user / Select existing user -> Security credentials -> Access keys.

Secret access key

secretAccessKeystringRequired

Your AWS secret access key used for authorization of the upload. You can get it from AWS Console -> IAM -> Users -> Create user / Select existing user -> Security credentials -> Access keys -> Create access key. The secret access key will be displayed only once, upon creation of the access key.

Region

regionEnumRequired

The AWS region where the target S3 bucket is located. You can get it from AWS Console -> S3 -> Create bucket / Select existing bucket -> Properties.

Value options:

"af-south-1": string"ap-east-1": string"ap-northeast-1": string"ap-northeast-2": string"ap-northeast-3": string"ap-south-1": string"ap-south-2": string"ap-southeast-1": string"ap-southeast-2": string"ap-southeast-3": string"ap-southeast-4": string"ap-southeast-5": string"ap-southeast-7": string"ca-central-1": string"ca-west-1": string"cn-north-1": string"cn-northwest-1": string"eu-central-1": string"eu-central-2": string"eu-north-1": string"eu-south-1": string"eu-south-2": string"eu-west-1": string"eu-west-2": string"eu-west-3": string"il-central-1": string"me-central-1": string"me-south-1": string"mx-central-1": string"sa-east-1": string"us-east-1": string"us-east-2": string"us-gov-east-1": string"us-gov-west-1": string"us-west-1": string"us-west-2": string

Bucket

bucketstringRequired

The name of the target S3 bucket.

Key

keystringRequired

The object key, which serves as an identifier for the uploaded data in the S3 bucket. It can include an optional prefix. If an object with the same key already exists, it will be overwritten with the uploaded data.

Dataset ID

datasetIdstringRequired

The Apify dataset ID from which data will be retrieved for the upload.

Format

formatEnumOptional

The format of the uploaded data.

Value options:

"json": string"jsonl": string"html": string"csv": string"xml": string"xlsx": string"rss": string

Default value of this property is "json"

Select

fieldsarrayOptional

Fields to include in the output. If not specified, all fields will be included.

Omit

omitarrayOptional

Fields to exclude from the output.

Unwind fields

unwindarrayOptional

Fields to unwind. If the field is an array, every element will become a separate record and merged with the parent object. If the unwound field is an object, it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object, it cannot be merged with a parent object, and the item gets preserved as is. If you specify multiple fields, they are unwound in the order you specify.

Flatten fields

flattenarrayOptional

Fields to transform from nested objects into a flat structure.

Offset

offsetintegerOptional

Number of items to skip from the beginning of the dataset.

Limit

limitintegerOptional

Maximum number of items to upload.

Clean only

cleanbooleanOptional

If enabled, only clean dataset items and their non-hidden fields will be uploaded.

Default value of this property is true

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.