Pricing

Pay per usage

Go to Store

Save To S3

Try for free

Developed by

Richard Weaver

Designed to be run from an ACTOR.RUN.SUCCEEDED webhook, this actor downloads a task run's default dataset and saves it to an S3 bucket.

0.0 (0)

Pricing

Pay per usage

Total users

Monthly users

Runs succeeded

15%

Last modified

2 years ago

Automation

Open source

AWS Key ID

accessKeyIdstringOptional

Enter the access key ID for the AWS user

AWS Secret Access Key

secretAccessKeystringOptional

Enter the secret access key for the AWS user

AWS region

regionstringOptional

Enter the AWS region your S3 bucket is located in

AWS bucket

bucketstringOptional

Enter the name of the S3 bucket to use

Object key format

objectKeyFormatstringOptional

The key to use for the filename

Default value of this property is "${resource.id}_${resource.startedAt}.${format}"

Data format

formatEnumOptional

The data format to download the dataset in

Value options:

"json": string"jsonl": string"xml": string"html": string"csv": string"xslx": string"rss": string

Default value of this property is "json"

Clean items only

cleanbooleanOptional

Crawler will ignore SSL certificate errors.

Default value of this property is false

Dataset options

datasetOptionsobjectOptional

An object whose properties will be enumerated and added to the dataset get items API request. See https://apify.com/docs/api/v2#/reference/datasets/item-collection/get-items.

Default value of this property is {}

Debug log

debugLogbooleanOptional

Debug messages will be included in the log. Use context.log.debug('message') to log your own debug messages.

Default value of this property is false

S3 Bucket Uploader

mstephen190/s3-bucket-uploader

Upload the items from the default dataset of an actor's run to an S3 bucket in JSON format.

Matthias Stephens

S3 Uploader

apify/s3-uploader

Upload data from an Apify dataset to an Amazon S3 bucket. Providing various filters and transformation options, this Actor allows precise control over data structure, formatting, and upload settings to ensure seamless integration into your data pipeline.

Apify

Dataset Image Downloader & Uploader

lukaskrivka/images-download-upload

Download image files from image URLs in your datasets and save them to a Zip file, Key-Value store, or directly your AWS S3 bucket.

Lukáš Křivka

808

GCP Uploader

circ_le/gcp-uploader

Upload datasets and KV store records to Google cloud storage

Cir◎cle

Firestore Import

apify/firestore-import

Seamlessly import data from Apify datasets into Firebase Firestore database. This integration allows full control over document IDs, conflict resolution (overwrite, merge, skip), and data transformation using a custom JavaScript function.

Apify

5.0

Scraper Results Checker

drobnikj/check-crawler-results

This actor checks results from Apify's scrapers or any other actor that stores its result to a dataset, and sends a notification if there are errors. It's designed to run from webhook.

Jakub Drobník

Upcheck

apikit/upcheck

Monitor websites and APIs with this simple yet powerful availability checker. This Apify Actor checks the status of your specified endpoints, tracks their response times, and alerts you when they become unavailable

API-KIT

5.0

Send Legacy PhantomJS Crawler Results

drobnikj/send-crawler-results

This actor downloads results from Legacy PhantomJS Crawler task and sends them to email as attachments. It is designed to run from finish webhook.

Jakub Drobník

Actor fail manager

lukaskrivka/actor-fail-manager

Automatically triggered on a failed run to analyze if the run should be resurrected and to create an error report for the author.

Lukáš Křivka

20K

Forward dataset as POST data

anchor/forward-dataset-webhook

This actor forwards the results of an Actor to an endpoint, instead of having to fetch the results manually. It will download the dataset and attach it to the body of a POST request you will specify. It acts as a new webhook. Simplify your Actor process !!!