Pricing

Pay per usage

Go to Apify Store

Save To S3

Try for free

Developed by

Richard Weaver

Designed to be run from an ACTOR.RUN.SUCCEEDED webhook, this actor downloads a task run's default dataset and saves it to an S3 bucket.

0.0 (0)

Pricing

Pay per usage

Last modified

2 years ago

Automation

Open source

AWS Key ID

accessKeyIdstringOptional

Enter the access key ID for the AWS user

AWS Secret Access Key

secretAccessKeystringOptional

Enter the secret access key for the AWS user

AWS region

regionstringOptional

Enter the AWS region your S3 bucket is located in

AWS bucket

bucketstringOptional

Enter the name of the S3 bucket to use

Object key format

objectKeyFormatstringOptional

The key to use for the filename

Default value of this property is "${resource.id}_${resource.startedAt}.${format}"

Data format

formatEnumOptional

The data format to download the dataset in

Value options:

"json": string"jsonl": string"xml": string"html": string"csv": string"xslx": string"rss": string

Default value of this property is "json"

Clean items only

cleanbooleanOptional

Crawler will ignore SSL certificate errors.

Default value of this property is false

Dataset options

datasetOptionsobjectOptional

An object whose properties will be enumerated and added to the dataset get items API request. See https://apify.com/docs/api/v2#/reference/datasets/item-collection/get-items.

Default value of this property is {}

Debug log

debugLogbooleanOptional

Debug messages will be included in the log. Use context.log.debug('message') to log your own debug messages.

Default value of this property is false

S3 Uploader

apify/s3-uploader

Upload data from an Apify dataset to an Amazon S3 bucket. Providing various filters and transformation options, this Actor allows precise control over data structure, formatting, and upload settings to ensure seamless integration into your data pipeline.

Apify

Markdown Converter

jindrich.bar/markdown-converter

A simple Actor for converting pdf / doc / docx files to Markdown.

Jindřich Bär

Power Webhook Integration

pocesar/run-webhook-digest

Allows you to provide multiple HTTP endpoints, that receive a more complete JSON from the run, and allow you to hit those endpoints using a proxy, and enable you to do conditional webhook calls with some lines of Javascript code and you can link/chain one actor to another

Paulo Cesar

S3 Bucket Uploader

mstephen190/s3-bucket-uploader

Upload the items from the default dataset of an actor's run to an S3 bucket in JSON format.

Matthias Stephens

Torrent Scraper

ondrejklinovsky/torrent-scraper

Scrape information about torrents from popular torrent sites. Download the data in JSON, CSV, and Excel.

Ondrej Klinovský

158

Google Drive

onidivo/google-drive

Transfer files between Apify's key-value stores and Google Drive.

Onidivo Technologies

PDF Text Extractor

sami_apify/PDF-Text-Extractor

This actor downloads PDFs from provided URLs, extracts text content from them, and saves the extracted data into an Apify dataset. It’s ideal for scraping and processing PDFs available online.

sami

JSDOM Scraper

apify/jsdom-scraper

Parses the HTML using the JSDOM library, providing the same DOM API as browsers do (e.g. `window`). It is able to process client-side JavaScript without using a real browser. Performance-wise, it stands somewhere between the Cheerio Scraper and the browser scrapers.

Apify

101

4.3

Scraper Results Checker

drobnikj/check-crawler-results

This actor checks results from Apify's scrapers or any other actor that stores its result to a dataset, and sends a notification if there are errors. It's designed to run from webhook.