Pricing

Pay per usage

Go to Store

Azure dataset uploader

Try for free

Developed by

Matěj Volf

The easiest way to upload datasets to Azure blob storage.

0.0 (0)

Pricing

Pay per usage

Monthly users

Runs succeeded

87%

Last modified

7 months ago

Automation

Developer tools

Integrations

Back to issues Create new issue

Azure dataset uploader supporting xlsx or html

Closed

confident_socket opened this issue

Hey, I love your dataset uploader but for indexing in azure I need to use either html or xlxs so it would be amazing to get that supported as I wouldn't have to do the conversion

Matěj Volf (mvolfik)

hi, I will add HTML support today or tomorrow. There are some issues with how the platform handles downloads of large datasets, so I switched to downloading in batches, which made everything other than JSON complicated (and I didn't expect many people to use this, this Actor was made specifically for one customer), but looking at it now, some hacky HTML support shouldn't be too hard, if there's demand for it.

confident_socket

Thank you, I’m just not experienced with Azure so your integration makes it super easy. I’m not planning for large amounts of data.

Matěj Volf (mvolfik)

v0.0.14 which supports HTML upload was just released

confident_socket

Thank you Matēj. Would be actually possible to add support for xlxs as well if it's not too much work?

Matěj Volf (mvolfik)

To be honest, adding support for large XLSX datasets would be quite a bit more work than HTML - XLSX is a zip archive under the hood, so we would have to unzip the xlsx downloaded from Apify platform, extract from it the XML file which contains the data, then append rows to it, and then zip everything again and upload to Azure.

I guess I could add support for xlsx without streaming, just copying the whole thing to Azure at once. Hopefully this week

Matěj Volf (mvolfik)

Added simple xlsx support in version 0.0.15

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

GCP Uploader

circ_le/gcp-uploader

Upload datasets and KV store records to Google cloud storage

Cir◎cle

Keboola Uploader

hckr-studio/keboola-uploader

Reliable uploader of Apify Datasets to Keboola Connection (aka KBC). Integration-ready.

hckr.studio

Storage Cleaner

useful-tools/storage-cleaner

Storage cleaner is a tool to delete all your Storage types (Datasets, Key-Value storages and Request queues) on your Apify user account based on the amount of days since they were last accessed.

Useful tools

S3 Uploader

apify/s3-uploader

Upload data from an Apify dataset to an Amazon S3 bucket. Providing various filters and transformation options, this Actor allows precise control over data structure, formatting, and upload settings to ensure seamless integration into your data pipeline.

Apify

CSV File to Dataset

lukaskrivka/csv-file-to-dataset

Upload a local or remote CSV/text file and convert it to Apify Dataset for further use.

Lukáš Křivka

S3 Bucket Uploader

mstephen190/s3-bucket-uploader

Upload the items from the default dataset of an actor's run to an S3 bucket in JSON format.

Matthias Stephens

Append to dataset

valek.josef/append-to-dataset

Utility actor that allows you to build a single large dataset from individual default datasets of other actor runs.

Josef Válek

FTP file uploader

petr_cermak/ftp-upload

Performs a simple upload of an array of files to an FTP.

Petr Cermak

Dataset Image Downloader & Uploader

lukaskrivka/images-download-upload

Download image files from image URLs in your datasets and save them to a Zip file, Key-Value store, or directly your AWS S3 bucket.

Lukáš Křivka

691

Notion Uploader

filip_cicvarek/notion-uploader

Upload data into a specified Notion database. It dynamically maps data from any Actor / Dataset to your Notion properties, ensuring your database stays up-to-date with the latest information.