Azure dataset uploader
No credit card required
Azure dataset uploader
No credit card required
The easiest way to upload datasets to Azure blob storage.
Azure dataset uploader supporting xlsx or html
Closed
Hey, I love your dataset uploader but for indexing in azure I need to use either html or xlxs so it would be amazing to get that supported as I wouldn't have to do the conversion
hi, I will add HTML support today or tomorrow. There are some issues with how the platform handles downloads of large datasets, so I switched to downloading in batches, which made everything other than JSON complicated (and I didn't expect many people to use this, this Actor was made specifically for one customer), but looking at it now, some hacky HTML support shouldn't be too hard, if there's demand for it.
confident_socket
Thank you, I’m just not experienced with Azure so your integration makes it super easy. I’m not planning for large amounts of data.
v0.0.14 which supports HTML upload was just released
confident_socket
Thank you Matēj. Would be actually possible to add support for xlxs as well if it's not too much work?
To be honest, adding support for large XLSX datasets would be quite a bit more work than HTML - XLSX is a zip archive under the hood, so we would have to unzip the xlsx downloaded from Apify platform, extract from it the XML file which contains the data, then append rows to it, and then zip everything again and upload to Azure.
I guess I could add support for xlsx without streaming, just copying the whole thing to Azure at once. Hopefully this week
Added simple xlsx support in version 0.0.15
Matěj VolfActor Metrics
1 monthly user
-
1 star
>99% runs succeeded
Created in Jun 2023
Modified 3 months ago
