Apify Storage

Scalable and reliable cloud data storage designed for web scraping and automation workloads.

Benefits

Specialized storage from Apify

Enterprise-grade reliability, performance, and scalability

Store a few records or a few hundred million, with the same low latency and high reliability. We use Amazon Web Services for the underlying data storage, giving you high availability and peace of mind.

Low-cost storage for web scraping and crawling

Apify provides low-cost storage carefully designed for the large workloads typical of web scraping and crawling operations.

Easy to use

Data can be viewed on the web, giving you a quick way to review and share it with other people. The Apify API and SDK makes it easy to integrate our storage into your apps.

Features

We’ve got you covered

Dataset
Store results from your web scraping, crawling or data processing jobs into Apify datasets and export them to various formats like JSON, CSV, XML, RSS, Excel or HTML.

Request queue
Maintain a queue of URLs of web pages in order to recursively crawl websites, starting from initial URLs and adding new links as they are found while skipping duplicates.

Key-value store
Store arbitrary data records along with their MIME content type. The records are accessible under a unique name and can be written and read at a rapid rate.

Ready to build your first Actor?

Start developing