Scalable and reliable cloud data storage designed for web scraping and automation workloads.
Store results from your web scraping, crawling or data processing jobs into Apify datasets and export them to various formats like JSON, CSV, XML, RSS, Excel or HTML.
Maintain a queue of URLs of web pages in order to recursively crawl websites, starting from initial URLs and adding new links as they are found while skipping duplicates.
Store arbitrary data records along with their MIME content type. The records are accessible under a unique name and can be written and read at a rapid rate.