Infrastructure Components for Efficient Data Management

This paper describes work that we have done in developing infrastructure components for efficient data management. A key
component is the use of multiple storage options for storing data including file systems, SQL (relational) databases, NoSQL
databases, and caches. We provide monitoring capabilities so users can determine the performance of different storage systems and pick the most appropriate one.

Another key aspect of this work is enhanced storage clients which are particularly applicable to cloud storage. Our work
extends existing clients by adding integrated caching support, encryption, compression, and delta encoding. We have built
enhanced clients for multiple storage systems including Cloudant and OpenStack Object Storage. We have also written a Java library for allowing our enhanced client features to be integrated with other storage clients and a wide range of applications.