Dynamic Policy Disk Caching for Storage Networking

Storage networking is becoming increasingly important, especially with the emergence of SAN over IP technologies. It plays an important role in resource consolidation and management for various systems, spanning from a large-scale data center to a set of interconnected workstations. However, existing storage systems may not scale well under the load from relatively large number of clients. Local disk caching has the potential to solve this problem by leveraging data locality with clientside storage, but it is lacking for typical storage networks. Addressing to this, this paper presents a general block-level disk cache, named dm-cache, built on top of Linux’s device-mapper architecture. It can be transparently plugged into a client for any storage systems, and supports dynamic customization for policy-guided optimizations. Experimental evaluation based on file system benchmarks and a typical application has been conducted to investigate its performance over iSCSI in a typical blade center. The results show that dm-cache can significantly improve the performance and scalability of storage system by orders of magnitude.

By: Eric Van Hensbergen; Ming Zhao

Published in: RC24123 in 2006

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

rc24123.pdf

Questions about this service can be mailed to reports@us.ibm.com .