Unveiling the performance of fast NVM storage with the uDepot KV-store

Storage devices based on novel NVM technologies, such as 3D XPoint, have recently become available and drastically improve performance compared to conventional SSDs. On one hand, these devices present opportunities to accelerate systems by complementing conventional (slower) storage and to reduce the costs of systems that rely on DRAM in order to meet their performance demands. On the other hand, their performance exposes many inefficiencies in applications and the IO stack, rendering them unable to fully exploit these new devices. In this paper, we present uDepot, a key-value store built bottom-up to match the performance of fast NVM storage devices. uDepot is carefully crafted to avoid inefficiencies, and employs a novel, task-based IO runtime system to maximize IO performance, enabling applications to use fast NVM devices at their full potential. We show that uDepot’s performance nearly matches the raw capabilities of the underlying devices, both in terms of throughput and latency, and is highly scalable across multiple devices. As an example, uDepot delivers more than 6 million GET operations per second on a single server. Moreover, we demonstrate a memcache service built on top of uDepot that offers similar performance to DRAM-based implementations at a much lower cost.

By: Kornilios Kourtis, Nikolas Ioannou, and Ioannis Koltsidas

Published in: 17th USENIX Conference on File and Storage Technologies (FAST ’19) , Usenix, p.1-15 in 2019


This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.


Questions about this service can be mailed to reports@us.ibm.com .