WEAVER Codes: Highly Fault Tolerant Erasure Codes for Storage Systems

We present the WEAVER codes, new families of simple highly fault tolerant XOR-based erasure codes for storage systems (with fault tolerance 12 in some cases). The design features of WEAVER codes are (a) placement of data and parity blocks on the same strip (so-called vertical codes) and (b) constrained parity in-degree (so parity computation costs are small). These codes are not maximum distance separable (MDS) but have optimal storage efficiency among all codes with constrained parity in-degree. Though applicable to RAID controller systems, the WEAVER codes are probably best suited in dRAID systems (distributed Redundant Arrangement of Independent Devices). In addition, these codes have other advantages over many erasure codes for storage systems.

By: James Lee Hafner

Published in: RJ10353 in 2005

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

rj10353.pdf

Questions about this service can be mailed to reports@us.ibm.com .