TriEC: Tripartite Graph Based Erasure Coding NIC Offload

Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019  (Best Student Paper Finalist)

Haiyang Shi, Xiaoyi Lu

Abstract

Erasure Coding (EC) NIC offload is a promising technology for designing next-generation distributed storage systems. However, this paper has identified three major limitations of current-generation EC NIC offload schemes on modern SmartNICs. Thus, this paper proposes a new EC NIC offload paradigm based on the tripartite graph model, namely TriEC. TriEC supports both encode-and-send and receive-and-decode operations efficiently. Through theorem-based proofs, co-designs with memcached (i.e., TriEC-Cache), and extensive experiments, we show that TriEC is correct and can deliver better performance than the state-of-the-art EC NIC offload schemes (i.e., BiEC). Benchmark evaluations demonstrate that TriEC outperforms BiEC by up to 1.82x and 2.33x for encoding and recovering, respectively. With extended YCSB workloads, TriEC reduces the average write latency by up to 23.2

Full text links

External link

Conference Proceedings

Isbn
9781450362290
Publisher
Association for Computing Machinery
Address
New York, NY, USA
Doi
10.1145/3295500.3356178
Booktitle
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
Articleno
44
Numpages
34
Location
Denver, Colorado
Highlight
Best Student Paper Finalist
Series
SC '19

Cite

Plain text

BibTeX