RDMP-KV: Designing Remote Direct Memory Persistence Based Key-Value Stores with PMEM

Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2020

Tianxi Li, Dipti Shankar, Shashank Gugnani, Xiaoyi Lu

Abstract

Byte-addressable persistent memory (PMEM) can be directly manipulated by Remote Direct Memory Access (RDMA) capable networks. However, existing studies to combine RDMA and PMEM can not deliver the desired performance due to their PMEM-oblivious communication protocols. In this paper, we propose novel PMEM-aware RDMA-based communication protocols for persistent key-value stores, referred to as <u>R</u>emote <u>D</u>irect <u>M</u>emory <u>P</u>ersistence based <u>K</u>ey-<u>V</u>alue stores (RDMP-KV). RDMP-KV employs a hybrid 'server-reply/server-bypass' approach to 'durably' store individual key-value objects on PMEM-equipped servers. RDMP-KV's runtime can easily adapt to existing (server-assisted durability) and emerging (appliance durability) RDMA-capable interconnects, while ensuring server scalability through a lightweight consistency scheme. Performance evaluations show that RDMP-KV can improve the server-side performance with different persistent key-value storage architectures by up to 22x, as compared with PMEM-oblivious RDMA-'Server-Reply' protocols. Our evaluations also show that RDMP-KV outperforms a distributed PMEM-based filesystem by up to 65

Conference Proceedings

Articleno
52
Booktitle
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
Date-added
2021-01-26 19:35:59 +0000
Date-modified
2021-02-03 04:03:50 +0000
Isbn
9781728199986
Location
Atlanta, Georgia
Publisher
IEEE Press
Series
SC '20

Cite

Plain text

BibTeX