Welcome to Journal of University of Chinese Academy of Sciences,Today is

Journal of University of Chinese Academy of Sciences ›› 2022, Vol. 39 ›› Issue (6): 817-826.DOI: 10.7523/j.ucas.2021.0051

• Research Articles • Previous Articles     Next Articles

A Ceph write performance optimization method based on double-control nodes

HUANG Zunxiang, ZHU Leiji, XIONG Yong   

  1. CAS Key Lab of Wireless Sensor Network and Communication, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 201800, China;
    University of Chinese Academy of Sciences, Beijing 100049, China
  • Received:2020-07-13 Revised:2020-11-11 Online:2022-11-15

Abstract: Because the distributed storage system Ceph uses a multi-copy strong consistency write mechanism, the cluster write performance is not ideal. To solve this problem, this paper proposes a Ceph write optimization method based on double-control nodes. With double-control double-RAID nodes, when one controller fails, another partner controller in the node creates a new OSD process and quickly takes over the RAID of the failed controller, thereby ensuring the safety and high reliability of data storage. At the same time, the write mechanism is optimized as follows: after the primary OSD is written to the journal, the write completion is returned to the client. After that, the primary OSD continues to collect the completion status of the write data disk and other slave copies, and then completes callback operations. Thereby reducing the impact of unnecessary write operations on the write performance of the cluster. Finally, the data availability and cluster write performance are tested experimentally. The write performance test compares the optimized method and Ceph’s native write mechanism in terms of sequential write and random write from three perspectives of write latency, throughput and IOPS. It further verifies the effect of the optimization method on improving write performance while maintaining high data availability.

Key words: distributed storage, Ceph, double-control node, replica consistency, write performance optimization

CLC Number: