Research and optimization on quality of service in distributed block storage system

Yaofeng TU; Hongzhang YANG; Yinjun HAN; Zhenghua CHEN

doi:10.11959/j.issn.1000-0801.2018157

您当前的位置：

首页 >

文章列表页 >

Research and optimization on quality of service in distributed block storage system

Operating technology wide Angle | 更新时间：2024-06-05

- Research and optimization on quality of service in distributed block storage system
- Telecommunications Science Vol. 34, Issue 4, Pages: 118-128(2018)
- 作者机构：
  
  1. 中兴通讯股份有限公司,广东深圳 518057
  2. 南京中兴新软件有限责任公司,江苏南京 210012
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2018157
  CLC： TP316.4
- Published Online：2018-04，
  
  Published：20 April 2018
- 稿件说明：
移动端阅览
Yaofeng TU, Hongzhang YANG, Yinjun HAN, et al. Research and optimization on quality of service in distributed block storage system[J]. Telecommunications science, 2018, 34(4): 118-128.
DOI：

Yaofeng TU, Hongzhang YANG, Yinjun HAN, et al. Research and optimization on quality of service in distributed block storage system[J]. Telecommunications science, 2018, 34(4): 118-128. DOI： 10.11959/j.issn.1000-0801.2018157.

摘要

在云存储技术中，资源复用和共享是一把双刃剑，在为用户降低开销的同时，也导致了应用之间的相互干扰和竞争，特别是在资源需求量超出存储系统能力时，无法提供令人满意的服务质量。提出一种自适应的任务调度技术，解决了前后端任务的资源平衡问题。还提出一种多级热度的缓存替换技术，解决了前端任务间的资源平衡问题。在中兴分布式块存储系统中将上述两项技术进行了工程实现和商用测试，上述优化方案满足了用户对分布式块存储服务质量的期望。

Abstract

In cloud storage technology

resource reuse and sharing is a double-edged sword.While it reducing the overhead for customers

it leads to a situation that the different applications will compete for hardware resources

especially when resource requirement exceeded storage system capability.As a consequence the cloud storage system is unable to provide satisfactory quality of service.An adaptive scheduling technology was proposed

solving the resource balance problem between front tasks and back tasks.A multilevel popularity cache replacement technology was also proposed

solving the resource balance problems between the front tasks themselves.These technology was implemented and tested on the ZTE distributed block storage system.The proposed technology satisfies the expectations of the quality of service from the users.

关键词

Keywords

references

孙健 , 贾晓菁 . Google 云计算平台的技术架构及对其成本的影响研究 [J ] . 电信科学 , 2010 , 26 ( 1 ): 38 - 44 .

SUN J , JIA X J . A study of the influence of technical architecture on the total cost of google cloud computing platform [J ] . Telecommunications Science , 2010 , 26 ( 1 ): 38 - 44 .

李丹 , 刘方明 , 郭得科 , 等 . 软件定义的云数据中心网络基础理论与关键技术 [J ] . 电信科学 , 2014 , 30 ( 6 ): 48 - 59 .

LI D , LIU F M , GUO D K , et al . Fundamental theory and key technology of software defined cloud data center network [J ] . Telecommunications Science , 2014 , 30 ( 6 ): 48 - 59 .

樊自甫 , 伍春玲 , 王金红 . 基于SDN架构的数据中心网络路由算法需求分析 [J ] . 电信科学 , 2015 , 31 ( 2 ): 42 - 51 .

FAN Z F , WU C L , WANG J H . Requirements analysis of data center network routing algorithm based on SDN architecture [J ] . Telecommunications Science , 2015 , 31 ( 2 ): 42 - 51 .

孙振正 , 龚靖 , 段勇 , 等 . 面向下一代数据中心的软件定义存储技术研究 [J ] . 电信科学 , 2014 , 30 ( 1 ): 39 - 43 .

SUN Z Z , GONG J , DUAN Y , et al . Research on software defined storage technology for the next-generation data center [J ] . Telecommunications Science , 2014 , 30 ( 1 ): 39 - 43 .

杨洪章 , 罗圣美 , 施景超 , 等 . 面向移动通信大数据的云存储系统优化 [J ] . 计算机应用 , 2017 , 37 ( a01 ): 27 - 33 .

YANG H Z , LUO S M , SHI J C , et al . Cloud storage system optimizations for telecom big data [J ] . Journal of Computer Applications , 2017 , 37 ( a01 ): 27 - 33 .

张泉 . 面向云数据中心的存储服务质量技术研究 [D ] . 武汉:华中科技大学 , 2014 .

ZHANG Q . Research on storage quality of service for cloud data centers [D ] . Wuhan:Huazhong University of Science and Technology , 2014

贾博文 , 张文军 , 李小勇 . 面向虚拟机的分布式块存储系统设计及实现 [J ] . 微型电脑应用 , 2015 ( 3 ): 32 - 37 .

JIA B W , ZHANG W J , LI X Y . Design and implementation of a distributed block storage system for virtual machines in the IaaS cloud [J ] . Microcomputer Applications , 2015 ( 3 ): 32 - 37 .

WEIL S A , BRANDT S A , MILLER E L , et al . Ceph:a scalable,high-performance distributed file system [C ] // The 7th symposium on Operating systems design and implementation,November 6-8,2006 , Seattle,Washington.[S.l.]:USENIX Association , 2006 : 307 - 320 .

NA W W , MENG X X , SI C , et al . A novel network RAID architecture with out-of-band virtualization and redundant management [C ] // The 14th IEEE International Conference on Parallel and Distributed Systems,December 8-10,2008 , Melbourne,Victoria,Australia .[S.l.:s.n ] 2008 : 105 - 112 .

DIKAIAKOS M D , KATSAROS D , MEHRA P , et al . Cloud Computing:distributed internet computing for IT and scientific research [J ] . IEEE Internet Computing , 2009 , 13 ( 5 ): 10 - 13 .

冯盼盼 , 卢明樊 . 一种分布式块存储系统及其存储质量控制方法及装置:CN201510544239.X [P ] . 2009 - 08 - 28 .

FENG P P , LU M F . A distributed block storage system and its storage quality control method and device:CN201510544239.X [P ] . 2009 - 08 - 28 .

HUANG L . Stonehenge:a high-performance virtualized IP storage cluster with QoS guarantees [M ] . New York : ACM Press , 2003 .

刘飞 , 蒋德钧 , 张欢 , 等 . 异构存储感知的Ceph存储系统数据放置方法 [J ] . 计算机科学 , 2017 , 44 ( 6 ): 17 - 22 .

LIU F , JIANG D J , ZHANG H , et al . Heterogeneous storage aware data placement of ceph storage system computer science [J ] . Computer Science , 2017 , 44 ( 6 ): 17 - 22 .

LEE D , CHOI J , KIM J H , et al . LRFU:a spectrum of policies that subsumes the least recently used and least frequently used policies [J ] . IEEE Transactions on Computers , 2001 , 50 ( 12 ): 1352 - 1361 .

JIANG S , ZHANG X . LIRS:an efficient low inter-reference recency set replacement policy to improve buffer cache performance [J ] . ACM SIGMETRICS Performance Evaluation Review , 2002 , 30 ( 1 ): 31 - 42 .

MEGIDDO N , MODHA D S . ARC:a self-tuning,low overhead replacement cache [C ] // The 2003 USENIX Conference on File and Storage Technologies,March 31 - April 2,2003 , San Francisco,California,USA.[S.l.]:USENIX Association , 2003 :9.

顾荣 . 大数据分布式存储技术与系统研究 [D ] . 南京:南京大学 , 2016 .

GU R . Research on techniques and systems for big data processing [D ] . Nanjing:Nanjing University , 2016 .

屠要峰 . 高性能、高可靠中兴超融合架构关键技术解析 [J ] . 通信世界 , 2017 ( 9 ): 55 - 56 .

TU Y F . Key technical analysis of high performance and high reliability ZTE hyper-convergence architecture [J ] . Communica tions World , 2017 ( 9 ): 55 - 56 .

Views

841

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Computational measurement and task scheduling: a study on IoT edge device strategies

Quality of service based hierarchical resource allocation algorithm

On-demand intelligent routing technology for deterministic network

Improved ant colony algorithm based cloud computing user task scheduling algorithm

Multi-constrained trusted cooperative task migration strategy for edge computing

Related Author

XU Qingqing

LI Xiaotao

CHEN Wei

ZHU Shuqiong

Yi WANG

Xiaodong CAO

Jinrong CHEN

Cheng DING

Related Institution

China Mobile Research Institute

School of Computer Science and Technology, Huazhong University of Science and Technology

School of Electronic Information and Communications, Huazhong University of Science and Technology

School of Mathematics and Information Engineering,Jiaxing University

School of Science, Jiangxi University of Science and Technology

⁰