《计算机应用研究》|Application Research of Computers

异构环境下纠删码的数据修复方法综述

Survey of heterogeneous-based data repair strategies for erasure codes

免费全文下载 (已被下载 次)  
获取PDF全文
作者 钟凤艳,王艳,李念爽
机构 华东交通大学 软件学院,南昌 330013
统计 摘要被查看 次,已被下载
文章编号 1001-3695(2019)08-001-2241-09
DOI 10.19734/j.issn.1001-3695.2018.04.0269
摘要 在大规模云存储系统中,由于磁盘或网络故障造成的存储节点失效事件频发,系统需要数据冗余技术以保证数据的可靠性和可用性。目前针对纠删码的冗余数据修复研究大多是无差别地对待每个存储节点,然而在实际分布式存储系统中,节点通常在带宽资源、计算资源、存储容量资源等方面存在差异性,这些资源的异构性对冗余数据修复性能影响很大。指出了影响修复性能的关键因素,选取带宽开销、磁盘访问开销、修复时间、参与修复的节点数量和修复代价作为修复性能的评价标准;分析了现有研究方法如何降低这五种开销,重点讨论了这些方法的优缺点;阐述了当前异构分布式存储系统中纠删码修复技术的研究现状,并指出了纠删码数据修复技术中尚未解决的一些难题和未来纠删码修复技术可能的发展方向。
关键词 存储系统; 纠删码; 异构; 数据修复; 性能优化
基金项目 国家自然科学基金资助项目(61402172)
江西省教育厅资助项目(GJJ150509)
本文URL http://www.arocmag.com/article/01-2019-08-001.html
英文标题 Survey of heterogeneous-based data repair strategies for erasure codes
作者英文名 Zhong Fengyan, Wang Yan, Li Nianshuang
机构英文名 School of Software,East China Jiaotong University,Nanchang 330013,China
英文摘要 In large scale cloud storage system, storage nodes fail frequently because of disk/link failures. In order to preserve data's reliability and availability, storage systems need to store redundant data. Most of the data recovery mechanisms for erasure codes think that there is no difference among storage nodes. In the actual distributed storage systems, however, there are some heterogeneities in the bandwidth, computing resources and storage capacity of the storage nodes, which have a great influence on the redundant data recovery performance. This paper presented data repair operation process in erasure code technology under heterogeneous environment, and identified the key factors that affected the recovery performance. Thereafter, it chose bandwidth cost, disk access overhead, repair time, the number of nodes participating in the repair and repair cost as the evaluation criterion for the recovery performance. In addition, it analyzed how to reduce these five costs by the existing research methods, and focused on the advantages and disadvantages of these methods. Finally, this paper indicated some unsolved problems in the research of erasure code repair method in the current heterogeneous storage systems and the possible development direction of the future erasure code repair method.
英文关键词 storage systems; erasure code; heterogeneity; data recovery; performance improvement
参考文献 查看稿件参考文献
 
收稿日期 2018/4/17
修回日期 2018/6/12
页码 2241-2249,2255
中图分类号 TP309.3
文献标志码 A