欢迎访问中国科学院大学学报,今天是

中国科学院大学学报 ›› 2016, Vol. 33 ›› Issue (5): 686-692.DOI: 10.7523/j.issn.2095-6134.2016.05.017

• 计算机科学 • 上一篇    下一篇

一种均衡视频资源的分布存储方法

侯金钟, 张立波, 罗铁坚   

  1. 中国科学院大学计算机与控制学院, 北京 101408
  • 收稿日期:2016-01-25 修回日期:2016-03-18 发布日期:2016-09-15
  • 通讯作者: 侯金钟
  • 基金资助:

    中国科学院设备共享管理系统优化项目(Y42901VED2)资助

A distributed storage method of balancing video resources

HOU Jinzhong, ZHANG Libo, LUO Tiejian   

  1. School of Computer and Control Engineering, University of Chinese Academy of Sciences, Beijing 101408, China
  • Received:2016-01-25 Revised:2016-03-18 Published:2016-09-15

摘要:

随着互联网视频内容日益增多,视频资源的分布式存储受到关注.在分布式存储系统中,如果文件能均衡存储在各个节点会使系统更加健壮,而传统的分布式存储系统通常在失衡发生后再调整,带来了较多的IO开销.对分布式视频文件存储进行研究,提出一种利用哈希和Bloom Filter的高性能存储系统HBF,在文件存入系统时即进行存储平衡.系统具备多个节点,文件分散保存在不同的节点上,系统通过增加或删除节点使容量具备可伸缩性,而且在存储平衡方面进行了改进,使存储节点之间的存储使用量保持相对一致.实验证明,HBF使分布式视频文件存储系统具有高性能并兼顾节点存储平衡,有利于负载均衡和资源的合理利用.

关键词: 视频资源, 分布式存储, 存储均衡, 高性能

Abstract:

With the increase of internet video contents, the method of distributively storing these videos has attracted much attention. In the distributed storage system, storage balance will make a system more robust. However traditional distributed storage systems always adjust the storage imbalance after it happens, which might cause more IO cost. This study focuses on distributed video file storage and proposes a kind of storage system based on Hash and Bloom Filter, namely HBF. It balances the storage when a file is being stored into the system. The system contains different nodes and the files are distributively stored on these nodes. The ability to easily add and remove nodes makes capacity of the system more scalable. In addition, improvments in storage balance have also been achieved, which keeps the usage of nodes storage relatively consistent. The experiments indicate that HBF achieves a good balance of nodes storage as well as the high performance of the distributed video files storage system. Thus the load balance could be greatly improved, and meanwhile the ultilization of resources would be more reasonable.

Key words: video resources, distributed storage, storage balance, high performance

中图分类号: