Shard Level Transaction Based Cluster Management for Online Distributed Storage
- 10.2991/amcce-15.2015.244How to use a DOI?
- management; online distributed storage; shard level transaction
Nowadays, distributed systems have been used everywhere, some for online applications, such as Apache HBase  and Cassandra , and some for offline applications, such as HDFS  and GFS. These systems achieve good result and largely reduce the cost. Due to the fact that distributed system is generally composed of lots of machines and failures occur recurrently, cluster management module is a must to handle these failures, thus provides availability and scalability. Low latency and high read and write performance is needed in many circumstances, such as in search engine and game field. Distributed storage for these systems need special ways to do cluster management. In this paper, a shard-level transaction based cluster management solution is proposed to handle such systems, and it can be easily extended.
- © 2015, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Wei Liu AU - Jiabao Zhao PY - 2015/04 DA - 2015/04 TI - Shard Level Transaction Based Cluster Management for Online Distributed Storage BT - Proceedings of the 2015 International Conference on Automation, Mechanical Control and Computational Engineering PB - Atlantis Press SN - 1951-6851 UR - https://doi.org/10.2991/amcce-15.2015.244 DO - 10.2991/amcce-15.2015.244 ID - Liu2015/04 ER -