Proceedings of the 2015 International Conference on Automation, Mechanical Control and Computational Engineering

Shard Level Transaction Based Cluster Management for Online Distributed Storage

Authors
Wei Liu, Jiabao Zhao
Corresponding Author
Wei Liu
Available Online April 2015.
DOI
https://doi.org/10.2991/amcce-15.2015.244How to use a DOI?
Keywords
management; online distributed storage; shard level transaction
Abstract
Nowadays, distributed systems have been used everywhere, some for online applications, such as Apache HBase [1] and Cassandra [2], and some for offline applications, such as HDFS [3] and GFS. These systems achieve good result and largely reduce the cost. Due to the fact that distributed system is generally composed of lots of machines and failures occur recurrently, cluster management module is a must to handle these failures, thus provides availability and scalability. Low latency and high read and write performance is needed in many circumstances, such as in search engine and game field. Distributed storage for these systems need special ways to do cluster management. In this paper, a shard-level transaction based cluster management solution is proposed to handle such systems, and it can be easily extended.
Open Access
This is an open access article distributed under the CC BY-NC license.

Download article (PDF)

Cite this article

TY  - CONF
AU  - Wei Liu
AU  - Jiabao Zhao
PY  - 2015/04
DA  - 2015/04
TI  - Shard Level Transaction Based Cluster Management for Online Distributed Storage
BT  - Proceedings of the 2015 International Conference on Automation, Mechanical Control and Computational Engineering
PB  - Atlantis Press
SN  - 1951-6851
UR  - https://doi.org/10.2991/amcce-15.2015.244
DO  - https://doi.org/10.2991/amcce-15.2015.244
ID  - Liu2015/04
ER  -