HDFS distributed metadata management research
Authors
An-ping Xiong, Jin-yong Ma
Corresponding Author
An-ping Xiong
Available Online May 2015.
- DOI
- 10.2991/asei-15.2015.190How to use a DOI?
- Keywords
- hdfs;Metadata Management;Consistency;Two-phase commit protocol
- Abstract
As it can provide high throughput data access, and easy to deploy on a cheap machine ,Distributed File System HDFS is used widely.All HDFS file access requests are required by the metadata server node .so the single metadata server nodes often become the bottleneck of the whole system problem, this paper design a multi-node distributed metadata management solution in the directory Hash-based metadata storage strategy, proposed a protocol based on two-phase commit to ensure distributed metadata consistency. Experimental results show that the program can improve HDFS file system metadata management efficiency.
- Copyright
- © 2015, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - An-ping Xiong AU - Jin-yong Ma PY - 2015/05 DA - 2015/05 TI - HDFS distributed metadata management research BT - Proceedings of the 2015 International conference on Applied Science and Engineering Innovation PB - Atlantis Press SP - 956 EP - 961 SN - 2352-5401 UR - https://doi.org/10.2991/asei-15.2015.190 DO - 10.2991/asei-15.2015.190 ID - Xiong2015/05 ER -