The Analysis Research of Hierarchical Storage System Based on Hadoop Framework

DOI

10.2991/isrme-15.2015.107How to use a DOI?

Keywords

Big Data, Hierarchical Storage System, Hadoop Framework.

Abstract

With the rapid development of data science and computer technology, hierarchical storage system based on Hadoop is being research. In this paper, we propose a novel methodology of hierarchical storage system based on Hadoop framework. This way the Hadoop cluster will not reach the stage where the NameNode becomes irresponsive due to excessive JVM garbage collection as the HDFS will not be heavily loaded. The experimental result illustrates the effectiveness and feasibility of proposed framework, further modification areas of research are proposed in the end.

Copyright

© 2015, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yan Liu
AU  - Tianjian Zheng
AU  - Mingjiang Li
AU  - Jinpeng Yuan
PY  - 2015/04
DA  - 2015/04
TI  - The Analysis Research of Hierarchical Storage System Based on Hadoop Framework
BT  - Proceedings of the 2015 International Conference on Intelligent Systems Research and Mechatronics Engineering
PB  - Atlantis Press
SP  - 501
EP  - 506
SN  - 1951-6851
UR  - https://doi.org/10.2991/isrme-15.2015.107
DO  - 10.2991/isrme-15.2015.107
ID  - Liu2015/04
ER  -