2nd International Conference On Systems Engineering and Modeling (ICSEM-13)

Storage Mechanism of Processing Magnanimity Small Files Applying HDFS Architecture

Authors
Xin Wang, Jun Ma
Corresponding Author
Xin Wang
Available Online April 2013.
DOI
https://doi.org/10.2991/icsem.2013.167How to use a DOI?
Keywords
HDFS, I/O Efficiency, Disk Buffer.
Abstract
Pointing at the low efficiency problem of I/O operations of small files using HDFS application architecture, this article proposes a new method, that is, add disk buffer on DataNode to reduce addressing time of reading small files, and thus reduce reading time, and reduce the stress bringed by frequent NameNode access, so as to optimize the reading efficiency of small files. Experiment results show that the design programme is feasible, and adding disk buffer benefits for increasing efficiency of processing small files applying HDFS.
Open Access
This is an open access article distributed under the CC BY-NC license.

Download article (PDF)

Proceedings
2nd International Conference On Systems Engineering and Modeling (ICSEM-13)
Part of series
Advances in Intelligent Systems Research
Publication Date
April 2013
ISBN
978-94-91216-42-8
ISSN
1951-6851
DOI
https://doi.org/10.2991/icsem.2013.167How to use a DOI?
Open Access
This is an open access article distributed under the CC BY-NC license.

Cite this article

TY  - CONF
AU  - Xin Wang
AU  - Jun Ma
PY  - 2013/04
DA  - 2013/04
TI  - Storage Mechanism of Processing Magnanimity Small Files Applying HDFS Architecture
BT  - 2nd International Conference On Systems Engineering and Modeling (ICSEM-13)
PB  - Atlantis Press
SN  - 1951-6851
UR  - https://doi.org/10.2991/icsem.2013.167
DO  - https://doi.org/10.2991/icsem.2013.167
ID  - Wang2013/04
ER  -