Storage Mechanism of Processing Magnanimity Small Files Applying HDFS Architecture
Xin Wang, Jun Ma
Available Online April 2013.
- https://doi.org/10.2991/icsem.2013.167How to use a DOI?
- HDFS, I/O Efficiency, Disk Buffer.
- Pointing at the low efficiency problem of I/O operations of small files using HDFS application architecture, this article proposes a new method, that is, add disk buffer on DataNode to reduce addressing time of reading small files, and thus reduce reading time, and reduce the stress bringed by frequent NameNode access, so as to optimize the reading efficiency of small files. Experiment results show that the design programme is feasible, and adding disk buffer benefits for increasing efficiency of processing small files applying HDFS.
- Open Access
- This is an open access article distributed under the CC BY-NC license.
Cite this article
TY - CONF AU - Xin Wang AU - Jun Ma PY - 2013/04 DA - 2013/04 TI - Storage Mechanism of Processing Magnanimity Small Files Applying HDFS Architecture BT - 2nd International Conference On Systems Engineering and Modeling (ICSEM-13) PB - Atlantis Press SN - 1951-6851 UR - https://doi.org/10.2991/icsem.2013.167 DO - https://doi.org/10.2991/icsem.2013.167 ID - Wang2013/04 ER -