An efficient Join-Engine to the SQL query based on Hive with Hbase
Zhi-cheng Zhao, Yi Jiang
Available Online May 2015.
- 10.2991/asei-15.2015.196How to use a DOI?
- Hbase; Hive; multi-join; Join Engine
Hbase combine Hive application platform can analysis of huge amounts of data easily. And querying on multi-join is the bottleneck of restricting the performance. To solve this problem designing a Join Engine between Hbase and Hive. It can read Hbase data and complete multiple table joins and optimization in advance to queries. Using the Join Engine can reduce the time of mapreduce process to data sort and shuffle, effectively improve the efficiency of Hbase combine Hive queries. The experimental results show that the solution with Join Engine can obviously shorten the query time in multi-table join, support the Hbase quasi real-time application.
- © 2015, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Zhi-cheng Zhao AU - Yi Jiang PY - 2015/05 DA - 2015/05 TI - An efficient Join-Engine to the SQL query based on Hive with Hbase BT - Proceedings of the 2015 International conference on Applied Science and Engineering Innovation PB - Atlantis Press SP - 991 EP - 996 SN - 2352-5401 UR - https://doi.org/10.2991/asei-15.2015.196 DO - 10.2991/asei-15.2015.196 ID - Zhao2015/05 ER -