Proceedings of the 2016 6th International Conference on Management, Education, Information and Control (MEICI 2016)

<Previous Article In Volume
Next Article In Volume>

Script-based Automation ETL Tool

Authors
Jizhe Li, Beijing Kuang, Jingang Liu
Corresponding Author
Jizhe Li
Available Online September 2016.
DOI
10.2991/meici-16.2016.201How to use a DOI?
Keywords
ETL; Sqoop; Hadoop; HDFS; Csv
Abstract

Due to the shortcoming of the traditional ETL tool and Sqoop, we proposed a script-based automation ETL tool. We proposed an automation ETL tool which is combined with scripting and database tools to implement the 3 ETL processes-Extraction, Transformation and Loading. At Last, we have proved that script-based automation ETL tool is faster than snoop on extracting and transforming data from Oracle to Impala.

Copyright
© 2016, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the 2016 6th International Conference on Management, Education, Information and Control (MEICI 2016)
Series
Advances in Intelligent Systems Research
Publication Date
September 2016
ISBN
10.2991/meici-16.2016.201
ISSN
1951-6851
DOI
10.2991/meici-16.2016.201How to use a DOI?
Copyright
© 2016, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

risenwbib
TY  - CONF
AU  - Jizhe Li
AU  - Beijing Kuang
AU  - Jingang Liu
PY  - 2016/09
DA  - 2016/09
TI  - Script-based Automation ETL Tool
BT  - Proceedings of the 2016 6th International Conference on Management, Education, Information and Control (MEICI 2016)
PB  - Atlantis Press
SP  - 968
EP  - 972
SN  - 1951-6851
UR  - https://doi.org/10.2991/meici-16.2016.201
DO  - 10.2991/meici-16.2016.201
ID  - Li2016/09
ER  -