Design and Implementation of Workflow Scheduling Platform for Big Data
Authors
Zhifei Tan, Chen Li, Xia Hou, Junlin Du, Haibo Wang
Corresponding Author
Zhifei Tan
Available Online June 2017.
- DOI
- 10.2991/caai-17.2017.92How to use a DOI?
- Keywords
- big data; workflow scheduling platform;hadoop
- Abstract
Data analysts use big data processing technology to analyze rich content and find statistical law. The demand for analyzing data is soaring. This paper designs a visualization big data workflow scheduling platform. It can simplify processes of analyzing data via using user interfaces to edit workflow. It integrates data processing algorithm for Hadoop and Spark, also provides various data analysis services and management interfaces for workflow programs and files.
- Copyright
- © 2017, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Zhifei Tan AU - Chen Li AU - Xia Hou AU - Junlin Du AU - Haibo Wang PY - 2017/06 DA - 2017/06 TI - Design and Implementation of Workflow Scheduling Platform for Big Data BT - Proceedings of the 2017 2nd International Conference on Control, Automation and Artificial Intelligence (CAAI 2017) PB - Atlantis Press SP - 406 EP - 410 SN - 1951-6851 UR - https://doi.org/10.2991/caai-17.2017.92 DO - 10.2991/caai-17.2017.92 ID - Tan2017/06 ER -