Arana: A Cross-domain Workflow Scheduling System
Jian-Hua Gu, Xue-Yuan Lan, Ying Hao, Yu-Tong Hu
Available Online December 2016.
- https://doi.org/10.2991/icwcsn-16.2017.72How to use a DOI?
- workflow; cross-domain; big data; close to data; schedule
- Single data center is difficult to meet current demands of data storage and computing resources, leading to data broadly stored in different data centers far from each other geographically. Cross-domain big data processing usually requires data from other data centers across different network. Since the network environment is extremely complex and large amount of data is required for computing, time spent in data transmission is unacceptable, resulting in slow scheduling. In this paper, we propose a cross-domain workflow scheduling system called Arana. By moving program close to data and integrating popular big data processing platform, this system enables user to complete computing with cross-domain data without transferring.
- Open Access
- This is an open access article distributed under the CC BY-NC license.
Cite this article
TY - CONF AU - Jian-Hua Gu AU - Xue-Yuan Lan AU - Ying Hao AU - Yu-Tong Hu PY - 2016/12 DA - 2016/12 TI - Arana: A Cross-domain Workflow Scheduling System BT - 3rd International Conference on Wireless Communication and Sensor Networks (WCSN 2016) PB - Atlantis Press SN - 2352-538X UR - https://doi.org/10.2991/icwcsn-16.2017.72 DO - https://doi.org/10.2991/icwcsn-16.2017.72 ID - Gu2016/12 ER -