Spark-Based Big Data Processing: AI to Decide on Opening a SiU9 Contract Position
- DOI
- 10.2991/aebmr.k.200312.474How to use a DOI?
- Abstract
This paper presents the theory behind using AI for big data processing. It considers an artificial neural network designed to make decisions whether to open a position on a SiU9 futures contract; to that end, Spark-based big data processing is applied. It is hypothesized and proven herein that the futures closing price can be predicted by the developed AI trained on a dataset containing web-parsed digitized ‘news-related’ fluctuations as well as time-series Japanese candlesticks of a SiU9 futures contract on a 15-minute timeframe. Research has shown that in the modern world, the ever-larger bulk of stock transactions are done by using trading systems (trading robots). More and more of them use AI. The novelty hereof is that the futures contract price is predicted by an AI trained not only on quantities and Japanese candlestick parameters, but also on the digitized news-related fluctuations collected by Skraper from websites. The dataset generated that was was fed to a perceptron that had a 305-parameter input layer, two hidden layers having (100 parameters and 10 parameters), and an output layer that gave the predicted price. The perceptron was created and run on the Deductor platform, while Skraper was a Python program in the Spark framework. The research team further analyzed how accurately the ANN could predict the price of a financial instrument, the SiU9 futures contract, on a Russian stock exchange over a 15-minute timeframe. The study has effectively produced an ANN-based trading algorithm for opening long and short SiU9 positions in the fixed-term stock market; the algorithm has a good predictive accuracy.
- Copyright
- © 2020, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - N I Lomakin AU - P D Kravcheny AU - M C Maramygin AU - A B Shohnech AU - I A Samorodova PY - 2020 DA - 2020/03/17 TI - Spark-Based Big Data Processing: AI to Decide on Opening a SiU9 Contract Position BT - Proceedings of the International Scientific Conference "Far East Con" (ISCFEC 2020) PB - Atlantis Press SP - 3283 EP - 3291 SN - 2352-5428 UR - https://doi.org/10.2991/aebmr.k.200312.474 DO - 10.2991/aebmr.k.200312.474 ID - Lomakin2020 ER -