Proceedings of the 8th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2020)

Evaluation of the Impact of Random Computing Hardware Faults on the Performance of Convolutional Neural Networks

Authors
Emil Valiev, Nafisa Yusupova, Andrey Morozov, Klaus Janschek, Michael Beyer
Corresponding Author
Emil Valiev
Available Online 10 November 2020.
DOI
10.2991/aisr.k.201029.058How to use a DOI?
Keywords
deep learning, fault injection, random hardware faults, automated fault injection, Convolutional Neural Network, neural network fault tolerance
Abstract

Artificial Intelligence (AI) rapidly spreads across high-tech industries and enters almost every safety-critical area such as automotive, aerospace, and medical industries. However, like any other software, AI-based applications are prone to random hardware faults such as a random bit flip in CPU, RAM, or network. Therefore, it is essential to understand how various hardware faults affect the performance and accuracy of AI applications. This paper provides a general description and particular conceptual and implementational features of our recently introduced Fault Injection (FI) framework InjectTF2. InjectTF2 is developed using the TensorFlow 2 API and allows the user to specify fault parameters and perform layer-wise fault injection into the TensorFlow 2 neural networks. It enables the automated injection of random bitflips. The paper describes the software architecture of the framework. The framework is open source and freely available on the GitHub. The application of InjectTF2 is demonstrated with extensive fault injection experiments on a Convolutional Neural Network (CNN) trained using the GTSRB dataset. The experiments’ results show how random bitflips in the outputs of the CNNs layers affect the classification accuracy. Such results support not only numerical analysis of reliability and safety characteristics but also help to identify the most critical CNN layers for more robust and fault-tolerant design.

Copyright
© 2020, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 8th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2020)
Series
Advances in Intelligent Systems Research
Publication Date
10 November 2020
ISBN
10.2991/aisr.k.201029.058
ISSN
1951-6851
DOI
10.2991/aisr.k.201029.058How to use a DOI?
Copyright
© 2020, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Emil Valiev
AU  - Nafisa Yusupova
AU  - Andrey Morozov
AU  - Klaus Janschek
AU  - Michael Beyer
PY  - 2020
DA  - 2020/11/10
TI  - Evaluation of the Impact of Random Computing Hardware Faults on the Performance of Convolutional Neural Networks
BT  - Proceedings of the 8th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2020)
PB  - Atlantis Press
SP  - 307
EP  - 312
SN  - 1951-6851
UR  - https://doi.org/10.2991/aisr.k.201029.058
DO  - 10.2991/aisr.k.201029.058
ID  - Valiev2020
ER  -