International Journal of Computational Intelligence Systems

Volume 12, Issue 1, November 2018, Pages 351 - 358

Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder

Authors
Jian Zhou1, 2, Xianwei Wei1, 2, Chunling Cheng1, 2, *, Qidong Yang1, 2, Qun Li1, 2
1College of Computer, Nanjing University of Posts and Telecommunications
2Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, No. 66 Xinmofan Road, Nanjing, Jiangsu, 210003, China
*Corresponding author. Email: chengcl@njupt.edu.cn
Corresponding Author
Chunling Cheng
Received 10 July 2018, Accepted 28 October 2018, Available Online 1 November 2018.
DOI
https://doi.org/10.2991/ijcis.2019.125905651How to use a DOI?
Keywords
Emotion recognition; Convolutional auto-encoder; Fully connected neural network; EEG signals; EP signals
Abstract

Emotion recognition is of great significance to computational intelligence systems. In order to improve the accuracy of emotion recognition, electroencephalogram (EEG) signals and external physiological (EP) signals are adopted due to their perfect performance in reflecting the slight variations of emotions, wherein EEG signals consist of multiple channels signals and EP signals consist of multiple types of signals. In this paper, a multimodal emotion recognition method based on convolutional auto-encoder (CAE) is proposed. Firstly, a CAE is designed to obtain the fusion features of multichannel EEG signals and multitype EP signals. Secondly, a fully connected neural network classifier is constructed to achieve emotion recognition. Finally, experiment results show that the proposed method can improve the accuracy of emotion recognition obviously compared with other similar methods.

Copyright
© 2019 The Authors. Published by Atlantis Press SARL.
Open Access
This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)
View full text (HTML)

Journal
International Journal of Computational Intelligence Systems
Volume-Issue
12 - 1
Pages
351 - 358
Publication Date
2018/11/01
ISSN (Online)
1875-6883
ISSN (Print)
1875-6891
DOI
https://doi.org/10.2991/ijcis.2019.125905651How to use a DOI?
Copyright
© 2019 The Authors. Published by Atlantis Press SARL.
Open Access
This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - JOUR
AU  - Jian Zhou
AU  - Xianwei Wei
AU  - Chunling Cheng
AU  - Qidong Yang
AU  - Qun Li
PY  - 2018
DA  - 2018/11/01
TI  - Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder
JO  - International Journal of Computational Intelligence Systems
SP  - 351
EP  - 358
VL  - 12
IS  - 1
SN  - 1875-6883
UR  - https://doi.org/10.2991/ijcis.2019.125905651
DO  - https://doi.org/10.2991/ijcis.2019.125905651
ID  - Zhou2018
ER  -