Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder

Jian Zhou; Xianwei Wei; Chunling Cheng; Qidong Yang; Qun Li

doi:10.2991/ijcis.2019.125905651

<Previous Article In Issue

Next Article In Issue>

Volume 12, Issue 1, November 2018, Pages 351 - 358

Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder

Authors

Jian Zhou¹^{, 2}, Xianwei Wei¹^{, 2}, Chunling Cheng¹^{, 2}^{, *}, Qidong Yang¹^{, 2}, Qun Li¹^{, 2}

1College of Computer, Nanjing University of Posts and Telecommunications

2Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, No. 66 Xinmofan Road, Nanjing, Jiangsu, 210003, China

^*Corresponding author. Email: chengcl@njupt.edu.cn

Corresponding Author

Chunling Cheng

Received 10 July 2018, Accepted 28 October 2018, Available Online 1 November 2018.

DOI: 10.2991/ijcis.2019.125905651 How to use a DOI?
Keywords: Emotion recognition; Convolutional auto-encoder; Fully connected neural network; EEG signals; EP signals
Abstract: Emotion recognition is of great significance to computational intelligence systems. In order to improve the accuracy of emotion recognition, electroencephalogram (EEG) signals and external physiological (EP) signals are adopted due to their perfect performance in reflecting the slight variations of emotions, wherein EEG signals consist of multiple channels signals and EP signals consist of multiple types of signals. In this paper, a multimodal emotion recognition method based on convolutional auto-encoder (CAE) is proposed. Firstly, a CAE is designed to obtain the fusion features of multichannel EEG signals and multitype EP signals. Secondly, a fully connected neural network classifier is constructed to achieve emotion recognition. Finally, experiment results show that the proposed method can improve the accuracy of emotion recognition obviously compared with other similar methods.
Copyright: © 2019 The Authors. Published by Atlantis Press SARL.
Open Access: This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)
View full text (HTML)

<Previous Article In Issue

Next Article In Issue>

Journal: International Journal of Computational Intelligence Systems
Volume-Issue: 12 - 1
Pages: 351 - 358
Publication Date: 2018/11/01
ISSN (Online): 1875-6883
ISSN (Print): 1875-6891
DOI: 10.2991/ijcis.2019.125905651 How to use a DOI?
Open Access: This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

ris enw bib

TY  - JOUR
AU  - Jian Zhou
AU  - Xianwei Wei
AU  - Chunling Cheng
AU  - Qidong Yang
AU  - Qun Li
PY  - 2018
DA  - 2018/11/01
TI  - Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder
JO  - International Journal of Computational Intelligence Systems
SP  - 351
EP  - 358
VL  - 12
IS  - 1
SN  - 1875-6883
UR  - https://doi.org/10.2991/ijcis.2019.125905651
DO  - 10.2991/ijcis.2019.125905651
ID  - Zhou2018
ER  -

download .riscopy to clipboard