The Effect of Extra-Oral Facial Information on Audiovisual Speech Perception

DOI

10.2991/erss-18.2019.160How to use a DOI?

Keywords

McGurk effect, audiovisual speech perception, extra-oral facial information

Abstract

An experiment consisting of five blocks was conducted to examine the effect of extra-oral facial information on audiovisual speech perception. Twenty Chinese native speakers were asked to report the syllables they perceived in different conditions: audio-only, video-only, video-only without oral part, audiovisual and audiovisual without oral part. The experimental materials were /pa/, /tsa/, /ta/, /tʂa/ and /ka/, which were selected according to places of articulation from front to back. The results showed that even though the extra-oral facial information was not enough to distinguish non-labial consonants, it could have significant effect on auditory speech perception.

Copyright

© 2019, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Zeyu Huang
AU  - Yao Lu
AU  - Lu Wang
AU  - Xiyu Wu
PY  - 2019/01
DA  - 2019/01
TI  - The Effect of Extra-Oral Facial Information on Audiovisual Speech Perception
BT  - Proceedings of the 2018 International Workshop on Education Reform and Social Sciences (ERSS 2018)
PB  - Atlantis Press
SP  - 808
EP  - 813
SN  - 2352-5398
UR  - https://doi.org/10.2991/erss-18.2019.160
DO  - 10.2991/erss-18.2019.160
ID  - Huang2019/01
ER  -