Computing and Library Services - delivering an inspiring information environment

Affective multi-modal interfaces: the case of McGurk effect

Ali, Azra N. and Marsden, Philip H. (2003) Affective multi-modal interfaces: the case of McGurk effect. Proceedings of the 8th international conference on Intelligent user interfaces. pp. 224-226.

Metadata only available from this repository.


This study is motivated by the increased need to understand human response to video-links, 3G telephony and avatars. We focus on response of participants to audiovisual presentations of talking heads, and examine the effect of noise and temporal misalignment of channels. We show that misalignment of audio and visual channels not only cause strange perception phenomena - the McGurk effect but also cause participants to apply extra mental effort, which is detectable from the physiological data collected. These data allow inferences to be drawn about the impact of the McGurk effect, thus providing indication of stress levels. This illuminates both to the mental and physical aspects of users interacting with multi-modal interfaces

Item Type: Article
Subjects: T Technology > T Technology (General)
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
P Language and Literature > P Philology. Linguistics
Schools: School of Computing and Engineering
Related URLs:
Depositing User: Briony Heyhoe
Date Deposited: 08 Sep 2008 10:31
Last Modified: 28 Aug 2021 10:41


Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©