Thumbnail
Access Restriction
Open

Author Ali, Azra ♦ Marsden, Philip H.
Source CiteSeerX
Content type Text
File Format PDF
Language English
Subject Domain (in DDC) Computer science, information & general works ♦ Data processing & computer science
Subject Keyword Strange Perception ♦ Physiological Data ♦ Physical Aspect ♦ Stress Level ♦ Visual Channel ♦ Mcgurk Effect ♦ Human Response ♦ Extra Mental Effort ♦ Affective Multi-modal Interface ♦ Multi-modal Interface ♦ Temporal Misalignment ♦ Audiovisual Presentation
Description This study is motivated by the increased need to understand human response to video-links, 3G telephony and avatars. We focus on response of participants to audiovisual presentations of talking heads, and examine the effect of noise and temporal misalignment of channels. We show that misalignment of audio and visual channels not only cause strange perception phenomena -- the McGurk effect but also cause participants to apply extra mental effort, which is detectable from the physiological data collected. These data allow inferences to be drawn about the impact of the McGurk effect, thus providing indication of stress levels. This illuminates both to the mental and physical aspects of users interacting with multi-modal interfaces.
Educational Role Student ♦ Teacher
Age Range above 22 year
Educational Use Research
Education Level UG and PG ♦ Career/Technical Study
Learning Resource Type Article
Publisher Institution In: Proceedings of the 8th International Conference on Intelligent User Interfaces