Thumbnail
Access Restriction
Open

Author Aist, Gregory
Source CiteSeerX
Content type Text
File Format PDF
Language English
Subject Domain (in DDC) Computer science, information & general works ♦ Data processing & computer science
Subject Keyword Spoken Dialog System ♦ Visual Channel ♦ Underlying Technology ♦ Head Pose ♦ Dialog Management ♦ Eye Gaze ♦ Pupil Dilation ♦ Many Language ♦ Visual Awareness ♦ Speech Recognition ♦ Visual Scene ♦ Natural Language Understanding ♦ Spoken Language ♦ Cluster Personal Perception ♦ Visual Input ♦ Various Domain ♦ Dialog System Research ♦ Important Application ♦ Blink Rate ♦ Central Aspect ♦ Certain Type ♦ Affective State ♦ Ll Call ♦ Speech Synthesis ♦ Natural Language Generation ♦ Computer Vision ♦ Vissual Input ♦ Dialog System Behavior
Description Spoken dialog systems have matured to the point where the underlying technologies of speech recognition, natural language understanding, dialog management, natural language generation, and speech synthesis are available for many languages and are portable to various domains. However, when people communicate, spoken language is accompanied by a host of other inputs and outputs. The most immediately salient of these processes is input and output perceived visually: gestures, eye gaze, posture, and the like. We focus on three kinds of visual input: the first can be roughly called visual awareness, and includes factors such as what objects (including people) are in the visual scene, how far away they are from the computer, and so forth. Certain types of visual input such as posture, head pose, blink rate, and pupil dilation are more fine-grained and have to do with analyzing an individual's cognitive and affective states; we'll call this cluster personal perception. The third is eyetracking: where the user is looking. Here we spell out a number of challenges posed by the introduction of the visual channel into spoken dialog systems, and enumerate some opportunities that vissual input provides. We focus especially on how these challenges relate to evaluation – since evaluation of a spoken dialog system’s behavior is a central aspect of dialog system research and is especially critical for important applications such as intelligent tutoring systems.
Educational Role Student ♦ Teacher
Age Range above 22 year
Educational Use Research
Education Level UG and PG ♦ Career/Technical Study
Learning Resource Type Article
Publisher Date 2006-01-01
Publisher Institution in Interspeech06 Satellite Workshop Dialogue on Dialogues - Multidisciplinary Evaluation of Advanced Speech-based Interactive Systems