Titel der Dissertation
Auditory Human-Computer Interaction: an Integrated Approach
Mag. Peter Fröhlich angestrebter akademischer Grad Doktor der Naturwissenschaften (Dr. rer. nat.) Wien, im September 2007 Supervisor
Prof. Univ.-Prof. Dr. Peter Vitouch Institut für Psychologie Universität Wien, Austria Examiner
Ao. Univ.Prof. Dr. Claus Lamm Social Cognitive Neuroscience Laboratory The University of Chicago 3
People are increasingly using information technology with their auditory sense: they listen to their iPod playlists, talk to car navigation systems, and check accounts over telephone-banking systems. Nevertheless, the capabilities of the human auditory modality for interacting with computers are still insufficiently exploited. This dissertation thesis advocates an integrated perspective on the multifaceted research and application fields of auditory human-computer interaction. The first part of the thesis conceptualizes the many differing ways auditory information is exchanged and processed between humans and computers. A taxonomy of 8 auditory user interface representations is proposed, consisting of linguistic representations (language-specific code, prosody, pragmatics), paralinguistic representations (speaker characteristics, emotions), and non-linguistic representations (spatial cues, music, sound signals). The empirical part of the thesis examines ways to integrate non-linguistic information in telephone-based spoken dialog systems. In four user studies, commonly assumed usability advantages of non-speech sound over speech are evaluated, in order to provide guidance for user interface design. Study 1 confirms that non-linguistic audio is highly useful to indicate time-dependent information, especially when the user of a telephone dialog system has to wait for certain requested information. Feedback to indicate waiting time, for example, for certain traffic information, should be introduced at the very beginning of...