Multisensory Integration With a Head-Mounted Display: Sound Delivery and Self-Motion

Thompson, Matthew and Sanderson, Penelope M. (2008) Multisensory Integration With a Head-Mounted Display: Sound Delivery and Self-Motion. Human Factors, 50 5: 789-800. doi:10.1518/001872008X312323

Author Thompson, Matthew
Sanderson, Penelope M.
Title Multisensory Integration With a Head-Mounted Display: Sound Delivery and Self-Motion
Journal name Human Factors   Check publisher's open access policy
ISSN 0018-7208
Publication date 2008-01-01
Year available 2008
Sub-type Article (original research)
DOI 10.1518/001872008X312323
Volume 50
Issue 5
Start page 789
End page 800
Total pages 11
Editor E. Sales
Place of publication Unites States of America
Publisher Sage Publications, Inc.
Language eng
Subject C1
970117 Expanding Knowledge in Psychology and Cognitive Sciences
080602 Computer-Human Interaction
Formatted abstract
Objective: We tested whether the method of sound delivery affects people's ability to integrate information from multiple modalities when they are walking and using a head-mounted display (HMD). Background: HMDs increasingly support mobile work. Human operators may benefit from auditory support when using an HMD. However, it is unclear whether sound is better delivered publicly in free field or privately via earpiece and what the effect of walking is. Method: Participants identified mismatches between sounds and visual information on an HMD. Participants heard the sounds via either earpiece or free field while they either sat or walked about the test room. Results: When using an earpiece, participants performed the mismatch task equally well whether sitting or walking, but when using free-field sound, participants performed the task significantly worse when walking than when sitting (p = .006). Conclusion: The worse performance for participants using free-field sound while walking may relate to spatial and motion inconsistencies between visual events on the head-referenced HMD and auditory events from world-referenced speakers. Researchers should more frequently examine the effect of self-motion on people's ability to perform various multisensory tasks. Application: When multisensory integration tasks are performed with an HMD and free-field delivery of sound, as may happen in medicine, transportation, or industry, performance may suffer when the relative location of sound changes as the user moves.
Keyword Behavioral Sciences
Engineering, Industrial
Psychology, Applied
Behavioral Sciences
Q-Index Code C1
Q-Index Status Confirmed Code
Grant ID DP0559504
Institutional Status UQ

Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 6 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 9 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Wed, 15 Apr 2009, 22:43:52 EST by Mrs Jennifer English on behalf of Faculty of Social & Behavioural Sciences