Effects of audio-visual integration on the detection of masked speech and non-speech sounds

Eramudugolla, Ranmalee, Henderson, Rachel and Mattingley, Jason B. (2011) Effects of audio-visual integration on the detection of masked speech and non-speech sounds. Brain and Cognition, 71 1: 60-66. doi:10.1016/j.bandc.2010.09.005

Author Eramudugolla, Ranmalee
Henderson, Rachel
Mattingley, Jason B.
Title Effects of audio-visual integration on the detection of masked speech and non-speech sounds
Journal name Brain and Cognition   Check publisher's open access policy
ISSN 0278-2626
Publication date 2011-02
Year available 2010
Sub-type Article (original research)
DOI 10.1016/j.bandc.2010.09.005
Volume 71
Issue 1
Start page 60
End page 66
Total pages 7
Place of publication United States
Publisher Academic Press
Collection year 2011
Language eng
Abstract Integration of simultaneous auditory and visual information about an event can enhance our ability to detect that event. This is particularly evident in the perception of speech, where the articulatory gestures of the speaker's lips and face can significantly improve the listener's detection and identification of the message, especially when that message is presented in a noisy background. Speech is a particularly important example of multisensory integration because of its behavioural relevance to humans and also because brain regions have been identified that appear to be specifically tuned for auditory speech and lip gestures. Previous research has suggested that speech stimuli may have an advantage over other types of auditory stimuli in terms of audio-visual integration. Here, we used a modified adaptive psychophysical staircase approach to compare the influence of congruent visual stimuli (brief movie clips) on the detection of noise-masked auditory speech and non-speech stimuli. We found that congruent visual stimuli significantly improved detection of an auditory stimulus relative to incongruent visual stimuli. This effect, however, was equally apparent for speech and non-speech stimuli. The findings suggest that speech stimuli are not specifically advantaged by audio-visual integration for detection at threshold when compared with other naturalistic sounds. © 2010 Elsevier Inc.
Keyword Audio-visual
Auditory perception
Multisensory integration
Visual perception
Q-Index Code C1
Q-Index Status Confirmed Code
Institutional Status UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: Official 2011 Collection
Queensland Brain Institute Publications
School of Psychology Publications
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 6 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 7 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Wed, 02 Mar 2011, 14:56:39 EST by Debra McMurtrie on behalf of Queensland Brain Institute