Visual streams can drive auditory segregation, but grouping order remains contested

Evidence

These two studies provide confirmation and development to the view that audiovisual fusion in speech perception includes a first stage of audiovisual speech scene analysis. A number of previous studies suggested that the presentation of a visual stream can enhance segregation by affecting primary auditory streaming (Rahne et al. 2007 ; Marozeau et al. 2010 ; Devergie et al. 2011 ) or that visual cues can improve speech detection and cue extraction (Grant and Seitz 2000 ; Kim and Davis 2004 ; Schwartz et al. 2004 ; Alsius and Munhall 2013 ); though some contradictory studies highlight cases where unimodal perceptual grouping precedes multisensory integration (Sanabria et al. 2005 ). — Dijk, Pim van, Physiology, Psychoacoustics and…, 5184

A number of previous studies suggested that the presentation of a visual stream can enhance segregation by affecting primary auditory streaming (Rahne et al. 2007 ; Marozeau et al. 2010 ; Devergie et al. 2011 ) or that visual cues can improve speech detection and cue extraction (Grant and Seitz 2000 ; Kim and Davis 2004 ; Schwartz et al. 2004 ; Alsius and Munhall 2013 ); though some contradictory studies highlight cases where unimodal perceptual grouping precedes multisensory integration (Sanabria et al. 2005 ). Altogether, the “binding stage” in the AVSSA process, in which the coherence between auditory and visual features would be evaluated in a complex scene, provides a mechanism in order to properly associate the adequate components inside a coherent audiovisual speech source. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5176

Categorization

• DEFINE: Introduces the AVSSA ‘binding stage’ as a coherence-evaluation mechanism paralleling auditory scene analysis in AV speech perception.
• XREF: Connects to classical auditory scene analysis work of Bregman, an anchoring concept for the reader’s psychoacoustics focus.
• corroborated: 2 independent passages support this claim — Dijk, Pim van, Physiology, Psychoacoustics and…, 5184; Dijk, Pim van, Physiology, Psychoacoustics and…, 5176