Audiovisual context coherence strengthens perceptual binding of speech syllables

Evidence

Audiovisual fusion has long been considered as an automatic fusion process (e.g. Massaro 1987 ). However Exp. A. confirms that the contextual stimulus may modulate fusion as in our previous experiments (Nahorna et al. 2012 ; Ganesh et al. 2013 ; Nahorna et al. 2015 ) and extends the concept to the case of competing sources. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5177 (#expands, via linked claim)

Categorization

• XREF: connects to: Auditory scene analysis organizes sound events into perceptual streams; Perceptual segregation of target sounds may arise from temporal coherence with cortical oscillations — Dijk, Pim van, Physiology, Psychoacoustics and…, 4768; The brain computes an audiovisual coherence index before deciding to fuse sensory inputs (+10 more)

Related

• Temporal audiovisual coherence strength determines visual weighting in fusion. (similarity 0.94)
• Selective attention modulates fusion only for low-coherence video sentence contexts. (similarity 0.94)
• Audiovisual fusion is context-modulated, not automatic, and scales with audio-video coherence (similarity 0.92)
• Audiovisual speech fusion is not an automatic process but context-modulated. (similarity 0.92)
• Syllables have stronger audiovisual coherence than sentences, predicting greater binding. (similarity 0.91)
• High-coherence stimuli bind pre-attentively while low-coherence ones need attention. (similarity 0.90)
• Voluntary attention modulates how audiovisual contexts affect subsequent fusion (similarity 0.90)
• Exposure to low-coherence audiovisual contexts reduces subsequent multisensory fusion (similarity 0.89)
• Attention modulates audiovisual binding only for low-coherence stimuli, not salient ones (similarity 0.89)
• Top-down instructional attention modulates audiovisual speech perception in unimpaired listeners (similarity 0.88)
• Syllable speech binds audio and video more strongly than sentences do (similarity 0.87)
• Temporal coherence of audiovisual signals predicts how strongly vision captures auditory perception. (similarity 0.87)
• A coherence index computed before fusion decides whether audiovisual inputs bind (similarity 0.87)
• Brief audiovisual context can sharply weaken the McGurk fusion effect. (similarity 0.86)
• Stronger temporal audiovisual coherence increases visual weight in binding (similarity 0.85)

Broader Connections

• Audiovisual fusion is context-modulated, not automatic, and scales with audio-video coherence #expands (0.88) — Dijk, Pim van, Physiology, Psychoacoustics and…, 5177
• Attention modulates audiovisual binding only for low-coherence stimuli, not salient ones #qualifies (0.82)
• Exposure to low-coherence audiovisual contexts reduces subsequent multisensory fusion #expands (0.78)