Exposure to low-coherence audiovisual contexts reduces subsequent multisensory fusion

Evidence

Audiovisual fusion has long been considered as an automatic fusion process (e.g. Massaro 1987 ). However Exp. A. confirms that the contextual stimulus may modulate fusion as in our previous experiments (Nahorna et al. 2012 ; Ganesh et al. 2013 ; Nahorna et al. 2015 ) and extends the concept to the case of competing sources. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5177 (#corroborates, via linked claim)

To provide evidence for this “binding and fusion” AVSSA process, Nahorna et al. ( 2012 , 2015 ) showed that the McGurk effect can be significantly and strongly reduced by an audiovisual context made of a few seconds of incoherent material (sounds and images coming from different speech sources) presented before the McGurk target (audio “ba” plus video “ga”): the target, classically perceived as “da” in the McGurk effect, was more often perceived as “ba”, suggesting a decreased weight of the visual input in the fusion process. The interpretation was that the incoherent context resulted in an “unbinding” effect decreasing the visual weight and hence diminishing the McGurk effect. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137 (#exemplifies, via linked claim)

Audiovisual fusion has long been considered as an automatic fusion process (e.g. Massaro 1987 ). However Exp. A. confirms that the contextual stimulus may modulate fusion as in our previous experiments (Nahorna et al. 2012 ; Ganesh et al. 2013 ; Nahorna et al. 2015 ) and extends the concept to the case of competing sources. This supports the AVSSA hypothesis, in which a first speech scene analysis process would group together the adequate audiovisual pieces of information and estimate the degree of audiovisual coherence. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137 (#corroborates, via linked claim)

Categorization

• XREF: connects to: The brain computes an audiovisual coherence index before deciding to fuse sensory inputs; Audiovisual fusion is context-modulated, not automatic, and scales with audio-video coherence — Dijk, Pim van, Physiology, Psychoacoustics and…, 5177; Voluntary attention modulates how audiovisual contexts affect subsequent fusion — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137 (+6 more)

Related

• Audiovisual speech fusion is not an automatic process but context-modulated. (similarity 0.94)
• Selective attention modulates fusion only for low-coherence video sentence contexts. (similarity 0.94)
• Brief audiovisual context can sharply weaken the McGurk fusion effect. (similarity 0.94)
• Voluntary attention modulates how audiovisual contexts affect subsequent fusion (similarity 0.94)
• Brief incoherent audiovisual contexts reduce the McGurk effect by decreasing visual weight. (similarity 0.93)
• Audiovisual fusion is context-modulated, not automatic, and scales with audio-video coherence (similarity 0.92)
• Audiovisual context coherence strengthens perceptual binding of speech syllables (similarity 0.89)
• Temporal audiovisual coherence strength determines visual weighting in fusion. (similarity 0.89)
• Brief prior exposure to mismatched audio-visual speech reduces later visual weight in fusion. (similarity 0.89)
• Seconds of mismatched audiovisual context weaken the McGurk visual bias. (similarity 0.87)
• Binding the visual stream to the less-coherent auditory source shrinks later McGurk fusion (similarity 0.86)
• Temporal coherence of audiovisual signals predicts how strongly vision captures auditory perception. (similarity 0.86)
• Top-down instructional attention modulates audiovisual speech perception in unimpaired listeners (similarity 0.86)
• High-coherence stimuli bind pre-attentively while low-coherence ones need attention. (similarity 0.84)
• Stronger temporal audiovisual coherence increases visual weight in binding (similarity 0.84)

Broader Connections

• Audiovisual fusion is context-modulated, not automatic, and scales with audio-video coherence #corroborates (0.92) — Dijk, Pim van, Physiology, Psychoacoustics and…, 5177
• Brief incoherent audiovisual contexts reduce the McGurk effect by decreasing visual weight. #exemplifies (0.88) — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137
• Temporal audiovisual coherence strength determines visual weighting in fusion. #expands (0.85)
• Audiovisual speech fusion is not an automatic process but context-modulated. #corroborates (0.85) — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137
• Voluntary attention modulates how audiovisual contexts affect subsequent fusion #qualifies (0.80) — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137
• Selective attention modulates fusion only for low-coherence video sentence contexts. #qualifies (0.78)