Multisensory binding decisions depend on a prior coherence estimate between auditory and visual streams.

Evidence

We introduce “Audio-Visual Speech Scene Analysis” (AVSSA) as an extension of the two-stage Auditory Scene Analysis model towards audiovisual scenes made of mixtures of speakers. AVSSA assumes that a coherence index between the auditory and the visual input is computed prior to audiovisual fusion, enabling to determine whether the sensory inputs should be bound together. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5135

Categorization

• DEFINE: Defines the AVSSA concept and its two-stage architecture: coherence assessment precedes fusion.
• XREF: Parallel to predictive-processing accounts where prior probability of integration (unity assumption) gates multisensory binding.