A coherence index computed before fusion decides whether audiovisual inputs bind

Evidence

We introduce “Audio-Visual Speech Scene Analysis” (AVSSA) as an extension of the two-stage Auditory Scene Analysis model towards audiovisual scenes made of mixtures of speakers. AVSSA assumes that a coherence index between the auditory and the visual input is computed prior to audiovisual fusion, enabling to determine whether the sensory inputs should be bound together. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5135

Categorization

• DEFINE: Introduces and defines AVSSA and its central mechanism of pre-fusion coherence computation.
• QUESTION: What exactly constitutes the coherence index physiologically — is it a real neural correlate or a modeling construct? Worth chasing in the references.