Two-stage scene analysis extends from auditory to audiovisual speech scenes.
Evidence
Since a pioneer proposal by Berthommier ( 2004 ), our group proposed that auditory scene analysis and multisensory interactions in speech perception should be combined into a single “Audio-Visual Speech Scene Analysis” (AVSSA) process. The basic claim is that the two-stage analysis-and-decision process at work in ASA should be extended to audiovisual speech scenes made of mixtures of auditory and visual speech sources. A first audiovisual binding stage would involve segmenting the scene into audiovisual elements, which should be segregated or grouped in respect to their common multisensory speech source, either by bottom-up audiovisual primitives or by learnt top-down audiovisual schemas . This audiovisual binding stage would control the output of the later decision stage, and hence intervene on the output of the speech-in-noise or McGurk paradigms. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5142
Since a pioneer proposal by Berthommier ( 2004 ), our group proposed that auditory scene analysis and multisensory interactions in speech perception should be combined into a single “Audio-Visual Speech Scene Analysis” (AVSSA) process. The basic claim is that the two-stage analysis-and-decision process at work in ASA should be extended to audiovisual speech scenes made of mixtures of auditory and visual speech sources. A first audiovisual binding stage would involve segmenting the scene into audiovisual elements, which should be segregated or grouped in respect to their common multisensory speech source, either by bottom-up audiovisual primitives or by learnt top-down audiovisual schemas . This audiovisual binding stage would control the output of the later decision stage, and hence intervene on the output of the speech-in-noise or McGurk paradigms. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5142
Categorization
- DEFINE: Defines the AVSSA framework: an audiovisual binding stage whose output gates the decision stage.
- QUESTION: Worth chasing: how exactly does the binding stage ‘control’ the decision output — a weighting shift or a hard gate?
- corroborated: 2 independent passages support this claim — Dijk, Pim van, Physiology, Psychoacoustics and…, 5142