Stronger temporal audiovisual coherence increases visual weight in binding

Evidence

However, these studies were based on audiovisual scenes that never implied competing sources. The objective of the present study was to test the “binding and fusion” AVSSA process in scenes including competition between audiovisual sources. For this aim, we generated two audiovisual sources, one made of a sequence of isolated syllables, and the other one made of a sequence of sentences. We prepared two kinds of combinations, with the same auditory content (mixing the two audio sources, syllables and sentences) and two different video contents, either the syllables or the sentences. These two combinations (“Video syllables” and “Video sentences”) were used as the context in a McGurk experiment. We hypothesized that since syllables correspond to stronger audiovisual modulations in time and hence stronger audiovisual coherence than sentences, the association between the visual input and the corresponding auditory input would be stronger for syllables than for sentences. Hence the coherence of the audiovisual context would be stronger for syllables, and it would lead to a larger visual weight and more McGurk effect than with visual sentences. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5144

Categorization

• QUESTION: Is the premise that syllables show stronger audiovisual modulation over time than sentences actually established in the literature cited, or assumed?