Syllable speech binds audio and video more strongly than sentences do

Evidence

The effect of context type is significant [F (1, 20) = 34. 65, p < 0.001], with a higher McGurk effect (10 % less “ba” responses) with the “Video syllables” context. This is in line with our prediction that audiovisual coherence is higher in the “Video syllables” condition, leading to a higher binding level, a larger visual weight and hence a larger number of McGurk fusion (“da” responses). — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137

We hypothesized that since syllables correspond to stronger audiovisual modulations in time and hence stronger audiovisual coherence than sentences, the association between the visual input and the corresponding auditory input would be stronger for syllables than for sentences. Hence the coherence of the audiovisual context would be stronger for syllables, and it would lead to a larger visual weight and more McGurk effect than with visual sentences. — Dijk, Pim van, Physiology, Psychoacoustics and…, 5138

Categorization

  • QUESTION: Is the coherence gradient simply temporal synchrony, or does phonological structure play a role?
  • corroborated: 2 independent passages support this claim — Dijk, Pim van, Physiology, Psychoacoustics and…, 5137; Dijk, Pim van, Physiology, Psychoacoustics and…, 5138