Visual cues override directional sound cues in film dialog perception

Evidence

Interestingly the fact that the speech is not in stereo is not noticeable because the visual cue dominates so that we hear the sound coming from the person speaking on the screen even if their sound is coming from a different direction. — David Howard, Jamie Angus, coustics and Psychoacoustics, 2244

Categorization

Category: Causal Relationships

• XREF: The ventriloquism effect in audio-visual perception; connects to cross-modal perception literature and could pair with the reader’s interest in how perception integrates across senses.
• DEEPTHINKING: The primacy of visual over auditory spatial cues in multimodal perception is a striking demonstration that our experience of sound location is constructed, not faithful — sits with the book’s theme that perception is interpretation.

Related

• Dynamic auditory cues can override clear visual evidence of source location (similarity 0.88)
• Vision and sound expectations must concord for convincing audio-scene perception (similarity 0.85)
• Vision dominates hearing in localization, identification, and size judgment (similarity 0.83)
• The ventriloquism effect lets a single monophonic center channel satisfy most on-screen dialogue (similarity 0.83)
• Synchronized visual motion captures perceived sound direction within 30 degrees (similarity 0.82)
• A mono center channel suffices because vision dominates perceived sound location. (similarity 0.81)
• Listeners continuously re-normalize distorted HRTFs using visual and motion cues (similarity 0.80)
• Recorded spatial content, not loudspeakers, dominates stereo perception (similarity 0.78)
• Matching audio to a visual scene requires scene-appropriate impulse responses. (similarity 0.78)

Broader Connections

• Vision and sound expectations must concord for convincing audio-scene perception #corroborates (0.82) — Eric J. Heller, Why You Hear What You Hear- An…, 476
• Visual and contextual cues bias human judgments of sound quality #expands (0.75) — Toole, Floyd E, Sound reproduction- the acoustics and…, 39
• Perceived sound direction and actual source direction need not coincide #corroborates (0.72) — Professor Dr.-Ing. Hugo Fastl, Professor Dr.-Ing. Eberhard, Psychoacoustics- Facts and Models, 1621