Listeners continuously re-normalize distorted HRTFs using visual and motion cues
Evidence
A well-known example where vision modifies the auditory perception is ventriloquism (Alais and Burr, 2004), where listeners perceive the sound to be coming from a direction other than the one it actually comes from, if the visual movements associated with the sound generation are synchronized with the sound. The synchronized movements then ‘capture’ the spatial perception of sound. The effect is most powerful if the separation between the sound and visual sources is less than about 30◦. However, the auditory cue may still be more salient than the visual cue in some cases. If the visual image is severely blurred, the perceived direction matches that of the sound source, and if both of them are blurred, an average direction is perceived. — Ville Pulkki, Matti Karjalainen, Communication Acoustics- An…, 1466 (
#corroborates, via linked claim)
In one case at least, Stereophile magazine, useful measurements are made (full credit to John Atkinson), but then, by my observation, these data are rarely incorporated in the discussion by the subjective reviewers who practice the “take-it-home-and-listen-to-it” method. Adaptation sets in, and numerous non-auditory influences are at play. There are many quotable passages in these reviews, but one sticks in my memory. It pertained to a loudspeaker with significant faults, clearly revealed in Atkinson’s measurements (and ours), and one can only presume heard by the reviewer. The subjective reviewer, perhaps believing in “breaking in,” persisted and stated that after living with the speaker for about two months he experienced an epiphany, and he suddenly heard wonderful things. So, did the loudspeaker “break in”? No. Did the reviewer come to an accommodation with the faults in it? Yes. In the absence of comparison listening to other products, the reviewer will never know what really happened. Readers were encouraged to go spend a lot of money on a mediocre product. — , Toole, Floyd E - Sound reproduction-…, 158 (
#expands, via linked claim)
Categorization
- XREF: connects to: Immersive headphone audio remains compromised without personalized HRTFs; In-head localization stems from mismatched HRTFs and missing head tracking; Humans normalize individual HRTFs from birth to recognize neutral timbre (+6 more)
Related
- Humans normalize individual HRTFs from birth to recognize neutral timbre (similarity 0.87)
- In-head localization stems from mismatched HRTFs and missing head tracking (similarity 0.85)
- Synchronized visual motion captures perceived sound direction within 30 degrees (similarity 0.82)
- Head-motion-dependent sound changes are required for external sound localization (similarity 0.81)
- Individualized HRTFs only improve localization in planes requiring pinnae cues (similarity 0.81)
- Hearing adapts in real time to drastically modified HRTFs (similarity 0.81)
- Vision dominates hearing in localization, identification, and size judgment (similarity 0.81)
- Horizontal-plane localization is mature while elevation reproduction is newly addressed (similarity 0.81)
- Individualized HRTF data is required for reliable crosstalk cancellation (similarity 0.81)
- Head related transfer functions anchor sounds to visual cues in VR (similarity 0.81)
- Amplitude panning produces equivalent spatial perception across headphones and loudspeakers. (similarity 0.80)
- Horizontal-plane localization needs no listener-specific HRTF, but vertical does (similarity 0.80)
- Pinna cues drive the need for individualized HRTFs in vertical localization (similarity 0.80)
- Headphone sounds are usually lateralized inside the head. (similarity 0.80)
- Head movement resolves directional ambiguity and explains headphone sounds seeming internal (similarity 0.80)
Broader Connections
- Humans normalize individual HRTFs from birth to recognize neutral timbre
#expands(0.85) - Synchronized visual motion captures perceived sound direction within 30 degrees
#corroborates(0.85) — Ville Pulkki, Matti Karjalainen, Communication Acoustics- An…, 1466 - Listeners habituate to reproduced-sound faults without comparison listening
#expands(0.80) — , Toole, Floyd E - Sound reproduction-…, 158 - Listeners perceptually normalize familiar rooms to judge loudspeakers clearly
#exemplifies(0.80) — Toole, Floyd E, Sound reproduction- the acoustics and…, 1098 - Individualized HRTFs only improve localization in planes requiring pinnae cues
#qualifies(0.80) - Listeners normalize room acoustics so a voice stays constant across radically different spaces
#exemplifies(0.78) - Listeners reconstruct the source signal by ignoring spectral room colouration
#expands(0.75)