Sonification renders time-varying data through pitch and timbre changes

Evidence

In this experiment, the rising arpeggio shown as response (A) is perceived as expected for stimulus (A) when all the note timbres are the same. However, the response changes to two separate falling arpeggii, shown as response (B), if note timbres are alternated between two timbres represented by the different notehead shapes, and “the difference in timbres is increased” as shown for stimulus (B). This is described as timbral streaming (e.g., Bregman, 1990). — David M. Howard, Jamie Angus, Acoustics and Psychoacoustics, 1629 (#expands, via linked claim)

Categorization

  • corroborated: 2 independent passages support this claim
  • XREF: connects to: Sonograms visually expose vowel formants as enhanced frequency bands; Timbral differences between instruments can be plotted dynamically through critical bands — David Howard, Jamie Angus, coustics and Psychoacoustics, 1514; Sonification maps measured data onto audible changes exploiting auditory perception — David M. Howard, Jamie Angus, Acoustics and Psychoacoustics, 2690 (+4 more)

Broader Connections