Information content is measured by occurrence probability and tied to bit count

Evidence

In order to measure the information content of a signal, we need to know how likely it is to occur. However, we also want to be able to relate the information content to something real, such as the number of bits necessary to transmit that information. — David M. Howard, Jamie Angus, Acoustics and Psychoacoustics, 2611