Equal-probability symbol sources are the most efficient, wasting no bits.

Evidence

This is always true: the most efficient information source is one that uses all its possible symbols with equal probabilities. If we encoded the sources shown in Table 7.9 using a 3-bit binary code, then we would be wasting bits. In principle we could code the audio signal using only 1.7 bits, but how? — David Howard, Jamie Angus, coustics and Psychoacoustics, 2631

Categorization

• QUESTION: Why is maximum-entropy (equal probability) the most efficient source rather than the least informative? Worth chasing the relationship between redundancy and efficiency.