Speech quality tests need at least 16 naive potential users for statistical power

Evidence

The number of listeners is important since each will have a personal opinion and it is generally suggested that at least 16 are used to ensure that statistical analysis of the results is sufficiently powerful. However, the greater the number of listeners the more reliable the results are. It is also most appropriate to use listeners who are potential users of whatever system might result from the work and listeners who are defi­ nitely not experts in the area. — David Howard, Jamie Angus, coustics and Psychoacoustics, 2368

Categorization

• DEFINE: Gives a concrete, usable minimum-sample guideline with the rationale that naive users reflect real use.