Reliable subjective ratings are prerequisites for validating technical measurements

Evidence

Figure 1.1 conveys an important message: meaningful technical measurements are the goal, but reliable, repeatable subjective ratings of sound quality are essential to reach that goal. Normally one gets opinions from sighted evaluations, and these are demonstrably unreliable (Toole and Olive, 1994). Getting trustworthy subjective data is time-consuming and requires preparation and discipline. — Toole, Floyd E, Sound reproduction- the acoustics and…, 54

Categorization

• XREF: Points forward to the blind-testing methodology Toole develops throughout the book; also connects to general claims about measurement validity requiring ground truth. — connects to: Grade standardization of grain required contestable human judgment. — Donald MacKenzie, An Engine, Not a Camera: How Financial…, 72