Unbalanced survey scales produce inflated internal correlations but deflated cross-measure correlations

Evidence

The Zealot Scale, like my other 0-6 measures such as the Religious Emphasis Scale, does not control for response sets. So the interitem correlations and alphas on these scales are doubtless inflated, perhaps considerably. And their correlations with other unbalanced measures will also be pumped up. But their correlations with balanced measures such as the RWA, Religious Fundamentalism, and DOG Scales would be lessened, not increased. — Bob Altemeyer, The Authoritarian Specter, 4274

Categorization

• XREF: Methodological caveat about response sets — connects to Psychometrics literature and survey design best practices in Altemeyer’s own RWA book.