Empirically-selected dogmatism scale items fail to replicate across samples, performing at chance level

Evidence

You would expect the ten items Schulze picked to make the Top Twenty on Troldahl and Powell’s list, would you not, if the procedure were valid? But only five of them did, exactly chance on a twenty item version of a forty-item scale. — Bob Altemeyer, The Authoritarian Specter, 4262

Categorization

• QUESTION: Worth chasing: what does this item-instability imply about how many ‘validated’ shortened scales replicate no better than chance?
• XREF: connects to: Combining exploratory and confirmatory factor analysis produces theory-driven results robust across samples — Ruiqian Li and Paul Froese, The Duality of American Christian…, 94; Latent profile count selection blends fit statistics with theory. — Erin Cooley, Jazmin L. Brown-Iannuzzi, Nava Caluori, Nicholas Elacqua, and William Cipolli, White Americans who perceive themselves…, 37