Converging multiple research methods strengthens confidence in a finding

Evidence

Marilynn Brewer cared about methodology. She recognized the benefits of multiple methods to converge on an idea, and her empirical work employed a variety of methodologies, from ethnography and field research to survey research and basic experimental laboratory research. Marilynn has been truly ambidextrous when it comes to data. Moreover, she has written widely on the proper understanding and creative use of research methodologies for testing hypotheses in the social sciences. — Roderick M. Kramer, Geoffrey J. Leonardelli, Robert W. Livingston, Social Cognition, Social Identity, and…, 79 (#corroborates, via linked claim)

Another fairly unique feature of the Secret Survey studies, compared with other sex surveys, arises from my methodological and personal fixedness. I have accumulated data in the exact same way on the sexual behavior of the same kind of university students in the same place over the past twelve years. The results give us a good look at how things have changed over time, at least Nevertheless, I would not want to pass these results off as the answer to a sex surveyor’s (or voyeur’s) dreams. — Bob Altemeyer, The Authoritarian Specter, 2212 (#complicates, via linked claim)

Categorization

• XREF: connects to: A focal definition enables replication and comparison across studies. — Erik Bleich, What Is Islamophobia and How Much Is…, 71; Respondents themselves requested broadening evidence across grouped cases — Henry M. Hart, Jr. and Albert M. Sacks, The Legal Process: Basic Problems in…, 437; Combining exploratory and confirmatory factor analysis produces theory-driven results robust across samples — Ruiqian Li and Paul Froese, The Duality of American Christian…, 94 (+9 more)

Broader Connections

• Convergent evidence from diverse methods strengthens scientific claims #corroborates (0.97) — Roderick M. Kramer, Geoffrey J. Leonardelli, Robert W. Livingston, Social Cognition, Social Identity, and…, 79
• Repeated identical methods across twelve years reveal genuine behavioral trends #complicates (0.75) — Bob Altemeyer, The Authoritarian Specter, 2212
• Science justifies methods by success while ignoring domains where intersubjective certainty fails #complicates (0.74)
• Disconfirming evidence can strengthen rather than weaken committed beliefs. #complicates (0.72) — Philip Mirowski, Never Let a Serious Crisis Go to Waste, 97