Religious priming effects appear only in published, not unpublished, studies

Evidence

It was important to test whether the classification of studies as published (k = 26) or unpublished (k = 18) influenced the overall priming effect. This moderation was significant, b = .07, [.04, .11], p < .001, and power to detect this moderating effect was >.95. A simple effects analysis shows that the religious priming effect was significant for published studies, b = . (.06, .12), p < .001, but not for unpublished studies, b = .02, (−.01, .04), p = .208. — Alexandra Snell, Miron Zuckerman, and Bonnie M. Le, Does Religious Priming Induce Greater…, 41

It was important to test whether the classification of studies as published (k = 26) or unpublished (k = 18) influenced the overall priming effect. This moderation was significant, b = .07, [.04, .11], p < .001, and power to detect this moderating effect was >.95. A simple effects analysis shows that the religious priming effect was significant for published studies, b = . (.06, .12), p < .001, but not for unpublished studies, b = .02, (−.01, .04), p = .208. This raises a question about whether religious priming produces an actual effect. One concern is that evidence of publication bias might indicate the occurrence of data mining in the literature. — Alexandra Snell, Miron Zuckerman, and Bonnie M. Le, Does Religious Priming Induce Greater…, 41

Categorization

  • QUESTION: The core threat to the entire priming effect — whether file-drawer nulls would nullify it — and whether this generalizes beyond religious priming.
  • SHARE: This published-vs-unpublished split finding is exactly what a colleague running priming or social-cognition work would want to see.
  • XREF: Directly central to the reading purpose on cross-category hostility transfer — publication bias qualifies the strength of any transfer effect found. — connects to: Religious priming causally increases prejudice toward LGBT people and atheists — Annetta Snell and Miron Zuckerman and Bonnie M. Le, Does Religious Priming Induce Greater…, 108; Religious priming produces real but small and sometimes unreliable effects — Annetta Snell and Miron Zuckerman and Bonnie M. Le, Does Religious Priming Induce Greater…, 95; Religious priming’s apparent prejudice effect exists only in published studies. — Annetta Snell and Miron Zuckerman and Bonnie M. Le, Does Religious Priming Induce Greater…, 41 (+2 more)
  • corroborated: 2 independent passages support this claim — Alexandra Snell, Miron Zuckerman, and Bonnie M. Le, Does Religious Priming Induce Greater…, 41

Broader Connections