Disciplinary priors strongly predict which direction of effect gets reported.

Evidence

What the results furthermore tell us, is that the direction of the effect varies according to discipline (see Table 4). 59% of the articles published in political science journals report that deliberation can reduce polarization, whereas this effect is only reported in 17% of the social psychology studies. Social psychologists (paralleling the findings from the remaining disciplines) report much more often (in 61% of the cases) that group discussion actually increases polarization. … The strong association between the discipline and the results requires further investigation, but two explanations are possible. On the one hand, there might arguably be a positive-results bias. Political science approaches the issue mainly from the angle of deliberative democracy, and the wide-spread assumption among political scientists is that deliberation is capable of overcoming even the deepest and most contentious forms of disagreement. It is therefore expected that deliberation reduces polarization. In contrast, most psychological studies approach the theme from the polarization angle, and are interested in the risky shift phenomenon, predicting that deliberating groups would go to extremes. As such, studies reporting findings in line with the discipline’s assumptions might get published more frequently, which might account for at least part of our findings. — Didier Caluwaerts et al., Deliberation and Polarization, 108

Categorization

  • XREF: Echoes the confirmation/publication-bias dynamics the reader probes in whether evidence of deliberation’s effects is trustworthy. — connects to: Deliberation reduces affective polarization but often increases idea-based polarization. — Didier Caluwaerts et al., Deliberation and Polarization: A…, 107; Journal article titles encode hypotheses and predicted findings

Broader Connections

  • Journal article titles encode hypotheses and predicted findings #expands (0.80)