Debiasing algorithms risk exacerbating bias without a careful implementation framework

Evidence

Bias in the legal system is a serious problem. We believe that the most promising route forward is to marshal legal technology to identify and correct for bias in the law. As we have pointed out, this route is not without risk. Algorithms that can help the human actors in the legal system mitigate racial bias can also exacerbate bias unless they are implemented with caution and care. Computational decision-making tools need a careful framework for their development and implementation. In this chapter, we have outlined five essential tasks that, if accomplished, will maximize the good and minimize the risk. In adhering to our framework and accomplishing these tasks, legal decision makers might be able to achieve something that has not been heretofore achieved: more equal justice for all. — Joseph Avery, Jim Sidanius, Joel Cooper, Gregory Davis, Amanda N., Bias in the Law, 1223

Categorization

• corroborated: 2 independent passages support this claim — Joseph Avery, Jim Sidanius, Joel Cooper, Gregory Davis, Amanda N., Bias in the Law: A Definitive Look at…, 1223
• XREF: connects to: Algorithmic filtering amplifies preexisting biases rather than causing them — Sander van der Linden, Foolproof: Why Misinformation Infects…, 414