Even well-intentioned technology can embed hidden functional biases

Evidence

Our enthusiasm for the use of technology to advance decision-making in a fair and unbiased manner is not unlimited. It is tempered by an accompanying concern that the use of modern technology can result in some curious and functionally biased outcomes. — Joseph Avery, Jim Sidanius, Joel Cooper, Gregory Davis, Amanda N., Bias in the Law, 1143

Categorization

• CANDY: The teased example (a soap dispenser that ignores dark skin) is a genuinely tweetable anecdote about tech bias.
• corroborated: 2 independent passages support this claim — Joseph Avery, Jim Sidanius, Joel Cooper, Gregory Davis, Amanda N., Bias in the Law: A Definitive Look at…, 1143
• XREF: connects to: Hidden value judgments hide behind claims of technical objectivity — Douglas A. Kysar, Regulating from Nowhere: Environmental…, 231; Algorithmic filtering amplifies preexisting biases rather than causing them — Sander van der Linden, Foolproof: Why Misinformation Infects…, 414