Automated recommendation systems reproduce and intensify offline racial discrimination.

Evidence

Safiya Umoja Noble uses the phrase “technological redlining” to describe how technologies of automation “reinforce oppressive social relationships and enact new modes of racial profiling.” Ruha Benjamin terms this technological discrimination “the New Jim Code,” which she defines as “the employment of new technologies that reflect and reproduce existing inequities but that are promoted and perceived as more objective or progressive than the discriminatory systems of a previous era.” — Grant Bollmer, Katherine Guinness, The Influencer Factory, 36

Categorization

  • DEFINE: Defines ‘technological redlining’ and ‘the New Jim Code’ — two named mechanisms for how the platform reproduces racial hierarchy.
  • XREF: connects to: Algorithmic discrimination affects real people despite targeting only probabilistic data doubles. — Nick Couldry & Ulises A. Mejias, The Costs of Connection: How Data Is…, 408; Targeted advertising systems automatically generated antisemitic ad categories — Shoshana Zuboff, The Age of Surveillance Capitalism, 1617; Racial determination still structures occupational possibility through indirect coded channels — David Theo Goldberg, The Threat of Race: Reflections on…, 1847 (+2 more)