AI training data is invisible yet permanently shapes deployed system behavior

Evidence

This training data, the Shirley cards of the twenty-first century, is often invisible, or taken for granted, or absent entirely: a pretrained model disseminated online almost never comes with its training data included. But it is very much present, and will permanently shape the behavior of a deployed system. — Brian Christian, The Alignment Problem, 150

Categorization

• XREF: Directly invokes the Shirley card photography history, echoing the reader’s core interest in invisible assumptions and blind spots. — connects to: Machine-learning bias often stems from unrepresentative training data; AI tools require hidden labor for data management and content screening. — Emily M. Bender, Alex Hanna, The AI Con- How to Fight Big Tech’s…, 173; Deployed machine-learning models often persist unchanged for decades in production (+4 more)
• SEED: Angle for an essay: the vanishing training data behind every pretrained model is a hidden cultural archive.
• corroborated: 2 independent passages support this claim — Brian Christian, The Alignment Problem, 150

Broader Connections

• Machine-learning bias often stems from unrepresentative training data #expands (0.85)
• AI tools require hidden labor for data management and content screening. #expands (0.65) — Emily M. Bender, Alex Hanna, The AI Con- How to Fight Big Tech’s…, 173
• Deployed machine-learning models often persist unchanged for decades in production #complicates (0.55)