Ensuring AI captures human intent is now a central computer science problem

Evidence

How to prevent such a catastrophic divergence—how to ensure that these models capture our norms and values, understand what we mean or intend, and, above all, do what we want—has emerged as one of the most central and most urgent scientific questions in the field of computer science. It has a name: the alignment problem. — Brian Christian, The Alignment Problem, 65

Categorization

  • DEFINE: Defines the titular ‘alignment problem’ in its own words.
  • corroborated: 2 independent passages support this claim — Brian Christian, The Alignment Problem, 65
  • XREF: connects to: AI alignment may require machines to pursue human objectives, not their own — Brian Christian, The Alignment Problem, 1167; Machines could learn human values by observing behavior instead of being programmed — Brian Christian, The Alignment Problem, 1086; AI researchers aim to align general-purpose systems with hard-to-specify human intentions (+7 more)

Broader Connections