Skinner showed animal behavior is conditioned by variable rewards and punishments

Evidence

We have already met John Watson, the psychologist-turned-advertising-executive, who pioneered the idea that humans are essentially like any other animals, reacting predictably to external stimuli. Over the 1930s, a more famous scientist, B. F. Skinner, would take the idea further. He regarded free will to be an illusion and argued that our behavior is a fabric of responses to past stimuli, in particular the rewards or punishments that any behavior attracts. Understood this way, all animal behavior developed through a learning process he called “operant conditioning,” whereby some actions are reinforced by positive consequences (rewards), others discouraged by negative ones (punishments). To demonstrate what he meant, he built the so-called Skinner Box or “operant conditioning chamber,” wherein he subjected animals to various consequences and observed their conditioning. For instance, by giving a pigeon a food pellet whenever it pecked at a button, Skinner conditioned the pigeon to peck the button so as to be fed. He also showed that pigeons could be conditioned to do things like turn in a circle (by reinforcing left turns), or even play competitive Ping-Pong.* According to Skinner, we, too, in most aspects of our lives, are like pigeons pecking at a button to receive little snacks. — Tim Wu, The Attention Merchants, 652

Categorization

• DEFINE: Defines operant conditioning and the Skinner Box, foundational concepts that anchor the chapter’s mechanism for attention retention.
• XREF: Links back to Chapter coverage of John Watson, showing the genealogy from behaviorist advertising to platform design. — connects to: Skinner’s reinforcement schedules replace simple stimulus-response with engineered behavior shaping. — Shoshana Zuboff, The Age of Surveillance Capitalism, 924; Variable reinforcement schedules can produce behaviors foreign to an animal’s natural repertoire — Shoshana Zuboff, The Age of Surveillance Capitalism, 1145; B.F. Skinner extrapolated laboratory animal behavior into grand theories of social organization — Shoshana Zuboff, The Age of Surveillance Capitalism, 1147 (+7 more)

Broader Connections

• Intermittent reward schedules produce more persistent behavior than consistent rewards do #expands (0.85) — Tim Wu, The Attention Merchants, 654
• Persuasion that stimulates some behaviors while suppressing others constitutes conditioning #expands (0.80) — Shoshana Zuboff, The Age of Surveillance Capitalism, 1019
• Aversive behavioral interventions suppress behavior locally but fail to transfer and cause escalation #qualifies (0.80) — , The Rod and the Child, 7424
• Skinner envisioned a population-scale technology of behavioral control that rejected freedom #expands (0.75) — Shoshana Zuboff, The Age of Surveillance Capitalism, 1012
• Functional explanations work when behavior responds to incentives #qualifies (0.72)