Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

Nature. 2006 Aug 31;442(7106):1042-5. doi: 10.1038/nature05051. Epub 2006 Aug 23.

Abstract

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

Publication types

  • Controlled Clinical Trial
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Algorithms
  • Behavior / drug effects
  • Behavior / physiology*
  • Computer Simulation
  • Computers
  • Dopamine / metabolism*
  • Dopamine Agents / pharmacology
  • Dopamine Antagonists / pharmacology
  • Female
  • Forecasting
  • Haloperidol / pharmacology
  • Humans
  • Learning / drug effects
  • Learning / physiology*
  • Levodopa / pharmacology
  • Male
  • Models, Neurological
  • Neostriatum / drug effects
  • Neostriatum / physiology
  • Punishment
  • Reward*

Substances

  • Dopamine Agents
  • Dopamine Antagonists
  • Levodopa
  • Haloperidol
  • Dopamine