Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards

Neuron. 2017 Sep 13;95(6):1395-1405.e3. doi: 10.1016/j.neuron.2017.08.025.

Abstract

Midbrain dopamine neurons have been proposed to signal prediction errors as defined in model-free reinforcement learning algorithms. While these algorithms have been extremely powerful in interpreting dopamine activity, these models do not register any error unless there is a difference between the value of what is predicted and what is received. Yet learning often occurs in response to changes in the unique features that characterize what is received, sometimes with no change in its value at all. Here, we show that classic error-signaling dopamine neurons also respond to changes in value-neutral sensory features of an expected reward. This suggests that dopamine neurons have access to a wider variety of information than contemplated by the models currently used to interpret their activity and that, while their firing may conform to predictions of these models in some cases, they are not restricted to signaling errors in the prediction of value.

Keywords: dopamine; learning; prediction error; rodent; single unit.

MeSH terms

  • Animals
  • Animals, Genetically Modified
  • Conditioning, Operant / physiology*
  • Dopaminergic Neurons / physiology*
  • Male
  • Models, Neurological
  • Rats
  • Reward*
  • Sensation / physiology*
  • Ventral Tegmental Area / physiology