QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, January 10, 2007, 27(2):371-378; doi:10.1523/JNEUROSCI.4421-06.2007

This Article Full Text Full Text (PDF) Supplemental Data Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via ISI Web of Science (7) Citing Articles via Google Scholar Google Scholar Articles by Cohen, M. X Articles by Ranganath, C. Search for Related Content PubMed PubMed Citation Articles by Cohen, M. X Articles by Ranganath, C.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Reinforcement Learning Signals Predict Future Decisions

Michael X Cohen^1,2 and Charan Ranganath²

¹Department of Epileptology and Center for Mind and Brain, University of Bonn, 53105 Bonn, Germany, and ²Center for Neuroscience, University of California, Davis, Davis, California 95616

Correspondence should be addressed to Michael X Cohen, Center for Neuroscience, University of California, Davis, 1544 Newton Court, Davis, CA 95616. Email: mcohen{at}ucdavis.edu

Optimal behavior in a competitive world requires the flexibility to adapt decision strategies based on recent outcomes. In the present study, we tested the hypothesis that this flexibility emerges through a reinforcement learning process, in which reward prediction errors are used dynamically to adjust representations of decision options. We recorded event-related brain potentials (ERPs) while subjects played a strategic economic game against a computer opponent to evaluate how neural responses to outcomes related to subsequent decision-making. Analyses of ERP data focused on the feedback-related negativity (FRN), an outcome-locked potential thought to reflect a neural prediction error signal. Consistent with predictions of a computational reinforcement learning model, we found that the magnitude of ERPs after losing to the computer opponent predicted whether subjects would change decision behavior on the subsequent trial. Furthermore, FRNs to decision outcomes were disproportionately larger over the motor cortex contralateral to the response hand that was used to make the decision. These findings provide novel evidence that humans engage a reinforcement learning process to adjust representations of competing decision options.

Key words: reward prediction error; ERN; decision-making; reinforcement learning; dopamine; event-related potential

---

Received March 9, 2006; revised Nov. 26, 2006; accepted Nov. 27, 2006.

Correspondence should be addressed to Michael X Cohen, Center for Neuroscience, University of California, Davis, 1544 Newton Court, Davis, CA 95616. Email: mcohen{at}ucdavis.edu

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help