QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, January 10, 2007, 27(2):371-378; doi:10.1523/JNEUROSCI.4421-06.2007

This Article Full Text Full Text (PDF) Supplemental Data Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (22) Citing Articles via Google Scholar Google Scholar Articles by Cohen, M. X Articles by Ranganath, C. Search for Related Content PubMed PubMed Citation Articles by Cohen, M. X Articles by Ranganath, C.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Reinforcement Learning Signals Predict Future Decisions

Michael X Cohen^1,2 and Charan Ranganath²

¹Department of Epileptology and Center for Mind and Brain, University of Bonn, 53105 Bonn, Germany, and ²Center for Neuroscience, University of California, Davis, Davis, California 95616

Correspondence should be addressed to Michael X Cohen, Center for Neuroscience, University of California, Davis, 1544 Newton Court, Davis, CA 95616. Email: mcohen{at}ucdavis.edu

Optimal behavior in a competitive world requires the flexibility to adapt decision strategies based on recent outcomes. In the present study, we tested the hypothesis that this flexibility emerges through a reinforcement learning process, in which reward prediction errors are used dynamically to adjust representations of decision options. We recorded event-related brain potentials (ERPs) while subjects played a strategic economic game against a computer opponent to evaluate how neural responses to outcomes related to subsequent decision-making. Analyses of ERP data focused on the feedback-related negativity (FRN), an outcome-locked potential thought to reflect a neural prediction error signal. Consistent with predictions of a computational reinforcement learning model, we found that the magnitude of ERPs after losing to the computer opponent predicted whether subjects would change decision behavior on the subsequent trial. Furthermore, FRNs to decision outcomes were disproportionately larger over the motor cortex contralateral to the response hand that was used to make the decision. These findings provide novel evidence that humans engage a reinforcement learning process to adjust representations of competing decision options.

Key words: reward prediction error; ERN; decision-making; reinforcement learning; dopamine; event-related potential

---

Received March 9, 2006; revised Nov. 26, 2006; accepted Nov. 27, 2006.

Correspondence should be addressed to Michael X Cohen, Center for Neuroscience, University of California, Davis, 1544 Newton Court, Davis, CA 95616. Email: mcohen{at}ucdavis.edu

This article has been cited by other articles:

				J. van der Helden, M. A. S. Boksem, and J. H. G. Blom The Importance of Failure: Feedback-Related Negativity Predicts Motor Learning Efficiency Cereb Cortex, October 19, 2009; (2009) bhp224v1. [Abstract] [Full Text] [PDF]

				C. B. Holroyd, O. E. Krigolson, R. Baker, S. Lee, and J. Gibson When is an error not a prediction error? An electrophysiological investigation Cogn Affect Behav Neurosci, March 1, 2009; 9(1): 59 - 70. [Abstract] [PDF]

				D. Thevarajah, A. Mikulic, and M. C. Dorris Role of the Superior Colliculus in Choosing Mixed-Strategy Saccades J. Neurosci., February 18, 2009; 29(7): 1998 - 2008. [Abstract] [Full Text] [PDF]

				R. B. Mars, S. Debener, T. E. Gladwin, L. M. Harrison, P. Haggard, J. C. Rothwell, and S. Bestmann Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise J. Neurosci., November 19, 2008; 28(47): 12539 - 12545. [Abstract] [Full Text] [PDF]

				A. Mikulic and M. C. Dorris Temporal and Spatial Allocation of Motor Preparation During a Mixed-Strategy Game J Neurophysiol, October 1, 2008; 100(4): 2101 - 2108. [Abstract] [Full Text] [PDF]

				M. X. COHEN Neurocomputational mechanisms of reinforcement-guided learning in humans: A review Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125. [Abstract] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help