QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, August 1, 2007, 27(31):8366-8377; doi:10.1523/JNEUROSCI.2369-07.2007

This Article Full Text Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (7) Citing Articles via Google Scholar Google Scholar Articles by Seo, H. Articles by Lee, D. Search for Related Content PubMed PubMed Citation Articles by Seo, H. Articles by Lee, D.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game

Hyojung Seo and Daeyeol Lee

Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut 06510

Correspondence should be addressed to Dr. Daeyeol Lee, Department of Neurobiology, Yale University School of Medicine, 333 Cedar Street, SHM B404, New Haven, CT 06510. Email: daeyeol.lee{at}yale.edu

The process of decision making in humans and other animals is adaptive and can be tuned through experience so as to optimize the outcomes of their choices in a dynamic environment. Previous studies have demonstrated that the anterior cingulate cortex plays an important role in updating the animal's behavioral strategies when the action outcome contingencies change. Moreover, neurons in the anterior cingulate cortex often encode the signals related to expected or actual reward. We investigated whether reward-related activity in the anterior cingulate cortex is affected by the animal's previous reward history. This was tested in rhesus monkeys trained to make binary choices in a computer-simulated competitive zero-sum game. The animal's choice behavior was relatively close to the optimal strategy but also revealed small systematic biases that are consistent with the use of a reinforcement learning algorithm. In addition, the activity of neurons in the dorsal anterior cingulate cortex that was related to the reward received by the animal in a given trial often was modulated by the rewards in the previous trials. Some of these neurons encoded the rate of rewards in previous trials, whereas others displayed activity modulations more closely related to the reward prediction errors. In contrast, signals related to the animal's choices were represented only weakly in this cortical area. These results suggest that neurons in the dorsal anterior cingulate cortex might be involved in the subjective evaluation of choice outcomes based on the animal's reward history.

Key words: reinforcement learning; game theory; neuroeconomics; decision; dopamine; reward

---

Received Feb. 18, 2007; revised June 23, 2007; accepted June 25, 2007.

Correspondence should be addressed to Dr. Daeyeol Lee, Department of Neurobiology, Yale University School of Medicine, 333 Cedar Street, SHM B404, New Haven, CT 06510. Email: daeyeol.lee{at}yale.edu

This article has been cited by other articles:

				J. Glascher, A. N. Hampton, and J. P. O'Doherty Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making Cereb Cortex, June 11, 2008; (2008) bhn098v1. [Abstract] [Full Text] [PDF]

				M. F.S. RUSHWORTH Intention, Choice, and the Medial Frontal Cortex Ann. N.Y. Acad. Sci., March 1, 2008; 1124(1): 181 - 207. [Abstract] [Full Text] [PDF]

				J.-W. Sohn and D. Lee Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas J. Neurosci., December 12, 2007; 27(50): 13655 - 13666. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help