QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, June 3, 2009, 29(22):7278-7289; doi:10.1523/JNEUROSCI.1479-09.2009

This Article Full Text Full Text (PDF) Supplemental Data Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Seo, H. Articles by Lee, D. Search for Related Content PubMed PubMed Citation Articles by Seo, H. Articles by Lee, D.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game

Hyojung Seo,^1 * Dominic J. Barraclough,^2 * and Daeyeol Lee¹

¹Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut 06510, and ²Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester, Rochester, New York 14627

Correspondence should be addressed to Dr. Daeyeol Lee, Department of Neurobiology, Yale University School of Medicine, 333 Cedar Street, Sterling Hall of Medicine B404, New Haven, CT 06510. Email: daeyeol.lee{at}yale.edu

Activity of the neurons in the lateral intraparietal cortex (LIP) displays a mixture of sensory, motor, and memory signals. Moreover, they often encode signals reflecting the accumulation of sensory evidence that certain eye movements might lead to a desirable outcome. However, when the environment changes dynamically, animals are also required to combine the information about its previously chosen actions and their outcomes appropriately to update continually the desirabilities of alternative actions. Here, we investigated whether LIP neurons encoded signals necessary to update an animal's decision-making strategies adaptively during a computer-simulated matching-pennies game. Using a reinforcement learning algorithm, we estimated the value functions that best predicted the animal's choices on a trial-by-trial basis. We found that, immediately before the animal revealed its choice, 18% of LIP neurons changed their activity according to the difference in the value functions for the two targets. In addition, a somewhat higher fraction of LIP neurons displayed signals related to the sum of the value functions, which might correspond to the state value function or an average rate of reward used as a reference point. Similar to the neurons in the prefrontal cortex, many LIP neurons also encoded the signals related to the animal's previous choices. Thus, the posterior parietal cortex might be a part of the network that provides the substrate for forming appropriate associations between actions and outcomes.

---

Received March 28, 2009; revised May 4, 2009; accepted May 6, 2009.

Correspondence should be addressed to Dr. Daeyeol Lee, Department of Neurobiology, Yale University School of Medicine, 333 Cedar Street, Sterling Hall of Medicine B404, New Haven, CT 06510. Email: daeyeol.lee{at}yale.edu

This article has been cited by other articles:

				H. Kim, J. H. Sul, N. Huh, D. Lee, and M. W. Jung Role of Striatum in Updating Values of Chosen Actions J. Neurosci., November 25, 2009; 29(47): 14701 - 14712. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help