QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, October 1, 2008, 28(40):10023-10030; doi:10.1523/JNEUROSCI.1400-08.2008

This Article Full Text Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Related articles in J. Neurosci. Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (7) Citing Articles via Google Scholar Google Scholar Articles by Belova, M. A. Articles by Salzman, C. D. Search for Related Content PubMed PubMed Citation Articles by Belova, M. A. Articles by Salzman, C. D.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Moment-to-Moment Tracking of State Value in the Amygdala

Marina A. Belova,^1 * Joseph J. Paton,^1 * and C. Daniel Salzman^1,2,3,4,5,6

Departments of ¹Neuroscience and ²Psychiatry, ³W. M. Keck Center on Brain Plasticity and Cognition, ⁴Kavli Institute for Brain Sciences, and ⁵Mahoney Center for Brain and Behavior, Columbia University Medical Center, and ⁶New York State Psychiatric Institute, New York, New York 10032

Correspondence should be addressed to C. Daniel Salzman, Departments of Psychiatry and Neuroscience, 1051 Riverside Drive, Unit 87, Kolb Research Building, New York State Psychiatric Institute, 5-67, New York, NY 10032. Email: cds2005{at}columbia.edu

As an organism interacts with the world, how good or bad things are at the moment, the value of the current state of the organism, is an important parameter that is likely to be encoded in the brain. As the environment changes and new stimuli appear, estimates of state value must be updated to support appropriate responses and learning. Indeed, many models of reinforcement learning posit representations of state value. We examined how the brain mediates this process by recording amygdala neural activity while monkeys performed a trace-conditioning task requiring fixation. The presentation of different stimuli induced state transitions; these stimuli included unconditioned stimuli (USs) (liquid rewards and aversive air puffs), newly learned reinforcement-predictive visual stimuli [conditioned stimuli (CSs)], and familiar stimuli long associated with reinforcement [fixation point (FP)]. The FP had a positive value to monkeys, because they chose to foveate it to initiate trials. Different populations of amygdala neurons tracked the positive or negative value of the current state, regardless of whether state transitions were caused by the FP, CSs, or USs. Positive value-coding neurons increased their firing during the fixation interval and fired more strongly after rewarded CSs and rewards than after punished CSs and air puffs. Negative value-coding neurons did the opposite, decreasing their firing during the fixation interval and firing more strongly after punished CSs and air puffs than after rewarded CSs and rewards. This representation of state value could underlie how the amygdala helps coordinate cognitive, emotional, and behavioral responses depending on the value of one's state.

Key words: amygdala; monkey; state value; reinforcement learning; reward; punishment

---

Received April 2, 2008; revised July 30, 2008; accepted Aug. 25, 2008.

Correspondence should be addressed to C. Daniel Salzman, Departments of Psychiatry and Neuroscience, 1051 Riverside Drive, Unit 87, Kolb Research Building, New York State Psychiatric Institute, 5-67, New York, NY 10032. Email: cds2005{at}columbia.edu

Related articles in J. Neurosci.:

This Week in The Journal

J. Neurosci. 2008 28: i. [Full Text]  

This article has been cited by other articles:

				T. V. Maia Reinforcement learning, conditioning, and the brain: Successes and challenges Cogn Affect Behav Neurosci, December 1, 2009; 9(4): 343 - 364. [Abstract] [PDF]

				C. A. Rabinak, C. A. Orsini, J. M. Zimmerman, and S. Maren The amygdala is not necessary for unconditioned stimulus inflation after Pavlovian fear conditioning in rats Learn. Mem., September 30, 2009; 16(10): 645 - 654. [Abstract] [Full Text] [PDF]

				S. E. Morrison and C. D. Salzman The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons J. Neurosci., September 16, 2009; 29(37): 11471 - 11483. [Abstract] [Full Text] [PDF]

				H. Seo, D. J. Barraclough, and D. Lee Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game J. Neurosci., June 3, 2009; 29(22): 7278 - 7289. [Abstract] [Full Text] [PDF]

				R. Kiani and M. N. Shadlen Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex Science, May 8, 2009; 324(5928): 759 - 764. [Abstract] [Full Text] [PDF]

				S. Ghods-Sharifi, J. R. St. Onge, and S. B. Floresco Fundamental Contribution by the Basolateral Amygdala to Different Forms of Decision Making J. Neurosci., April 22, 2009; 29(16): 5251 - 5259. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help