 |
|||||
|
|||||
|
|||||
|
|||||
|
|||||
The Journal of Neuroscience, February 18, 2004, 24(7):1660-1665; doi:10.1523/JNEUROSCI.3417-03.2004
Previous Article | Next Article
BRIEF COMMUNICATION
A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task
Masahiko Haruno,1 Tomoe Kuroda,1 Kenji Doya,1,2 Keisuke Toyama,3 Minoru Kimura,4 Kazuyuki Samejima,1,2 Hiroshi Imamizu,1 andMitsuo Kawato1 1Computational Neuroscience Laboratories, Advanced Telecommunications Research Institute, Kyoto 619-0288, Japan, 2Core Research for Evolutional Science and Technology, Japan Science and Technology Agency, Kyoto 619-0288, Japan, 3Shimadzu Technical Research Laboratory, Kyoto 619-0237, Japan, and 4Kyoto Prefectural University of Medicine, Kyoto 605-8566, Japan
Humans can acquire appropriate behaviors that maximize rewards on a trial-and-error basis. Recent electrophysiological and imaging studies have demonstrated that neural activity in the midbrain and ventral striatum encodes the error of reward prediction. However, it is yet to be examined whether the striatum is the main locus of reward-based behavioral learning. To address this, we conducted functional magnetic resonance imaging (fMRI) of a stochastic decision task involving monetary rewards, in which subjects had to learn behaviors involving different task difficulties that were controlled by probability. We performed a correlation analysis of fMRI data by using the explanatory variables derived from subject behaviors. We found that activity in the caudate nucleus was correlated with short-term reward and, furthermore, paralleled the magnitude of a subject's behavioral change during learning. In addition, we confirmed that this parallelism between learning and activity in the caudate nucleus is robustly maintained even when we vary task difficulty by controlling the probability. These findings suggest that the caudate nucleus is one of the main loci for reward-based behavioral learning.
Key words: basal ganglia; imaging; learning; motivation; reinforcement; reward
Received June 16, 2003; revised December 22, 2003; accepted December 23, 2003.
This article has been cited by other articles:
S. Palminteri, T. Boraud, G. Lafargue, B. Dubois, and M. Pessiglione
Brain Hemispheres Selectively Track the Expected Value of Contralateral Options
J. Neurosci., October 28, 2009; 29(43): 13465 - 13472.
[Abstract] [Full Text] [PDF]
K. Wunderlich, A. Rangel, and J. P. O'Doherty
Neural computations underlying action-based decision making in the human brain
PNAS, October 6, 2009; 106(40): 17199 - 17204.
[Abstract] [Full Text] [PDF]
A. Christakou, M. Brammer, V. Giampietro, and K. Rubia
Right Ventromedial and Dorsolateral Prefrontal Cortices Mediate Adaptive Decisions under Ambiguity by Integrating Choice Utility and Outcome Evaluation
J. Neurosci., September 2, 2009; 29(35): 11020 - 11028.
[Abstract] [Full Text] [PDF]
K. Tachibana, K. Suzuki, E. Mori, N. Miura, R. Kawashima, K. Horie, S. Sato, J. Tanji, and H. Mushiake
Neural Activity in the Human Brain Signals Logical Rule Identification
J Neurophysiol, September 1, 2009; 102(3): 1526 - 1537.
[Abstract] [Full Text] [PDF]
P. F. Rodriguez
Stimulus-outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing
Learn. Mem., April 29, 2009; 16(5): 324 - 331.
[Abstract] [Full Text] [PDF]
M. Haruno and M. Kawato
Activity in the Superior Temporal Sulcus Highlights Learning Competence in an Interaction Game
J. Neurosci., April 8, 2009; 29(14): 4542 - 4547.
[Abstract] [Full Text] [PDF]
T. Wachter, O. V. Lungu, T. Liu, D. T. Willingham, and J. Ashe
Differential Effect of Reward and Punishment on Procedural Learning
J. Neurosci., January 14, 2009; 29(2): 436 - 443.
[Abstract] [Full Text] [PDF]
P. Dayan and N. D. Daw
Decision theory, reinforcement learning, and the brain
Cogn Affect Behav Neurosci, December 1, 2008; 8(4): 429 - 453.
[Abstract] [PDF]
M. R. Delgado, A. Schotter, E. Y. Ozbay, and E. A. Phelps
Understanding Overbidding: Using the Neural Circuitry of Reward to Design Economic Auctions
Science, September 26, 2008; 321(5897): 1849 - 1852.
[Abstract] [Full Text] [PDF]
M. Kawato
From 'Understanding the Brain by Creating the Brain' towards manipulative neuroscience
Phil Trans R Soc B, June 27, 2008; 363(1500): 2201 - 2214.
[Abstract] [Full Text] [PDF]
M. X. COHEN
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125.
[Abstract] [PDF]
C. Bellebaum, B. Koch, M. Schwarz, and I. Daum
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Brain, March 1, 2008; 131(3): 829 - 841.
[Abstract] [Full Text] [PDF]
B. Lau and P. W. Glimcher
Action and Outcome Encoding in the Primate Caudate Nucleus
J. Neurosci., December 26, 2007; 27(52): 14502 - 14514.
[Abstract] [Full Text] [PDF]
B. W. Balleine, M. R. Delgado, and O. Hikosaka
The Role of the Dorsal Striatum in Reward and Decision-Making
J. Neurosci., August 1, 2007; 27(31): 8161 - 8165.
[Abstract] [Full Text] [PDF]
T. Lohrenz, K. McCabe, C. F. Camerer, and P. R. Montague
Neural signature of fictive learning signals in a sequential investment task
PNAS, May 29, 2007; 104(22): 9493 - 9498.
[Abstract] [Full Text] [PDF]
B. Seymour, N. Daw, P. Dayan, T. Singer, and R. Dolan
Differential Encoding of Losses and Gains in the Human Striatum
J. Neurosci., May 2, 2007; 27(18): 4826 - 4831.
[Abstract] [Full Text] [PDF]
C. Landmann, S. Dehaene, S. Pappata, A. Jobert, M. Bottlaender, D. Roumenov, and D. Le Bihan
Dynamics of Prefrontal and Cingulate Activity during a Reward-Based Logical Deduction Task
Cereb Cortex, April 1, 2007; 17(4): 749 - 759.
[Abstract] [Full Text] [PDF]
A. R. Hariri, S. M. Brown, D. E. Williamson, J. D. Flory, H. de Wit, and S. B. Manuck
Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity
J. Neurosci., December 20, 2006; 26(51): 13213 - 13217.
[Abstract] [Full Text] [PDF]
K. Nakamura and O. Hikosaka
Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate
J. Neurosci., December 13, 2006; 26(50): 12885 - 12895.
[Abstract] [Full Text] [PDF]
S. N. Haber, K.-S. Kim, P. Mailly, and R. Calzavara
Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning.
J. Neurosci., August 9, 2006; 26(32): 8368 - 8376.
[Abstract] [Full Text] [PDF]
A. Galvan, T. A. Hare, C. E. Parra, J. Penn, H. Voss, G. Glover, and B. J. Casey
Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents.
J. Neurosci., June 21, 2006; 26(25): 6885 - 6892.
[Abstract] [Full Text] [PDF]
O. Hikosaka, K. Nakamura, and H. Nakahara
Basal Ganglia Orient Eyes to Reward
J Neurophysiol, February 1, 2006; 95(2): 567 - 584.
[Abstract] [Full Text] [PDF]
M. Haruno and M. Kawato
Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning
J Neurophysiol, February 1, 2006; 95(2): 948 - 959.
[Abstract] [Full Text] [PDF]
L. K. Tremblay, C. A. Naranjo, S. J. Graham, N. Herrmann, H. S. Mayberg, S. Hevenor, and U. E. Busto
Functional Neuroanatomical Substrates of Altered Reward Processing in Major Depressive Disorder Revealed by a Dopaminergic Probe
Arch Gen Psychiatry, November 1, 2005; 62(11): 1228 - 1236.
[Abstract] [Full Text] [PDF]
A. Aron, H. Fisher, D. J. Mashek, G. Strong, H. Li, and L. L. Brown
Reward, Motivation, and Emotion Systems Associated With Early-Stage Intense Romantic Love
J Neurophysiol, July 1, 2005; 94(1): 327 - 337.
[Abstract] [Full Text] [PDF]
C. A. Seger and C. M. Cincotta
The Roles of the Caudate Nucleus in Human Classification Learning
J. Neurosci., March 16, 2005; 25(11): 2941 - 2951.
[Abstract] [Full Text] [PDF]
|
|
|
|
 |
|