QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, February 18, 2004, 24(7):1660-1665; doi:10.1523/JNEUROSCI.3417-03.2004

This Article Full Text Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (58) Citing Articles via Google Scholar Google Scholar Articles by Haruno, M. Articles by Kawato, M. Search for Related Content PubMed PubMed Citation Articles by Haruno, M. Articles by Kawato, M.

 Previous Article  |  Next Article 

BRIEF COMMUNICATION
A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task

Masahiko Haruno,¹ Tomoe Kuroda,¹ Kenji Doya,^1,2 Keisuke Toyama,³ Minoru Kimura,⁴ Kazuyuki Samejima,^1,2 Hiroshi Imamizu,¹ and Mitsuo Kawato¹

¹Computational Neuroscience Laboratories, Advanced Telecommunications Research Institute, Kyoto 619-0288, Japan, ²Core Research for Evolutional Science and Technology, Japan Science and Technology Agency, Kyoto 619-0288, Japan, ³Shimadzu Technical Research Laboratory, Kyoto 619-0237, Japan, and ⁴Kyoto Prefectural University of Medicine, Kyoto 605-8566, Japan

Humans can acquire appropriate behaviors that maximize rewards on a trial-and-error basis. Recent electrophysiological and imaging studies have demonstrated that neural activity in the midbrain and ventral striatum encodes the error of reward prediction. However, it is yet to be examined whether the striatum is the main locus of reward-based behavioral learning. To address this, we conducted functional magnetic resonance imaging (fMRI) of a stochastic decision task involving monetary rewards, in which subjects had to learn behaviors involving different task difficulties that were controlled by probability. We performed a correlation analysis of fMRI data by using the explanatory variables derived from subject behaviors. We found that activity in the caudate nucleus was correlated with short-term reward and, furthermore, paralleled the magnitude of a subject's behavioral change during learning. In addition, we confirmed that this parallelism between learning and activity in the caudate nucleus is robustly maintained even when we vary task difficulty by controlling the probability. These findings suggest that the caudate nucleus is one of the main loci for reward-based behavioral learning.

Key words: basal ganglia; imaging; learning; motivation; reinforcement; reward

---

Received June 16, 2003; revised December 22, 2003; accepted December 23, 2003.

This article has been cited by other articles:

				C. Bellebaum, B. Koch, M. Schwarz, and I. Daum Focal basal ganglia lesions are associated with impairments in reward-based reversal learning Brain, March 1, 2008; 131(3): 829 - 841. [Abstract] [Full Text] [PDF]

				B. Lau and P. W. Glimcher Action and Outcome Encoding in the Primate Caudate Nucleus J. Neurosci., December 26, 2007; 27(52): 14502 - 14514. [Abstract] [Full Text] [PDF]

				B. W. Balleine, M. R. Delgado, and O. Hikosaka The Role of the Dorsal Striatum in Reward and Decision-Making J. Neurosci., August 1, 2007; 27(31): 8161 - 8165. [Abstract] [Full Text] [PDF]

				T. Lohrenz, K. McCabe, C. F. Camerer, and P. R. Montague Neural signature of fictive learning signals in a sequential investment task PNAS, May 29, 2007; 104(22): 9493 - 9498. [Abstract] [Full Text] [PDF]

				B. Seymour, N. Daw, P. Dayan, T. Singer, and R. Dolan Differential Encoding of Losses and Gains in the Human Striatum J. Neurosci., May 2, 2007; 27(18): 4826 - 4831. [Abstract] [Full Text] [PDF]

				C. Landmann, S. Dehaene, S. Pappata, A. Jobert, M. Bottlaender, D. Roumenov, and D. Le Bihan Dynamics of Prefrontal and Cingulate Activity during a Reward-Based Logical Deduction Task Cereb Cortex, April 1, 2007; 17(4): 749 - 759. [Abstract] [Full Text] [PDF]

				C. M. Cincotta and C. A. Seger Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation. J. Cogn. Neurosci., February 1, 2007; 19(2): 249 - 265. [Abstract] [Full Text] [PDF]

				Y. Sakai and T. Fukai The Actor-Critic Learning Is Behind the Matching Law: Matching Versus Optimal Behaviors Neural Comput., January 1, 2007; 20(1): 227 - 251. [Abstract] [Full Text] [PDF]

				A. R. Hariri, S. M. Brown, D. E. Williamson, J. D. Flory, H. de Wit, and S. B. Manuck Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity J. Neurosci., December 20, 2006; 26(51): 13213 - 13217. [Abstract] [Full Text] [PDF]

				K. Nakamura and O. Hikosaka Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate J. Neurosci., December 13, 2006; 26(50): 12885 - 12895. [Abstract] [Full Text] [PDF]

				S. N. Haber, K.-S. Kim, P. Mailly, and R. Calzavara Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning. J. Neurosci., August 9, 2006; 26(32): 8368 - 8376. [Abstract] [Full Text] [PDF]

				A. Galvan, T. A. Hare, C. E. Parra, J. Penn, H. Voss, G. Glover, and B. J. Casey Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J. Neurosci., June 21, 2006; 26(25): 6885 - 6892. [Abstract] [Full Text] [PDF]

				E. Tricomi, M. R. Delgado, B. D. McCandliss, J. L. McClelland, and J. A. Fiez Performance feedback drives caudate activation in a phonological learning task. J. Cogn. Neurosci., June 1, 2006; 18(6): 1029 - 1043. [Abstract] [Full Text] [PDF]

				O. Hikosaka, K. Nakamura, and H. Nakahara Basal Ganglia Orient Eyes to Reward J Neurophysiol, February 1, 2006; 95(2): 567 - 584. [Abstract] [Full Text] [PDF]

				M. Haruno and M. Kawato Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning J Neurophysiol, February 1, 2006; 95(2): 948 - 959. [Abstract] [Full Text] [PDF]

				L. K. Tremblay, C. A. Naranjo, S. J. Graham, N. Herrmann, H. S. Mayberg, S. Hevenor, and U. E. Busto Functional Neuroanatomical Substrates of Altered Reward Processing in Major Depressive Disorder Revealed by a Dopaminergic Probe Arch Gen Psychiatry, November 1, 2005; 62(11): 1228 - 1236. [Abstract] [Full Text] [PDF]

				A. Aron, H. Fisher, D. J. Mashek, G. Strong, H. Li, and L. L. Brown Reward, Motivation, and Emotion Systems Associated With Early-Stage Intense Romantic Love J Neurophysiol, July 1, 2005; 94(1): 327 - 337. [Abstract] [Full Text] [PDF]

				C. A. Seger and C. M. Cincotta The Roles of the Caudate Nucleus in Human Classification Learning J. Neurosci., March 16, 2005; 25(11): 2941 - 2951. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help