 |
|||||
|
|||||
|
|||||
|
|||||
|
|||||
The Journal of Neuroscience, September 13, 2006, 26(37):9530-9537; doi:10.1523/JNEUROSCI.2915-06.2006
Previous Article | Next Article
Cellular/Molecular
Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain
Juliana Yacubian,1 * Jan Gläscher,1 * Katrin Schroeder,2 Tobias Sommer,1 Dieter F. Braus,2 andChristian Büchel1 Departments of 1Systems Neuroscience and 2Psychiatry, NeuroImage Nord, University Medical Center Hamburg-Eppendorf, D-20246 Hamburg, Germany
Correspondence should be addressed to Christian Büchel, NeuroImage Nord, Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Building S10, Martinistrasse 52, D-20246 Hamburg, Germany. Email: buechel{at}uke.uni-hamburg.de
Midbrain dopaminergic neurons projecting to the ventral striatum code for reward magnitude and probability during reward anticipation and then indicate the difference between actual and predicted outcome. It has been questioned whether such a common system for the prediction and evaluation of reward exists in humans. Using functional magnetic resonance imaging and a guessing task in two large cohorts, we are able to confirm ventral striatal responses coding both reward probability and magnitude during anticipation, permitting the local computation of expected value (EV). However, the ventral striatum only represented the gain-related part of EV (EV+). At reward delivery, the same area shows a reward probability and magnitude-dependent prediction error signal, best modeled as the difference between actual outcome and EV+. In contrast, loss-related expected value (EV–) and the associated prediction error was represented in the amygdala. Thus, the ventral striatum and the amygdala distinctively process the value of a prediction and subsequently compute a prediction error for gains and losses, respectively. Therefore, a homeostatic balance of both systems might be important for generating adequate expectations under uncertainty. Prevalence of either part might render expectations more positive or negative, which could contribute to the pathophysiology of mood disorders like major depression.
Key words: amygdala; punishment; ventral striatum; prediction error; fMRI; dopaminergic
Received May 4, 2006; accepted July 28, 2006.
Correspondence should be addressed to Christian Büchel, NeuroImage Nord, Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Building S10, Martinistrasse 52, D-20246 Hamburg, Germany. Email: buechel{at}uke.uni-hamburg.de
This article has been cited by other articles:
S. Zhong, S. Israel, H. Xue, P. C. Sham, R. P. Ebstein, and S. H. Chew
A neurochemical approach to valuation sensitivity over gains and losses
Proc R Soc B, December 7, 2009; 276(1676): 4181 - 4188.
[Abstract] [Full Text] [PDF]
G. I. Christopoulos, P. N. Tobler, P. Bossaerts, R. J. Dolan, and W. Schultz
Neural Correlates of Value, Risk, and Risk Aversion Contributing to Decision Making under Risk
J. Neurosci., October 7, 2009; 29(40): 12574 - 12583.
[Abstract] [Full Text] [PDF]
A. Christakou, M. Brammer, V. Giampietro, and K. Rubia
Right Ventromedial and Dorsolateral Prefrontal Cortices Mediate Adaptive Decisions under Ambiguity by Integrating Choice Utility and Outcome Evaluation
J. Neurosci., September 2, 2009; 29(35): 11020 - 11028.
[Abstract] [Full Text] [PDF]
R. Reisenzein
Emotional Experience in the Computational Belief-Desire Theory of Emotion
Emotion Review, July 1, 2009; 1(3): 214 - 222.
[Abstract] [PDF]
M. X Cohen, N. Axmacher, D. Lenartz, C. E. Elger, V. Sturm, and T. E. Schlaepfer
Nuclei Accumbens Phase Synchrony Predicts Decision-Making Reversals Following Negative Feedback
J. Neurosci., June 10, 2009; 29(23): 7591 - 7598.
[Abstract] [Full Text] [PDF]
P. F. Rodriguez
Stimulus-outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing
Learn. Mem., April 29, 2009; 16(5): 324 - 331.
[Abstract] [Full Text] [PDF]
P. N. Tobler, G. I. Christopoulos, J. P. O'Doherty, R. J. Dolan, and W. Schultz
Risk-dependent reward value signal in human prefrontal cortex
PNAS, April 28, 2009; 106(17): 7185 - 7190.
[Abstract] [Full Text] [PDF]
C.-s. R. Li, H. H.-A. Chao, and T.-W. Lee
Neural Correlates of Speeded as Compared with Delayed Responses in a Stop Signal Task: An Indirect Analog of Risk Taking and Association with an Anxiety Trait
Cereb Cortex, April 1, 2009; 19(4): 839 - 848.
[Abstract] [Full Text] [PDF]
B. De Martino, D. Kumaran, B. Holt, and R. J. Dolan
The Neurobiology of Reference-Dependent Value Computation
J. Neurosci., March 25, 2009; 29(12): 3833 - 3842.
[Abstract] [Full Text] [PDF]
L. Gregorios-Pippas, P. N. Tobler, and W. Schultz
Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum
J Neurophysiol, March 1, 2009; 101(3): 1507 - 1523.
[Abstract] [Full Text] [PDF]
M. Hsu, I. Krajbich, C. Zhao, and C. F. Camerer
Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities
J. Neurosci., February 18, 2009; 29(7): 2231 - 2237.
[Abstract] [Full Text] [PDF]
D. H. Zald, R. L. Cowan, P. Riccardi, R. M. Baldwin, M. S. Ansari, R. Li, E. S. Shelby, C. E. Smith, M. McHugo, and R. M. Kessler
Midbrain Dopamine Receptor Availability Is Inversely Associated with Novelty-Seeking Traits in Humans
J. Neurosci., December 31, 2008; 28(53): 14372 - 14378.
[Abstract] [Full Text] [PDF]
M. R Delgado, J. Li, D. Schiller, and E. A Phelps
The role of the striatum in aversive learning and aversive prediction errors
Phil Trans R Soc B, December 12, 2008; 363(1511): 3787 - 3800.
[Abstract] [Full Text] [PDF]
M. d'Acremont and P. Bossaerts
Neurobiological studies of risk assessment: A comparison of expected utility and mean-variance approaches
Cogn Affect Behav Neurosci, December 1, 2008; 8(4): 363 - 374.
[Abstract] [PDF]
P. N. Tobler, A. Kalis, and T. Kalenscher
The role of moral utility in decision making: An interdisciplinary framework
Cogn Affect Behav Neurosci, December 1, 2008; 8(4): 390 - 401.
[Abstract] [PDF]
A. Kalis, A. Mojzisch, T. S. Schweizer, and S. Kaiser
Weakness of will, akrasia, and the neuropsychiatry of decision making: An interdisciplinary perspective
Cogn Affect Behav Neurosci, December 1, 2008; 8(4): 402 - 417.
[Abstract] [PDF]
D. Schiller, I. Levy, Y. Niv, J. E. LeDoux, and E. A. Phelps
From Fear to Safety and Back: Reversal of Fear in the Human Brain
J. Neurosci., November 5, 2008; 28(45): 11517 - 11525.
[Abstract] [Full Text] [PDF]
P. N. Tobler, G. I. Christopoulos, J. P. O'Doherty, R. J. Dolan, and W. Schultz
Neuronal Distortions of Reward Probability without Choice
J. Neurosci., November 5, 2008; 28(45): 11703 - 11711.
[Abstract] [Full Text] [PDF]
K. Koch, C. Schachtzabel, G. Wagner, J. R. Reichenbach, H. Sauer, and R. Schlosser
The neural correlates of reward-related trial-and-error learning: An fMRI study with a probabilistic learning task
Learn. Mem., October 2, 2008; 15(10): 728 - 732.
[Abstract] [Full Text] [PDF]
M. X. COHEN
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125.
[Abstract] [PDF]
T. A. Hare, J. O'Doherty, C. F. Camerer, W. Schultz, and A. Rangel
Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors
J. Neurosci., May 28, 2008; 28(22): 5623 - 5630.
[Abstract] [Full Text] [PDF]
F. Eippert, U. Bingel, E. Schoell, J. Yacubian, and C. Buchel
Blockade of Endogenous Opioid Neurotransmission Enhances Acquisition of Conditioned Fear in Humans
J. Neurosci., May 21, 2008; 28(21): 5465 - 5472.
[Abstract] [Full Text] [PDF]
E. C. Finger, A. A. Marsh, D. G. Mitchell, M. E. Reid, C. Sims, S. Budhani, D. S. Kosson, G. Chen, K. E. Towbin, E. Leibenluft, et al.
Abnormal Ventromedial Prefrontal Cortex Function in Children With Psychopathic Traits During Reversal Learning
Arch Gen Psychiatry, May 1, 2008; 65(5): 586 - 594.
[Abstract] [Full Text] [PDF]
E. Z. Wheeler and L. K. Fellows
The human ventromedial frontal lobe is critical for learning from negative feedback
Brain, May 1, 2008; 131(5): 1323 - 1331.
[Abstract] [Full Text] [PDF]
C. A. Hutcherson, P. R. Goldin, W. Ramel, K. McRae, and J. J. Gross
Attention and emotion influence the relationship between extraversion and neural response
Soc Cogn Affect Neurosci, March 1, 2008; 3(1): 71 - 79.
[Abstract] [Full Text] [PDF]
E. T. Rolls, C. McCabe, and J. Redoute
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task
Cereb Cortex, March 1, 2008; 18(3): 652 - 663.
[Abstract] [Full Text] [PDF]
C. Bellebaum, B. Koch, M. Schwarz, and I. Daum
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Brain, March 1, 2008; 131(3): 829 - 841.
[Abstract] [Full Text] [PDF]
D. J. Scott, C. S. Stohler, C. M. Egnatuk, H. Wang, R. A. Koeppe, and J.-K. Zubieta
Placebo and Nocebo Effects Are Defined by Opposite Opioid and Dopaminergic Responses
Arch Gen Psychiatry, February 1, 2008; 65(2): 220 - 231.
[Abstract] [Full Text] [PDF]
C. A. Boettiger, J. M. Mitchell, V. C. Tavares, M. Robertson, G. Joslyn, M. D'Esposito, and H. L. Fields
Immediate Reward Bias in Humans: Fronto-Parietal Networks and a Role for the Catechol-O-Methyltransferase 158Val/Val Genotype
J. Neurosci., December 26, 2007; 27(52): 14383 - 14391.
[Abstract] [Full Text] [PDF]
R. E. Gur, J. Loughead, C. G. Kohler, M. A. Elliott, K. Lesko, K. Ruparel, D. H. Wolf, W. B. Bilker, and R. C. Gur
Limbic Activation Associated With Misidentification of Fearful Faces and Flat Affect in Schizophrenia
Arch Gen Psychiatry, December 1, 2007; 64(12): 1356 - 1366.
[Abstract] [Full Text] [PDF]
D. T. Gilbert and T. D. Wilson
Prospection: Experiencing the Future
Science, September 7, 2007; 317(5843): 1351 - 1354.
[Abstract] [Full Text] [PDF]
B. H. Schott, L. Niehaus, B. C. Wittmann, H. Schutze, C. I. Seidenbecher, H.-J. Heinze, and E. Duzel
Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing
Brain, September 1, 2007; 130(9): 2412 - 2424.
[Abstract] [Full Text] [PDF]
B. Knutson and P. Bossaerts
Neural Antecedents of Financial Decisions
J. Neurosci., August 1, 2007; 27(31): 8174 - 8177.
[Abstract] [Full Text] [PDF]
S. Bray, S. Shimojo, and J. P. O'Doherty
Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback
J. Neurosci., July 11, 2007; 27(28): 7498 - 7507.
[Abstract] [Full Text] [PDF]
J. Yacubian, T. Sommer, K. Schroeder, J. Glascher, R. Kalisch, B. Leuenberger, D. F. Braus, and C. Buchel
Gene gene interaction associated with neural reward sensitivity
PNAS, May 8, 2007; 104(19): 8125 - 8130.
[Abstract] [Full Text] [PDF]
B. Seymour, N. Daw, P. Dayan, T. Singer, and R. Dolan
Differential Encoding of Losses and Gains in the Human Striatum
J. Neurosci., May 2, 2007; 27(18): 4826 - 4831.
[Abstract] [Full Text] [PDF]
S. M. Tom, C. R. Fox, C. Trepel, and R. A. Poldrack
The Neural Basis of Loss Aversion in Decision-Making Under Risk
Science, January 26, 2007; 315(5811): 515 - 518.
[Abstract] [Full Text] [PDF]
|
|
|
|
 |
|