 |
Previous Article | Next Article 
The Journal of Neuroscience, June 1, 2002, 22(11):4563-4567
Defining the Neural Mechanisms of Probabilistic Reversal Learning
Using Event-Related Functional Magnetic Resonance Imaging
Roshan
Cools1,
Luke
Clark1,
Adrian M.
Owen2, and
Trevor W.
Robbins1
1 Department of Experimental Psychology, University of
Cambridge, Cambridge CB2 3EB, United Kingdom, and
2 Medical Research Council Cognition and Brain
Sciences Unit, Cambridge CB2 2EF, United Kingdom
Event-related functional magnetic resonance imaging was used to
measure blood oxygenation level-dependent responses in 13 young healthy
human volunteers during performance of a probabilistic reversal-learning task. The task allowed the separate investigation of
the relearning of stimulus-reward associations and the reception of
negative feedback. Significant signal change in the right ventrolateral prefrontal cortex was demonstrated on trials when subjects stopped responding to the previously relevant stimulus and shifted responding to the newly relevant stimulus. Significant signal change in the region
of the ventral striatum was also observed on such reversal errors, from
a region of interest analysis. The ventrolateral prefrontal cortex and
ventral striatum were not significantly activated by the other,
preceding reversal errors, or when subjects received negative feedback
for correct responses. Moreover, the response on the final reversal
error, before shifting, was not modulated by the number of preceding
reversal errors, indicating that error-related activity does not simply
accumulate in this network. The signal change in this ventral
frontostriatal circuit is therefore associated with reversal learning
and is uncontaminated by negative feedback. Overall, these data concur
with findings in rodents and nonhuman primates of reversal-learning
deficits after damage to ventral frontostriatal circuitry, and also
support recent clinical findings using this task.
Key words:
reversal shifting; brain imaging; ventrolateral PFC; VS; probabilistic learning; inhibitory control
Copyright © 2002 Society for Neuroscience 0270-6474/02/22114563-05$05.00/0
This article has been cited by other articles:

|
 |

|
 |
 
S. B. R. E. Brown and K. R. Ridderinkhof
Aging and the neuroeconomics of decision making: A review
Cogn Affect Behav Neurosci,
December 1, 2009;
9(4):
365 - 379.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. G. Ghahremani, J. Monterosso, J. D. Jentsch, R. M. Bilder, and R. A. Poldrack
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Cereb Cortex,
November 13, 2009;
(2009)
bhp247v1.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
L. K. Krugel, G. Biele, P. N. C. Mohr, S.-C. Li, and H. R. Heekeren
Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions
PNAS,
October 20, 2009;
106(42):
17951 - 17956.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. G. V. Mitchell, Q. Luo, S. B. Avny, T. Kasprzycki, K. Gupta, G. Chen, E. C. Finger, and R. J. R. Blair
Adapting to Dynamic Stimulus-Response Values: Differential Contributions of Inferior Frontal, Dorsomedial, and Dorsolateral Regions of Prefrontal Cortex to Decision Making
J. Neurosci.,
September 2, 2009;
29(35):
10827 - 10834.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. Tachibana, K. Suzuki, E. Mori, N. Miura, R. Kawashima, K. Horie, S. Sato, J. Tanji, and H. Mushiake
Neural Activity in the Human Brain Signals Logical Rule Identification
J Neurophysiol,
September 1, 2009;
102(3):
1526 - 1537.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Jocham, J. Neumann, T. A. Klein, C. Danielmeier, and M. Ullsperger
Adaptive Coding of Action Values in the Human Rostral Cingulate Zone
J. Neurosci.,
June 10, 2009;
29(23):
7489 - 7496.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. X Cohen, N. Axmacher, D. Lenartz, C. E. Elger, V. Sturm, and T. E. Schlaepfer
Nuclei Accumbens Phase Synchrony Predicts Decision-Making Reversals Following Negative Feedback
J. Neurosci.,
June 10, 2009;
29(23):
7591 - 7598.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Elliott, Z. Agnew, and J.F.W. Deakin
Hedonic and Informational Functions of the Human Orbitofrontal Cortex
Cereb Cortex,
May 12, 2009;
(2009)
bhp092v1.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. D. Walsh and M. L. Phillips
Interacting Outcome Retrieval, Anticipation, and Feedback Processes in the Human Brain
Cereb Cortex,
May 8, 2009;
(2009)
bhp098v1.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. S. Lawrence, F. Jollant, O. O'Daly, F. Zelaya, and M. L. Phillips
Distinct Roles of Prefrontal Cortical Subregions in the Iowa Gambling Task
Cereb Cortex,
May 1, 2009;
19(5):
1134 - 1143.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Jocham, T. A. Klein, J. Neumann, D. Y. von Cramon, M. Reuter, and M. Ullsperger
Dopamine DRD2 Polymorphism Alters Reversal Learning and Associated Neural Activity
J. Neurosci.,
March 25, 2009;
29(12):
3695 - 3704.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Kazama and J. Bachevalier
Selective Aspiration or Neurotoxic Lesions of Orbital Frontal Areas 11 and 13 Spared Monkeys' Performance on the Object Discrimination Reversal Task
J. Neurosci.,
March 4, 2009;
29(9):
2794 - 2804.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Glascher, A. N. Hampton, and J. P. O'Doherty
Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making
Cereb Cortex,
February 1, 2009;
19(2):
483 - 495.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
L. Passamonti, J. B. Rowe, C. Schwarzbauer, M. P. Ewbank, E. von dem Hagen, and A. J. Calder
Personality Predicts the Brain's Response to Viewing Appetizing Foods: The Neural Basis of a Risk Factor for Overeating
J. Neurosci.,
January 7, 2009;
29(1):
43 - 51.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. D. Ragland, R. Cools, M. Frank, D. A. Pizzagalli, A. Preston, C. Ranganath, and A. D. Wagner
CNTRICS Final Task Selection: Long-Term Memory
Schizophr Bull,
January 1, 2009;
35(1):
197 - 212.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. M. Barch, T. S. Braver, C. S. Carter, R. A. Poldrack, and T. W. Robbins
CNTRICS Final Task Selection: Executive Control
Schizophr Bull,
January 1, 2009;
35(1):
115 - 135.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. Schiller, I. Levy, Y. Niv, J. E. LeDoux, and E. A. Phelps
From Fear to Safety and Back: Reversal of Fear in the Human Brain
J. Neurosci.,
November 5, 2008;
28(45):
11517 - 11525.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Xue, D. G. Ghahremani, and R. A. Poldrack
Neural Substrates for Reversing Stimulus-Outcome and Stimulus-Response Associations
J. Neurosci.,
October 29, 2008;
28(44):
11196 - 11204.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. F. Clarke, T. W. Robbins, and A. C. Roberts
Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments during Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex
J. Neurosci.,
October 22, 2008;
28(43):
10972 - 10982.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
T. J.R Beveridge, K. E Gill, C. A Hanlon, and L. J Porrino
Parallel studies of cocaine-related neural and cognitive impairment in humans and monkeys
Phil Trans R Soc B,
October 12, 2008;
363(1507):
3257 - 3266.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. M. Gold, J. A. Waltz, K. J. Prentice, S. E. Morris, and E. A. Heerey
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Schizophr Bull,
September 1, 2008;
34(5):
835 - 847.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. K. Murray, F. Cheng, L. Clark, J. H. Barnett, A. D. Blackwell, P. C. Fletcher, T. W. Robbins, E. T. Bullmore, and P. B. Jones
Reinforcement and Reversal Learning in First-Episode Psychosis
Schizophr Bull,
September 1, 2008;
34(5):
848 - 855.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R.J.R Blair
The amygdala and ventromedial prefrontal cortex: functional contributions and dysfunction in psychopathy
Phil Trans R Soc B,
August 12, 2008;
363(1503):
2557 - 2565.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. B. Rowe, L. Hughes, B. C. P. Ghosh, D. Eckstein, C. H. Williams-Gray, S. Fallon, R. A. Barker, and A. M. Owen
Parkinson's disease and dopaminergic therapy--differential effects on movement, reward and cognition
Brain,
August 1, 2008;
131(8):
2094 - 2105.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. M. Dodds, U. Muller, L. Clark, A. van Loon, R. Cools, and T. W. Robbins
Methylphenidate Has Differential Effects on Blood Oxygenation Level-Dependent Signal Related to Cognitive Subprocesses of Reversal Learning
J. Neurosci.,
June 4, 2008;
28(23):
5976 - 5982.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. X. COHEN
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cogn Affect Behav Neurosci,
June 1, 2008;
8(2):
113 - 125.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
E. C. Finger, A. A. Marsh, D. G. Mitchell, M. E. Reid, C. Sims, S. Budhani, D. S. Kosson, G. Chen, K. E. Towbin, E. Leibenluft, et al.
Abnormal Ventromedial Prefrontal Cortex Function in Children With Psychopathic Traits During Reversal Learning
Arch Gen Psychiatry,
May 1, 2008;
65(5):
586 - 594.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Valerius, A. Lumpp, A.-K. Kuelz, T. Freyer, and U. Voderholzer
Reversal Learning as a Neuropsychological Indicator for the Neuropathology of Obsessive Compulsive Disorder? A Behavioral Study
J Neuropsychiatry Clin Neurosci,
May 1, 2008;
20(2):
210 - 218.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. M. McIntosh, H. C. Whalley, J. McKirdy, J. Hall, J. E. D. Sussmann, P. Shankar, E. C. Johnstone, and S. M. Lawrie
Prefrontal Function and Activation in Bipolar Disorder and Schizophrenia
Am J Psychiatry,
March 1, 2008;
165(3):
378 - 384.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. Bellebaum, B. Koch, M. Schwarz, and I. Daum
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Brain,
March 1, 2008;
131(3):
829 - 841.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. H. Williams-Gray, A. Hampshire, R. A. Barker, and A. M. Owen
Attentional control in Parkinson's disease is dependent on COMT val158met genotype
Brain,
February 1, 2008;
131(2):
397 - 408.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
B. J. Hallam, N. D. Silverberg, A. K. LaMarre, I. R. A. Mackenzie, and H. H. Feldman
Clinical Presentation of Prodromal Frontotemporal Dementia
American Journal of Alzheimer's Disease and Other Dementias,
January 1, 2008;
22(6):
456 - 467.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T. A. Klein, J. Neumann, M. Reuter, J. Hennig, D. Y. von Cramon, and M. Ullsperger
Genetically Determined Differences in Learning from Errors
Science,
December 7, 2007;
318(5856):
1642 - 1645.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Wingen, K.P.C. Kuypers, and J.G. Ramaekers
Selective verbal and spatial memory impairment after 5-HT1A and 5-HT2A receptor blockade in healthy volunteers pre-treated with an SSRI
J Psychopharmacol,
July 1, 2007;
21(5):
477 - 485.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T.W Robbins
Shifting and stopping: fronto-striatal substrates, neurochemical modulation and clinical implications
Phil Trans R Soc B,
May 29, 2007;
362(1481):
917 - 932.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
X. Liu, D. K. Powell, H. Wang, B. T. Gold, C. R. Corbly, and J. E. Joseph
Functional Dissociation in Frontal and Striatal Areas for Processing of Positive and Negative Reward Information
J. Neurosci.,
April 25, 2007;
27(17):
4587 - 4597.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. N. Hampton and J. P. O'Doherty
Decoding the neural substrates of reward-related decision making with functional MRI
PNAS,
January 23, 2007;
104(4):
1377 - 1382.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Hampshire and A. M. Owen
Fractionating Attentional Control Using Event-Related fMRI
Cereb Cortex,
December 1, 2006;
16(12):
1679 - 1689.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. L. Remijnse, M. M. A. Nielen, A. J. L. M. van Balkom, D. C. Cath, P. van Oppen, H. B. M. Uylings, and D. J. Veltman
Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder.
Arch Gen Psychiatry,
November 1, 2006;
63(11):
1225 - 1236.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. I. Hooker, L. T. Germine, R. T. Knight, and M. D'Esposito
Amygdala response to facial expressions reflects emotional learning.
J. Neurosci.,
August 30, 2006;
26(35):
8915 - 8922.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. N. Hampton, P. Bossaerts, and J. P. O'Doherty
The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans.
J. Neurosci.,
August 9, 2006;
26(32):
8360 - 8367.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. A. Crone, C. Wendelken, S. E. Donohue, and S. A. Bunge
Neural Evidence for Dissociable Components of Task-switching
Cereb Cortex,
April 1, 2006;
16(4):
475 - 486.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
T. Gorrindo, R.J.R. Blair, S. Budhani, D. P. Dickstein, D. S. Pine, and E. Leibenluft
Deficits on a Probabilistic Response-Reversal Task in Patients With Pediatric Bipolar Disorder
Am J Psychiatry,
October 1, 2005;
162(10):
1975 - 1977.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. D. Barber and C. S. Carter
Cognitive Control Involved in Overcoming Prepotent Response Tendencies and Switching Between Tasks
Cereb Cortex,
July 1, 2005;
15(7):
899 - 912.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. A. Seger and C. M. Cincotta
The Roles of the Caudate Nucleus in Human Classification Learning
J. Neurosci.,
March 16, 2005;
25(11):
2941 - 2951.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. E. Longworth, S. E. Keenan, R. A. Barker, W. D. Marslen-Wilson, and L. K. Tyler
The basal ganglia and rule-governed language use: evidence from vascular and degenerative conditions
Brain,
March 1, 2005;
128(3):
584 - 596.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
Y Nagahama, T Okina, N Suzuki, H Nabatame, and M Matsuda
The cerebral correlates of different types of perseveration in the Wisconsin Card Sorting Test
J. Neurol. Neurosurg. Psychiatry,
February 1, 2005;
76(2):
169 - 175.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Deco and E. T. Rolls
Synaptic and Spiking Dynamics underlying Reward Reversal in the Orbitofrontal Cortex
Cereb Cortex,
January 1, 2005;
15(1):
15 - 30.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. R. Ridderinkhof, M. Ullsperger, E. A. Crone, and S. Nieuwenhuis
The Role of the Medial Frontal Cortex in Cognitive Control
Science,
October 15, 2004;
306(5695):
443 - 447.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. C. Turner, M. R.F. Aitken, D. R. Shanks, B. J. Sahakian, T. W. Robbins, C. Schwarzbauer, and P. C. Fletcher
The Role of the Lateral Frontal Cortex in Causal Associative Learning: Exploring Preventative and Super-learning
Cereb Cortex,
August 1, 2004;
14(8):
872 - 880.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. R. Aron, S. Monsell, B. J. Sahakian, and T. W. Robbins
A componential analysis of task-switching deficits associated with lesions of left and right frontal cortex
Brain,
July 1, 2004;
127(7):
1561 - 1573.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Cools, L. Clark, and T. W. Robbins
Differential Responses in Human Striatum and Prefrontal Cortex to Changes in Object and Rule Relevance
J. Neurosci.,
February 4, 2004;
24(5):
1129 - 1135.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Pears, J. A. Parkinson, L. Hopewell, B. J. Everitt, and A. C. Roberts
Lesions of the Orbitofrontal but not Medial Prefrontal Cortex Disrupt Conditioned Reinforcement in Primates
J. Neurosci.,
December 3, 2003;
23(35):
11189 - 11201.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. O'Doherty, H. Critchley, R. Deichmann, and R. J. Dolan
Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices
J. Neurosci.,
August 27, 2003;
23(21):
7931 - 7939.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
L. K. Fellows and M. J. Farah
Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm
Brain,
August 1, 2003;
126(8):
1830 - 1837.
[Abstract]
[Full Text]
[PDF]
|
 |
|
|

|