QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, November 12, 2003, 23(32):10402-10410

This Article Full Text Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (53) Citing Articles via Google Scholar Google Scholar Articles by Tobler, P. N. Articles by Schultz, W. Search for Related Content PubMed PubMed Citation Articles by Tobler, P. N. Articles by Schultz, W.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm

Philippe N. Tobler,¹ Anthony Dickinson,² and Wolfram Schultz¹

¹Department of Anatomy, University of Cambridge, Cambridge CB2 3DY, United Kingdom, and Institute of Physiology, University of Fribourg, 1700 Fribourg, Switzerland, and ²Department of Experimental Psychology, University of Cambridge, Cambridge CB2 3EB, United Kingdom

Animals learn not only about stimuli that predict reward but also about those that signal the omission of an expected reward. We used a conditioned inhibition paradigm derived from animal learning theory to train a discrimination between a visual stimulus that predicted reward (conditioned excitor) and a second stimulus that predicted the omission of reward (conditioned inhibitor). Performing the discrimination required attention to both the conditioned excitor and the inhibitor; however, dopamine neurons showed very different responses to the two classes of stimuli. Conditioned inhibitors elicited considerable depressions in 48 of 69 neurons (median of 35% below baseline) and minor activations in 29 of 69 neurons (69% above baseline), whereas reward-predicting excitors induced pure activations in all 69 neurons tested (242% above baseline), thereby demonstrating that the neurons discriminated between conditioned stimuli predicting reward versus nonreward. The discriminative responses to stimuli with differential reward-predicting but common attentional functions indicate differential neural coding of reward prediction and attention. The neuronal responses appear to reflect reward prediction errors, thus suggesting an extension of the correspondence between learning theory and activity of single dopamine neurons to the prediction of nonreward.

Key words: dopamine; reward; attention; prediction error; inhibition; learning theory

---

Received June 16, 2003; revised September 17, 2003; accepted September 19, 2003.

This article has been cited by other articles:

				W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland Tripartite Mechanism of Extinction Suggested by Dopamine Neuron Activity and Temporal Difference Model J. Neurosci., September 24, 2008; 28(39): 9619 - 9631. [Abstract] [Full Text] [PDF]

				S. Kobayashi and W. Schultz Influence of Reward Delays on Responses of Dopamine Neurons J. Neurosci., July 30, 2008; 28(31): 7837 - 7846. [Abstract] [Full Text] [PDF]

				H. Ji and P. D. Shepard Lateral Habenula Stimulation Inhibits Rat Midbrain Dopamine Neurons through a GABAA Receptor-Mediated Mechanism J. Neurosci., June 27, 2007; 27(26): 6923 - 6930. [Abstract] [Full Text] [PDF]

				A. J. Wills, A. Lavric, G. S. Croft, and T. L. Hodgson Predictive Learning, Prediction Errors, and Attention: Evidence from Event-related Potentials and Eye Tracking. J. Cogn. Neurosci., May 1, 2007; 19(5): 843 - 854. [Abstract] [Full Text] [PDF]

				E. B. Margolis, H. Lock, G. O. Hjelmstad, and H. L. Fields The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? J. Physiol., December 15, 2006; 577(3): 907 - 924. [Abstract] [Full Text] [PDF]

				N. D. Daw, A. C. Courville, and D. S. Touretzky Representation and Timing in Theories of the Dopamine System Neural Comput., July 1, 2006; 18(7): 1637 - 1677. [Abstract] [Full Text] [PDF]

				R. Levy and B. Dubois Apathy and the Functional Anatomy of the Prefrontal Cortex-Basal Ganglia Circuits Cereb Cortex, July 1, 2006; 16(7): 916 - 928. [Abstract] [Full Text] [PDF]

				O. Hikosaka, K. Nakamura, and H. Nakahara Basal Ganglia Orient Eyes to Reward J Neurophysiol, February 1, 2006; 95(2): 567 - 584. [Abstract] [Full Text] [PDF]

				A. S. Kuznetsov, N. J. Kopell, and C. J. Wilson Transient High-Frequency Firing in a Coupled-Oscillator Model of the Mesencephalic Dopaminergic Neuron J Neurophysiol, February 1, 2006; 95(2): 932 - 947. [Abstract] [Full Text] [PDF]

				G. P. McNally, M. Pigg, and G. Weidemann Opioid Receptors in the Midbrain Periaqueductal Gray Regulate Extinction of Pavlovian Fear Conditioning J. Neurosci., August 4, 2004; 24(31): 6912 - 6919. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help