Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Letter
  • Published:

Retrospective and prospective coding for predicted reward in the sensory thalamus

Abstract

Reward is important for shaping goal-directed behaviour1,2,3,4. After stimulus–reward associative learning, an organism can assess the motivational value of the incoming stimuli on the basis of past experience (retrospective processing), and predict forthcoming rewarding events (prospective processing)1,2,3,4,5. The traditional role of the sensory thalamus is to relay current sensory information to cortex. Here we find that non-primary thalamic neurons respond to reward-related events in two ways. The early, phasic responses occurred shortly after the onset of the stimuli and depended on the sensory modality. Their magnitudes resisted extinction and correlated with the learning experience. The late responses gradually increased during the cue and delay periods, and peaked just before delivery of the reward. These responses were independent of sensory modality and were modulated by the value and timing of the reward. These observations provide new evidence that single thalamic neurons can code for the acquired significance of sensory stimuli in the early responses (retrospective coding) and predict upcoming reward value in the late responses (prospective coding).

This is a preview of subscription content, access via your institution

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Prices may be subject to local taxes which are calculated during checkout

Figure 1: Rastergrams and spike-density functions (SDFs) of the neuronal activity to each cue stimulus (top panels, auditory cues; bottom panels, visual cues).
Figure 2: Effects of reward value and timing on the activity of the neuron with two response components, shown in Fig. 1a.
Figure 3: The plasticity of responses to tone 1 of the neuron shown in Fig. 1a during extinction and relearning.
Figure 4: Functional topography.

Similar content being viewed by others

References

  1. Dickinson, A. & Balleine, B. Motivational control of goal-directed action. Anim. Learn. Behav. 22, 1–18 (1994).

    Article  Google Scholar 

  2. Schultz, W. Multiple reward signals in the brain. Nature Rev. Neurosci. 1, 199–207 (2000).

    Article  CAS  Google Scholar 

  3. Schultz, W., Tremblay, L. & Hollerman, J. R. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex 10, 272–283 (2000).

    Article  CAS  Google Scholar 

  4. Rolls, E. T. The Brain and Emotion. (Oxford Univ. Press, New York, 1999).

    Google Scholar 

  5. Rainer, G., Rao, S. C. & Miller, E. K. Prospective coding for objects in primate prefrontal cortex. J. Neurosci. 19, 5493–5505 (1999).

    Article  CAS  Google Scholar 

  6. Fibiger, H. C. & Phillips, A. G. in Handbook of Physiology—The Nervous System Vol. IV (ed. Bloom, F. E.) 647–675 (Williams and Wilkins, Baltimore, 1986).

    Google Scholar 

  7. Wise, R. A. & Rompre, P. P. Brain dopamine and reward. Annu. Rev. Psychol. 40, 191–225 (1989).

    Article  CAS  Google Scholar 

  8. Mirenowicz, J. & Schultz, W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449–451 (1996).

    Article  ADS  CAS  Google Scholar 

  9. Nakamura, K., Ono, T. & Tamura, R. Central sites involved in the lateral hypothalamus conditioned neural responses to acoustic cues in the rat. J. Neurophysiol. 58, 1123–1148 (1987).

    Article  CAS  Google Scholar 

  10. Robbins, T. W. & Everitt, B. J. Neurobehavioral mechanism of reward and motivation. Curr. Opin. Neurobiol. 6, 228–236 (1996).

    Article  CAS  Google Scholar 

  11. Ono, T., Nishijo, H. & Uwano, T. Amygdala role in conditioned associative learning. Prog. Neurobiol. 46, 401–422 (1995).

    Article  CAS  Google Scholar 

  12. Schoenbaum, G., Chiba, A. A. & Gallagher, M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neurosci. 1, 155–159 (1998).

    Article  CAS  Google Scholar 

  13. Bechara, A., Damasio, H., Tranel, D. & Anderson, S. W. Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18, 428–437 (1998).

    Article  CAS  Google Scholar 

  14. Watanabe, M. Reward expectancy in primate prefrontal neurons. Nature 382, 629–632 (1996).

    Article  ADS  CAS  Google Scholar 

  15. Kawagoe, R., Takikawa, Y. & Hikosaka, O. Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci. 1, 411–416 (1998).

    Article  CAS  Google Scholar 

  16. LeDoux, J. E., Farb, C. R., & Romanski, L. M. Overlapping projections to the amygdala and striatum from auditory processing areas of the thalamus and cortex. Neurosci. Lett. 134, 139–144 (1991).

    Article  CAS  Google Scholar 

  17. Linke, R., De Lima, A. D., Schwegler, H. & Pare, H.-C. Direct synaptic connections of axons from superior colliculus with identified thalamo-amygdaloid projection neurons in the rat: possible substrates of a subcortical visual pathway to the amygdala. J. Comp. Neurol. 403, 158–170 (1999).

    Article  CAS  Google Scholar 

  18. Weinberger, N. M. Learning-induced changes of auditory receptive fields. Curr. Opin. Neurobiol. 3, 570–577 (1993).

    Article  CAS  Google Scholar 

  19. LeDoux, J. E. Emotion circuits in the brain. Ann. Rev. Neurosci. 23, 155–184 (2000).

    Article  CAS  Google Scholar 

  20. Dolan, R. J. in The New Cognitive Neurosciences 2nd edn (ed. Gazzaniga, M. S.) 1115–1131 (MIT Press, Cambridge, Massachusetts, 2000).

    Google Scholar 

  21. Gallistel, C. R., Leon, M., Waraczynski, M. & Hanau, M. S. Effect of current on the maximum possible reward. Behav. Neurosci. 105, 901–912 (1991).

    Article  CAS  Google Scholar 

  22. Bouton, M. E. Context, ambiguity, and classical conditioning. Curr. Direct. Psychol. Sci. 3, 49–53 (1994).

    Article  Google Scholar 

  23. Bordi, F. & LeDoux, J. E. Response properties of single units in areas of rat auditory thalamus that project to the amygdala. I. Acoustic discharge patterns and frequency receptive fields. Exp. Brain Res. 98, 261–274 (1994).

    Article  CAS  Google Scholar 

  24. Edeline, J. M., Manunta, Y., Nodal, F. R. & Bajo, V. M. Do auditory responses recorded from awake animals reflect the anatomical parcellation of the auditory thalamus? Hear. Res. 131, 135–152 (1999).

    Article  CAS  Google Scholar 

  25. Winer, J. A. & Morest, D. K. The medial division of the medial geniculate body of the cat: implications for thalamic organization. J. Neurosci. 3, 2629–2651 (1983).

    Article  CAS  Google Scholar 

  26. Sefton, A. J. & Dreher, B. in The Rat Nervous System 2nd edn (ed. Paxinos, G.) 833–898 (Academic, San Diego, 1995).

    Google Scholar 

  27. LaBerge, D. Thalamic and cortical mechanisms of attention suggested by recent positron emission tomographic experiments. J. Cogn. Neurosci. 2, 358–372 (1990).

    Article  CAS  Google Scholar 

  28. Liu, Z., Murray, E. A. & Richmond, B. J. Learning motivational significance of visual cues for reward schedules requires rhinal cortex. Nature Neurosci. 3, 1307–1315 (2000).

    Article  CAS  Google Scholar 

  29. Paxinos, G. & Watson, C. The Rat Brain in Stereotaxic Coordinates 4th edn (Academic, San Diego, 1998).

    Google Scholar 

  30. Richmond, B. J. & Optican, L. M. Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. II. Quantification of response waveform. J. Neurophysiol. 57, 147–161 (1987).

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We thank R. Norgren (invited by Gofo Life Sciences International Fund) for helpful comments on this manuscript, and T. Kitamura for technical assistance. This work was partly supported by Grants-in-Aid for Scientific Research from the Japanese Ministry of Education, Science and Culture.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Taketoshi Ono.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Komura, Y., Tamura, R., Uwano, T. et al. Retrospective and prospective coding for predicted reward in the sensory thalamus. Nature 412, 546–549 (2001). https://doi.org/10.1038/35087595

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/35087595

This article is cited by

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing