ReviewFrom ventral-medial to dorsal-lateral striatum: Neural correlates of reward-guided decision-making
Introduction
Decision-making is governed by goal-directed and stimulus–response (S–R) driven mechanisms, with the former being more closely associated with medial regions of striatum, including nucleus accumbens core (NAc) and dorsal medial striatum (DMS), and the latter with dorsal lateral striatum (DLS). During learning, the transition from goal-directed behavior to S–R driven habits is thought to depend on “spiraling” connectivity from ventral-medial regions in striatum to dopamine (DA) neurons, which then project to more dorsal lateral portions of striatum (Haber et al., 2000, Houk et al., 1995, Ikemoto, 2007, Joel et al., 2002, Niv and Schoenbaum, 2008, Takahashi et al., 2008, van der Meer and Redish, 2011). This network (Fig. 1) allows for feed-forward propagation of information from limbic networks to associative and sensorimotor networks (Haber, 2003, Haber and Knutson, 2010, Haber et al., 2000, Ikemoto, 2007).
Here, we review neural correlates from our labs related to reward-guided decision-making in NAc, DMS, and DLS (Fig. 1). We will specifically focus on neural correlates from studies where animals performed the same behavioral task, thus allowing for direct comparison. Along the way we will describe neural and behavioral changes that occur when these subdivisions are selectively interfered with, offering insight into how these networks guide decision-making. From these studies it appears that different regions in striatum can compensate for each other when function in one is disrupted, suggesting that these structures can work in parallel.
The review is broken down into three sections based on popular ways to subdivide striatum. The classic division has been to subdivide striatum along the dorsal–ventral axis. We will begin our discussion of neural correlates by focusing on neural selectivity from the extremes of this division, nucleus accumbens and dorsal lateral striatum (Fig. 1). Next, we will examine correlates from dorsal striatum along the medial–lateral axis. This work has focused on the finding that DMS and DLS function can be clearly dissociated using devaluation and contingency degradation paradigms showing their respective roles in goal-driven and habitual behaviors (Balleine & O’Doherty, 2010). Finally, we will discuss a synthesis of the dorsal–ventral and the medial–lateral distinction of striatum, namely, a ventromedial to dorsolateral functional organization based on connectivity (Haber and Knutson, 2010, Nakamura et al., 2012, Voorn et al., 2004). Afferents innervating striatum progress from limbic to associative to sensorimotor, moving from ventral-medial to central to dorsal-lateral striatum, respectively (Haber, 2003, Haber and Knutson, 2010, Haber et al., 2000, Voorn et al., 2004). In this section, we will describe primate data illustrating how reward, motor, and cognitive neural correlates progress across the diagonal of striatum (Fig. 5B). Collectively these studies suggest that as one progresses from ventral-medial to dorsal-lateral striatum, there is a shift from more prominent value encoding to encoding that better reflects associative and sensorimotor functions.
Section snippets
Nucleus accumbens core versus dorsal lateral striatum
Several studies have reported that neural activity in both NAc and DLS is correlated with the value of expected outcomes. We examined these correlates using an odor-guided decision-making task during which we manipulated anticipated value by independently varying reward size and the length of delay preceding reward delivery (Roesch, Singh, Brown, Mullins, & Schoenbaum, 2009). As illustrated in Fig. 2A, rats were trained to nose-poke in a central odor port where one of three different odors was
Medial versus lateral dorsal striatum
So far, we have discussed the functional segregation between NAc and DLS, which is a common way to divide striatal function (i.e., dorsal–ventral plane). Other studies have focused on segregation of function across medial and lateral aspects of striatum, specifically within dorsal striatum (DS). Reward-related actions controlled by DS are thought to reflect the integration of two different learning processes, one that controls goal-directed behavior and the other the acquisition of habits (
From ventromedial to dorsolateral striatum
The majority of rodent work in DS has focused on dissociating medial versus lateral function. Unfortunately, little attention has been given to the examination of neural correlates across the dorsal–ventral plane of DS. In monkeys, Nakamura and colleagues recently dissected neural correlates in primate caudate, closely examining differences not only in the medial–lateral plane, but also in the dorsal–ventral plane (Nakamura et al., 2012).
In this study, monkeys made saccades to target stimuli
Conclusions
In conclusion, we describe data showing that although there is considerable overlap of neural correlates across striatum, as one progresses from ventral-medial striatum to dorsal-lateral striatum, there is a shift from more prominent value encoding to activity more closely related to associative and motor aspects of decision-making. Neural activity in NAc appears to be strongly correlated with the expected value of outcomes critical for motivating behavior in the pursuit of reward. Neural
Acknowledgments
This work was supported by Grants from the NIDA (R01DA031695, MR). Correspondence and requests for materials should be addressed to MR (email: [email protected]).
References (43)
- et al.
Functional architecture of basal ganglia circuits: Neural substrates of parallel processing
Trends in Neurosciences
(1990) - et al.
Dopamine in motivational control: Rewarding, aversive, and alerting
Neuron
(2010) - et al.
Ventral striatum lesions enhance stimulus and response encoding in dorsal striatum
Biological Psychiatry
(2014) - et al.
Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice
Neuron
(2011) - et al.
A network state linking motivation and action in the nucleus accumbens
Neuron
(2013) The primate basal ganglia: Parallel and integrative networks
Journal of Chemical Neuroanatomy
(2003)- et al.
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning
Neural Networks: The Official Journal of the International Neural Network Society
(2006) Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex
Brain Research Reviews
(2007)- et al.
Actor–critic models of the basal ganglia: New anatomical and computational perspectives
Neural Networks
(2002) - et al.
The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum
Neuroscience
(2000)
Value representations in the primate striatum during matching behavior
Neuron
Nucleus accumbens core lesions enhance two-way active avoidance
Neuroscience
Invigoration of reward seeking by cue and proximity encoding in the nucleus accumbens
Neuron
Dialogues on prediction errors
Trends in Cognitive Sciences
Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning
Neuron
Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task
Neuron
Ventral striatum: A critical look at models of learning and evaluation
Current Opinion in Neurobiology
Putting a spin on the dorsal-ventral divide of the striatum
Trends in Neurosciences
Basal ganglia–thalamocortical circuits: Parallel substrates for motor, oculomotor, “prefrontal” and “limbic” functions
Progress in Brain Research
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Annual Review of Neuroscience
Responses to reward in monkey dorsal and ventral striatum
Experimental Brain Research Experimentelle Hirnforschung Experimentation Cerebrale
Cited by (157)
Abnormal Brain Networks Related to Drug and Nondrug Reward Anticipation and Outcome Processing in Stimulant Use Disorder: A Functional Connectomics Approach
2023, Biological Psychiatry: Cognitive Neuroscience and NeuroimagingShared and distinct neural activity during anticipation and outcome of win and loss: A meta-analysis of the monetary incentive delay task
2022, NeuroImageCitation Excerpt :We found that both VS and dorsal striatum (DS) contribute substantially to win and loss anticipation as well as to win outcome, in accord with Oldham et al. (2018). Previous studies suggested functional heterogeneity within striatal subregions, with the VS involved in encoding both positive and negative stimuli and the DS in associative and motor aspects of decision-making (Burton et al., 2015). Studies in rats also showed elevated neuronal activities in the VS and DS each in association with the expectation of larger rewards and behavioral responses to retrieve the reward (Burton et al., 2014; Roesch et al., 2009).