Abstract
The dopaminergic modulation of neural activity in the prefrontal cortex (PFC) is essential for working memory. Delay-activity in the PFC in working memory tasks persists even if interfering stimuli intervene between the presentation of the sample and the target stimulus. Here, the hypothesis is put forward that the functional role of dopamine in working memory processing is to stabilize active neural representations in the PFC network and thereby to protect goal-related delay-activity against interfering stimuli. To test this hypothesis, we examined the reported dopamine-induced changes in several biophysical properties of PFC neurons to determine whether they could fulfill this function. An attractor network model consisting of model neurons was devised in which the empirically observed effects of dopamine on synaptic and voltage-gated membrane conductances could be represented in a biophysically realistic manner. In the model, the dopamine-induced enhancement of the persistent Na+ and reduction of the slowly inactivating K+ current increased firing of the delay-active neurons, thereby increasing inhibitory feedback and thus reducing activity of the “background” neurons. Furthermore, the dopamine-induced reduction of EPSP sizes and a dendritic Ca2+ current diminished the impact of intervening stimuli on current network activity. In this manner, dopaminergic effects indeed acted to stabilize current delay-activity. Working memory deficits observed after supranormal D1-receptor stimulation could also be explained within this framework. Thus, the model offers a mechanistic explanation for the behavioral deficits observed after blockade or after supranormal stimulation of dopamine receptors in the PFC and, in addition, makes some specific empirical predictions.
The prefrontal cortex (PFC) plays a major role in working memory (Passingham, 1975; Fuster, 1989;Goldman-Rakic, 1990, 1995; Petrides, 1995; Kesner et al., 1996). In a series of recent experiments, Miller and colleagues (Miller et al., 1991, 1993, 1996; Miller and Desimone, 1994) extended the classical delayed matching-to-sample (DMS) paradigm, which is often used to assess working memory functions, by introducing intervening stimuli between the presentation of the sample stimulus and the matching stimulus, after which a response had to be given. While monkeys were performing this task, these authors recorded from PFC neurons. As shown previously (for review, see Fuster, 1989; Goldman-Rakic, 1990), Miller et al. (1996) found that many neurons exhibited stimulus-selective delay-activity. In addition, in contrast to delay-active neurons in the temporal (Miller et al., 1993, 1996; Miller and Desimone, 1994) and posterior parietal (Di Pellegrino and Wise, 1993; Constantinidis and Steinmetz, 1996) lobe, delay-activity of most PFC neurons persisted even when intervening stimuli were presented. Thus, PFC neurons or networks seem to be equipped with a mechanism that enables them to hold active neural representations of goal-related information and to protect this goal-related delay activity against interfering stimuli. However, the nature of this neural mechanism is largely unknown.
We speculated that dopamine (DA) might play a crucial role in such a mechanism. Dopaminergic midbrain neurons become active (Schultz et al., 1993) and DA levels in the PFC significantly increase (Watanabe et al., 1997) during working memory performance. Prefrontal DA depletion (Brozoski et al., 1979; Simon et al., 1980) or blockade of D1 receptors in the PFC (Sawaguchi and Goldman-Rakic, 1991, 1994; Seamans et al., 1998) causes severe working memory deficits, whereas D1 agonists might enhance delay task performance [Arnsten et al. (1994); Müller et al. (1998); but see Zahrt et al. (1997)]. Moreover, DA strongly modulates the electrical activity of PFC neurons in vivo andin vitro by multiple D1- and D2-receptor-mediated presynaptic and postsynaptic mechanisms (Bernardi et al., 1982; Ferron et al., 1984; Mantz et al., 1988; Sesack and Bunney, 1989; Sawaguchi et al., 1990a,b; Godbout et al., 1991; Williams and Goldman-Rakic, 1995;Yang and Seamans, 1996). DA enhances a persistent Na+ and reduces a slowly inactivating K+ and a dendritic HVA Ca2+current in rat PFC pyramidal neurons via D1 stimulation in vitro (Yang and Seamans, 1996; Gorelova and Yang, 1997; Shi et al., 1997), it reduces glutamatergic synaptic inputs (Pralong and Jones, 1993; Law-Tho et al., 1994), and it enhances activity and spontaneous transmitter release of GABAergic neurons in the PFC (Penit-Soria et al., 1987; Rétaux et al., 1991; Pirot et al., 1992; Yang et al., 1997). We asked whether DA by modulating these biophysical properties of PFC neurons could act to stabilize and protect goal-related delay-activity in PFC networks. To answer this question, we constructed a network of leaky-integrator model neurons that allowed for a biophysically realistic implementation of the cellular effects of DA. Network simulations were performed, and the stability of representations was evaluated while DA-dependent neural and synaptic parameters were varied.
MATERIALS AND METHODS
Single neuron model. The goal of the present model was to explain the stability of delay-activity in the PFC and the dopaminergic modulation of this activity. We tried to keep the model as simple as possible within the constraints imposed by this goal. For example, because only average spike rates but not single spike codes are considered in the literature dealing with delay-activity during working memory and the dopaminergic modulation of this activity, spike rates were directly derived from membrane potential fluctuations in the model neurons instead of implementing an explicit spike-generating mechanism. On the other hand, we attempted to put sufficient detail into the equations to realistically describe the impact of DA on the state and behavior of the model neurons. For the purposes of the present study, we extended a network model extensively studied by Amit and colleagues (Amit et al., 1994; Amit and Brunel, 1995), who also showed that this model could reproduce very well various aspects of the electrophysiological behavior of neocortical neurons recorded in vivo.
The excitatory model neurons used in the present network study were intended to represent deep-layer PFC pyramidal cells. Layer V/VI pyramidal cells are the ones most densely innervated by dopaminergic fibers in the rat PFC (Berger et al., 1988, 1991; Joyce et al., 1993) and constitute the major portion of neurons with sustained delay activity (Fuster, 1973). To account for the electrotonically separated proximal (soma, basal, apical oblique) and distal (apical tuft) dendrites of these neurons, the model neurons were chosen to consist of a distal and a proximal “dendritic” compartment, connected by a coupling resistance, as depicted in Figure 1.
The proximal and distal compartments were described by simple “leaky-integrator” differential equations. The equation describing the proximal compartment contained additional nonlinear terms that represented the contribution of a persistent Na+(VNaP) and a slowly inactivating K+ (VKS) current to the membrane potential:
Equation 1a
Equation 1bwhere Vp,i is the proximal andVd,i the distal membrane potential of uniti, τp the proximal and τd the distal membrane time constant, λpd a coupling strength between the proximal and the distal compartment (which may be interpreted as a length constant of the model neuron), ηexc and ηinh the general excitatory and inhibitory synaptic efficiency, wij the specific excitatory synaptic coupling strength (weight) from neuron jto neuron i, fexc andfinh the (instantaneous) firing rates of the excitatory neurons and the inhibitory unit, respectively, andIaff represents an afferent input arising from other association or higher sensory areas (see below) (all variables in arbitrary units).
Because two of the major cellular effects of DA (see Implementation of the dopaminergic modulation) are on the persistent Na+ (INaP) (Alzheimer et al., 1993; Brown et al., 1994; Yang and Seamans, 1996) and slowly inactivating K+ current (IKS) (Huguenard and Prince, 1991; Spain et al., 1991; Yang and Seamans, 1996), a simplified biophysical description of these currents was implemented in the model. Both currents activate on depolarization and were represented by the product of a maximum current (INaP,max andIKS,max, respectively) with a voltage-dependent (steady-state) activation gate, given by a sigmoid (Boltzmann) function (the slow inactivation process of these currents was omitted for simplicity). The change in membrane voltage induced by these currents relates to these currents by the constant passive membrane resistance R, which was set to 1.0 for simplicity (but could be set to any other value provided that the maximum currents are scaled accordingly):
Equation 2
In the present paper, we were not seeking precise quantitative matches with empirical data. Rather our goal was to demonstrate some important functional principles that work regardless of the detailed activation kinetics (which are fast compared with the membrane time constants) or the exact parameter settings of the gating functions. For the present line of argument, the key point is that there are inward and outward currents in the model neurons that increase with membrane potential and could be differentially modulated by DA.
The spike frequency output fexc of an excitatory neuron was set to zero below a certain threshold θexc and depended logarithmically on membrane potential above this threshold (as described by Amit and Brunel, 1995):
Equation 3The population of GABAergic interneurons was lumped into a single inhibitory unit (Amit et al., 1994; Amit and Brunel, 1995). For this unit, membrane potential and spike frequency output were given by the following equations:
Equation 4
where Vinh is the membrane potential, τinh the time constant, θinh the firing threshold of the inhibitory unit, and NS the (mean) number of units coding for a stimulus (see below), introduced into the equation as a scaling constant.
A parameter configuration defining a “standard model” at baseline DA activity is summarized in Table 1(column χbase). Parameters regulating the maximum persistent Na+ and slowly inactivating K+ current, the maximum synaptic current, and the current flow between the two compartments were derived from simulations carried out with a detailed compartmental model of PFC pyramidal neurons (Durstewitz and Seamans, 1997; Durstewitz, 1998). We determined from this pyramidal cell model, which could faithfully reproduce somatic and dendritic recordings from real rat PFC neurons, the size of the total (subthreshold) INaP, the (subthreshold) axial current from the dendrites to the soma, and the mean total synaptic currents (AMPA + NMDA, or GABAA) under simulated “in vivo” conditions. We then used these values to adjust the relative contributions of these currents to membrane potential in the simple leaky-integrator neuron used here.
Model parameter settings
Network model. Figure 1depicts the structure of the network model. The network consisted of a PFC layer, a motor output unit, and a DA unit. The PFC layer consisted of N = 100 excitatory “layer V/VI pyramidal neurons,” arranged in a 10 × 10 square, and an inhibitory feedback unit, representing a population of GABAergic cells (Amit and Brunel, 1995). Within the PFC layer, each pyramidal cell made excitatory synaptic contacts only on the proximal compartments of other pyramidal neurons. In contrast, higher sensory afferent inputs (Iaff in Eq. 1b) were simulated by charging the distal model compartments. The inhibitory feedback unit received input from all pyramidal neurons and projected back onto the proximal compartments of all of those neurons. This pattern of connections was chosen according to neuroanatomical data. Lübke et al. (1996) andMarkram et al. (1997) reported that deep-layer neocortical pyramidal cells made synaptic contacts on other deep-layer pyramidal cells preferentially within the proximal dendritic tree, and Kritzer and Goldman-Rakic (1995) and Levitt et al. (1993) showed that axonal arborizations of PFC deep-layer pyramidal neurons extending laterally across column boundaries mainly stayed within the same deep layers. In contrast, Mitchell and Cauller (1997) showed that afferent fibers from other cortical association and higher sensory areas terminate in the upper PFC layers I–II, which seems to be a common pattern of association fiber connections in the neocortex (Jones, 1984; Cauller, 1995; Cauller et al., 1998). Finally, axons from Chandelier and basket GABAergic interneurons primarily terminate on the initial axonal segment, soma, and proximal dendrites (i.e., the proximal compartment) of deep-layer pyramidal cells (Douglas and Martin, 1990). However, it should be emphasized that all of the results presented here except the ones regarding dopaminergic modulation of dendritic Ca2+ currents (see Results) do not depend on these anatomical assumptions.
Structure of the PFC network model. Within the PFC network, excitatory neurons (representing deep-layer pyramidal cells) are interconnected by excitatory synapses on their proximal compartments (prox) while receiving afferent input from other cortices on their distal compartments (dis). An inhibitory unit (INH) provides feedback inhibition. A “striatal” motor unit (MOTOR) receives excitatory input from all PFC “pyramidal cells” and inhibits the “mesencephalic” DA unit, which modulates parameters of PFC neurons and synapses in an activity-dependent manner.
In the Miller et al. (1996) task, which will be used here for the simulations, the monkeys gave their responses by pressing a lever. Thus, suprathreshold activity of the motor output unit in the present simulations was meant to indicate such a lever press. The motor output and the DA unit consisted of just one compartment as described by Equation 1a, without the terms for voltage-gated and axial current flow and without inhibitory feedback. Parameters for these units are given in Table 1. The motor unit received (nonreciprocal) connections from all PFC pyramidal neurons, with a fixed total weight ηexc× w = 1/(10 × NS) = 0.005, where NS = 20 is the number of neurons participating in the representation of a given stimulus (see below). This connection in the model network corresponds to the unidirectional glutamatergic fiber connections from PFC layer V pyramidal cells to striatal neurons (Selemon and Goldman-Rakic, 1985; Goldman-Rakic, 1995;Heimer et al., 1995).
The DA unit received excitatory input from all PFC pyramidal neurons, with a fixed total weight ηexc × w = 1/(10 × NS) = 0.005, and inhibitory input from the motor unit with fixed weight w = 1.0 (ηmot = −5.0). Glutamatergic projections from the PFC to the substantia nigra (SN) have been demonstrated by glutamate uptake and ablation studies (Carter, 1982; Kornhuber et al., 1984). In addition, it has been shown that electrical and chemical stimulation of the PFC induces burst firing in the ventral tegmental area (VTA) and SN dopaminergic neurons (Murase et al., 1993; Tong et al., 1996a,b), which resembles natural burst events as elicited by behaviorally significant stimuli (Schultz and Romo, 1990; Ljungberg et al., 1992; Schultz et al., 1993). Burst firing in turn (as opposed to a single spike mode) leads to increased DA release at dopaminergic terminals in the forebrain (Gonon, 1988). Thus, PFC activity can stimulate DA release via direct or indirect (Tong et al., 1996a) excitatory fiber connections to the VTA/SN (Karreman and Moghaddam, 1996), justifying the assumptions made here.
The inhibitory signal from the motor unit to the DA unit represented the GABAergic input that SN and VTA dopaminergic neurons receive via the striatonigral pathway (Heimer et al., 1995). In an operant feeding task carried out by Nishino et al. (1991), VTA neurons increased their firing rate initially while monkeys pressed a lever for food reward but became inhibited thereafter during ingestion, i.e. when the goal has been achieved (see also Richardson and Gratton, 1998). Goldman-Rakic et al. (1992a) speculated that in an oculomotor delayed-response task, a command signal that originates in the PFC activates neurons in the striatum, which in turn inhibit the SN (Hikosaka and Wurtz, 1983), which finally results in disinhibition of the medial dorsal thalamic nucleus and superior colliculus. Thus, PFC neurons could directly excite dopaminergic midbrain neurons and stimulate DA release, or could inhibit them indirectly by initiating a motor output that results in goal achievement.
The kind of implementation outlined above was chosen to demonstrate the functioning of a completely self-regulating system. However, for the central ideas pursued in this paper, it does not matter whether the PFC itself activates the DA unit, whether it is activated by some other brain structure (e.g. the amygdala; Goldstein et al., 1996), or whether increased DA release in the PFC during working memory is regulated at the terminal level (Blaha et al., 1997), as long as it is provided that prefrontal DA levels rise at the onset of the working memory task [for a discussion of related points see Schultz (1992)]. Evidence for this comes (1) from the in vivo studies by Schultz et al. (1993), who demonstrated that VTA/SN neurons increase their firing rate with the presentation of the first, instructing stimulus in a spatial delayed response task, and (2) from Watanabe et al. (1997), who observed increased DA levels especially in the dorsolateral PFC of monkeys during performance of a delayed alternation but not during a sensory-guided control task.
Synaptic connections within the PFC layer and neural representation of stimuli. A number of different patterns, representing different environmental stimuli, were stored in the synaptic weight matrix of the network by connecting the neurons coding for a particular stimulus by high synaptic weights. For simplicity, patterns were represented by binary vectors S = {si}, and were stored in the PFC network according to a Willshaw matrix (Amit and Brunel, 1995):
Equation 5For all simulations, the weights were set to w = 1/(NS − 1). All stimuli were represented by binary patterns with fixed coding level c =NS/N = 0.2, whereN = 100 is the total number of excitatory neurons in the PFC layer, and NS = 20 as defined above [if different patterns are to be represented by varying numbersNS of units, NS in the equations above should be set to the average number of units participating in a pattern (see Amit and Brunel, 1995)]. For the purpose of illustrating general network performance, patterns forming integer numbers (“0,” “1,” …) were used as easily recognizable stimuli. All input patterns that were used during a simulation run were stored a priori in the synaptic weight matrix [for mechanisms of online learning, see Amit and Brunel (1995)]. In the simulations demonstrating general network performance, there were always 10 patterns stored in the weight matrix. However, different numbers of patterns, different coding levels, or the assumption of small, non-zero, randomly initialized weights (<10% of was defined above) between all network units all yield the same basic results (using parameters as given in Table 1). For different coding levels, only the weights have to be adjusted according toNS as described above.
Stimuli (input patterns) were presented to the net by directly charging the distal compartments of the PFC layer pyramidal neurons (i.e., clamping Iaff in Eq. 1b). It is generally assumed that the increased firing rate of PFC neurons during the delay periods of working memory tasks represents the active holding of stimuli (Fuster, 1989; Goldman-Rakic, 1990, 1995; Funahashi and Kubota, 1994). Likewise, in the present network model, the active holding, or active short-term representation, of stimuli was reflected in the elevated firing rates of the neurons participating in the neural representation of the respective stimulus (Amit, 1995; Amit et al., 1997). Thus, different stimuli activated different representations encoded in the synaptic weight matrix of the network, which were then eventually maintained by recurrent excitation and thus transformed into active working memory representations. Amit and Brunel (1995)expressed conditions under which increased firing rates will be maintained in the absence of external input in associative networks of the type used here.
Implementation of the dopaminergic modulation. In the PFC, pyramidal cells seem to be the preferential targets of dopaminergic afferents and the major cell population expressing the D1-receptor-related phosphoprotein DARPP-32 (Goldman-Rakic et al., 1989; Berger et al., 1990; Smiley and Goldman-Rakic, 1993). However, dopaminergic inputs to smooth stellate and thus probably GABAergic interneurons and D1-like immunoreactivity in these neurons have also been observed (Smiley and Goldman-Rakic, 1993; Muly et al., 1998). In the rat PFC, layers V–VI receive the densest dopaminergic input, and in monkeys, in addition, the superficial (supragranular) cell layers (Berger et al., 1988, 1991; Goldman-Rakic et al., 1992b; Lewis et al., 1992). For simplicity we have assumed that biophysical parameters ofall pyramidal neurons in these layers and thus in the model net are affected by DA [which seems also to be reasonably justified according to DARPP-32-positive cell countings in association areas of the avian “neocortex” (Durstewitz et al., 1998)].
DA has a variety of different effects on intrinsic membrane currents and synaptic parameters of pyramidal and GABAergic neurons in the PFC. We will focus here on the effects that are best documented. Furthermore, because the effects of DA on neural activity and single ion channels exhibit considerable substrate specificity [e.g., compareCepeda et al. (1995) with Yang and Seamans (1996)], we will use in the present study only effects confirmed in rat PFC neurons. Dopaminergic actions considered in the present study were the following.
First, DA has been shown to enhance a persistent Na+current, probably by shifting the activation kinetics of this current into the hyperpolarized direction and by prolonging its inactivation time constant (Yang and Seamans, 1996; Gorelova and Yang, 1997). This effect might underlie the DA-induced depolarization of PFC neurons observed in vitro and in vivo (Bernardi et al., 1982; Yang and Seamans, 1996; Shi et al., 1997) and the dramatic increase in spike frequency (Yang and Seamans, 1996; Shi et al., 1997). In the model, this effect was implemented by shifting the activation curve of the persistent Na+ current (i.e., parameter αNaP) toward less positive potentials in a DA-dependent fashion (see below).
Recently, Gulledge and Jaffe (1998) reported that DA reducesthe spike frequency of PFC pyramidal cells in vitro, in conflict with the findings cited above. The fact that Gulledge and Jaffe (1998) did not yet unravel the ionic mechanisms underlying this effect makes an assessment of its possible role in working memory processes very difficult. More importantly, these authors found that the depressive effect of DA is D2-mediated, whereas D1 receptor agonists and antagonists had no effect. In contrast, working memory performance (Arnsten et al., 1994; Sawaguchi and Goldman-Rakic, 1994;Zahrt et al., 1997; Müller et al., 1998; Seamans et al., 1998) and delay activity in vivo (Sawaguchi et al., 1990b;Williams and Goldman-Rakic, 1995) are mainly susceptible to D1 but not D2 receptor stimulation or blockade, as were the DA-dependent ionic mechanisms unraveled in the studies by Yang and Seamans (1996) andGorelova and Yang (1997). In accordance with these findings, the D2-mediated depressive effect on spike frequency might only occur initially, shortly after bath application of DA in vitro(starting from a zero DA concentration), until the D1-mediated effects take over (J. Seamans, unpublished observations), and hence might not show up in an in vivo situation in which there is a constant baseline level of DA in the PFC (Abercrombie et al., 1989; Moore et al., 1998). Finally, D1 receptors are also much higher in density than D2 receptors in the PFC (Goldman-Rakic et al., 1992b; Joyce et al., 1993). Thus, the D2-mediated effects described by Gulledge and Jaffe (1998) might not play a prominent role in working memory processes, and we focused here on the D1-mediated effects elucidated by Yang and Seamans (1996) and Gorelova and Yang (1997).
Second, DA has been shown to reduce a slowly inactivating K+ conductance (IKS) in PFC pyramidal cells (Yang and Seamans, 1996). This effect might contribute to the depolarization and increased firing rate of PFC neurons under DA action. In the model, DA reducedIKS,max (see Eq. 2).
Third, DA reduces the amplitude and half-width of isolated dendritic Ca2+ spikes generated by a dendritic high voltage-activated (HVA) Ca2+ current (Yang and Seamans, 1996; Formenti et al., 1998). In vitro (Seamans et al., 1997) and compartmental modeling data (Bernander et al., 1994;Durstewitz and Seamans, 1997) have demonstrated that dendritic HVA Ca2+ currents can amplify EPSPs induced in the distal dendrites of deep layer PFC neurons on their way to the soma. In addition, Schiller et al. (1997) have shown that synaptic inputs to the distal dendrites activate local HVA Ca2+ currents, causing increased responses at the soma. Hence, dendritic HVA Ca2+ currents affect the ability of distal EPSPs to effectively depolarize the soma, and DA might reduce this ability. In addition, the data of Yang and Seamans (1996) made it likely that the DA-affected Ca2+ current resides primarily in the distal dendrites and might thus be of the N-type [more directly shown by Surmeier et al. (1995) and Formenti et al. (1998)], which reaches a local maximum in the distal dendrites of pyramidal cells (Westenbroek et al., 1992; Yuste et al., 1994). Thus, DA might specifically diminish distal EPSPs, or might at least attenuate them more strongly than proximal EPSPs [as first suggested by Yang and Seamans (1996)]. This has in fact been shown by Yang et al. (1996) and Law-Tho et al. (1994). The effect that DA induces via reduction of a dendritic Ca2+ conductance could be interpreted as an increase in the electrotonic distance between the distal and the proximal dendritic region, which causes a reduction in current flow from distal to proximal. Thus, in the model neurons, DA increased the electrotonic distance between the distal and the proximal compartment by reducing the coupling strength (λpd). However, in addition to this simple way of representing in the model dopaminergic effects on dendritic Ca2+ conductances, we also examined whether a more explicit representation of the DA-induced reduction of a dendritic Ca2+ current (see Results) basically yields the same results.
Fourth, in the PFC, as in other cortical areas (Pralong and Jones, 1993), DA depresses the AMPA as well as the NMDA component of EPSPs via D1 receptors (Law-Tho et al., 1994), thus reducing the amplitude of EPSPs evoked by layer I stimulation by up to 50%. Cepeda et al. (1992)also found that DA strongly suppresses glutamate-induced responses but reported enhanced responses to NMDA. (They did not, however, record from PFC neurons, and their slices were obtained from human brains that might have undergone pathological changes, so that the applicability of their results to the healthy PFC might have to be interpreted with some caution.) The suppressing effect of DA on glutamate-induced responses and EPSPs was implemented in the model by reducing the general excitatory synaptic efficiency ηexc.
Fifth, DA has been reported to enhance spontaneous activity of GABAergic interneurons and to increase IPSP size (Penit-Soria et al., 1987; Rétaux et al., 1991; Pirot et al., 1992; Yang et al., 1997). This effect, in addition to the DA-induced reduction of EPSPs, might be responsible for the inhibition of neural activity in the PFC observed in vivo in anesthetized rats after local DA application or VTA stimulation (Ferron et al., 1984; Godbout et al., 1991; Pirot et al., 1992, 1996) (note that these studies were performed in rats anesthetized by ketamine, i.e., with NMDA currents blocked and outside a behavioral context). However, it should be noted that a reduction of evoked GABAergic activity and a reduction of IPSP sizes by DA in the PFC have also been reported (Rétaux et al., 1991; Law-Tho et al., 1994). We will show here what the effect of varying the general inhibitory synaptic efficiency ηinhon network behavior might be.
All of the DA-modulated network parameters were chosen to depend linearly on the deviation of the DA unit output from some baseline firing frequency. That is, with the DA unit firing at baseline, all network parameters had the values given in Table 1, and these values were varied according to the deviation ΔfDA of the DA unit output from some arbitrary baseline:
Equation 6where χ denotes some network parameter, and χbase and χshift are given for each DA-modulated parameter in Table 1. The deviation of the DA unit output from the baseline depended sigmoidally on the membrane potential of the DA unit, with a constant offset:
Equation 7where VDA is the membrane potential of the DA unit, and γDA is a parameter normally set to 1.0 except for “pathological” conditions of DA hypoactivity (−DA condition, see below) or DA hyperactivity (++DA condition, see below). During the simulation runs demonstrating general network performance, the DA-induced parameter changes were roughly adjusted according to estimations derived from in vitro data (Law-Tho et al., 1994; Yang and Seamans, 1996) and to values obtained with simulations with a detailed compartmental model of PFC pyramidal cells (Durstewitz, 1998).
Testing the stability of working memory representations. To demonstrate the general performance of the PFC model network, the DMS task with intervening stimuli as used by Miller et al. (1993, 1996) and Miller and Desimone et al. (1994) was used here. An arbitrary sample pattern was first presented to the network by clamping distal afferent inputs (Iaff in Eq. 1b), followed by an arbitrary sequence of partly overlapping “intervening stimuli” (e.g., 4, 0, 0, 2, 4). The network had to respond, i.e., to activate the motor output unit, when the initially presented sample pattern appeared the second time (target condition). A new trial could then be started. Note that also a delayed non-matching-to-sample (DNMS) task could easily be implemented in the network by assuming that the initial sample pattern activates a representation of the target pattern (TP), i.e., evokes a representation of the goal state [as suggested, e.g., by the electrophysiological data of Quintana et al. (1988)]. This essentially would internally transform the DNMS problem into a DMS problem. It is also important to note that in the Miller et al. (1993, 1996) task, stimuli were not trial unique, i.e., intervening stimuli appeared as sample/target stimuli on other trials and were all known in advance to the animals, raising the opportunity for considerable interference between trials and stimuli and justifying the a priori storage of stimuli in the present network.
The central hypothesis of the present paper was that DA stabilizes goal-related delay activity and protects it against interfering stimulation. To investigate the effect of the DA-induced parameter changes on stability of goal-related neural representations more systematically, the afferent input (Iaff in Eq.1b) needed to disrupt the ongoing network activity (i.e., the current neural representation) was taken as an index for stability. The higher the afferent input needed to establish a new activity pattern (i.e., a new attractor state) in the PFC network, the more stable is the currently active neural representation. We termed this currentIaff,crit in the following. In these simulations, a single (DA-dependent) network parameter was systematically varied while for each run a sample pattern was established in the isolated PFC network (no motor and DA unit), and the dependence of Iaff,crit needed to override this pattern on the value of the respective parameter was determined. The afferent input was presented for a time long enough for the activity of the stimulated neurons to reach their approximate maximum.
Computational techniques. The simulation software was programmed in C++, and all simulations were run on a 200 MHz Pentium PC using LINUX, a UNIX version for PCs, as operating system. The whole system of differential equations was simultaneously solved by a fourth-order Runge-Kutta method or the semi-implicit extrapolation method as described in Press et al. (1992), yielding the same results for the error criterion used here.
RESULTS
General network performance
The central hypothesis put forward here was that the function of DA during working memory processing is to stabilize active neural representations, i.e., to maintain goal-related neural activity in the PFC even in the presence of interfering afferent stimulation. The simulations presented in Figure 2demonstrate that (1) the DA-induced changes of biophysical parameters, taken all together, are appropriate for fulfilling this function, and (2) the prefrontal system via known anatomical connections could dynamically regulate its DA level to achieve the proposed function.
Activity of the PFC network under conditions of normal (+DA) and reduced (−DA) DA unit output during two successive trials of a DMS task with intervening stimuli. A, Mean proximal membrane potential (top parts) of all PFC net units belonging to the pattern “4,” which is the TP in the first trial (TP1), and pattern “0,” which is the TP in the second trial (TP2).Gray bars indicate the time intervals during which stimuli were presented. Three intervening stimuli (IS1–IS3 andIS4–IS6, respectively) were presented between the first (sample) and the second (matching) presentation of a TP. Note thatIS1 = IS2 = TP2 andIS4 = IS5 = TP1. Bottom parts give the gray level-coded membrane potential of all 100 PFC network units at discrete time points during presentation of the stimuli in the first trial. Lighter gray levels indicate higher activity. With normal DA output, TPs stay stable during a whole trial (+DA), whereas intervening patterns override currently active patterns under conditions of reduced DA unit output (−DA). Iaff = 0.55.B, Membrane potential of the motor unit under the+DA and the −DA conditions. C, Mean firing frenquency of the inhibitory unit under the +DA and the −DA condition.
Figure 2A compares the activity of the pyramidal units of the PFC network under two different conditions of simulated dopaminergic activity during a simulated DMS task with intervening stimuli as outlined in Materials and Methods. In the first condition (+DA), the intact network as given by the configuration in Table 1 was used. In the second condition (−DA), the output of the DA unit (or, in other terms, the DA level in the PFC) was strongly diminished by reducing the scaling factor γDA in Equation 7 to 0.3. Another interpretation of this manipulation might be a partial blockade of DA receptors in the PFC.
Figure 2A shows the mean membrane potential of all model neurons participating in the representation of a pattern that was the target in the first trial (TP1), and of all neurons participating in the representation of a pattern that was the target in the second trial (TP2). The first target served as an intervening stimulus (IS) during the second trial (i.e., IS4 = IS5 = TP1), and the second target as an intervening stimulus during the first trial (i.e., IS1 = IS2 = TP2). All patterns were presented by injectingIaff = 0.55. Membrane potential instead of mean frequency output fexc was chosen for visualization to depict also the subthreshold activity of the units not participating in the representation of the actual TP, and to allow comparison of this activity with that of the TP units. Because spike frequency in the model units relates logarithmically (i.e., strictly monotonically) to membrane potential above threshold, essentially the same picture would have been obtained for mean frequency of the TP units. Furthermore, for discrete time points during the first trial when the TP or one of the intervening stimuli was presented, the gray level-coded activity of all 100 network units is depicted.
As can be seen from Figure 2A, in the +DA network, activity related to the TP stayed stable during the whole trial even at times where interfering stimuli were presented to the network. Note that the mean activity of the delay-active units temporally increases during presentation of each of the intervening stimuli and reaches a maximum with the second presentation of the TP. This same basic pattern has been observed in vivo for single PFC neurons as well as for the mean frequency of a sample of delay-active neurons (Miller et al., 1996, their Figs. 4, 5), indicating that the model net could reproduce very well the basic electrophysiological pattern of delay-active neurons in the monkey PFC during DMS tasks with intervening stimuli. The increased firing rate during the second presentation of the target, which was termed “match enhancement” byMiller et al. (1996) and was observed in the majority of monkey PFC neurons with significant delay activity, triggered a suprathreshold motor output (Fig. 2B). Thus, the motor unit received suprathreshold activation only when a goal-related match occurred. [In this sense the motor unit encoded a “pure match” as it has been observed for some neurons by Miller et al. (1996)]. As described byMiller et al. (1996), simple repetition of a stimulus (IS1 = IS2, IS4 = IS5 in Fig. 2A) or intervening presentation of a stimulus that was the target in other trials (IS1 = TP2, IS4 = TP1 in Fig. 2A) did not disrupt delay activity. However, after the motor response had been delivered, the strong inhibition of the DA unit enabled the transition to and active storage of a new TP.
For the −DA condition, the situation was quite different. The first intervening pattern wiped out the target-related delay activity, preventing any significant match enhancement effect and thus disabling correct motor output (Fig. 2B). Thus, in the model network the DA-induced parameter changes were a necessary prerequisite for the protection of goal-related delay activity against interfering afferent stimulation.
Figure 2B illustrates that a motor response during the DMS simulation depicted in Figure 2A is delivered only in the +DA model when a match between sample and target stimulus occurred. Figure 2C shows that the activity of the inhibitory unit closely mimics that of the excitatory model neurons. Furthermore, the activity of the inhibitory unit is higher in the +DA condition than in the −DA condition because of the increased firing frequency of the excitatory units.
Having demonstrated that DA, in principle, could subserve the proposed function, we will investigate in the next sections in detail which of the DA-modulated biophysical mechanisms could lead to stabilization of goal-related neural representations in working memory.
Contribution of the persistent Na+ current to stabilization of delay activity
The DA-induced shift of the INaP activation curve (i.e., parameter αNaP) toward less positive potentials makes the currently active representation more stable in terms of the afferent input needed to disrupt the current delay activity (see Materials and Methods) (Fig.3). This generally holds for different steepnesses of the INaP activation function (data not shown), for different degrees of overlap between the target and the intervening pattern (Fig. 3A), and for different degrees of “connectivity” (Fig. 3B).
Effects of DA-induced variations inINaP parameters on the stability of TPs. Stability is measured in terms of the afferent input needed to disrupt current neural representations (Iaff,crit).Dashed vertical lines indicate the range within which the respective parameters or variables during full network simulations varied. All other network parameters had the baseline values given in Table 1. OVL, Overlap; CON, connectivity.A, Reduction of the INaP activation threshold (αNaP) increases the stability of the active neural representation at different overlaps (CON= 25%). B, Reduction of the INaPactivation threshold (αNaP) increases the stability of the active neural representation at different connectivities (OVL = 15%). C, Dependence of the stability of an active representation on the amplitude of a constant (i.e., non-voltage-dependent) Na+ current at different connectivities (OVL = 15%). D, Dependence of the stability of an active representation on the effective INaP amplitude (INaP,eff), compared for the constantINaP (labeled INaP,cons), for INaP,max variation of the voltage-dependentINaP (labeled INaP,max), and for αNaP variation of the voltage-dependentINaP (labeled αNaP).OVL = 15%; CON = 25%.
The term “overlap” (OVL) denotes the number of pyramidal units shared by the target stimulus and the intervening stimulus representation. As is evident from Figure 3A, increasing the overlap of the intervening stimulus with the TP reduces the afferent input needed to override the currently active pattern. However, no interaction of overlap with the INaP amplitude or activation threshold is apparent. Dashed vertical lines in Figure 3illustrate in which range αNaP varies within the full network simulation as depicted in Figure 2.
By connectivity (CON) we mean the number of inputs that units of the intervening pattern receive from the TP units, and vice versa. For the calculation of this index, all connections including units participating in the representation of bothpatterns (i.e., the overlapping units) were excluded. Thus, the connectivity as defined here depends solely on the other patterns stored in the network. In the extreme case, if there is a very large number of patterns stored in the network that overlap with the TP and the intervening pattern, each unit of the intervening pattern might receive inputs from all pattern units (and vice versa). Thus, the number of inputs may vary between 0 andNS, and CON was expressed as percentage of the maximal number of possible inputs NS. Furthermore, the connectivity between the target and the intervening pattern was always fully symmetrical. If the connectivity is too high, too many network units may become simultaneously active so that the TP breaks down because the stable membrane potential is temporarily pushed below the excitatory threshold by the increased inhibitory feedback (note from Equation 10 in the that for ηinh > 1 the inhibitory feedback increases more steeply with rising mean frequency fexc than the excitatory feedback). This in general was the case for CON ≥70% in the present network (depending on the specific settings of the parameters). Thus, only values of CON <70% were used in the present simulations. In general, also for CON <70%, increasing the connectivity diminishes stability (as evident in Fig. 3B) because the non-TP units receive more excitation whereas nothing changes for the TP units as long asfexc = 0 for the non-TP units.
The DA-induced shift in the INaP activation function enhances INaP in the normal potential range of the excitatory neurons, and thus provides an additional source of current. Figure 3C demonstrates that this additional current alone, within a wide range of reasonableINaP amplitudes, could be sufficient for stabilizing current delay activity. That is, neglecting the voltage dependency of INaP and representing the dopaminergic modulation of INaP just by adding aconstant INaP,cons to all excitatory neurons suffices to make the representation more stable in the PFC network. This, again, holds for various degrees of overlap between the target and the intervening pattern (data not shown), and for various connectivities (Fig. 3C). As shown more analytically in the, an additional excitatory current pushes the stable frequency of the delay-active neurons to higher values. Concurrently, the difference in membrane potential between the TP and the non-TP units increases (see ). As indicated by simulation results (data not shown), within the range of INaP,cons amplitudes examined here, the rise in the firing rate of the TP units via increasing the inhibitory feedback causes a decrease in the membrane potential of the non-TP units. Thus, higher afferent inputs are needed to drive these units above threshold; that is, it becomes more difficult for intervening stimuli to override the currently active neural representation. However, if INaP,consbecomes too big, there is again a downward trend in stability (evident from Fig. 3C as a slight downward bend in the curve for the highest connectivity). This occurs whenINaP,cons becomes high enough to push also the non-TP units closer to threshold (despite the increased inhibition), especially in concert with high connectivities. Nevertheless, within a reasonable range of INaP amplitudes, the pure enhancement of INaP attributable to DA action could be a major determinant of the stabilizing effect.
The voltage dependency of INaP as implemented in the present model neurons makes an additional contribution to the stability of currently active representations. This is shown in Figure3D, where the afferent input needed to disrupt the actual pattern is compared for the constant INaP and the voltage-dependent INaP as implemented here. To compare these two conditions, the respectiveINaP,cons values were set to exactly the same values that the voltage-dependent INaP of the delay-active neurons had at the time when the afferent input was injected (termed INaP,eff here), whileINaP,max was varied (for the constantINaP, INaP,eff =INaP,cons =INaP,max; for the voltage-dependentINaP, INaP,eff≤ INaP,max). Furthermore, shifting theINaP activation threshold αNaPtoward less positive potentials essentially has the same effect as increasing INaP,max, as illustrated in Figure3D. Only for very high effective INaPamplitudes, shifting the threshold becomes less efficient than increasing INaP,max. Note also that for the threshold variation simulations, INaP,eff is limited by INaP,max = 0.09.
The additional stabilizing effect of the voltage-dependentINaP compared with a constant currentINaP,cons is attributable to the fact thatINaP increases with membrane potential and does so steeper for higher potentials (unless αNa becomes very low). As a consequence, if αNaP is reduced, there is a bigger increase in INaP in the TP units that reside at a higher membrane potential than in the non-TP units. Thus, reducing αNaP not only increases an excitatory membrane current but in addition enlarges the difference inINaP activation between the TP and the non-TP units. In Figure 3B, the points where the trend in stability reverses with decreasing αNaP values indicate the points of maximum difference in INaP activation between the TP and the non-TP units. Below these points, the non-TP units gain more additional current than the TP units with decreasing αNaP values. In general, whether a decrease in αNaP results in an enlargement or a reduction of the difference in INaP activation between the TP and the non-TP units depends on whether the membrane potential of the TP or the non-TP units resides in a region of greater steepness of the sigmoid INaP activation function. In real neocortical pyramidal cells, this should always be the case for the membrane potential of the TP units because the point of maximum slope conductance (dI/dV) of the Na+ currents lies well above firing threshold (Cummins et al., 1994; Fleidervish et al., 1996).
The persistent Na+ current has been ascribed to a major role in synaptic amplification (Schwindt and Crill, 1995, 1996;Stuart and Sakmann, 1995). Basically, this view is fully compatible with the account given above. The model neurons are driven by excitatory synaptic inputs that activate INaP by pushing the membrane potential to higher levels. The amplification these synaptic inputs gain by activating INaPincreases at higher membrane potential levels, so that the TP units profit more from a shift of αNaP. However, one might argue that this is attributable to the fact thatINaP was placed only into the proximal compartment (see Eq. 1), where the recurrent synapses terminate. Although this model assumption is completely justified by the results of Stuart and Sakmann (1995) and immunocytochemical data on the distribution of Na+ channels by Westenbroek et al. (1989), it might not be well supported by the data of Schwindt and Crill (1995) and Mittmann et al. (1997), which suggest an amplification of distal EPSPs by INaP all along the apical dendrite. Hence, to rule out any possible objection one might base on a homogeneous dendritic distribution ofINaP, the simulations shown in Figure3A,B were rerun with model neurons whereINaP was inserted also into the distal compartment (with the same properties as in the proximal compartment). The results were essentially the same, and the stabilizing effect was not less in magnitude than the one shown in Figure 3A,B.
Contribution of the slowly inactivating K+current to stabilization of delay activity
Because the slowly inactivating K+ current like the persistent Na+ current increases with membrane potential but acts in the opposite direction, reduction of its amplitude (IKS,max) as induced by DA mirrors the effect that is produced by increasing the amplitude ofINaP. TP representations become more stable at various overlaps with the intervening stimulus (Fig.4A) and various degrees of connectivity (Fig. 4B) with decreasing values ofIKS,max. Just diminishing a source of (constant) negative current has a similar effect as an increase inINaP,cons. In addition, reducingIKS,max also results in a proportionally bigger decrease of the effective IKS in the TP than in the non-TP units because of the fact that IKSincreases with depolarization (see Eq. 2). Another way to put this is that IKS at higher membrane potentials more strongly withholds further depolarization induced by excitatory synaptic input, so that the TP units are affected to a bigger degree than the non-TP units by a partial removal of this current. As it was the case with the persistent Na+ current, this stabilizing effect is generally robust with respect to other parameter settings, like that of the steepness of theIKS activation function (βKS), its threshold (αKS), or the general excitatory synaptic efficiency (ηexc), although its magnitude depends on these parameters. We also verified that the stabilizing effect ofIKS,max reduction still holds whenIKS is inserted into the distal dendritic compartment in addition to its proximal placement.
Effects of DA-induced variations inIKS,max on the stability of TPs (as measured byIaff,crit). Dashed vertical linesindicate the parameter range within whichIKS,max during full network simulations varied. All other network parameters had the baseline values given in Table 1.OVL, Overlap; CON, connectivity. A, Reduction of IKS,max leads to higher stability for different overlaps, more pronounced at low overlaps (CON = 25%). B, Reduction ofIKS,max leads to higher stability for different connectivities, and this trend is more pronounced at low connectivities (OVL = 15%).
Contribution of the general excitatory synaptic efficiency to stabilization of delay activity
The effect of a reduction of the general excitatory synaptic efficiency (ηexc), which mimics the EPSP reduction observed after DA application in vitro (Pralong and Jones, 1993; Law-Tho et al., 1994), depends on the settings of the other network parameters and on the connectivity between the TP and the intervening stimulus. In particular, with the network model being in a low DA configuration (i.e., with all parameters assuming baseline values as given in Table 1), a reduction of ηexc only has a slightly stabilizing effect at different levels of overlap between the target and intervening pattern (Fig.5A), and only at degrees (up to 50%) of connectivity that are not too high (data not shown). However, with all other parameters having values of a high DA configuration (i.e., assuming maximal DA unit output, ΔfDA = 1.0 in Equation 6), reduction of ηexc has a strongly stabilizing effect at different degrees of overlap (Fig. 5B). This effect is much more pronounced for low degrees of connectivity, and nearly absent at very high connectivities (Fig. 5C). Thus, reduction of the general excitatory synaptic efficiency has a consistently stabilizing effect only in concert with other DA-induced parameter changes. This is shown in more detail in Figure 5D,E, which demonstrates for a moderate degree of overlap (15%) and connectivity (25%) that the stabilizing effect of ηexc reduction increases with decreasing values of the INaP activation threshold (αNaP) and decreasing values of the maximum IKS amplitude (IKS,max). Only for very low values of αNaP does the effect reverse for the same reason mentioned in the section on INaP. At some point, decreasing αNaP results in a decline of the difference inINaP activation between the TP and the non-TP units. The interaction of the DA-induced changes in ηexcwith changes of INaP orIKS is related to the fact thatINaP amplifies and IKSdiminishes excitatory synaptic input. Mathematically, this relationship can be understood by explicating the stable frequency equation of the delay activity (see , Eq. 11), where ηexc enters in a divisive fashion into the VNaP andVKS terms.
Effects of DA-induced variations in the general excitatory synaptic efficiency (ηexc) on the stability of TPs (as measured by Iaff,crit).Dashed vertical lines indicate the parameter range within which ηexc during full network simulations varied.OVL, Overlap; CON, connectivity. A, With all other network parameters being in a low (baseline) DA configuration, reduction of ηexc has only a slightly stabilizing effect at different overlaps (CON = 25%).B, With all other network parameters in a high DA configuration, reduction of ηexc has a >10-fold greater stabilizing effect (CON = 25%). C, In a high DA configuration, reduction of ηexc has a stabilizing effect at all except very high connectivities (OVL = 15%). D, The effect of a variation in ηexc is more pronounced at low than at high, except very low INaP activation thresholds (αNaP) (OVL = 15%;CON = 25%). E, The effect of a variation in ηexc is more pronounced at low values ofIKS,max (OVL = 15%;CON = 25%). F, In the high DA configuration, a reduction of ηexc only for PFCinternal excitatory synapses but not for afferent synapses has a slightly stabilizing effect for high but not for low degrees of overlap (CON = 25%).
Figure 5F demonstrates that in the high DA configuration the reduction of ηexc exerts its effect mainly but not exclusively by diminishing the impact of intervening stimuli on current network activity. Reducing the excitatory synaptic efficiency for theinternal connections only while leaving it constant for the afferent input still leads to a small stabilizing effect for higher degrees of overlap, whereas the effect reverses at low overlaps. Thus, the change in the internal network dynamics produced by ηexc reduction itself does not have a consistent effect on stability (although it would if INaP,maxwould be set very high).
Contribution of the coupling strength to stabilization of delay activity
The decrease of the coupling strength between the distal and proximal model compartment, which was meant to represent the dopaminergic modulation of a dendritic HVA Ca2+current (see Materials and Methods), not surprisingly strongly diminishes the impact that intervening stimuli have on current network activity. More interestingly, this effect is much more pronounced for short-lasting distal afferent inputs than for longer-lasting inputs (Fig. 6A), at various degrees of overlap and connectivity (data not shown). Hence, decreasing λpd has a much bigger impact on afferent high-frequency than on low-frequency events, a result well known from passive cable theory (Spruston et al., 1993, 1994). Thus, in a high DA condition, afferent inputs to the distal dendrites not only have to be stronger [as first suggested by Yang and Seamans (1996)] but also have to be longer lasting. Only very significant and persistent stimuli may thus gain access to the working PFC network.
Effects of DA-induced variations in a dendritic “HVA Ca2+ channel.” All other network parameters had the baseline values given in Table 1. OVL, Overlap;CON, connectivity. A, Decreasing the coupling strength (λpd) between the proximal and the distal “pyramidal cell” compartment diminishes the impact of intervening patterns on current network activity (as measured byIaff,crit). This tendency is much more pronounced for short stimulus presentation times (Δtstim). OVL = 15%;CON = 25%. Dashed vertical lines indicate the parameter range within which λpd during full network simulations varied. B, Reduction of the amplitude (IHVA,max) of an explicitly modeled dendritic HVA Ca2+ channel has a stabilizing effect within a reasonable parameter range (IHVA,max < 0.17) at different overlaps (CON = 25%). C, Reduction of the amplitude (IHVA,max) of an explicitly modeled dendritic HVA Ca2+ channel has a stabilizing effect within a reasonable parameter range at different connectivities (OVL = 15%).
The implementation of the dopaminergic modulation of a dendritic HVA Ca2+ current by variation of the coupling strength was chosen for simplicity. This kind of implementation is reasonable in terms of the physiological effects that a DA-induced reduction of a dendritic HVA Ca2+ current has on the current flow from the distal to the proximal dendrites and thus on distally induced EPSPs (see Materials and Methods). Nevertheless, to further confirm the hypothesis that reduction of a dendritic HVA Ca2+current reduces the impact of interfering stimuli and thus helps to stabilize currently active patterns, we also looked for the effects of modulating an explicitly modeled HVA Ca2+ current (IHVA) inserted into the distal (apical dendrite) model compartment. This current was given a higher activation threshold than INaP, and its contribution to membrane voltage was described by:
When inserted into the distal compartment, Equation 1bchanges to:
For the simulation runs includingIHVA, λpd was decreased from 0.7 to 0.2 because part of the current flow from distal to proximal results from activation of HVA Ca2+channels distributed along the apical dendrites (Durstewitz and Seamans, 1997; Seamans et al., 1997).
As apparent from Figure 6B,C, decreasing the amplitude IHVA,max of the distal HVA Ca2+ current in fact leads to stabilization of the currently active pattern within a large range of current amplitudes for different degrees of overlap and connectivity. However, for very large values of IHVA,max (much larger thanINaP,max andIKS,max, as given in Table 1), there is a sudden jump onto a higher level of stability where the relation betweenIHVA,max reduction and stability reverses. This occurs whenever a depolarization of the distal compartment is maintained at a very high level through almost full activation of the remote Ca2+ channels. This in turn could happen when the current amplitude (IHVA,max) becomes very high or the IHVA threshold becomes very low, or when there is a very loose electrotonic coupling between the proximal and the distal compartment, i.e., when λpd gets close to 0. However, these represent rather extreme cases, so that within a physiologically reasonable parameter range reduction ofIHVA,max increases stability, as opposed to the effect of reducing the proximally located, lower thresholdINaP.
Contribution of inhibitory activity to stabilization of delay activity
An enhancement of the general inhibitory synaptic efficiency (ηinh), as possibly induced by DA (Rétaux et al., 1991; Yang et al., 1997), has a destabilizing effect on current delay activity, i.e., makes it easier for afferent patterns to interrupt current network activity, although this tendency is not very pronounced for the parameter range used in the full model simulations (ηinh ≥1.1), and is clearly surpassed by the other DA-induced parameter changes (e.g., as evident from Fig.2A). Slight destabilization occurs for various overlaps (Fig. 7A) and degrees of connectivity (Fig. 7B). The same holds for a reduction of the inhibitory unit firing threshold (θinh) (data not shown), which might represent the increased spontaneous firing frequency of GABAergic neurons under dopaminergic control (Rétaux et al., 1991). Hence, the dopaminergic modulation of GABAergic neuron activity is the only effect of DA that does not seem to fit into the present framework (but see Discussion). However, it should be mentioned that some authors have also reported a reduction of GABAergic currents caused by DA, not only in the basal ganglia (Bergstrom and Walters, 1984; Mercuri et al., 1985) but also in the PFC (Law-Tho et al., 1994). As apparent from Figure 7, a reduction of ηinh leads to higher stability of the TP and is thus consistent with the function of DA proposed here.
Effects of DA-induced variations in the inhibitory synaptic efficiency (ηinh) on the stability of TPs (as measured by Iaff,crit). Dashed vertical lines indicate the parameter range within which ηinh during full network simulations varied. All other network parameters had the baseline values given in Table 1.OVL, Overlap; CON, connectivity. A, Within the parameter range used during full network simulations, increase of ηinh has a mildly destabilizing effect for different overlaps (CON = 25%). B, Same asA for different connectivities (OVL = 15%).C, Simulation of a DMS task with the full network shows too high pyramidal cell activity peaks eventually followed by a collapse of the TP when ηinh (1.11) is kept constant.
The DA-induced enhancement of synaptic inhibition, although having a slightly detrimental effect on TP stability, might fulfill another purpose during working memory processing. The DA-induced increase in synaptic inhibition concurrently with the other DA-induced changes may be necessary to prevent excessive excitation that could result from the enhancing effects of DA on pyramidal cell activity, i.e., may be necessary to keep the pyramidal cell activity within certain boundaries. This is illustrated in Figure 7C. If the baseline value of ηinh is slightly reduced (to 1.11) compared with the standard parameter set given in Table 1 and is not varied according to the level of DA unit output (i.e., is kept constant), the full network driven by excitation that is too strong shows very high activity peaks during presentation of the stimuli, which like the “match enhancement” will eventually cause the TP to collapse. The DA-induced increase of ηinh by allowing other DA-modulated network parameters to assume more extreme values might in fact indirectly contribute to stabilization. Thus, increasing ηinh from 1.191 to 1.252 allows a further reduction of αNaP and IKS,max in the high DA state via increasing the χshift (Eq. 6) for these two parameters 1.27-fold while keeping the level of delay activity below a given limit. The result is an overall increase in stability of ΔIaff,crit ≈ 0.05, i.e., the increase in ηinh although it is by itself destabilizing enables a net increase in stability via further reduction of αNaP andIKS,max (this trend was confirmed for several pairs of ηinh/χshift values). As illustrated next, detrimental network performance could occur even in the presence of a DA-induced enhancement of inhibition if the DA unit output is increased to supranormal levels.
Supranormal DA levels might disrupt correct network performance
Behavioral reports indicate that supranormal stimulation of D1 receptors or supranormal DA levels in the PFC, as caused by stressful events or anxiogenic drugs, might disrupt working memory performance as subnormal stimulation or DA receptor blockade does (Murphy et al., 1996a,b; Zahrt et al., 1997). Moreover, the firing frequency of delay-active PFC neurons might bear an inverse U-shaped relation to the level of DA receptor stimulation (Sawaguchi et al., 1990a,b; Williams and Goldman-Rakic, 1995). To test the idea that extreme changes in DA-modulated biophysical parameters have a destructive effect on working memory performance, the DA level in the PFC was strongly increased by setting γDA in Equation 7 to 1.9 (++DA condition). The effect of this manipulation on network performance in the DMS task can be assessed from Figure8. Excitatory neurons in the network show premature activity peaks (Fig. 8A), leading in turn to premature motor responses (Fig. 8B) and to temporarily strongly increased inhibitory feedback. This interplay leads to uncontrolled network oscillations without any meaningful relation to the stimulus situation. The temporarily strongly decreased membrane potential of the TP units and thus temporarily weak inhibitory impact on the non-TP units also enables intervening stimuli to override the currently active representation, i.e., the current working memory content is destroyed (Fig. 8A, IS1). This fatal behavior of the network could not be prevented by letting the inhibition increase slightly stronger with the output of the DA unit than other network parameters under the ++DA condition relative to the +DA condition (i.e., setting γDA > 1.9 for ηinh only).
Activity of the PFC network under conditions of supranormal DA unit output (++DA) during two successive trials of a DMS task with intervening stimuli. A, Mean proximal membrane potential of all PFC net units belonging to the pattern “4” (=TP1; see Fig. 2) and pattern “0” (=TP2; see Fig. 2). Gray bars indicate the time intervals during which stimuli were presented. Three intervening stimuli were presented during each trial as described in Figure 2. The TPs are disrupted by intervening stimuli. Iaff = 0.55. B, Membrane potential of the motor unit, showing many premature motor responses.
DISCUSSION
To gain insights into dopaminergic functions and mechanisms during working memory processing in the PFC, a neural network model was constructed within which the dopaminergic modulation of several cellular and synaptic parameters could be implemented. Simulation results with this model network suggested that the DA-induced changes of biophysical properties of pyramidal cells and glutamatergic synapses are appropriate for stabilizing neural representations in the PFC working memory net, and thus for protecting goal-related delay activity against interfering stimuli. The dopaminergic modulation of GABAergic activity might be necessary in this context to prevent excessive excitation. Furthermore, extreme shifts in DA-modulated parameters could be as detrimental for working memory performance as no DA-induced variation at all because of uncontrolled network oscillations and premature responses. Thus, in the model net as is apparent in behavioral data (Murphy et al., 1996a; Zahrt et al., 1997), there was an optimal level of DA modulation.
Combining experimental results into a unifying explanatory neurocomputational framework
The network model presented here integrates various behavioral, neuropsychological, electrophysiological, and pharmacological in vitro and in vivo results into a unifying concept of dopaminergic functioning in the PFC and could contribute to an understanding of the biophysical mechanisms underlying this functioning. On the behavioral level, the model provides a mechanistic explanation of where the working memory and attentional deficits encountered after lesions or blockade of components of the dopaminergic input to the PFC (Brozoski et al., 1979; Simon et al., 1980; Sawaguchi and Goldman-Rakic, 1994) could come from. If no dopaminergic modulation of parameters was assumed in the model network (−DA condition in Fig.2), active representations in the PFC net were unstable, i.e., could easily be wiped out by interfering stimulation.
Stability of active neural representations in working memory is a necessary prerequisite for (1) guiding action according to a behavioral plan or goal, (2) focusing attention on goal-relevant objects in the environment, and (3) protecting goal-related behavior against interfering stimuli or behavioral tendencies. In terms of the neural dynamics, stable goal-related representations in PFC networks might actively suppress presently irrelevant response options or might prime representations of goal-relevant responses and sensory objects (Fuster et al., 1985; Desimone et al., 1995). Thus, according to the present neurocomputational model, various attentional and working memory disorders observed after prefrontal and dopaminergic system lesions in fact might be related to the same neural mechanism, namely to the ability of the prefrontal/dopaminergic system to stabilize neural representations. Indeed, in favor of this hypothesis, susceptibility to interference and distractibility are also prominent features of animals with prefrontal or DA system lesions, and working memory performance can generally be enhanced by reducing possible sources of interference (Montaron et al., 1982; Fuster, 1989; Roberts et al., 1994).
On a physiological level, the model might help to understand some seemingly paradoxical effects of DA. On the one hand, DA increases excitability and spike output of prefrontal pyramidal neurons via enhancing INaP and suppressingIKS (Yang and Seamans, 1996). On the other hand, the DA-induced reduction of EPSP sizes and dendritic Ca2+ conductances acts in the opposite way, i.e., decreases excitability and spike output on synaptic stimulation. However, the model simulations suggested that all of these effects might in fact cooperate to stabilize neural representations in the PFC network. Whereas the former two effects raised the stable frequency of the TP units, thereby increasing feedback inhibition and reducing non-TP unit activation, the latter two effects diminished the impact of intervening afferent stimulation more directly. Thus, all of the DA-induced parameter changes might subserve the same function of stabilizing goal-relevant representations in working memory.
The only dopaminergic effect that does not easily fit into the present framework is that of DA on GABAergic activity. The dopaminergic modulation of GABAergic activity might have other functions during working memory processes that could compensate for the slightly detrimental effect it has on TP stability. An increase in synaptic inhibition concurrently with the DA-induced enhancement of pyramidal cell activity might be necessary simply to prevent excessive excitation that could result from the “excitatory” effects of DA. Moreover, an increase in synaptic inhibition might actually allow bigger changes in other DA-modulated parameters, thereby promoting the stabilizing effect of other DA-induced changes and increasing the net effect on stability. The dopaminergic modulation of GABAergic activity might also help to reset the working memory buffer after a goal state has been achieved, thus preventing the perseveration of TP representations. In the framework of the present model, however, this would require that the DA-induced changes in GABAergic neurons and synapses have a different time course or dynamic than the DA-induced changes in pyramidal cells and glutamatergic synapses, so that the effects on GABAergic activity persist for some time after the other DA-induced effects started to cease and/or reach a particularly high peak during the match enhancement.
Further experimental testing of model assumptions
The mean electrophysiological behavior of the delay-active model neurons matched quite well the average course of activity observed during in vivo recordings in the PFC (Miller et al., 1996). Moreover, a DA-induced enhancement of cue-, response-, and delay-related neural activity in working memory tasks as exhibited by the model (Fig. 2A) has also been demonstratedin vivo (Sawaguchi et al., 1988, 1990a), whereas DA receptor blockade might reduce task-related activity at high (Sawaguchi et al., 1990b) but not low (Williams and Goldman-Rakic, 1995) doses. In addition, DA increases the signal-to-noise ratio in delay activityin vivo (Sawaguchi et al., 1990a,b) like it increases the difference between TP and non-TP unit activity in the model. However, one critical prediction of the present model still awaits empirical confirmation. Higher doses of DA antagonists applied locally in the PFC during delay tasks with intervening stimuli should lead to a breakdown of activity of most delay-active neurons on the presentation of an intervening stimulus. In contrast, without antagonizing DA effects, activity of delay-active neurons should be enhanced on presentation of intervening stimuli. That is, intervening stimuli should influence current delay activity in opposite ways depending on the level of DA. To test this prediction, one would have to combine theMiller et al. (1996) task with local DA antagonist application and concurrent electrophysiological recordings. The question of whether recurrent excitation of PFC pyramidal cells is enhanced by DA and thus could provide a mechanism for stabilizing delay activity might also be addressed in vitro by dual cell recordings (Markram et al., 1997).
Another assumption made by the model that is open to experimental testing was that the PFC could dynamically regulate its own DA level via its efferent projections to the VTA/SN. Although this issue is not of central importance for the main hypothesis of the present model (as outlined in Materials and Methods), in our opinion, dynamic, context-dependent self-regulation of the prefrontal DA level provides a very interesting theoretical possibility, and the temporal relationship between the onset of stimulus-related and delay activity in the PFC and in the SN/VTA should be investigated in vivo.
Extensions of the present model
The present work showed that the DA-induced biophysical changes are, in principle, appropriate for stabilizing neural representations in the PFC network during working memory tasks. To show this, a model on a relatively high level of biological abstraction was chosen. This model had the advantage that the biophysical mechanisms leading to the proposed function of DA in working memory could be analyzed and understood relatively easily. However, as a next step, it should be confirmed that the same functional effects of DA also hold in a network of biologically very detailed compartmental model neurons (Durstewitz and Seamans, 1997; Durstewitz, 1998). In a more detailed network model it might also be possible to find a functional interpretation for the DA-induced changes in GABAergic unit activity. For example, increased GABAergic interneuron activity and IPSP sizes (Rétaux et al., 1991; Yang et al., 1997) might induce a mode of synchronous oscillations in which GABAergic interneurons probably play an important role (Lytton and Sejnowski, 1991; Cobb et al., 1995; Bush and Sejnowski, 1996). This mode of synchronous oscillations, besides providing a representational medium (Singer, 1993; König et al., 1996), might indeed have an additional stabilizing effect on current delay activity. This is a question that cannot be examined with the present model neurons with their mean frequency output.
In conclusion, it is predicted that the role of DA is to stabilize critical, goal-related delay activity and to protect it against interfering stimulation and response tendencies, regardless of the kind of working memory task used. In addition, we would like to point out that the function of DA proposed here might not be restricted fto working memory processes, because stable, maintained neural activity probably plays an important role in many sensory motor processes and operant learning situations in which DA is involved (Salamone, 1992,1994; Beninger, 1993).
Appendix
We will show here that an additional source of current, as provided by the DA-induced enhancement of the persistent Na+ current, present in all model neurons will push the stable frequency of the delay-active TP units to higher values and will increase the difference in membrane potential between the TP and the non-TP units. To show this, we make the following assumptions. (1) The network is in an attractor state with suprathreshold delay activity, i.e.:dVp/dt =dVd/dt =dVinh/dt = 0, andVp > θexc for all TP neurons. (2) For all non-TP units, fexc = 0. This will usually be the case if some TP is active, and neitherINaP,max nor the connectivity or the overlap between the TP and the intervening pattern become too high. (3)finh > 0. This, again, should usually be the case if a TP is active, because otherwise excitation could spread throughout the entire network. (4) For simplicity, we will furthermore assume that IKS (and thusVKS) is a constant. Assuming (1), the distal membrane potential is given by:
Equation 8Inserting Equations 4 and 8 into Equation 1a, we get for the proximal membrane potential in the stable state:
Equation 9with a1 = (2 λpd + 1)/(λpd + 1) > 0 for λpd ≥ 0 anda2 = (λpd ηexcIaff)/(λpd + 1). If synaptic connectivity is strictly defined by the Willshaw matrix (Eq.5), then all the delay-active excitatory neurons receive exactly the same input and settle at the same stable frequencyfexc > 0. Thus, Equation 9 simplifies to:
Equation 10Inserting Equation 3 into Equation 10, we can rewrite this equation as:
Equation 11with b1 = −a1/(ηexc − ηinh ηexc) > 0,b2 = ln(θexc) − (ηinhθinh + VKS +a2)/(ηexc − ηinh ηexc), andb3 = −R/(ηexc − ηinh ηexc) > 0 (provided that ηinh > 1 as in Table 1; if ηinh < 1, bothb1 and b3 become negative, in which case an analysis can be performed analog to the one presented here, leading to the same results). The solutions of this equation are the intersections of the straight line on the left-hand side and the logarithmic function on the right-hand side, as plotted in Figure 9. For the parameter settings used in the present simulations (ηinh > 1), only one intersection and thus only one solution exists. This solution is a stable state (fix point attractor) of the network (Amit and Brunel, 1995). Indicating the intersection withVX, this can be shown by verifying thatdVp/dt > 0 forVp ε] θexc;VX[ anddVp/dt < 0 forVp > VX, because of the fact that the logarithmic function lies below the straight line for Vp < VX, and lies above it for Vp >VX.
The crossings of the logarithmic function with the straight lines give the stable membrane potential of the TP units for conditions of lowINaP,cons (=0.04), highINaP,cons (=0.09), and high connectivity (INaP,cons = 0.04) where the non-TP units become active above threshold.
Now one can see directly from Equation 11 that increasingINaP, as accomplished by DA, will move the straight line in a positive direction on the y-axis as shown in Figure 9. Thus, the intersection VXmoves to the right, i.e., the stable membrane potential and hence the stable frequency increase. For the neurons not involved in encoding the target stimulus, the situation looks quite different. For these (non-TP) neurons, the proximal membrane potential in the stable state is given by:
Equation 12where CON denotes here the relative (to NS − 1) number of inputs that the respective non-TP unit receives from TP units, because of an overlap between the patterns or the “pure” connectivity as defined in Materials and Methods (note that Vp,non-TP does not occur on the right-hand side). Note that the assumptions made at the beginning imply that CON < 1.0. Comparing Equation 12 with 10, one sees that by increasing INaP for all neurons, the difference in membrane potential between the TP and the non-TP units will increase by an amount [1 − CON] ηexcΔfexc, where Δfexc is the increase in the stable frequency of the TP units attributable to the enhancedINaP. Thus, providing an additional source of excitatory current to all model neurons enlarges the difference between TP and non-TP unit activation.
Note that this analysis strictly holds only under the assumption thatfexc = 0 for the non-TP units. If too many network units become active close in time, as it happens with too high connectivites or too high values of constantINaP injection, the stable membrane potential decreases (as illustrated by the dotted line in Fig. 9) and may be temporarily pushed below the excitatory threshold by the fast rising inhibitory feedback. (Even in cases in which the stable frequency still lies above the excitatory threshold, in the dynamic model the membrane potential may be pushed below it, depending on the time constants of the excitatory and inhibitory units.)
Footnotes
This research was supported by grants of the Alfried Krupp-Stiftung (D.D., O.G.) and the Deutsche Forschungsgemeinschaft through its Sonderforschungsbereich NEUROVISION (O.G.). We are very thankful to Dr. Jean-Marc Fellous and to Dr. Jeremy Seamans for their helpful comments on this manuscript.
Correspondence should be addressed to Dr. Daniel Durstewitz, Salk Institute for Biological Studies, Computational Neurobiology Laboratory, 10010 North Torrey Pines Road, La Jolla, CA 92037.