Fast Remapping of Sensory Stimuli onto Motor Actions on the Basis of Contextual Modulation

Introduction

If somebody suddenly holds your hand, your reaction may vary dramatically depending on whether the person who touches you is a nurse taking your pulse, a son grabbing your attention, or a stranger with unknown intentions. Clearly, the impact of a perceived stimulus depends on other concurrent stimuli, recent and distant events, and current motivations and goals (Drea, 1998; Platt and Glimcher, 1999; Handel and Glimcher, 2000; Wise and Murray, 2000; Hobin et al., 2003). How is all of this context information combined and used to influence motor behavior?

A generic way by which the nervous system integrates information from various modalities or sources is through changes in gain (Andersen et al., 1997; Salinas and Thier, 2000; Salinas and Abbott, 2001; Salinas and Sejnowski, 2001). Neurons with so-called “gain fields” react to certain sensory stimuli, but their overall responsiveness varies as a function of some modulatory parameter, which does not affect their selectivity. Many cases of gain-modulated (GM) responses have been documented, and theoretical work has shown that, in general, they are useful for performing coordinate transformations (Zipser and Andersen, 1988; Andersen et al., 1993; Salinas and Abbott, 1995, 1997; Pouget and Sejnowski, 1997; Deneve and Pouget, 2003). For instance, eye-centered visual receptive fields that are gain modulated by the direction of gaze can give rise to body-centered receptive fields downstream (Zipser and Andersen, 1988; Salinas and Abbott, 1995, 1997; Pouget and Sejnowski, 1997). However, previous models and neurophysiological experiments have focused almost exclusively on modulation by internal or proprioceptive signals, such as gaze direction (Andersen and Mountcastle, 1983; Andersen et al., 1985, 1990; Brotchie et al., 1995), eye or head velocity (Snyder et al., 1998; Shenoy et al., 1999), arm position (Buneo et al., 2002), or attentional location (Connor et al., 1997; McAdams and Maunsell, 1999; Treue and Martínez-Trujillo, 1999), which are directly combined with spatial sensory information to produce a change in reference frame (Andersen et al., 1993; Pouget and Snyder, 2000; Salinas and Thier, 2000; Salinas and Abbott, 2001).

This study suggests that the nervous system might generalize this strategy to situations in which the transformation is more abstract and depends on arbitrary context signals that contain no intrinsic spatial value. For example, consider a musician who can play the flute and the violin; the stimulus is the score of a tune. While playing, the printed notes are translated into finger and mouth movements that are specific for each instrument. In switching instruments, the functional connectivity between visual and motor networks in the brain changes drastically and almost instantaneously. The contextual input does not shape the sensory-motor map, however; it simply identifies the correct one. That is, context indicates which instrument to play but not how to play it.

To establish a clear link with possible neurophysiological experiments, the results are presented here in terms of a hypothetical remapping task that requires the same type of sensory-motor flexibility just discussed but is well suited for experimental work with awake primates. The computer simulations presented here show that a network with sensory neurons that are gain modulated by context cues can solve this task efficiently.

Materials and Methods

All simulations were performed using Matlab (The Mathworks, Natick, MA). The code is available on request.

Visuomotor task. The task used to investigate the remapping problem is schematized in Figure 1. In any trial of this task, 1 of 16 stimuli (Fig. 1e) is presented, and the subject has to classify it. There are four possible response targets, and the chosen class is indicated by an eye movement made toward one of the targets. Crucially, there are five task conditions, four that generate unique maps between stimuli and responses plus an additional no-go condition in which a stimulus is presented but no movement is made. The condition that applies in each trial is indicated by a separate nonspatial cue, the color of the fixation spot, which acts as the context.

Network architecture. The network that simulates the task has two layers. The first contains GM neurons, and these drive a second layer of output or motor neurons through a set of connections. Each GM unit makes contact with all output units. In each trial of the task, the GM neurons are activated by the sensory and context signals, and a movement is generated by the output neurons. For this, the profile of activity of the output neurons should have a single peak indicating the location (or direction) of the movement to be made. Note that the temporal development of the task is not modeled, just the sensory-motor associations.

GM responses. The GM neurons respond to the stimuli, but their selectivity for individual features, including length, color, and orientation, is not modeled explicitly. A particular stimulus is simply a label between 1 and 16 that evokes a certain amount of activity in each GM unit. Although actual neuronal responses typically vary smoothly as functions of single sensory features, this is a reasonable simplification when only a few stimuli are selected from a vast, multidimensional feature space, as in the present task.

The stimulus is indicated by x, which takes integer values from 1 to 16. The context or condition is indicated by y, which takes integer values from 1 to 5. The mean firing rate, r_j, of GM unit j depends on x and y, and is written as follows: (1) where f_j(x) and g_j(y) are functions that vary between 0 and 1, B is a baseline rate equal to 4 spikes/sec, r_max = 35 spikes/sec, and D is the modulation depth. Throughout this study, D = 0.5, which produces a maximum contextual suppression of 50%. To include neuronal variability, Gaussian noise is added independently to each GM response in every trial of the task. The noise is multiplicative: the variance of the noise for unit j is equal to αr_j (see Fig. 4 legend).

The gain functions g_j(y) take five values, one for each task condition. These values are g_j(y) = {1, 0.8, 0.5, 0.3, 0}. Crucially, they are assigned randomly to each of the five conditions, with a new random permutation for each GM unit. As a final step, the g_j(y) values are jittered by small random amounts. In this way, context affects each GM neuron differently. The tuning functions f_j(x) are generated using the same procedure but different numbers. First, 16 preset values between 0 and 1 are generated. Second, for each unit j, these are dealt randomly to the 16 stimuli, with a different permutation for each GM neuron. Finally, random jitter is added to each f_j(x). This guarantees that there is no topography, and that all neurons have different tuning functions.

Output responses. The firing rate R_i of output unit i is calculated through a weighted sum of GM rates: (2) where w_ij represents the synaptic connection from GM neuron j to output neuron i. This expression is used when the GM neurons drive the output neurons. However, there is also an intended or desired response for each output neuron, F_i(x,y), which is used only when setting the connections: (3) where y = 5 is the no-go condition, σ = 0.35 and c_i, the preferred target location of unit i, varies uniformly between –3 and 3. The intended output profile of activity is obtained by plotting the above expression as a function of c_i. In go trials, this corresponds to a Gaussian profile that peaks at T(x, y), which is the target location (–2, –1, +1, or +2) that corresponds to the correct classification of stimulus x in condition y (see Fig. 1). In no-go trials, all output neurons should keep firing at the baseline rate B. The number of output units is always 30. The center of mass of the output activity T_out is interpreted as the encoded target location, and is given by: (4) The error is equal to T(x, y) – T_out, and is computed in go trials only.

Synaptic weights. The connections to any given output neuron are chosen so that they minimize the average squared difference between intended and driven responses. To simplify the notation, consider only one output neuron with driven response Σ_j w_j r_j and intended response F(x, y). The row vector contains all of the connections to this chosen postsynaptic neuron, and the optimal values are given by: (5) where (6) (7) Here, angle brackets indicate an average over all values of x and y and over multiple trials, and C^–1 is the inverse of the correlation matrix C. This inverse (or the pseudoinverse) is found numerically. To compute the above averages, all GM rates are evaluated using Equation 1 plus the noise terms. Because the noise is multiplicative and uncorrelated across neurons, it contributes an amount α〈r_i〉 to each diagonal element C_ii. The connections to other output units are computed in the same way, with different vectors but the same matrix C^–1.

Additional modifications. The basic model just described is also tested with four additional manipulations. The first is to make the tuning and gain functions binary, which restricts the mean GM responses to three values. That is, the five gain factors for neuron j are now g_j(y) = {1, 1, 1, 0, 0}, again with a random permutation for each neuron. Similarly, f_j(x) consists of n ones and 16 – n zeros, randomly permuted. Under these conditions, Equation 1 can generate only three rates: r_max + B, r_max(1 – D) + B, and B. Performance in the simulations depends on n, which determines the frequencies of the three rates.

The second manipulation is to use correlated instead of independent noise. The response of GM unit j is equal to r_j + σ_jγ_j, which is the sum of the mean rate plus a noise term; σ_j is the SD of the response, and γ_j is drawn from a Gaussian distribution with zero mean and unit variance, that is, 〈γ_j 〉= 0 and . The key to generating correlated samples is to determine the matrix of desired correlation coefficients, which has entries 〈γ_jγ_k〉. All elements along the diagonal are equal to 1. Off the diagonal, when samples are drawn independently, 〈γ_jγ_k〉 = 0. When all pairs are equally correlated, 〈γ_jγ_k〉 = ρ, and when correlations are proportional to the overlap between response curves: (8) where ρ measures the correlation strength and is between 0 and 1. Given this matrix, correlated samples can be obtained, for instance, by calling the Matlab function mvnrnd. Although noise correlations can also be included in the calculation of synaptic weights, this makes little difference; thus, results are reported using the unmodified method described above.

In the third manipulation, the GM cells combine sensory and context signals linearly. In this case, the mean firing rate of GM cell j is given by: (9) instead of Equation 1.

Finally, an alternative nonlinear interaction between stimulus and context is implemented by substituting Equation 1 with: (10) where the brackets indicate rectification; that is, [x]₊ = max{0,x}. In each case, everything else is as in the original simulations.

Results

The model network performs the visuomotor task shown in Figure 1. In each trial, the GM neurons respond to the sensory and context signals and drive a set of output or motor neurons, which then generate an eye movement.

The responses of two representative GM units are displayed in Figure 2, a and c. The plots show the firing rates evoked by each stimulus, with different colors corresponding to different task conditions or contexts. The cells respond more strongly to some stimuli than to others, and their preference order is different. In Figure 2a, the three most effective stimuli are 9, 14, and 10, whereas in Figure 2b, they are 3, 15, and 2. In the network, the preference sequences are set randomly, so each cell ends up with a random stimulus–response curve, or tuning curve, that is unique. However, note that these tuning curves have the same shape for the five modulatory conditions. This is crucial and reflects the key assumption that context influences the sensory responses by changing their gain; thus, the five curves differ only in their amplitudes. Indeed, this is achieved by modeling each GM response as a product of two factors, one that depends only on the stimulus and another that depends only on the condition (see Materials and Methods). In this way, context affects the overall responsiveness of the neuron but not its selectivity, which is the defining feature of gain modulation (Salinas and Thier, 2000; Salinas and Abbott, 2001; Salinas and Sejnowski, 2001). Plotting the GM responses in the format of Figure 2, b and d, is an alternative way to reveal gain variations (Fig. 2 legend) (McAdams and Maunsell, 1999). Another important feature of the GM units is that the order in which they prefer the five conditions is set randomly, so it is also different for each cell (see Materials and Methods).

The firing rate of each output neuron in the model is determined by a weighted sum of GM rates in which the weights represent synaptic connections. The output population is meant to encode the location of a target for an impending movement. Thus, in every go trial, the evoked profile of activity should have a single peak indicating the correct target location, which depends on the stimulus and the context of that trial. In the no-go condition, however, all output responses should stay at their low baseline level, so the profile should be flat. The connections that achieve all of this as best as possible are found through an optimal algorithm (see Materials and Methods). This algorithm is run only once; afterward, the synaptic weights are not adjusted any further.

Having specified the GM tuning curves and the network connections, the model is tested in a series of trials of the task. Each trial proceeds by (1) choosing a stimulus and a context, (2) generating all GM responses (Eq. 1), (3) calculating the driven, output firing rates (Eq. 2), and (4) calculating the center of mass of the output activity (Eq. 4), which is taken as the encoded target location. Finally, the encoded location is compared with the location that should have been reached given the stimulus and the condition. It is important to note that noise is added to all GM responses in each trial of the task (see Materials and Methods). This is to simulate neuronal variability and evaluate the robustness of the model.

Figure 3 illustrates the behavior of the full model in four single trials. Here, 30 output neurons are driven by 864 GM units. The GM responses are color coded and, for graphical purposes, are ordered according to preferred stimuli. There is no single focus of intense activity, only a diffuse band. This is because the neurons preferring, for example, stimulus 8 are clustered together, but the neurons that have stimulus 8 as their second or third preferred stimulus are randomly scattered. The output neurons, ordered by their preferred target locations, are meant to produce a peak of activity at either of four points, –2, –1, +1, or +2, which correspond to the four response targets in the task (Fig. 1). In some trials, there is a clear single peak of activity at or very near the proper target location (Fig. 3a,b). In other trials, secondary peaks are evident (Fig. 3c). These arise because of the noise added to the GM responses; they entirely disappear with zero noise. Their effect is to shift the center of mass, increasing the error. Overall, however, the model performs accurately, because the encoded target location (red vertical line) is typically very close to the intended one (black vertical line) for all combinations of stimulus and condition.

The model also performs correctly in the no-go condition; the profile of output responses is approximately flat, with rates close to the baseline firing level (Fig. 3d). This can be quantified by measuring the highest firing rate of all motor neurons in go versus no-go trials. For the network of 864 GM neurons, in no-go trials the maximum rate was on average 8.9 ± 2.5 (SD) spikes/sec, whereas in go trials, it was 35.6 ± 4.2 spikes/sec. Also, without noise, the profile of output responses was perfectly flat.

The accuracy of the network in go trials depends on the variability of the GM neurons. That is, the difference between correct and encoded target locations (the error) increases with noise. In the simulations in Figure 3, the variance of the noise of each unit was equal to the mean response of the unit, and the ensuing root mean square (rms) error was 0.2 (the average error was practically 0, because positive and negative deviations were equally likely); for reference, recall that the maximum separation between targets is 4 units. One way to measure the robustness of the model with respect to noise is to plot the rms error as a function of the number of GM neurons, N, as in Figure 4a. The error decreases sharply (faster than ) indicating that noise is what limits the performance of the network. In accordance, when no noise was added, the error was virtually zero. The performance of the network can also be quantified by considering a trial successful whenever the encoded target location is within a certain fixed distance from the proper target. In this way, a percentage of incorrect classifications or incorrect movements can be measured. This classification error also drops sharply with network size (Fig. 4b).

Discussion

The model presented here achieves drastic, context-dependent changes in functional connectivity, which is a way of folding multiple networks, each rendering a specific sensory-motor map, into one. The underlying mechanism is the same as that proposed for performing coordinate transformations from one reference frame to another (Zipser and Andersen, 1988; Andersen et al., 1993; Salinas and Abbott, 1995, 1997; Pouget and Sejnowski, 1997; Deneve and Pouget, 2003) and has the great advantage that the output neurons can read out the correct maps using a simple algorithm, a weighted sum. However, three novel results stand out. First, previous modeling studies typically aimed to combine a modulatory quantity with some feature of a stimulus. The classic example is adding eye position to stimulus position in retinal coordinates to obtain the location of the stimulus in head-centered coordinates (Zipser and Andersen, 1988; Salinas and Abbott, 1995; Pouget and Sejnowski, 1997). In contrast, here, the stimuli and modulatory cues do not need to be related or combined in any particular way. Second, no sensory topography is required. Variants of the model in which the GM responses change smoothly across the population or across stimuli also work, and this smoothness is important for generalization, that is, for correctly classifying novel, unseen stimuli (data not shown). However, it is not strictly necessary for selecting among previously learned maps, as this model does. Finally, the dramatic changes in motor activity can be driven by relatively subtle variations in the firing of the GM cells: the maximum decrease in a GM rate between two conditions was 50% (see Materials and Methods), and the average decrease was ∼25% (Fig. 3, compare a and b). These numbers are well inside the range of experimental values reported for modulatory variables such as attention (Connor et al., 1997; McAdams and Maunsell, 1999; Treue and Martínez-Trujillo, 1999).