Abstract
We investigated the neural dynamics of sensorimotor transformations in the parietal reach region (PRR) of monkeys. To dissociate sensory from motor goal representations, we used a memory-guided anti-reach task. The monkeys had to reach either to a visually instructed, memorized peripheral target position (pro-reach) or to a diametrically opposed position (anti) while keeping central ocular fixation. Pro- and anti-reaches were randomly interleaved and indicated by a color instruction from the beginning of each trial. We analyzed spatiotemporal single-cell tuning and performed time-resolved population decoding to quantify the dynamic representation of the spatial visual cue, the reach goal, and the currently valid task rule (pro/anti mapping). Sensory information regarding the visual cue position was represented weakly during a short period of cue visibility. PRR predominantly encoded the reach goal from the end of the cue period on. The representation of the reach goal in the memory task evolves later for the anti- compared with pro-reaches, consistent with a 40–50 ms difference in reaction time between the two task rules. The task rule could be decoded before the appearance of the spatial cue, which indicates that abstract rule information is present in PRR that is independent of spatial cue or motor goal representations. Our findings support the hypothesis that PRR immediately translates current sensory information into reach movement plans, rather than storing the memorized cue location in the instructed-delay task. This finding indicates that PRR represents integrated knowledge on spatial sensory information combined with abstract behavioral rules to encode the desired movement goal.
- sensorimotor transformation
- posterior parietal cortex
- motor intention
- goal-directed behavior
- anti-reach
- S–R compatibility
Introduction
Identical external sensory information can be used to plan and guide different movements depending on internal behavioral goals or imposed task rules. We can guide our reach to a glass, if we want to drink, or a bottle, if we want to refill the glass. Reach movement plans depend not only on the location and shape of the target object but also on more abstract goals. Goal-directed behavior requires the integration of rules into sensorimotor transformations.
Areas in the superior lobe of the posterior parietal cortex (PPC), as part of a complex, reciprocally connected frontoparietal network, have been shown to contribute to skeletomotor sensorimotor transformation processes (for review, see Kalaska, 1996; Wise et al., 1997; Burnod et al., 1999; Battaglia-Mayer et al., 2000; Andersen and Buneo, 2002; Buneo and Andersen, 2006). The parietal reach region (PRR) in the medial intraparietal sulcus of the PPC is especially involved in the planning of reach movements (Mountcastle et al., 1975; Johnson et al., 1996; Snyder et al., 1997; Marconi et al., 2001; Battaglia-Mayer et al., 2003) with spatial reach goals being mainly represented in visual coordinates (Batista et al., 1999; Buneo et al., 2002). The neural representations of abstract behavioral rules, and processes related to learning them, are typically associated with frontal (sub)cortical networks, including prefrontal cortex, dorsal premotor cortex, and basal ganglia (Petrides, 1982; Toni and Passingham, 1999; White and Wise, 1999; Wallis et al., 2001; Wallis and Miller, 2003; Nixon et al., 2004; Boettiger and D'Esposito, 2005; Pasupathy and Miller, 2005; Petrides, 2005). Other studies also suggest a role of PPC in representing abstract rules (Stoet and Snyder, 2004), especially once they are well established (Grol et al., 2006). This raises the questions how abstract rules are integrated into sensorimotor transformation processes. How and where are multiple context-specific visuomotor mappings for visually guided reaches represented?
We used a memory-guided anti-reach task to investigate rule-dependent sensorimotor mapping in PRR of monkeys. The monkeys had to perform two alternative spatial visuomotor transformations, either to reach toward the memorized location of a previously flashed visual cue, or to a location diametrically opposite of it. The spatial dissociation of the cue and motor goal in this task (Georgopoulos et al., 1989; Boussaoud and Wise, 1993a,b; di Pellegrino and Wise, 1993; Funahashi et al., 1993; Crammond and Kalaska, 1994; Schlag-Rey et al., 1997; Zhang et al., 1997; Everling et al., 1999; Gottlieb and Goldberg, 1999; Everling and Munoz, 2000; Zhang and Barash, 2000) permitted the time-continuous assessment of sensory- versus motor-related spatial tuning of neural activity (Georgopoulos et al., 1989; Lurito et al., 1991; Zhang et al., 1997; Zhang and Barash, 2000, 2004). The dynamics of the sensory-to-motor transition revealed context-specific visuomotor transformations in PRR. During the delay period of a memory reach task, PRR exclusively represented motor goals, not visual memories. The latencies of these neural motor goal representations corresponded with subjects' reaction times, being higher for the incongruent spatial stimulus–response (S–R) mapping during anti-reaches.
Materials and Methods
Anti-reach task and control of behavioral parameters.
Two male rhesus monkeys (Macaca mulatta) were trained to perform a visually instructed, center-out anti-reach task in a frontoparallel plane. Two versions of the task were used, a memory task (Fig. 1 A) and a reaction time task. The memory task was used for neural recordings to analyze the PRR activity with respect to motor goal representations during the delay period (as opposed to motor representations during motor preparation/execution). The reaction time task was used to test for behavioral effects of the task rule (pro/anti) on the speed of sensorimotor transformations.
In the memory task, the monkey initiated a trial by fixating a small central, red fixation spot and touching an adjacent green or blue hand target (fixation period). The green touch target instructed a pro-reach trial, and the blue target an anti-reach trial. After a fixed delay (1.0 s), a peripheral visual cue of the same color as the central hand target was briefly flashed (cue period, 0.2 s), indicating to the monkey where he later will have to reach. For a variable duration, the monkey had to keep the hand fixation (memory period, 1.0–1.5 s). When the central hand target turned off (go signal), the monkey had to reach (movement period, maximum, 1.0 s) either to the memorized location of the previously flashed cue (pro-reach; green cue) or to the diametrically opposed position (anti-reach; blue cue). The monkey received visual feedback about the correct movement goal (circular patch stimulus at the motor goal location) as soon as he acquired the desired position, or after the maximum movement period expired, in which case the trial was aborted. The monkey had to keep his hand at the reach target location (feedback period, 0.3 s) to successfully finish the trial and receive liquid reward.
In the reaction time task, the monkeys had to reach toward the movement goal immediately after the visual cue was presented. The memory period was omitted in this case, and the maximum allowed movement period (reaction plus movement time) was reduced to 0.7–0.8 s. In every other respect, the reaction time task was identical to the memory task described above. Reaction time was defined as the time between the movement instruction and the monkey's release of the touch screen. Movement time was defined as the time between the release and reacquisition of the touch screen at the target position.
Both versions of the anti-reach task consisted of eight different trial conditions (four target positions by two mapping rules, pro/anti). The four possible peripheral reach targets (right, 0°; up, 90°; left, 180°; down, 270° direction) were pseudorandomly interleaved from trial to trial. Eccentricity was always 9 cm (corresponding to 17–20° visual angles for screen distances of 25–30 cm for the two monkeys). Pro- and anti-reaches were also pseudorandomly interleaved; except for 12 of the 60 recording sessions total, when a block design was used (80 trials per block). The data from the block-wise recordings yield no differences to the randomized recordings and, therefore, will be presented jointly.
Eye position was registered with an infrared CCD camera (240 Hz; ISCAN, Burlington, MA). The monkeys had to keep ocular fixation throughout the course of the trial (tolerance, 3.5–4.0° visual angle). Hand position was registered with a 19 inch touch screen (IntelliTouch; ELO Systems, Menlo Park, CA). The hand stimulus had to be continuously touched within a tolerance window of typically 1.8 cm (3.5–4.0° visual angle at 25–30 cm screen distance) for the central, and 2.5–3.5 cm (4.8–8.0°) for the peripheral targets. Otherwise, the trial was immediately aborted without reward. Visual instruction stimuli were either presented on a liquid crystal display monitor (19 inch ViewSonic VX924; <5 ms off–on–off response time) mounted behind the touch-sensitive screen, or rear-projected from a digital light processing projector (U2–870; Plus Corporation, Tokyo, Japan) onto a tangent screen attached to back of the touch-sensitive screen. Visual display latencies were recorded with photo diodes for both systems and corrected for in the data analysis.
Animal preparation and recording procedure.
Both monkeys first were implanted with a head holder. After the monkeys had learned the task, recording chambers were implanted above the posterior parietal cortex, contralaterally to the handedness of each monkey, to allow access to the medial wall of the intraparietal sulcus. Structural magnetic resonance imaging was used to identify the position of the intraparietal sulcus for placement of the recording chambers and guidance of the recordings (Fig. 1 B). Surgical and imaging procedures were conducted under general anesthesia. All procedures were done in accordance with National Institutes of Health guidelines and were approved by the California Institute of Technology Animal Care and Use Committee.
Extracellular neural recordings were made from up to five microelectrodes simultaneously using a five-channel microdrive (“mini-matrix”; Thomas Recording, Giessen, Germany). The raw signal from each electrode was preamplified (20×; Thomas Recording), bandpassed, and amplified (154 Hz to 8.8 kHz; 400–800×; Plexon, Dallas, TX), before being subjected to on-line spike-sorting (Sort Client; Plexon). All spike waveforms were digitized (40 kHz) and recorded to disk for off-line control of sorting quality and stationarity (Offline Sorter; Plexon). In some sessions, a single-channel drive (Narishige, Tokyo, Japan) was used in combination with other electrodes (FHC, Bowdoinham, ME) and a 20× gain head stage (Plexon), but otherwise identical signal processing.
Single-cell spiking activity in the cortex beneath the recording chamber in each monkey was mapped for reach-related, delay-period activity to define a region of interest that conforms with the functional definition of PRR reported previously (Snyder et al., 1997). Recording sites were within 5–10 mm posterior and 4–7 mm lateral (Horsley-Clarke coordinates) at 3–6 mm subsurface, in the hemisphere contralateral to the arm used for reaching (monkey TI, left arm; TA, right). Data from this mapping procedure were not included in the current study. From independent subsequent recordings in this region, all units were included in the analysis that were sufficiently well isolated and stationary, regardless of their task-relatedness or specific tuning properties.
Neural tuning analysis.
Single-cell spiking activity from successful memory reach trials were analyzed for spatial selectivity on a cell-by-cell basis (tuning analysis), and on the population level (see below, Neural decoding analysis).
In the tuning analysis, the selectivity of single-cell spike rates for the location of the visual cue/motor goal was assessed at different times relative to stimulus or behavioral events occurring during the trial. Fixed, predefined periods (each 200 ms) were used for the tuning analysis: the last 200 ms before cue stimulus onset (baseline), the 200 ms of cue visibility (cue), the time between 100 and 300 ms after cue offset (early memory), the last 200 ms before the go signal (late memory), the last 200 ms before reach target acquisition (movement), and 200 ms after target acquisition during the visual feedback (feedback). Because the memory period and the arm movement itself had variable duration across trials, the neural signals were aligned either with respect to the cue onset, the end of memory period, or the time of the target acquisition to calculate averages. Spatial selectivity was quantified with a directional tuning vector (DTV), separately for pro- and anti-reaches. It is defined as vector average across all center-out cue directions u⃗ i (unit vectors) weighted with the corresponding mean spike rates rij of neuron j as follows: The mean spike rate is calculated within each period and averaged across trials with identical conditions (∼15–20 repetitions per condition). The direction of the resulting tuning vector defines the preferred direction of a neuron (for an example, see Fig. 1 C). The DTV was calculated relative to the location of the cue (instead of the motor goal), which is an arbitrary choice that does not in any way affect the results. Significance of directional tuning was tested with a nonparametric one-way ANOVA (Kruskal–Wallis) with the four different visual cue directions as groups and sample sizes defined by the number of identical trial repetitions.
Four main tuning categories were defined based on the presence (or absence) of tuning in the pro- and the anti-reach condition. In each period, a neuron could either be tuned in both conditions (category I), in one of the two conditions [pro-only (II) or anti-only (III) tuning], or in none of the conditions (IV). For the pro and anti tuning category (I), three spatially defined subcategories were built based on a second factor, the relative preferred direction between pro- and anti-reaches. In case a neuron was tuned in the pro and anti condition, the difference of preferred directions between pro- and anti-reach tuning could be <45° (visual tuning), >135° (motor tuning), or in-between (spatially undefined tuning).
Neural decoding analysis.
In the decoding analysis, we used one-nearest-neighbor classification to quantify how informative the neural population response is about individual task parameters (Duda et al., 2001). We used classification procedures with different class definitions (class, set of trials with the task parameter in question kept constant) to predict different task parameters. With an eight-way classifier, trials were classified with respect to all possible task parameter combinations (“total decode,” four cue directions by two task rules). With a two-way classifier, trials were classified only with respect to the task rule, regardless of cue/motor goal direction (“context decode”). With a modified four-way classifier, trials were classified with respect to cue/motor goal direction. Trials with one task rule (pro-reaches) were used to train the classifier, whereas trials with the other task rule (anti-reaches) were used as test trials (“transconditional decode”).
Similarity of the neural population response patterns between test and training trials is used to predict to which class a test trial belongs. In the one-nearest-neighbor algorithm, class membership of a test trial is predicted by the class membership of the training trial whose neural response vector has minimal Euclidian distance (“nearest neighbor”) to the response vector of the test trial in the N-dimensional space. N corresponds to the total number of neurons (see below). The neural response vector r⃗i (t) = (r 1j(t),…,rNj (t)) is time dependent, where rij (t) represents the spike rate of neuron i in the time interval t of trial j. The classification procedure was performed separately for each time interval t. Time intervals were 100 ms long with successive intervals overlapping by 50 ms.
Decoding performance is the percentage of correctly predicted test trials. The classifier was trained with six of seven of all relevant trials (training set) and predictions were made for the remaining one of seven of the trials (test set) for all seven permutations of the sets (sevenfold cross-validation; see below for the total number of trials). Initial assignment of individual trials to the seven subsets was done at random. Decoding performances were averaged across the seven individual cross-validation results. Deviation of decoding performances from chance level, or differences in performances between different classification conditions (e.g., decoding the motor goal in pro- vs anti-trials only), were tested with a t test. The significance criterion was Bonferroni-corrected for the number of nonoverlapping time windows (Nt = 15; 30 time steps with 50% window overlap) to account for multiple testing induced by the time-dependent analysis.
The population of neurons was collected over multiple experimental sessions with a variable number of trials recorded for each neuron (typically ∼20 trials per condition). For the classification analysis, the same number of trials (=15) for each of the eight possible classes (four direction by two task rules) was selected as a random subsample of all trials recorded for this neuron. Only neurons were included in the decoding analysis for which a minimum of 15 trials per trial parameter combination was recorded (N = 131 of 143 recorded neurons). We did not preselect the neurons in any other way, which means the population decode includes all well isolated neurons, even if they are not significantly spatially tuned or task related based on the single-cell analysis.
Spatial selectivity of the neural activity only emerged after a spatial cue has been presented in each trial. To test for latency differences in the onset of spatial selectivity in pro- versus anti-reaches on the population level, we compared the dynamics of the decoding performances PP and PA between the two task conditions (pro/anti). For this, we calculated a cross-correlation function between the two performance curves (see Fig. 5 A) as a function of time. The relative time shift Δt between the two temporal performance profiles was calculated as the time lag of the peak in the unbiased cross-correlation function: Arguments n and m denote indices for the time bins. To increase the temporal resolution for the calculation of the time shift, the performance profiles PP and PA were interpolated by a factor of 25 before cross-correlating (“ideal” low-passing via fast Fourier-transform; MATLAB function interp), leading to a nominal 2 ms resolution. The time lag measure is sensitive to small differences in the exact shape of the two performance curves. This shape can vary slightly depending on the random trial selection in the cross-validation procedure. To estimate the reliability of the time lag measure, we averaged across 100 repetitions of calculating the performance curves with different random trial selections.
Other classification algorithms, such as maximum likelihood or Fisher's linear discriminant analysis, were tested also, yielding qualitatively the same results. Because the general conclusions are not affected by the choice of the classification algorithm, we decided on the nearest-neighbor algorithm because of its simplicity, robustness, and lack of assumptions on the shape of spike rate distribution or directional tuning functions.
Results
Visual versus motor goal tuning
Extracellular single-cell spiking activity was recorded from 143 PRR neurons (90 monkey TI; 53 monkey TA) while the monkeys performed the memory anti-reach task. Results in both monkeys were qualitatively the same and will be presented jointly.
By comparing the directional tuning of the neurons in the pro- versus anti-reach conditions, we were able to discriminate neural representations of visual sensory information (cue location) from motor goal information (reach target location) over the course of the trial. Figure 2 shows the peristimulus time histograms (PSTHs) of two example neurons for pro-/anti-reaches in the preferred and the opposite direction. Both neurons show different time courses of their neural responses. Neuron A is exclusively active during the memory period in two of the four task conditions shown. The two active conditions shared a common motor goal, in this case an upward (90°) reach target, but with opposite-side visual instruction cues. In the two downward (270°) reach conditions, the neuron was inactive, independent of the position of the cue. This means that example neuron A represented the location of the monkey's motor goal during the entire memory period. At no time did the activity of this neuron contain information on the position of the visual cue. We will call this type of spatiotemporal selectivity “motor goal tuning” (“goal” because the tuning appears long before the actual reach movement itself); it is defined by significant spatial tuning during the memory period in both, the pro- and anti-reach trials, with the preferred directions in the two conditions being opposite to each other when calculated with respect to the cue direction (i.e., being identical when calculated with respect to the reach direction). Neuron B, in contrast, had a spatiotemporal “visuomotor tuning.” This is characterized by a selectivity of a neuron for the spatial location of the instructive cue during the presence of the cue, changing into selectivity for the spatial location of the motor goal some time during the memory period. At any time the neuron was active during two of the four conditions shown. Immediately after cue onset, the neuron had high firing rate for leftward (180°) cues, regardless of the reach goal (spatially visual tuning). In contrast, from early on in the memory period, the neuron was highly active only in case of leftward reaches, regardless of the previous cue location (spatially motor goal tuning).
In the following analyses, we will quantify the relative contributions of visual versus motor goal tuning to the overall neural representation in PRR. We used decoding analysis for time-resolved analysis of the population response, and tuning analysis in predefined time windows to track the contributions of the individual neurons to the population behavior. We will focus on the transition from the cue period to the memory period; later periods are dominated by spatial tuning for the direction of the motor goal and will not be the focus of this study.
Decoding analyses were used to predict different task parameters based on the population response of all recorded neurons (131 of 143 with sufficient number of trials for this analysis; see Materials and Methods). In the complete decode, we classified the total set of different trial conditions (four directions by two rules). The decoding performance in this case is a measure of how much of the combined information on the cue/motor goal direction and the mapping rule (the behavioral context) is contained in the population activity. One hundred milliseconds after cue onset, total prediction performance rose steeply above chance level (12.5%), peaking at ∼90% ∼150 ms after the start of the memory period (50 ms resolution) (Fig. 3 A). The prediction performance increased monotonically with the number of neurons (Fig. 3 A, inset).
The prevalence of sensory or motor-related spatial tuning cannot be derived from the total decode performance. To achieve this dissociation, we performed a transconditional decode. The classifier was trained on the four directions in pro-reach trials only (cue and reach-goal directions are identical in this case) and used to predict a direction in anti-reach trials. This predicted direction was compared with the true direction of either the cue or the reach-goal direction in the anti-reach trials (Fig. 3 B). The idea behind the transconditional decode is that if PRR at any given time mainly represents visual cue information, then the classifier trained on pro-trials should be able to predict the cue direction in anti-trials. If PRR mainly represents motor goal information, then the classifier trained on pro-trials should be able to predict the reach direction in anti-trials. PRR population response shows a moderate (<60%) prediction performance for the cue direction at ∼100 ms latency relative to cue onset. This visual cue representation vanishes quickly and, already by the end of the cue period, is replaced by a motor goal representation, indicated by a significant prediction performance for the reach direction. This motor goal prediction increases to >90% during the memory period. Note, because cue and reach directions are opposite in anti-reaches, correct predictions of visual cue and motor goal are mutual exclusive, when the training is based on pro-trials, where the two directions are identical. This explains the anti-correlated performance curves in Figure 3 B, “mirrored” at the chance level (25%). Note also that the prediction performance of the transconditional classification analysis per se does not imply that there is no visual cue information encoded in the population activity during the memory period. It only indicates a strong predominance of motor goal tuning over visual tuning. The additional analysis of the tuning of individual neurons, however, showed that indeed there are no neurons with sustained visual tuning (see below).
How do individual neurons contribute to the transformation of a cue into a motor goal representation? It could be that this transformation is seen individually in the response profile of each neuron, as in example neuron B with visuomotor tuning (Fig. 2). Alternatively, different subpopulations of neurons could encode either the visual cue or the motor goal alone; where the first group shows transient activation during the cue period, and is complemented by a second group that “takes over” at the beginning of the memory period. Neuron A with motor goal tuning during the memory period represents an example of the second group (Fig. 2). To quantify the different spatiotemporal tuning profiles, first, we characterized individual neurons by assigning them to a certain spatial tuning category and, second, compared the spatial tuning category of a neuron between the cue and the late memory period. We chose the late instead of the early memory period to capture also neurons that develop their tuning not immediately but later during the memory period (see below). The spatial tuning category was determined by two factors, the presence (or absence) of tuning in the pro- and the anti-reach condition, and the relative preferred direction between pro- and anti-reach tuning in the case in which a neuron was tuned in both conditions (for details, see Materials and Methods). The persistency rates for staying within a spatial tuning category, and the conversion rates from one to another spatial tuning category, respectively, during the transition from the cue to the memory period are shown in Figure 4. Several observations can be made: First, only few neurons in the cue period were visually tuned (19 of 143; 13%), most of which later became motor-tuned (10 of 19; 53%). Second, there were practically no neurons that were tuned exclusively during the cue period or had sustained visual tuning. Conversion rates from any kind of tuning during the cue period to not being tuned during the memory period were all <3%, and hence considered coincidental. Third, most neurons showed motor goal tuning in the memory period (74 of 143; 52%), many of which have not been tuned during the cue period (37 of 74; 50%), and if so, then often only during pro-trials (19 of 74; 26%). In summary, there were only few neurons (10 of 143; 7%) with visuomotor tuning as introduced with example neuron B (Fig. 2), whereas there were many neurons that show motor goal tuning as soon as they are consistently tuned in both the pro- and anti-reach conditions, without ever having been visually tuned [(74 − 10)/143 = 45%], as is the case in example neuron A (Fig. 2).
Corresponding analysis for the early memory period revealed the same trend as found in the late memory period. The prevalence of motor tuning was less pronounced in the early memory period, as can be expected from the increasingly strong motor goal representation seen in the time-continuous decoding analysis (Fig. 3 B).
Latency of motor goal tuning
The spatial tuning emerges faster in the pro- compared with the anti-reach trials. This can already be seen from example neuron A (Fig. 2), in which the neural activation for the preferred direction in pro-reaches has shorter latency than for anti-reaches to the same direction. The fact that during the cue period many neurons are spatially tuned exclusively during the pro-trials (32 of 143; 22%), whereas this is hardly the case for anti-trials (8 of 143; 6%), further indicates that the shorter tuning latency in pro-trials denotes a general trend (Fig. 4). Note that most of the neurons that initially are only tuned during the pro-trials later are tuned in both task conditions, and then represent the motor goal (19 of 32; 59%). This makes the assumption plausible that the early tuning in the pro-trials already represents motor goal tuning, although a strict definition of motor goal tuning would require the comparison of spatial tuning between pro- and anti-reaches, which is not possible in this case. To quantify the difference in tuning latency between the pro- and anti-reach conditions, we evaluated the prediction performance separately for the pro- and anti-reach trials. This was done by calculating the performance for all pro-/anti-trials as a subset of all trials contributing to the total decode (eight-way classification). The prediction performance as a function of time is delayed by 56 ± 8 ms (mean ± SD; t test, p < 0.01) in anti- compared with pro-reach trials (Fig. 5 A) (for the calculation of the delay, see Materials and Methods), indicating that overall spatial information is represented earlier in pro- compared with anti-reach conditions.
Reaction time task
A delayed spatial tuning in anti-reaches is plausible when assuming that anti-reaches require an additional geometrical computation of the reach goal (“inversion vector”), in contrast to pro-reaches, and that this computation takes time. To behaviorally test for the existence of such an additional time-consuming process in anti- compared with pro-reaches, we let the monkeys perform both types or reaches in a reaction time task without instructed delay (see Materials and Methods). An instructed delay would obscure any reaction time difference related to the computation of the reach goal because the memory period lasts long enough for the monkey to decide on either reach goal, congruent (pro-reaches) or incongruent (anti-). Therefore, in the memory task, no reaction time differences were expected, which was the case in both monkeys (data not shown). In contrast, in the reaction time task correct pro-reaches are performed significantly faster than correct anti-reaches by 38–50 ms (confidence interval for difference in mean reaction times, α = 0.01) (Fig. 5 B).
In our reaction time task, we found no behavioral indications for early involuntary pro-reaches during anti-reach trials, as might be expected from respective anti-saccade findings. The likelihood of miss-reaches in anti-trials was not higher in fast (RT < median RT) compared with slow (RT > median RT) trials (χ2 test; monkey TA, p > 0.05, N = 1728; TI, p = 0.046, N = 2208). Also, the likelihood in anti-trials of miss-reaches to the pro-reach target, compared with other distracter targets, was not higher in fast compared with slow trials (p > 0.05, each monkey).
Task-rule-dependent activity
The fact that the tuning of PRR neurons depends on the behavioral context (pro vs anti mapping rule) suggest that PRR activity contains at least implicit contextual information. By “implicit,” we mean information that allows inferring on the currently valid behavioral context from the population activity of the neurons. But this information could be conveyed indirectly by the fact that the relative tuning properties of the neurons are different in the two conditions. Explicit contextual information, in contrast, is present when the behavioral context can be inferred independently from the spatial tuning of the neurons. Figure 6 shows that a two-way classification of the behavioral context becomes significant already during the fixation period (i.e., before any spatial information on the cue location/motor goal was available to the monkey, and hence before any spatial tuning in the neural activity occurred). This strongly indicates the existence of explicit contextual information in PRR activity in addition to, and independent from, the spatial tuning. Whereas normalized spike rates across the population of recorded neurons did not on average show a significant difference between pro- and anti-reaches in the fixation period 200 ms before cue onset (p > 0.05, Wilcoxon signed-rank test), significant spike rate differences between pro- and anti-reaches in this period could be found in 21 individual neurons. Sixteen neurons showed stronger activation during pro-reaches, and five neurons during anti-reaches. Spike rates during the fixation (and other) periods were highly variable across neurons. Neurons with context modulation during the fixation period tended to have higher spike rates than nonmodulated neurons in this period (p < 0.05, rank sum test). Spike rates (averaged across all trials) ranged from 0.9 to 46 Hz with a median of 6.6 Hz (25/75% quantiles, 3.3/15 Hz) for the 21 context-modulated neurons, and from 0 to 34 Hz with a median of 3.8 Hz (25/75% quantiles, 1.5/7.9 Hz) for the population of nonmodulated neurons.
Discussion
The parietal reach region immediately translates current sensory information into reach movement plans (i.e., it represents spatial information about the goal of a pending movement rather than the previous cue during the delay period of a memory task). The integration of spatial sensory information with the task rule (pro/anti) takes longer for incongruent compared with congruent visuomotor mappings. The latency difference in the occurrence of the motor goal representation is consistent with longer reaction times for anti-reaches compared with pro-reaches.
Context-specific mapping: sensory versus motor-related activity
In previous delayed-response experiments, the temporal proximity of neural responses to the sensory or behavioral motor event, respectively, was used as a plausibility argument for the sensor- or motor-relatedness of neural activity (Fuster, 1973; Hikosaka and Wurtz, 1983; Andersen et al., 1987; Gnadt and Andersen, 1988). The proximity argument does not work for sustained activity in the delay period between sensory cue and motor response. This led to contradictory interpretations of sustained PPC activity either representing sensory memory/spatial attention (Colby et al., 1996; Gottlieb et al., 1998; Powell and Goldberg, 2000; Bisley and Goldberg, 2003) or motor planning/intention-related processes (Gnadt and Andersen, 1988; Bracewell et al., 1996; Mazzoni et al., 1996; Snyder et al., 1997).
With the anti-reach task, we could overcome this ambiguity by assessing time-resolved spatial selectivity for either the cue or the motor goal. We found moderate (<60%) transient representation of the cue location during the cue period and the strong (>90%) representation of the motor goal during the memory period (Fig. 3). This means, first, that the sustained “memory” activity cannot be explained by retrospective processes like short-term visual memory of the cue. Second, the dynamic spatial tuning of the few (7%) sensorimotor-type neurons (Fig. 2 B) could represent either a transition from a visual to a motor goal representation, both in retinal coordinates, or a spatial shift of attention from the cue to the motor goal location, two alternatives that might denote different sides of the same coin, namely “selection-for-action” (Allport, 1987; Rizzolatti et al., 1987). Because the time of the go signal was unpredictable and was the only behaviorally relevant stimulus event after the cue presentation, one would expect the monkey's spatial attention in this trial phase to shift at least in part toward the center of the screen. However, the motor goal tuning in the visuomotor-tuned neurons persists unchanged throughout the delay period (Fig. 2 B) and, on the population level, is even strongest toward the end of the delay period (Fig. 3 B). This makes the attention interpretation implausible even for the few visuomotor-tuned neurons (hence our choice of calling them “visuomotor”). Third, the spatial encoding of the many (45%) neurons with sustained motor goal tuning (Fig. 2 A) completely defies an interpretation in favor of attentional shifting, because these neurons exclusively represent the motor goal. The early onset of their motor tuning, long before the actual reach movement instruction, suggests that this activity is related to motor-intention or -goal representations, rather than motor-preparatory or -control activity.
The conclusion that sustained PRR activity during the delay period of a memory task represents mainly motor-related information is further supported by the fact that most PRR neurons are selectively active during planned reaches but not during planned saccades (Snyder et al., 1997). Anti-saccade experiments in the inferior parietal lobe (LIP) yielded mixed results with respect to the sensory versus motor dissociation, with one report indicating largely sensory tuning (Gottlieb and Goldberg, 1999) and another set of studies reporting prevalence of motor goal tuning similar to our PRR results (Zhang and Barash, 2000, 2004).
Task rule representations in PRR
The discriminability of pro- and anti-reaches during the fixation period (Fig. 6) indicates task rule-specific modulation of PRR activity. Because we used a color instruction to indicate the task rule to the monkey, the observed differences could be a modulation attributable to stimulus color. We consider this possibility very unlikely. First, the task rule can be decoded significantly above chance level only shortly before cue onset, whereas the colored instruction stimulus is present during the whole fixation period. Second, to our knowledge, there have been no reports of genuine color selectivity in PPC. Selective responses to colored instruction stimuli in PPC could always be attributed to either the stimulus-associated movement response (Snyder et al., 1997) or the associated task rule (Toth and Assad, 2002; Stoet and Snyder, 2004). The representation of arbitrary S–R associations is mostly associated with areas in the frontal lobe. Although the association between color and task rule in our case is also “arbitrary” in this sense, the content of the two task rules denote two different kinds of spatial S–R mappings i.e., two different modes of visual guidance of the reach movement (toward or away from the cue location). Because PRR is known to be involved in visually guided reaching, the spatial nature of the task rule might explain the observed rule-specific modulations in PRR. More generally, because of its spatial competence, PPC might be recruited for the integration of abstract task rules with sensorimotor processing whenever spatial transformation rules are in effect (Toni et al., 2001).
Dynamics of context-specific sensorimotor transformations
At least three separate processes contribute to a sensory-to-motor (goal) transformation in an anti-reach task: context categorization (pro/anti), cue identification, and spatial cue-to-goal mapping. The time to perform the cue-to-goal mapping depends on the S–R congruency and is longer for incongruent mappings by ∼50 ms, corresponding to latency differences in the motor goal representations of PRR (Fig. 5). We argue that PRR reflects the computational costs of performing an incongruent cue-to-goal mapping by a belated occurrence of its motor goal representations. We suggest that the response profile of the visuomotor-tuned “transformation” neurons might directly reflect the spatial cue-to-goal mapping procedure (“vector inversion”). Neurons with visuomotor tuning reverse their tuning dynamically during anti-reaches (e.g., they shut down after an initial activation, when the cue but not the motor goal was in their response field, and they become active after initial silence in the opposite case) (Fig. 2 B, blue curves). The time cost for changing the activation status of these transformation neurons during anti-reaches might explain the higher latency for reaches with incongruent spatial mapping. Motor-tuned neurons in PRR became spatially tuned after the switch in the transformation neurons had occurred. They represented the outcome of the spatial transformation once it was accomplished (the “verdict” of PRR) and probably denote the output stage of this area.
The cue-to-goal mapping took at most 100 ms in our data: It could not yet have been accomplished when PRR first established cue representations (∼50–100 ms) but must have been when the sensory-to-motor goal transformation was completed (150–200 ms). The total time for a sensory-to-motor transformation in an anti-saccade experiment in LIP (Zhang and Barash, 2000) was much longer (average, 415 ms after cue offset) on the population level [for a similar time course, see also Bisley and Goldberg (2003)]. The difference might in part be explained by a cost for context categorization: Zhang and Barash (2000) provided the context information (pro/anti) with the spatial cue, which means context categorization could take place only during or after cue identification. We provided context information from the beginning of the trials. This allowed context categorization before cue identification, which is supported by our finding of rule-dependent neural activity during the fixation period (Fig. 6). Because individual “paradoxical” neurons in the Zhang and Barash (2000) experiment showed early context-specific, nonvisual responses ∼50–100 ms after response onset in LIP (∼60 ms), it was suggested that context categorization does not exceed the latency for availability of spatial cue information to PPC areas by more than 50–100 ms (Barash, 2003). The remaining >200 ms for cue-to-goal mapping are slower than the estimated ∼100 ms in our data. This could be a consequence of a need for “default-response cancellation” (Kornblum et al., 1990), which might be specific to anti-saccades. To successfully initiate an anti-saccade, “reflexive” pro-saccades, as manifest in express saccades (Fischer and Boch, 1983; Fischer and Weber, 1993), have to be suppressed. From our reaction time experiment, we have no indication for an urge of the monkeys to perform pro-reaches in the early period of anti-trials. Should a corresponding covert “default” movement plan for pro-reaches nevertheless exist in anti-reach trials, it is noteworthy that the majority of neurons in PRR, which have sustained motor goal tuning, do not represent this “erroneous” reach plan.
Conclusions
Our experiment shows that PRR represents integrated knowledge on spatial sensory information combined with abstract behavioral rules (pro/anti) to represent the desired movement goal independent of the instruction stimulus as soon as all relevant information is available. The dynamic contribution of individual neurons to both visual and motor goal representations at different points in time underlines the notion that within the frontoparietal network the distinction between “sensory” and “motor” relatedness is often less an anatomical–physiological distinction, a label that could be assigned to individual areas or neurons based on its static tuning properties, but rather denotes a temporal aspect of the ongoing sensorimotor dynamics, shifting between sensory and motor tuning depending on the currently most relevant or available control signals.
Footnotes
-
This work was supported by the National Institutes of Health, Defense Advanced Research Projects Agency, and Office of Naval Research. We thank Axel Lindner, Marina Brozovic, and Sam Musallam for valuable comments on a previous draft of this manuscript, K. Pejsa, N. Sammons, and L. Martel for animal care, and T. Yao and V. Shcherbatyuk for administrative and technical support.
- Correspondence should be addressed to Dr. Richard A. Andersen, Division of Biology, California Institute of Technology, M/C 216-76, 1200 East California Boulevard, Pasadena, CA 91125. andersen{at}vis.caltech.edu
References
- Allport, 1987.↵
- Andersen and Buneo, 2002.↵
- Andersen et al., 1987.↵
- Barash, 2003.↵
- Batista et al., 1999.↵
- Battaglia-Mayer et al., 2000.↵
- Battaglia-Mayer et al., 2003.↵
- Bisley and Goldberg, 2003.↵
- Boettiger and D'Esposito, 2005.↵
- Boussaoud and Wise, 1993a.↵
- Boussaoud and Wise, 1993b.
- Bracewell et al., 1996.↵
- Buneo and Andersen 2006.↵
- Buneo et al., 2002.↵
- Burnod et al., 1999.↵
- Colby et al., 1996.↵
- Crammond and Kalaska, 1994.↵
- di Pellegrino and Wise, 1993.↵
- Duda et al., 2001.↵
- Everling and Munoz, 2000.↵
- Everling et al., 1999.↵
- Fischer and Boch, 1983.↵
- Fischer and Weber, 1993.↵
- Funahashi et al., 1993.↵
- Fuster, 1973.↵
- Georgopoulos et al., 1989.↵
- Gnadt and Andersen, 1988.↵
- Gottlieb and Goldberg, 1999.↵
- Gottlieb et al., 1998.↵
- Grol et al., 2006.↵
- Hikosaka and Wurtz, 1983.↵
- Johnson et al., 1996.↵
- Kalaska, 1996.↵
- Kornblum et al., 1990.↵
- Lurito et al., 1991.↵
- Marconi et al., 2001.↵
- Mazzoni et al., 1996.↵
- Mountcastle et al., 1975.↵
- Nixon et al., 2004.↵
- Pasupathy and Miller, 2005.↵
- Petrides, 1982.↵
- Petrides, 2005.↵
- Powell and Goldberg, 2000.↵
- Rizzolatti et al., 1987.↵
- Schlag-Rey et al., 1997.↵
- Snyder et al., 1997.↵
- Stoet and Snyder, 2004.↵
- Toni and Passingham, 1999.↵
- Toni et al., 2001.↵
- Toth and Assad, 2002.↵
- Wallis and Miller, 2003.↵
- Wallis et al., 2001.↵
- White and Wise, 1999.↵
- Wise et al., 1997.↵
- Zhang et al., 1997.↵
- Zhang and Barash, 2000.↵
- Zhang and Barash, 2004.↵