Abstract
To elucidate cortical mechanisms of visuomotor integration, we recorded whole-scalp neuromagnetic signals from six normal volunteers while they were viewing a black dot moving linearly at the speed of 4°/sec within a virtual rectangle. The dot changed its direction randomly once every 0.3–2 sec. The subject either (1) fixated a cross in the center of the screen (eye fixation task), (2) followed the moving dot with the eyes (eye pursuit task), or (3) followed the dot with both the eyes and the right index finger (eye–finger pursuit task). Prominent magnetic signals, triggered by the changes of the direction of the dot, were seen in all conditions, but they were clearly enhanced by the tasks and were strongest during the eye–finger pursuit task and over the anterior inferior parietal lobule (aIPL). Source modeling indicated activation of aIPL [Brodmann’s area (BA) 40], the posterosuperior parietal lobule (SPL; BA 7), the dorsolateral frontal cortex (DLF; BA 6), and the occipital cortex (BA 18/19). The activation first peaked in the occipital areas, then in the aIPL and DLF, and some 50 msec later in the SPL. Our results suggest that all these areas are involved in visuomotor transformation, with aIPL playing a crucial role in this process.
- visuomotor integration
- eye–finger pursuit
- smooth pursuit
- fixation
- MEG
- anterior inferior parietal lobule
- human
The mammalian visual system is composed of several parallel pathways, each subserving a different aspect of visual experience (Maunsell and Newsome, 1987; Van Essen et al., 1992). Visual processing in the primates can be divided into ventral and dorsal pathways (Ungerleider and Mishkin, 1982). The dorsal stream, projecting from the striate cortex to the parietal region, is concerned with spatial localization of objects of interest, with the composition of motor commands for visually guided actions and with movements related to objects (Goodale and Milner, 1992). It codes spatial characteristics of visual stimuli and mediates visuomotor transformations.
Cortical analysis of visuomotor integration has been extensively made in monkeys. Visuospatial information is preprocessed in visual cortices and then transferred to visual area 5 (V5) and middle temporal area (MT), middle superior temporal area (MST) (Maunsell and Van Essen, 1987; Komatsu and Wurtz, 1988a,b), and parieto-occipital area (PO), and subsequently to several other areas [medial intraparietal area (MIP), ventral intraparietal area (VIP), lateral intraparietal area (LIP), and anterior inferior parietal area (AIP) in the intraparietal sulcus (IPS) and to its proximity (7a and 7b) in the inferior parietal lobule (IPL) (Zeki, 1974; Lynch et al., 1977; Motter and Mountcastle, 1981; Van Essen et al., 1981; Sakata et al., 1983; Felleman and Van Essen, 1991;Colby et al., 1993; Johnson et al., 1996). Neurons of LIP and area 7a discharge in relation to saccades and direction-specific pursuit eye movements (Mountcastle et al., 1975; Lynch et al., 1977, 1985; Sakata et al., 1983; Andersen, 1995; Bremmer et al., 1997; Savaki et al., 1997). Area 7b is related to hand movements (Hyvärinen and Poranen, 1974). Some recent studies showed activity associated with visually guided hand movements in inferior IPS and the adjacent anterior inferior parietal lobule (aIPL) (Gallese et al., 1994; Sakata et al., 1995; Johnson et al., 1996; Savaki et al., 1997).
In addition to the visual pathways in the occipitoparietal areas, the dorsolateral frontal area (DLF) has been shown to be related to oculomotor control and attention to visual stimuli. Both human patients and nonhuman primates with lesions in the DLF show deficits of smooth pursuit eye movements, and microstimulation of this area elicits smooth eye movements (Lynch, 1987; Keating, 1991; MacAvoy et al., 1991;Gottlieb et al., 1993, 1994; Morrow and Sharpe, 1995; Lekwuwa and Barnes, 1996).
Cortical networks of visuomotor transformation have been elucidated in monkeys by the tracing techniques (Andersen et al., 1985, 1990;Ungerleider et al., 1986; Cavada and Goldman-Rakic, 1989a,b; Neal et al., 1990; Jeannerod et al., 1995; Johnson et al., 1996), but they are still insufficiently known in humans despite extensive imaging studies (Grafton et al., 1992; Faillenot et al., 1997; Lacquaniti et al., 1997;Petit et al., 1997; Luna et al., 1998).
In this study, to clarify neural mechanisms underlying human visuomotor integration, we analyzed cortical activation patterns during eye fixation, eye pursuit, and eye–finger pursuit tasks using a whole-scalp magnetoencephalography (MEG), which provides reasonable spatial and excellent temporal resolution.
MATERIALS AND METHODS
Subjects
Six healthy volunteers (four males and two females, age 25–40 years, mean 30; five right-handed and one left-handed) were studied. None of them had previous history of neurological or visual disorders. Informed consent was obtained from each subject after full explanation of the study.
Experimental paradigm
During the experiment, the subject was sitting in a magnetically shielded room. The head was positioned in a helmet-shaped dewar and closely attached against its inner vault. The visual stimuli, produced with MacProbe running on a Macintosh Quadra 840 AV computer, were projected onto a white board placed 1 m in front of the subject, with a Sony data projector that was positioned outside the magnetically shielded room. The subject was viewing the screen in dim light. A black dot (radius, 0.57°) was moved linearly within a virtual rectangle of 30 × 40 cm at the speed of 4°/sec, and it changed randomly its direction once every 0.3–2 sec (Fig.1a). The recording time for each block was 3 min on the average. The subject was asked either (1) to fixate a cross on the center of the screen (eye fixation task), (2) to follow the moving dot with the eyes (eye pursuit task), or (3) to follow it with both the eyes and the right index finger (eye–finger pursuit task). During the latter task, the subject kept the right index finger on her/his lap and was asked to draw on a paper the lines precisely mimicking the trajectory of the visual target with a small pen attached to the finger tip (Fig. 1b).
Data acquisition
The magnetic signals of the brain were measured with a helmet-shaped 122-channel Neuromag-122 neuromagnetometer, which uses 61 pairs of orthogonally arranged “figure eight” planar first-order gradiometers. This system measures the two orthogonal derivatives of the radial magnetic field component (Ahonen et al., 1993), and it typically detects the largest signal just above the corresponding cerebral current source. Head position with respect to the sensor array was measured with head position indicator (HPI) coils placed on defined scalp sites. To allow alignment of the MEG and magnetic resonance imaging (MRI) coordinate systems, the positions of the HPI coils with respect to anatomical landmarks were measured with a three-dimensional digitizer (Isotrak 3S1002; Polhemus Navigation Sciences, Colchester, VT). At the beginning of each recording block, the magnetic signals produced by the three HPI coils on the scalp were measured by the sensors to obtain head position with respect to the sensor array. Head position was recalculated at the start of each block. Head MRIs were obtained with a 1.5 tesla Siemens Magnetom system. To monitor eye movements and blinks, bipolar horizontal and vertical electro-oculograms (EOGh and EOGv, respectively) were recorded from electrodes placed below and above the left eye and to bilateral outer canthi. To monitor the subject’s vigilance, the waveforms of EOG and selected channels of MEG were inspected continuously during the recording. The subject could refresh during short breaks between the blocks, but he or she was requested to maintain the head position as stable as possible during the intermissions. The recording bandpass was 0.03–100 Hz (3 dB points) for MEG and 0.01–100 Hz (6 dB points) for EOG. The sampling rate for digital conversion was 404 Hz, and the data were stored on an optical disk for later off-line analysis. In the beginning of the task, the background brain activity was recorded for 3 min while the subject was fixating a cross placed on the center of the screen. To confirm the signal reproducibility, the data were collected during two to four identical blocks for each task, and the order of tasks was counterbalanced across subjects. Blocks contaminated with excessive artifacts (eye movements, blinks, noise) in any of the channels, or with drowsiness of the subject, were excluded from the analysis, and an additional block was acquired.
Data analysis
Signal analysis. We analyzed only those signals associated with stimulus triggers separated by at least 1 sec from the preceding and following ones. The signals were averaged off-line from 100 msec before to 900 msec after the time when the visual target changed its direction, separately for the three different conditions. Epochs containing MEG signals exceeding 1500 fT/cm and/or EOG signals exceeding 150 μV were omitted. Amplitudes were measured with respect to the 100 msec pretrigger baseline for each channel.
Source modeling. After confirming the individual reproducibility of the MEG waveforms, the data of two blocks per task were averaged, and the averages were digitally low-pass filtered at 40 Hz. The preprocessed data were used for construction of isocontour maps. The sources of the magnetic fields were modeled as equivalent current dipoles (ECDs) whose three-dimensional locations, orientations and current strengths were estimated from the preprocessed data using a least-squares method. A spherical head model was adopted, based on the individual MRI obtained from each subject (Hämäläinen et al., 1993).
The ECDs that best explained the most dominant signals were determined from signals of 20–30 channels at areas including the local signal maxima. For each subset of channels, ECDs were calculated for every 1msec segment over the time period of 50 msec containing the signal maximum. We only accepted ECDs that could account for >80% of the field variance at selected periods of time for each subset of channels and whose confidence volume (Hämäläinen et al., 1993) was <1 cm3. ECDs with the highest percentage of explained variance and the smallest confidence volume were accepted for further analysis. Thereafter, the analysis period was extended to the whole recording time and to all channels, using a multidipole model in which the strengths of the previously found ECDs were allowed to vary as a function of time while their locations and orientations were kept fixed (Scherg and Von Cramon, 1986; Mosher et al., 1992; Scherg, 1992;Hämäläinen et al., 1993). Such multiple dipoles are assumed to model satisfactorily the combined activity arising from several brain regions when the activation spots, each <2–4 cm in diameter, overlap in time but are spatially distinct.
The measured signals explained by the model were extracted with Signal Space Projection (Uusitalo and Ilmoniemi, 1997), and a new ECD was identified on the basis of the remaining field pattern. Every time when a new ECD was obtained, the waveforms predicted by the multidipole model were compared with the measured signals. If the model left some dominant signals unexplained, the data were re-evaluated for more accurate estimation of the generator areas, but with a conservative attitude to explain only the dominant features of the field pattern. This approach, described in detail previously (Hämäläinen et al., 1993), has been successfully applied in several previous reports (Hari et al., 1993; Forss et al., 1994; Levänen et al., 1996; Raij et al., 1997; Nishitani et al., 1998).
Finally, the estimated dipoles obtained through this procedure were superimposed on the subject’s own MRI, after alignment of the MEG and MRI coordinate systems. For the transformation of the source locations to the Talairach’s standard brain space (Talairach and Tournoux, 1988), the following coordinate system was used: x-axis perpendicular to the other two axes through the anterior commissure,y-axis passing through the anterior and posterior commissure, and z-axis perpendicular to they-axis through the anterior commissure at the middle plane of the brain. The source locations were transformed into the standard brain space with spatial normalization by matching each subject’s brain to a standard brain space. The coordinates x(left/right), y (anterior/posterior), and z(superior/inferior) were expressed in millimeters from the anterior commissure at the midline of the brain. Brodmann’s areas (BA) were defined according to the atlas of Talairach’s standard brain space.
Furthermore, the validity of the multidipole model was confirmed by using L1 Minimum Norm Estimate (L1 MNE), which can resolve several local or distributed MEG current sources without explicit a priori information about the number of sources (Uutela et al., 1997). The L1 MNE is the current distribution where the total sum of the current is as small as possible, while it still explains almost all the measured signals. The estimated source distributions were visualized by projecting the currents to the surface of the subject’s brain.
Statistical analysis
The latencies and strengths of the sources were compared with an ANOVA with repeated measurements. The factors analyzed were task, measurement location, and response laterality. The peak latencies were scaled relative to the peak latency of the aIPL source (see below) in each subject.
RESULTS
Waveforms
In the fixation task, both EOGv and EOGh were stable in all subjects. In the eye pursuit and eye–finger pursuit tasks, both EOGs showed oscillations, reflecting pursuit eye movements (Fig.2).
Figure 3 shows typical MEG signals from subject 1. The largest magnetic deflections peaked 200–400 msec after the time when the visual target changed its direction. Prominent responses were observed at wide areas bilaterally during all tasks.
Figure 4 illustrates that all subjects had clear magnetic deflections time-locked to changes of the direction of the dot. The main deflections peaked at 200–450 msec in different subjects and were consistently largest during the eye–finger pursuit task.
Source modeling
At the main response peaks, the magnetic field patterns were dipolar over several regions of both hemispheres, although with clear interindividual variability. Figure 5shows field patterns of subject 4 over the right hemisphere. These patterns suggested four main source areas (occipital cortex, IPL, DLF, and SPL), which were similar across tasks except for the IPL region in the eye fixation task in which no clear ECD was identified. Similar dipolar patterns were seen on this subject’s left hemisphere for all tasks and also in other subjects. Similarly to subject 4, no dipolar patterns were seen during the eye fixation task on the left hemisphere in three subjects and on the right hemisphere in two subjects.
Figure 6 shows the sources of magnetic fields from subject 4 superimposed on his own MRI. During the eye fixation task, the main sources were located in DLF, aIPL, and SPL of each hemisphere. In the eye pursuit and eye–finger pursuit tasks, additional sources were observed in the occipital cortex of each hemisphere. Despite interindividual variability in the field patterns and the number of dipoles, there was a considerable consistency in the source locations across subjects and tasks (Fig.7). Table 1summarizes the source locations in Talairach coordinates in each area and for all tasks; the source locations did not differ significantly between hemispheres in any task (p > 0.87).
Figure 8 shows an independent evaluation of the activation pattern of the brain with L1 MNEs during the eye–finger pursuit task for subject 4. Compared with the data presented in Figures 5 and 6, the current estimates were in good agreement with the dipole models, implying the activation in the occipital cortex, aIPL, DLF, and SPL of each hemisphere.
Figure 9 shows the strengths of all eight dipoles (four sources in each hemisphere) calculated from a multidipole model during the eye–finger pursuit task for subject 1. The activations peaked at 220 and 265 msec in the left and right occipital areas, at 278 and 330 msec in the left and right aIPL, at 292 and 284 msec in the left and right DLF, and at 350 and 374 msec in the left and right SPL, each respectively. The 8-dipole model explained the signal distributions best (g > 90%) at 280–325 msec.
Figure 10 (top) shows the mean (+ SEM) source strengths in the four brain regions during all tasks. The sources were of about the same strength in all areas during the eye fixation task. During the eye pursuit and eye–finger pursuit tasks, no modification was seen in the occipital area, whereas in the other regions the sources were significantly stronger; the most prominent activation occurred during the eye–finger pursuit task in the aIPL; the signals were significantly stronger during the eye pursuit and eye–finger pursuit than the eye fixation task (p < 0.005). A similar trend did not reach statistical significance in the other regions. There was a statistically nonsignificant trend for stronger right than left hemi-sphere sources (mean differences 13% during eye fixation, 18% during eye pursuit, and 5% during eye–finger pursuit).
Figure 10 (bottom) shows the peak latencies of activation in DLF, SPL, and occipital areas relative to latencies in the aIPL. Earliest activation occurred in the occipital areas (p < 0.05) followed by the signals in the aIPL. Activation tended to peak slightly later in the DLF than the aIPL (NS), and the activation peaked on average 55 msec later in the SPL than the aIPL (p < 0.005). The mean latencies did not differ significantly between the hemispheres in any of these areas.
DISCUSSION
Activated brain areas and their temporal order
This study aimed to clarify human cortical mechanisms of visuomotor integration. Strong magnetic signals were triggered by changes of the direction of the dot in four main brain areas: the occipital cortex and areas aIPL, DLF, and SPL, which, according to the Talairach coordinates, correspond anatomically to Brodmann’s areas 18/19, 40, 6, and 7, respectively.
The aIPL showed the strongest signals in all conditions. The pursuit tasks increased the activity of all areas but most strongly that of aIPL, in which the source strength was almost tripled during the eye–finger pursuit task compared with the eye fixation task. Our aIPL region was located within 15 mm from the positron emission tomography (PET) activations observed during visually guided grasping task, but ∼30 mm dorsolateral to the PET activations during reaching task, and ∼25 mm anterolateral and inferior to the functional magnetic resonance imaging (fMRI) spots observed during visually guided saccades (Faillenot et al., 1997; Lacquaniti et al., 1997; Luna et al., 1998).
The present results suggest that the aIPL plays a crucial role in the visuomotor integration during the pursuit tasks. This proposal is supported by clinical observations. The right aIPL is involved in visuospatial attention (Mesulam, 1981), and its lesions cause visual neglect (Heilman et al., 1985; Vallar and Perani, 1986; Rizzolatti and Gallese, 1998). The slowness and prolonged accelerations of contralesional movements in patients with visual neglect, but with intact primary motor area, suggest that the human aIPL not only plays a role in the visuomotor planning but also operates as a sensorimotor interface, rather than having exclusively perceptual or motor functions (Mattingley et al., 1994, 1998; Andersen et al., 1997; Snyder et al., 1997).
Patients with lesions centered on the inferior IPS and SPL may have “optic ataxia” in which they cannot use visual information for accurate control of visually guided hand movements or to accurately reach targets (Perenin and Vighetto, 1988; Grafton et al., 1992;Jackson and Husain, 1997). The observed activation of the SPL may be related to visuospatial attention required to follow the moving dot in the pursuit task (Posner et al., 1984; Corbetta, 1998). The activated SPL region is 7–15 mm lateral to the fMRI activations related to attention to visual motion and 10 mm superior to the mean PET activations during the visuospatial attention task (Nobre et al., 1997; Buchel et al., 1998). The attentional processing in this region of the SPL may also be tightly linked to oculomotor processes, and SPL is likely to play a critical role in movement selection (Deiber et al., 1991).
It is generally believed that sensorimotor coordination involves parallel modules (Stein, 1992; Savaki et al., 1997). Our data also provide an evidence on sequential processing in human visuomotor integration. The activation peak was ∼50 msec earlier in the aIPL than in the SPL during both pursuit tasks. Thus, the SPL might obtain input either from the aIPL or the DLF, in addition to the occipital area, which is in agreement with the view that the parietal lobe is the final stage of the dorsal visual stream (Ungerleider and Mishkin, 1982).
Monkey homologs of human IPL and SPL areas
Hyvärinen (1981) suggested that the most anterior part of the human IPL, activated in the present study, corresponds to the monkey 7b, which is related to hand manipulation and eye movements and may code orientation of different body parts in the immediate extrapersonal space (Hyvärinen and Poranen, 1974; Mountcastle et al., 1975; Hyvärinen, 1981). Our data agree with a recent PET study showing that a visually guided pursuit task activates the dorsolateral visual pathways that are connected with the aIPL (Faillenot et al., 1997). The strongest MEG signals in the eye–finger pursuit task in the aIPL thus agree with the properties of monkey 7b. Also in line with monkey data (Hyvärinen, 1981; Andersen et al., 1990), we observed bilateral activation of aIPL during the right index finger pursuit task. Thus, our results are in line with the assumption that the human aIPL is the homolog of the monkey area 7b (Hyvärinen, 1981; Eidelberg and Galaburda, 1984). The monkey 7b is connected reciprocally to SII, AIP, and 7a and to the ventral premotor cortex, and it is a part of the network for producing motor responses to visual and somatosensory stimuli (Andersen et al., 1990;Neal et al., 1990; Graziano et al., 1994).
The monkey area 7a responds more strongly to attended than nonattended stimuli (Mountcastle et al., 1981; Steinmetz and Constantinidis, 1995) and is related to direction-specific eye movements (Mountcastle et al., 1975; Lynch et al., 1977, 1985; Sakata et al., 1983; Andersen, 1995;Bremmer et al., 1997; Savaki et al., 1997). The human posterior eye fields are located in precuneus and along the IPS extending into the superior IPL and SPL (Muri et al., 1996; Luna et al., 1998), and they are related to triggering of reflexive visually guided saccades (Pierrot-Deseilligny, 1994; Pierrot-Deseilligny et al., 1995). Our results would thus be in line with the human SPL being the homolog of the monkey 7a.
The significant strengthening of aIPL and SPL activations during both pursuit tasks agrees with monkey data showing that many visual neurons in areas 7a and 7b respond better to moving than stationary stimuli (Motter and Mountcastle, 1981). It is to be noted, however, that the parcellation of the human parietal cortex to functionally homogeneous areas is still largely unknown.
Activation of the dorsolateral frontal cortex
We observed activation of DLF (BA 6) in all tasks, presumably caused by the smooth eye pursuit movements and the visuospatial attention aroused by the changes of the direction of the dot. The human frontal eye field (FEF) is located in BA 6 at the junction of the precentral and the superior frontal sulci (Kleinschmit et al., 1994;Darby et al., 1996; Muri et al., 1996; Paus, 1996; Sweeney et al., 1997; Luna et al., 1998). Our DLF area was ∼10 mm anterior to the PET activations observed when subjects followed a visual dot target moving horizontally (Petit et al., 1997). This may suggest the existence of FEF subregions for the oculomotor control related to movement direction. Lesions in the precentral sulcus between the superior and inferior frontal sulci and in the adjacent parts of the precentral gyrus and of the middle frontal gyrus, in good agreement with our source locations, produce deficits of smooth pursuit eye movements (Rivaud et al., 1994; Morrow and Sharpe, 1995; Lekwuwa and Barnes, 1996).
The areas around the arcuate sulcus in monkey may thus be homologous to the posterior bank of the human precentral sulcus (BA 6). The importance of this region for eye movements is evident from studies in nonhuman primates: ablation of the anterior bank of the arcuate gyrus degrades smooth pursuit eye movements (Lynch, 1987; Keating, 1991;MacAvoy et al., 1991), and microstimulation of this region elicits smooth eye movements (MacAvoy et al., 1991; Gottlieb et al., 1993,1994). Tanaka and Fukushima (1998), recording electric responses related to smooth pursuit eye movements from the periarcuate area, suggested that the periarcuate neurons participate in the early stages of pursuit initiation.
Absence of phasic activation in parieto-occipital sulcus, V5, and motor cortex
Some recent MEG data have revealed that the human medial parieto-occipital sulcus (POS) area may be the human homolog of the monkey visual area 6 (V6) and visual area 6A (V6A) complex, which is well equipped for encoding visuospatial information related to visually guided movements (Galletti et al., 1995, 1997; Hari et al., 1994;Jousmäki et al., 1996; Hari and Salmelin, 1997). The absence of phasic activation of the medial POS with the present continuous visual motion suggests that the POS region is most reactive to onsets and offsets of the stimuli. In a similar manner, the lack of clear V5 activation, time-locked to changes of the dot movement, indicates that a change in the direction of the dot per se does not produce a sufficiently strong phasic change in V5 activation, at least when responses to changes of all directions are averaged. Furthermore, although the motor cortex is definitely active during voluntary finger movements, there were no detectable signals associated with the changes of movement direction; neither were any systematic changes detected in the rhythmic activity of the motor cortex (our unpublished observations). It has to be emphasized that the signals of the POS region, the V5 cortex, and the primary motor cortex are quite easy to be discriminated by means of whole-scalp MEG recordings (Salenius et al., 1997; Vanni et al., 1997; Portin et al., 1998), and thus we feel confident to claim that these areas did not show major phasic activity associated with changes of the direction of the dot.
Conclusions
Despite the restrictions caused by the nonuniqueness of the neuromagnetic inverse problem (Hämäläinen et al., 1993), we found largely consistent activation of multiple source areas, confirmed by an independent analysis based on minimum-norm current estimates. Our data demonstrate that the occipital cortex, the aIPL, DPL, and SPL areas are all involved in visuomotor integration. The anterior inferior parietal lobules of both hemispheres were activated ∼50 msec earlier than the SPL, whereas the DLF was activated at about the same time as the aIPL. Compared with fMRI and PET data, which reflect blood flow changes related to brain activation, the MEG signals directly reflect neuronal activation, mainly postsynaptic currents, and can thus provide complementary information to other human imaging studies. Our data support the view that the aIPL might be the homolog of the monkey area 7b and that it probably plays a pivotal role in the visuomotor integration.
Footnotes
This study was supported by the Academy of Finland, the Sigrid Jusélius Foundation, Japan Foundation for Aging and Health, the Research Grant for the Future Program JSPS-RFTF97L00201 from the Japan Society for the promotion of Science, and Research Grant for International Scientific Research 10044269 from the Japan Ministry of Education, Science, Sports, and Culture. The MRIs were acquired at the Department of Radiology of the Helsinki University Central Hospital. We thank Mr. Mika Seppä for the MRI surface rendering, Dr. Simo Vanni for insightful comments on a previous version of this manuscript, Mr. Ricardo Vigario for support in the additional analyses, and Ms. Mia Illman for assistance in the measurements.
Correspondence should be addressed to Dr. Nobuyuki Nishitani, Brain Research Unit, Low Temperature Laboratory, Helsinki University of Technology, P.O. Box 2200, FIN-02015 HUT, Espoo, Finland.