Abstract
Monitoring and evaluating movement errors to guide subsequent movements is a critical feature of normal motor control. Previously, we showed that the postmovement increase in electroencephalographic (EEG) beta power over the sensorimotor cortex reflects neural processes that evaluate motor errors consistent with Bayesian inference (Tan et al., 2014). Whether such neural processes are limited to this cortical region or involve the basal ganglia is unclear. Here, we recorded EEG over the cortex and local field potential (LFP) activity in the subthalamic nucleus (STN) from electrodes implanted in patients with Parkinson's disease, while they moved a joystick-controlled cursor to visual targets displayed on a computer screen. After movement offsets, we found increased beta activity in both local STN LFP and sensorimotor cortical EEG and in the coupling between the two, which was affected by both error magnitude and its contextual saliency. The postmovement increase in the coupling between STN and cortex was dominated by information flow from sensorimotor cortex to STN. However, an information drive appeared from STN to sensorimotor cortex in the first phase of the adaptation, when a constant rotation was applied between joystick inputs and cursor outputs. The strength of the STN to cortex drive correlated with the degree of adaption achieved across subjects. These results suggest that oscillatory activity in the beta band may dynamically couple the sensorimotor cortex and basal ganglia after movements. In particular, beta activity driven from the STN to cortex indicates task-relevant movement errors, information that may be important in modifying subsequent motor responses.
- adaptation
- effective connectivity
- information flow
- movement error
- sensorimotor cortex
- subthalamic nucleus
Introduction
The capacity for motor learning allows humans to adapt to perturbations and changes in the environment during movement production. The process of adaptation involves the updating of an internal model driven by the prediction error, i.e., difference between the predicted and actual consequence of a voluntary movement (Wolpert and Miall, 1996), in a manner consistent with Bayesian inference (Korenberg and Ghahramani, 2002; Körding and Wolpert, 2004). Motor adaptation in response to sensorimotor perturbations has been primarily considered a function of the cerebellum (Tseng et al., 2007; Miall and King, 2008). Converging evidence suggests that suppressions in beta oscillations (13–30 Hz) over the sensorimotor cortex are associated with the processing of error feedback (Luft et al., 2014) and cortical reorganization during motor learning (Nakano et al., 2013; Pollok et al., 2014). We reported previously a negative correlation between movement error size and the amplitude of postmovement beta event-related synchronization (ERS) over the sensorimotor cortex in healthy subjects, with this negative correlation enhanced when the contextual salience of movement errors was additionally considered (Tan et al., 2014). Thus, we proposed that the postmovement beta ERS over the sensorimotor cortex reflects neural processes that evaluate the result of a completed movement with respect to its predicted outcome and do so in the context of the previous error history. However, it remains unclear whether the sensorimotor cortex subserves such a function alone or does so with key subcortical interactions.
Here we explore the hypothesis that dynamic input from the basal ganglia makes an important contribution to the system evaluating and adjusting to motor errors, particularly by modulating the cortical beta ERS. The reasons for thinking this are several. First, oscillatory activity in the beta band is widespread in the cortico-basal ganglia network, and beta-band coherence between subthalamic nucleus (STN) and cortical activity increases after movement termination (Litvak et al., 2012; Hirschmann et al., 2013). Second, evidence has amassed suggesting that the basal ganglia make a substantial contribution to the early phase of motor adaptation when large and consistent errors are experienced (Krebs et al., 1998; Krakauer et al., 2004; Seidler et al., 2006; Scheidt et al., 2012). Linking these first two strands of evidence is the observation that beta power in the striatum was modulated by the movement error and motor learning in rodents (Howe et al., 2011). Finally, the STN is a key node in the indirect pathways of the basal ganglia, particularly important in learning through negative associations (Frank et al., 2004). Movement errors may be processed as a nonrewarding negative feedback that signals the need to suppress unwanted movements and inappropriate motor programming.
Accordingly, we seek evidence for activity within the basal ganglia sensitive to movement prediction error and evidence that the STN–cortical connectivity is dynamically modulated by such error during the process of motor adaptation. To this end, we simultaneously recorded STN LFP activity and electroencephalographic (EEG) activity from patients with Parkinson's disease (PD) while they performed a joystick tracking task with and without perturbations in the form of visuomotor rotations.
Materials and Methods
Subjects.
Fifteen patients with idiopathic PD (mean disease duration, 13 years; mean age, 62 years; range, 49–69 years; all males) provided informed consent to take part in this study, which was approved by the local ethics committees. Patients underwent bilateral implantation of deep-brain stimulation (DBS) electrodes into the STN, as a prelude to high-frequency stimulation for the treatment of advanced PD with motor fluctuations and/or dyskinesia. Techniques to target and implant electrodes in the STN have been described previously (Foltynie and Hariz, 2010). Microelectrode recordings were not made during surgery. The permanent quadripolar macroelectrode used was model 3389 (Medtronic) featuring four platinum–iridium cylindrical surfaces. At the University College London Institute of Neurology, patients were operated on under general anesthesia, and lead location was confirmed with intraoperative stereotactic magnetic resonance imaging. At King's College Hospital, where implantation was performed with patients awake, effective stimulation was confirmed intraoperatively, and lead location was further confirmed with immediate postoperative stereotactic computerized tomography. Clinical details of the patients are given in Table 1. The patients all had normal or corrected-to-normal vision and showed 64.1 ± 4.5% (p < 0.001) improvement in the motor section of the Unified Parkinson's Disease Rating Scale on treatment with levodopa, indicating good responsiveness to this drug. All patients went on to have chronic monopolar stimulation, with, at 9–20 months after the implantation, the case used as the positive node and one channel (in 10 of 12 STNs) or two channels (in 2 of 12 STNs) used as the negative node. In all patients, the bipolar channel selected for analysis (see below) turned out to include the contact (10 STNs) or one of the two contacts (two STNs) used for stimulation.
Experimental setup.
Subjects were seated in front of a computer monitor and held a finger joystick with their dominant hand, which rested on a padded arm support. The position of the joystick was displayed on the computer monitor as a cursor in the form of a red circle that was 6 mm (0.6 visual degrees) in diameter. The target was a green circle (6 mm diameter) displayed on the screen. Each trial started with the target (in green) and the cursor (in red) in the center of the monitor. Then the target jumped from the screen center to another position randomly selected from eight positions equally spaced around an invisible circle with a radius of 7.5 cm (6.1 visual degrees; Fig. 1A). The green target remained at its new position for 750 ms before returning to the center position, where the target stayed stationary for an additional 2.5 s before the next trial began, making the total intertrial interval 3 s. Subjects were instructed to move the joystick when the green target jumped so as to shift the red cursor from the central start position to match the position of the green target in a rapid, discrete, and straight movement. The positions of both the red cursor and green target circles were continuously presented throughout the experiment. Perturbation was implemented by introducing an angular rotation between the red cursor and the actual movement of the joystick, so that the visual feedback of the joystick position was deviated from its actual position (Fig. 1B). Each subject completed three sessions of the task, in which the rotational perturbation was zero (“NoRoT” session), randomly changing in terms of size and direction from trial to trial (“RdmRot” session), or constant (“CnstRot” session). All subjects completed the three sessions in the fixed order and were not informed about the type of perturbations in advance. There was a short break of 2–3 min between each session. The rotational angles used in different sessions are shown in Figure 2A.
Data recording.
Recordings were made when the patients were on their usual dopaminergic medication, 3–6 d postoperatively, while electrodes were externalized and before implantation of the pulse generator. The task was presented using open-source software (PsychoPy version 1.74). The timing of jumps in the green target and the positions of the cursor and target were sampled through PsychoPy at 100 Hz and sent to a digital-to-analog converter (U3; LabJack) to synchronize the cursor and target position with simultaneous EEG recordings.
STN local field potentials (LFPs) were recorded from the DBS electrodes. Simultaneously, scalp EEG was recorded from six channels over FCz, Cz, CPz, Oz, C3, and C4 according to the international 10–20 EEG system. It should be acknowledged that the precise location of the C3 and C4 electrodes may have been compromised (i.e., placed 1–2 cm off target) because of surgical wounds and dressings in this patient group. All signals were sampled at 2048 Hz and amplified using a TMSi Porti and its respective software (TMS International). The position of the joystick and the timing of the target jump were also recorded through the Porti amplifier. Before any analysis, monopolar recordings were downsampled to 250 Hz, bandpass filtered between 0.5 and 100 Hz, notch filtered at 50 Hz, and converted to a bipolar montage between contacts so as to limit the effects of volume conduction from distant sources (three bipolar channels per STN side and three bipolar channels for the EEG recordings: Fz–Cz, C3–Cz, and C4–Cz). Individual trials of bipolar LFP and EEG signals were visually inspected before filtering, and trials with channels containing obvious artifacts attributable to facial muscle contraction, movement artifact, or poor conductance were marked as invalid and excluded from additional analysis.
Behavioral analysis.
Data were analyzed using custom-written MATLAB (version R2012b; MathWorks) scripts. The position of the cursor was differentiated to calculate velocity, which was subsequently low-pass filtered through a Gaussian kernel with a window duration of 50 ms. The angular error was computed as the angle between the line connecting the start position and the cursor at the time of maximum velocity and the line connecting the start position and the target (Fig. 1C). Movement initiation was defined as the time when the joystick velocity crossed a threshold of three times the standard deviation (SD) of the signal (and its noise) at “rest” and sustained this speed for at least 100 ms. Movement termination was the last time the hand velocity fell below the threshold for that trial (Fig. 1D). Thus, our measure of movement duration included all corrective movements, but our measurement of error was focused on the initial angular error of the cursor relative to the target before any corrective movements. Reaction time (interval between target jump and movement initiation), movement duration (interval between movement initiation and movement termination), and initial angular error were calculated for each individual trial and then averaged within subjects for each experimental condition. Because the focus of the study was to, as far as possible, examine the physiological functioning of STN in motor adaptation, we studied patients when they were on their normal dopaminergic medication and so they were as close to normal as possible in terms of performance in the task. In addition, trials with extra-long reaction time (more than mean + 2.5 × SD) or initial movement error larger than 90° or movement amplitude smaller than two-thirds of the target displacement were disregarded. Patients with >20% invalid trials were excluded from additional analysis. This selection led to the exclusion of three patients. The 20% (3 of 15) patient exclusion rate reflects the relatively high cognitive and motor demands of the task and the feeling of fatigue and confusion some patients experience after surgery.
To evaluate how behavioral measurements changed in the task, trials in the constant rotation session were grouped into three bins according to execution order, with 46–50 trials for each bin. The trials in the random rotation session were first grouped into two bins according to execution order, and each bin was then divided into two bins according to error size relative to median error size. Thus, the trials in the random rotation session were grouped into four bins in total: (1) larger error trials in the first half of the session; (2) smaller error trials in the first half of the session; (3) larger error trials in the last half of the session; and (4) smaller error trials in the last half of the session, with 30–35 trials in each bin. All behavioral measurements were first calculated for each individual trial based on the time series of joystick positions and then averaged within experimental bins, before averaging across subjects.
Electrophysiological data analysis: frequency–time decomposition and intersite phase synchrony.
The instantaneous power and phase of the bipolar channels in each trial were first calculated using the wavelet transform from 2 to 95 Hz with frequency resolution of 1 Hz. A Morlet wavelet with 10 cycles for each frequency was used for the wavelet transform. An estimate of frequency band-specific power at each time point was defined as the squared magnitude of the resulting complex signal. Event-related change in power were calculated by normalizing the value of each time point against the mean value across the whole session and then subtracting 100 from each time point. Thus, a positive event-related change indicated a value larger than the overall average of the whole session and vice versa. The time-evolving cross-channel phase synchronization index (PSI) for each frequency was also evaluated across trials within each experimental bin and across a moving time window of 100 ms (Lachaux et al., 1999). This was performed because this index is not confounded by amplitude covariance.
Analysis of the LFP from the STN focused on the side of the STN that was contralateral to the hand used to perform the task. Of the three bipolar channels from each STN, the channel with the largest event-related power change in the beta band (13–30 Hz), i.e., the largest difference between the trough of event-related desynchronization during movement and the peak postmovement synchronization (ERS) in the beta band, was selected for additional analysis.
Partial directed coherence connectivity analysis.
One of our primary aims was to explore the dynamics of cortical–STN connectivity in terms of functional coupling and causality in response to movement and motor error. To address this, we used multivariate autoregressive (MVAR) modeling and estimated the partial directed coherence (PDC), introduced by Baccalá and Sameshima (2001), as an index of the strength and direction of Granger causal information flow between LFP signals recorded from the STN and EEG signals recorded over the sensorimotor cortical area contralateral to the moving hand. As described below, one signal can be said to “Granger-cause” a second signal, if the inclusion of past observations of the first signal reduce the prediction error of the second signal in a linear regression model (relative to a model that only includes past observations of the second signal). Therefore, note that Granger causal information flow need not imply direct connectivity, for example, in the form of the hyperdirect pathway from the frontal cortex to the STN. It can also capture indirect connectivity, as for example from the STN to cortex mediated by globus pallidus and thalamus. Moreover, this measure cannot distinguish the above from common drives with different time lags to, for example, the STN and cortex, and so results must be interpreted in the context of known anatomy and additional physiological data. Still, Granger causality has proved informative in a number of investigations of effective connectivity in the CNS (Zavala et al., 2013; Herrojo Ruiz et al., 2014; Nakhnikian et al., 2014).
The MVAR modeling is strictly based on the principle of Granger causality and therefore does not take into account zero-lagged or instantaneous influence: where [x1,…, xN] is a vector of N stationary stochastic processes, p is the model order, i.e., the number of previous time points used to predict the present value of each process, Ar ϵ RN × N is the regression coefficient matrix and Ar(i,j) represents the linear prediction effect of xj(n − r) on predicting xi(n). [w1,…, wN] are independent white-noise processes describing the modeling residuals. According to Granger causality, the time series xj(n) can be said to Granger-cause another time series xi(n), if the prediction error of xi(n) can be reduced by including past observations of xj(n), i.e., if the coefficients of the history of the first signal are not uniformly zero [Ar(i, j) ≠ 0 for some r].
The PDC was derived from the spectral representation of the entries of the regression coefficient matrix (Ar) based on MVAR modeling (Kamiński and Blinowska, 1991; Baccalá and Sameshima, 2001): This measurement of PDC [πi←j(ω)] is equal to zero when Ar(i, j) is uniformly zero and can be viewed as a frequency-domain measure for multivariate Granger causality.
A Granger causality connectivity analysis (GCCA) tool box (Seth, 2010) was used to preprocess the data, check the covariance stationarity of the signals, search for optimal modeling order for the MVAR, calculate the MVAR matrix, and perform model validation by checking the whiteness and independence of the estimated model residuals.
To minimize nonstationarities across trials in each experimental condition, data from each trial were first zero-meaned by subtracting the mean voltage of that trial from each time point and then ensemble zero-meaned by subtracting the ensemble mean from each time point (Ding et al., 2000). The ensemble mean is determined by averaging the values for each variable at each time point across trials within each experimental condition. Therefore, the connectivity analysis reported here is based on the induced activity with the across-trial average removed. Covariance stationarity was checked using the augmented Dickey Fuller test and the Kwiatkowski-Phillips-Schmidt-Shin (KPSS) test (“cca_check_cov_stat” and “cca_kpss” functions in the GCCA tool box, respectively). Models with model order between 2 and 50 were compared, and the appropriate MVAR model order was determined using the Bayesian information criterion. The MVAR matrix was calculated for each experimental condition and then converted into the spectral domain, before the PDC was calculated and used to determine the directionality of STN–EEG interactions.
Statistical analysis.
Grand averages of behavioral and electrophysiological measurements for different experimental conditions were calculated after deriving each of these variables from each individual trial made by a subject and then calculating averages across trials for that subject, before averaging across study participants. For electrophysiological measurements, significant differences from baseline for each condition were first evaluated using one-sample t tests. Differences between conditions were assessed with ANOVA. Means ± SEMs are presented throughout the text, unless otherwise specified.
Statistical analyses were performed in SPSS Statistics 19 (SPSS). Kolmogorov–Smirnov tests were applied to confirm that behavioral measures and LFP data were normally distributed, before additional parametric testing. When Mauchly's test of sphericity was significant (p < 0.05) in repeated-measures ANOVAs, Greenhouse–Geisser corrections were applied. Multiple comparisons were corrected for using the false discovery rate procedure (Curran-Everett, 2000), and only those p values remaining significant after this procedure are given.
Results
Behavioral results
In the session in which a constant rotational perturbation was introduced, trials were grouped into three experimental bins according to execution order. Subjects made progressively less movement error as bin number increased (F(2,22) = 43.069, p < 0.001; Fig. 2B), indicating a significant adaptation over time. The absolute movement error reduced from 30.9 ± 1.9° in the first bin of 50 trials to 17.8 ± 1.8° in the last (t(11) = 7.391, p < 0.001). The movement error was stable in the last bin of adaptation, as confirmed by similar movement errors between the first half and the second half of this bin (t(11) = 1.232, p = 0.244), although the average error in the last bin was still larger than that when there was no perturbation rotation (17.8 ± 1.8° compared with 10.9 ± 1.0°, t(11) = 3.60, p = 0.004). The mean degree of adaptation, defined as the difference between the average errors in the first bin and the last bin, was 12.2 ± 1.3° across subjects.
Other movement parameters, including reaction time and movement duration, were not modulated by the time spent in a session or by different types of perturbations, as confirmed by a lack of main effect of execution bin (early or late in each session: F(4,44) = 0.798, p = 0.533 for reaction time; F(4,44) = 1.059, p = 0.388 for movement duration), perturbation type (none, random, or constant: F(1,11) = 0.159, p = 0.698 for reaction time; F(1,11) = 0.625, p = 0.446 for movement duration), or interaction between execution bin and perturbation type (F(4,44) = 2.334, p = 0.172 for reaction time; F(4,40) = 0.429, p = 0.787 for movement duration). The average reaction times and movement durations were 472 ± 17 and 612 ± 43 ms, respectively, across subjects.
The particular value of the random perturbation session, in which perturbations randomly changed in both direction and size across trials without forewarning of randomness, was that movement error was dissociated from the time spent on the task. In this session, all trials were grouped into four experimental bins according to error amplitude and when the error was experienced (see Materials and Methods). Two-way repeated-measures ANOVA applied on the average movement errors in these four bins with factors of error size and time spent in the task (first or last half of the session) identified a significant effect of error size (F(1,11) = 175.173, p < 0.001) and lack of effect of time spent in the task (F(1,11) = 0.185, p = 0.675). This suggests that there was no difference in the movement errors between the first half and the last half of the session because of the randomness of the perturbation. However, despite the fact that the errors were constant throughout the session, the contextual salience of the movement error changed over time. With more time spent on the task, the randomness of the error became more obvious and the salience of the error reduced. This change in the perceived salience of movement errors was manifested in the change in reaction time in the trial after a trial with large errors: paired t tests showed that there was a slowing down in the reaction time after large errors compared with that after small error trials in the first half of the session (489 ± 24 ms compared with 467 ± 22 ms, t(11) = 3.347, p = 0.005) but not in the last half of the session (469 ± 26 ms compared with 466 ± 25 ms, t(11) = 0.326, p = 0.749). Thus, large errors were only salient, as judged by their effect on the subsequent trial, in the first half of the random perturbation session.
Postmovement beta resynchronization changes with movement errors and contextual salience in the STN LFP and cortical EEG
Our principal goal was to establish whether the STN and, in particular, the effective connectivity between the STN and cerebral cortex, was involved in the system processing the contextual significance of movement errors manifest through the modulation of the cortical ERS during visuomotor adaptation (Tan et al., 2014). To this end, we set out to both confirm that our patients had a similar pattern of cortical ERS reactivity to that reported previously in healthy young subjects during adaptation (Tan et al., 2014) and demonstrate a similar reactivity within the STN. Simultaneous cortical and subcortical recordings showed that power decreased during movement over a broad beta frequency band (13–30 Hz) in bipolar EEG channels overlying mesial frontal (FzCz) and contralateral sensorimotor cortical areas (C3Cz) and in bipolar STN LFP channels contralateral to the moving hand. This was followed by a rebound increase in power after movement termination, as shown in Figure 3A. These are well recognized features of STN and cortical reactivity (Litvak et al., 2012; Hirschmann et al., 2013). Also of interest was the short-latency increase in theta power after movement onset in both STN and FzCz but not C3Cz (Fig. 3A). However, here, we focus on activity in the beta band (13–30 Hz). The first novel observation in this band was that the postmovement beta resynchronization in both the STN and C3Cz, but not the FzCz, increased as trial number increased during the constant perturbation session, suggesting either a dependency on error (which was greatest early in the session) or time on task (Fig. 3B). Thus, the postmovement beta resynchronization in the STN and C3Cz in the last bin of the session with constant perturbation was increased compared with that in the first bin (23.78 ± 3.53% compared with 6.72 ± 4.01%, t(11) = 2.741, p = 0.019 in STN; and 8.35 ± 1.63% compared with 2.61 ± 1.40% for C3Cz, t(11) = 3.427, p = 0.005). Because there was no difference in the beta rebound with time spent on task in the session that contained no perturbations (data not shown), the observed increases were most likely attributable to a dependency on error.
During the session when perturbations randomly changed in both direction and size from trial to trial, movement error was dissociated from the time spent on the task, whereas the contextual salience of the movement error changed with time spent on the task. With more time spent on the task, the randomness of the error became more obvious and the salience of the error reduced, as reflected in the loss of post-error slowing (see behavioral results). In this session, the postmovement beta synchronization in the STN and C3Cz also was suppressed after trials with large errors but only in the first half of the session (Fig. 3C,D). Three-way repeated-measures ANOVA with factors of error size (large or small), time spent in the task (first or last half), and channels (STN, C3Cz, or FzCz) was performed on the average postmovement beta ERS. This identified a significant effect of error (F(1,11) = 10.688, p = 0.007), a significant interaction between error and time in the task (F(1,11) = 9.621, p = 0.010), and a significant three-way interaction (F(2,22) = 3.946, p = 0.034). Paired t tests confirmed that the beta synchronization in the STN after large errors was lower than that after small errors in the first half, but there is no effect of error size on beta ERS in the second half of the session. A similar effect was also found for the beta ERS at C3Cz (Fig. 3C,D).
These results suggest an effect of the amplitude of movement errors and of the contextual salience of movement errors on the modulation of the postmovement beta ERS in STN and over sensorimotor cortex, similar to that observed over the C3Cz in young healthy subjects (Tan et al., 2014).
Postmovement cortex–STN connectivity in beta band depends on cortical region and is asymmetric between STN and C3Cz
Because beta activity increased after movement offset in STN and in C3Cz and FzCz and the postmovement beta ERSs in both C3Cz and STN were modulated by movement error and its contextual salience, we investigated the connectivity between STN and different cortical areas. The intersite PSI was used to assess functional connectivity that was independent of power changes. This demonstrated a frequency-specific and movement status-dependent pattern in the intersite PSI in unperturbed movements (Fig. 4A,B). A two-way repeated-measures ANOVA with factors of sites (STN–FzCz or STN–C3Cz) and movement status (during movement or postmovement with time window length of 600 ms each) was applied to the average PSI in the beta band. This identified a significant interaction between sites and movement status (F(1,11) = 9.228, p = 0.010). Paired t tests showed that the beta-band PSI between STN and FzCz remained low in both movement states (0.076 ± 0.005 during movement compared with 0.080 ± 0.006 after movement, t(11) = −0.364, p = 0.722). In contrast, the beta-band PSI between STN and C3Cz was significantly increased after movement compared with that during movement (0.136 ± 0.013 compared with 0.076 ± 0.009, t(11) = 5.679, p < 0.001). The peak postmovement STN–C3Cz PSI in the beta band was not correlated with the peak postmovement beta power increase in either the STN (r = 0.280, p = 0.404) or C3Cz (r = 0.217, p = 0.454) across subjects, confirming that the increased connectivity observed after movement between the STN and C3Cz was not directly related to the increased beta power at the two levels.
The directionality of this increased coherence between STN and the sensorimotor cortical area (C3Cz) during the postmovement time window was evaluated using MVAR modeling and PDC analysis. This analysis was performed for different experimental sessions separately, with data from the postmovement window (600 ms duration after movement offset) from all individual trials as independent realizations of the same stationary process. This identified that the PDC from C3Cz to STN dominated in the beta band, independent from the type of perturbations in different experimental sessions (Fig. 4C,D). Two-way repeated-measures ANOVA with factors of direction of the connectivity (C3Cz to STN or STN to C3Cz) and type of perturbation (none, constant, or random: all trials) on the postmovement PDC averaged between 13 and 30 Hz confirmed significant effects of direction (F(1,11) = 34.90, p < 0.001) but did not show the effect of type of perturbation (F(2,22) = 0.234, p = 0.793) or interaction between perturbation type and direction (F(2,22) = 2.391, p = 0.111). In the postmovement time window, C3Cz-to-STN PDC (0.165 ± 0.019) was significantly larger than STN-to-C3Cz PDC (0.059 ± 0.009, t(11) = 5.908, p < 0.001), suggesting that the primary direction of information flow during this window was from C3Cz to the STN. This asymmetry was validated by the same PDC analysis applied to the time-reversed data (Haufe et al., 2013) from the session with no perturbation. This confirmed causal information flow in the reversed direction between data from STN and time-reversed C3Cz, with beta PDC from STN to time-reversed C3Cz significantly larger than that from time-reversed C3Cz to STN (0.119 ± 0.013 compared with 0.039 ± 0.010, t(11) = 5.638, p < 0.001). This safety check ensures that any PDC asymmetry is not generated by differing signal-to-noise ratios between the signals.
Balance of information flow between the cortex and STN changes with adaptation
Next, we investigated whether there might be a change in the direction of information flow in the beta band during the postmovement phase of constant perturbation trials, as adaptation developed. To this end, MVAR modeling and PDC analyses between STN and C3Cz were applied to the data from different trial bins. During the last execution bin when the movement errors reached asymptote, the coupling in the beta band was dominated by information flow from the cortex, and the information flow from the STN was negligible, similar to baseline movements when there was no perturbation. In contrast, during the first execution bin of the adaptation phase, there was increased information flow from the STN to C3Cz in the beta band (Fig. 5B). Two-way repeated-measures ANOVA with factors of execution bin (first or last) and direction (C3Cz to STN or STN to C3Cz) identified a significant interaction between the two factors (F(1,11) = 14.433, p = 0.003; Fig. 5C) but a lack of a main effect of direction (F(1,11) = 4.637, p = 0.054) or execution bin (F(1,11) = 2.314, p = 0.156). Post hoc analysis with paired t tests showed that there was no effect of adaptation on the C3Cz-to-STN information flow. However, STN-to-C3Cz beta information flow was significantly increased during the first 50 trials of adaptation compared with the last 50 trials (0.100 ± 0.028 vs 0.063 ± 0.010, t(11) = 4.265, p = 0.001). Importantly, the STN-to-C3Cz information flow in the first 50 trials correlated with the degree of adaptation (difference between the average error in the last bin and the first bin) that was achieved across subjects (r2 = 0.500, p = 0.010; Fig. 5D). A similar ANOVA applied to the beta-band FzCz-to-STN PDC showed no significant effect of direction (F(1,11) = 2.037, p = 0.181) or interaction between movement and direction (F(1,11) = 0.364, p = 0.559).
STN-to-C3Cz information flow increased after large errors but only when this is salient
During the session when perturbations randomly changed in both direction and size from trial to trial, the contextual salience of the movement error changed with time spent on the task, as reflected in the loss of post-error slowing and lack of beta ERS modulation in the last half of the trials from the session (see behavioral and beta ERS results). In this session, the STN-to-C3Cz PDC in the beta band after trials with large errors also increased but only in the first half of the session (Fig. 6A,B). In contrast, after movements with large errors in the second half of the session and after the movements with small errors, the information flow between the STN and C3Cz was more heavily dominated by the C3Cz-to-STN PDC in the beta band, similar to the situation after unperturbed movements (Fig. 6C,D). Repeated two-way ANOVA of STN-to-C3Cz PDC in the broad beta band with factors of error amplitude (large or small) and execution order (first or last half of the session) identified a significant interaction between error and execution order (F(1,11) = 9.411, p = 0.011). Paired t tests showed that STN-to-C3Cz information flow was larger after large errors experienced in the first half of the session (0.108 ± 0.013) than in the last half of the session (0.063 ± 0.005, t(11) = 3.360, p = 0.006) and also significantly larger than STN-to-C3Cz information flow after small errors (0.077 ± 0.010, t(11) = 2.775, p = 0.018). A similar ANOVA applied on the information flow from C3Cz to STN failed to identify any effects of error (F(1,11) = 0.786, p = 0.394) or execution order (F(1,11) = 1.446, p = 0.254) or their interaction (F(1,11) = 0.667, p = 0.431). Accordingly, only information flow from STN to C3Cz was modulated by the contextual salience of errors.
Discussion
We investigated spectral change in the STN and cortical EEG and effective connectivity between the STN and EEG in PD patients while they performed a joystick-based motor adaptation task on their normal dopaminergic medication. We found that, after movement offset, there was a beta-band activity in both local STN LFP and sensorimotor cortical EEG power affected by both motor error magnitude and its contextual saliency. Postmovement beta activities at the two sites were coupled, and the relative directionality of information flow (PDC) changed during visuomotor adaptation. Information flow from the STN to the sensorimotor cortex increased after large, salient errors, and the degree of increase correlated with motor-command adjustment across subjects. Such activity suggests an interaction between the STN and the sensorimotor cortex that is involved in the evaluation of the salience of movement errors, both in terms of their size and context and/or in the modifying of motor responses in the light of this.
Other studies have furnished evidence that activity in the STN and its downstream target, the globus pallidus interna, may be modulated by error and by the related phenomenon of conflict. However, previous research on error monitoring has primarily focused on decision making and action selection, in which the evaluation of the performance is discrete and the error concerns inappropriate action selection. In addition, activities reported in previous studies have different characteristics: (1) they occur before completion of the response; (2) are mediated by oscillations in the theta frequency band; (3) are preferentially coupled to the mesial frontal cortex; and (4) are not modulated by performance history (Zavala et al., 2013; Cavanagh et al., 2014; Herrojo Ruiz et al., 2014). Accordingly, the postmovement beta activity within and between the STN and sensorimotor cortex investigated here is likely to represent a distinct process.
Beta oscillations in the corticobasal ganglia network in movement error processing
We have showed previously that the postmovement beta synchronization over the sensorimotor cortex was reduced after task-relevant movement errors, and we speculated that the relative decrease in postmovement beta ERS allows for more flexibility and capacity for information coding and thereby revision of motor plans (Brittain and Brown, 2014; Tan et al., 2014). Here we showed that beta-band activity in the STN LFP reacted to movement errors in a similar manner. Beta activity in the STN and cerebral cortex has been hypothesized to promote the status quo (Brown, 2007; Engel and Fries, 2010). Accordingly, the attenuation of the postmovement beta ERS in trials with large errors might facilitate changes in motor programming, especially when past movement errors have shown little variability.
Beta oscillations recorded from the STN and sensorimotor cortical areas are coherent (Cassidy et al., 2002; Williams et al., 2002), and, like beta power in the STN, coherence has been found to be attenuated by movement (Lalo et al., 2008; Litvak et al., 2012), the administration of levodopa (Williams et al., 2002; Hirschmann et al., 2013), and DBS (Kühn et al., 2008). It is, as yet, unclear as to whether such coherence is pathological or physiological (Litvak et al., 2012). Inter-regional coherence in the beta band may differ in function from local synchronization in the same frequency band (Silberstein et al., 2005), and, indeed, these were uncorrelated in our paradigm. We observed increased coherence between sensorimotor cortical areas and the STN in the beta band after ballistic goal-directed movements when the patients were on their normal medication, and our results suggest that the coupling between these two structures may be involved in evaluating the outcome of the previous movement according to its contextual relevance.
In particular, we showed that the STN-to-sensorimotor cortex beta drive was modulated by salient movement errors. The STN-to-sensorimotor cortex beta drive increased after large errors but only when the errors were contextually salient, as in adaptation to constant perturbations or, with random perturbations, before randomness was apparent. When the unpredictability of the movement error became manifest later on in time in the random perturbation session, its significance with respect to action reprogramming was reduced, and the information flow from the STN fell off.
What might be the specific role of the STN drive to the sensorimotor cortex early during visuomotor adaptation? We posit that this STN-to-cortex beta drive paradoxically acts to limit the local cortical synchronization after movement prediction error, thereby facilitating revision of the last motor program. The functional importance of the STN-to-cortex information flow in the beta band was confirmed by its correlation with the degree of adaptation achieved across subjects. In addition, the notion that basal ganglia beta activity could, under some circumstances, paradoxically degrade local cortical synchronization in the beta band has a precedent in the suppression of cortico-muscular beta activity and of the cortical beta ERS when subcortical beta activity is elevated in PD patients withdrawn from dopaminergic medication or during discontinuation of DBS (Brown et al., 2001; Marsden et al., 2001; Salenius et al., 2002; Devos et al., 2004). Nevertheless, the hypothesis that STN-to-cortex beta drive might contribute to the attenuation of the cortical beta-band ERS after motor errors remains speculative and requires additional testing.
BG in motor learning
The results presented here are consistent with models of motor learning that propose that the basal ganglia contribute to early learning processes, regardless of the type of learning (Doyon and Benali, 2005; Doyon et al., 2009). However, previous models have focused on the potential role of the basal ganglia, and the striatum in particular, in learning the costs (effort required) and rewards associated with the execution of a motor action (Shadmehr and Krakauer, 2008; Turner and Desmurget, 2010; Liljeholm and O'Doherty, 2012). Midbrain dopamine neurons are hypothesized to encode reward prediction error (Houk et al., 1995; Nakahara et al., 2004; Bayer and Glimcher, 2005), and this error signal can be used for learning rewarding stimulus–action associations (Graybiel et al., 1994; Reynolds et al., 2001). Furthermore, dopamine-containing neurons in the basal ganglia have been shown to tune their sensitivity according to reward uncertainty (Tobler et al., 2005) and to code reward prediction error in a context-dependent manner (Nakahara et al., 2004).
More specifically, it has been proposed that learning positive associations (rewarding) and negative (nonrewarding) associations can be mediated by different pathways in the corticobasal ganglia network, with the positive association learning controlled by the direct Go pathway, which bypasses the STN, and negative associations by the indirect No-Go pathway, which involves the STN (Frank et al., 2004). Consistent with involvement of the indirect pathway in the processing of negative associations, our data suggest that the STN contributes to the early learning phase in visuomotor adaptation as part of the network that recognizes movement prediction errors in a context-dependent manner and contributes to post-error motor adjustment. Information flow from the STN to the cortex in the beta band might then serve to promote change at the cortical level so that motor programs are recalibrated in the face of large and salient errors.
Potential limitations and concluding remarks
The current study has some major limitations. First, our study participants were necessarily patients with PD, so inferences regarding normal functioning must be circumspect (Williams et al., 2002). However, all data presented here were recorded when the patients were on their normal dopaminergic medication in an attempt to approximate physiological functioning as closely as possible. In line with this, the patients presented here showed significant reduction of error when a constant perturbation was applied as a sign of adaptation. Second, we have not defined the relative contributions of the basal ganglia and cerebellar system in visuomotor adaptation, whereas the interaction of the two is thought to be critical for establishing new motor behaviors (Doyon et al., 2009). Third, analyses were performed on binned data (i.e., first block of 50 trials vs last block of 50 trials, or the first half of the session vs the last half of the session). Therefore, our results only show the overall change in information flow in different phases of motor learning. Whether these changes can be used to explain behavioral variations across individual trials needs additional investigation.
With the above provisos in mind, we have provided evidence for the involvement of the STN and its connections with the sensorimotor cortex in the early phase of visuomotor adaptation and, more generally, for the role of STN and these connections in the monitoring and evaluation of movement errors and in subsequent motor adjustment. Once a movement is finished, there is a brief increase in activity in the beta band that is coherent between the STN and sensorimotor cortex. The flow of information between these sites changes during adaptation, with the drive of the STN to sensorimotor cortical areas being increased when large movement errors are made that are contextually salient insofar as they provide information that can be used to optimize subsequent movements. This STN-to-sensorimotor cortex drive may help modulate local cortical processes that would otherwise act to maintain the parameters of the motor program that delivered the last movement (Tan et al., 2014).
Footnotes
This work was funded by the Medical Research Council. The work was performed in the National Institute for Health Research Cognitive Health Clinical Research Facility, Oxford.
The authors declare no competing financial interests.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.
- Correspondence should be addressed to Huiling Tan, Nuffield Department of Clinical Neurosciences, University of Oxford, Level 6, West Wing, John Radcliffe Hospital, Oxford, OX3 9DU, UK. Huiling.tan{at}ndcn.ox.ac.uk
This article is freely available online through the J Neurosci Author Open Choice option.