Neural mechanisms of brain–computer interface control
Research highlights
► Brain processes during observation of movement predict SMR-BCI aptitude. ► BCI aptitude is unrelated to brain processes during execution of movement. ► Higher activation in SMA of high aptitude users during imagery and observation tasks. ► Higher activation in middle frontal gyrus of high aptitude users during observation.
Introduction
Motor imagery uses the conscious effort of simulating movements without actually performing them in an overt fashion (Jeannerod, 1995, Decety, 1996). The concept of a functional equivalence between imagery of movement and the perception of performing goes back to the inception of the ideo-motor theory of thinking in the 19th century (Carpenter, 1874, Stock and Stock, 2004). Motor imagery is generally assumed to activate the same representations as the corresponding motor execution. For example, it has been shown that imagined and executed movements follow the same temporal constraints (Decety et al., 1989). Using motor imagery in a training program has even been shown to lead to measurable increases in the voluntary force production of one of the five digits (Yue and Cole, 1992). Consequently mental practice of movement sequences activates similar brain areas as physical practice and also leads to improved performance when learning a sequence of foot movements (Lafleur et al., 2002, Jackson et al., 2003). There is some evidence that mental rehearsal may have rehabilitative effects in stroke and spinal cord injury (Malouin and Richards, 2010).
Brain–computer interfaces (BCIs) use voluntary control of brain activity in many applications (Kübler and Neumann, 2005). They were developed for people with neurodegenerative diseases, brain injuries or stroke that can lead to severe or complete paralysis. Various BCI paradigms have been proposed and three in particular have been evaluated with patients (mostly affected by amyotrophic lateral sclerosis (ALS), a degenerative disease of the first and second motor neurons leading to paralysis). BCIs are controlled by components of the electroencephalogram (EEG) (Berger, 1929) such as slow cortical potentials (SCPs) (Birbaumer et al., 1999), event-related potentials (ERPs, mainly the P300) (Nijboer et al., 2008b, Silvoni et al., 2009) and sensorimotor-rhythm (SMR) or μ-rhythm (Kübler et al., 2005). Apart from restoring communication there is some evidence that motor imagery-based BCIs may have a rehabilitative effect in chronic stroke patients (Buch et al., 2008). It was shown that out of a sample of 8 patients, 6 were able to learn successfully to control an orthosis through a neuromagnetic BCI.
The SMR is a brain rhythm (8–15 Hz) located over sensorimotor areas and is insensitive to visual input (Kuhlman, 1978). Instead of one uniform rhythm the sensorimotor area generates a variety of rhythms that have specific functional and topographic properties. Distinct rhythms are generated by areas involving e.g. hand and foot movements over the postcentral somatosensory cortex with the strongest contributions originating from the somatosensory cortex of the hand (Hari and Salmelin, 1997, Pfurtscheller et al., 1997). Also associated with the sensorimotor system is a phase coupled second peak in the beta band (16–30 Hz) of the resting EEG over the precentral motor cortex anterior to the sources of the alpha component of the SMR (Hari and Salmelin, 1997). The alpha and the beta peak can become independent for example at the offset of a movement after which the beta band rebounds faster and with a higher amplitude than the alpha band (Pfurtscheller, 1981). Additionally, desynchronization of the beta band during motor tasks can occur in slightly different frequency bands than the subsequent synchronization (rebound) after the motor task (Müller-Putz et al., 2007). Both of these rhythms are desynchronized by overt and covert movement, planning and observation of movement and movement imagery. Specifically, the sensitivity to motor imagery renders the SMR a useful control signal for BCIs (Blankertz et al., 2008, Blankertz et al., 2010, Kübler et al., 2005, Neuper et al., 2003, Neuper et al., 2009, Nijboer et al., 2008a). Consequently SMR based BCIs are a useful tool for measuring the effectiveness of regulating the thalamocortical system responsible for SMR-modulation through motor imagery.
In the current study we aimed at elucidating differences in the cortical network between high and low aptitude users during BCI performance using motor imagery. To achieve this goal we identified 10 high and 10 low aptitude BCI users in an fMRI study. The 20 participants were recruited from the participant pool (n = 80) that participated in the study of Blankertz et al. (2010) and were assigned to the group of high or low aptitude users according to their performance in the EEG-BCI experiment (median split). Functional MRI was measured on average 2 weeks after the EEG experiment, never on the same day, and comprised a motor imagery, motor execution and motor observation task.
Motor imagery and motor observation have been extensively studied with fMRI and other brain imaging techniques such as positron emission tomography (PET) (see Lotze and Halsband (2006) for a review). The results indicate that neural networks similar to those of executed movements are activated by imagery and observation of movement (Decety et al., 1994). Differences in activations between motor imagery and motor execution tasks have been found in bilateral premotor, prefrontal, supplementary motor and left posterior parietal areas as well as the caudate nuclei (Gerardin et al., 2000). The individual capacity to imagine movements has also been studied previously with imaging techniques. Stronger activations in high aptitude than in low aptitudemotor imagery performers were found in parietal and ventrolateral premotor regions and stronger activations for low as compared to high aptitude performers in the cerebellum, orbito-frontal and posterior cingulate cortices indicating that low aptitude users unsuccessfully compensate a reduced activation of motor areas with activation of cortical areas not directly related to movement execution or imagery (Guillot et al., 2008). In the previously described study motor imagery ability was assessed using questionnaires and physiological measures based on peripheral autonomic responses such as skin resistance. In a comparison of professional and amateur musicians the participant's level of expertise coincided with focused activations in the SMA, the superior PMC, more anterior areas (Larsell's lobule HVI) in the left cerebellar hemisphere and bilateral superior parietal areas whereas amateurs showed less focused and thus more widespread activations while playing and not imaging of a well trained musical piece (Lotze et al., 2003).
Taking into account the positive correlation between the resting SMR power and later BCI performance found in Blankertz et al. (2010), we hypothesized that high aptitude BCI users would recruit and activate to a larger extent the motor network known to be involved in motor imagery, namely premotor and supplementary motor areas. We further predicted that we would find such differences to a lesser extent during the motor observation task. During observation participants were asked to image the observed movement. We assumed that this would be easier than motor imagery alone. Finally, we hypothesized that the recruitment and activation of motor areas as measured with fMRI would predict performance in the BCI controlled by electrocortical signals.
Section snippets
Participants
Twenty healthy participants (7 female and 13 male, mean age 24.5 years, SD ± 3.7, range 19–36) took part in the study which was approved by the Internal Review Board of the Medical Faculty, University of Tübingen. Each participant was informed about the purpose of the study and signed informed consent prior to participation. Additionally, each participant signed a form informing him or her about potential risks and exclusion criteria of functional magnetic resonance imaging. Participants were
EEG-BCI online accuracy
Data from the EEG recording during feedback of motor imagery related brain activity was used to select participants for a group of high and low aptitude users. Ten high and 10 low aptitude users participated in the fMRI experiment. The 20 participants achieved a median performance of 82.1% in the EEG SMR-BCI feedback task. No gender effects were found in the EEG performance of all 80 participants (t(78) = .151; p = .880). Performance of low (64.2%) and high (91.2%) aptitude users differed
Discussion
We succeeded to show that there were significant differences in the functional activation measured during an motor imagery and motor observation task between two groups of participants that were split according to their performance with an EEG imagery-based BCI. The activation in the right middle frontal gyrus during motor observation and precentral gyrus during motor imagery correlated significantly with task performance in a BCI session based on motor imagery which was conducted several days
Conclusions
With this study we identified a strong physiological predictor of motor imagery skill as measured in an EEG-BCI. The volume activated in the whole brain during motor observation predicted performance in the EEG-BCI with r = 0.52 (see Fig. 8). The activation in the right middle frontal gyrus showed correlations of r = 0.72 indicating the importance of prefrontal activation to guide action and monitor performance (see Fig. 9). High aptitude users had a higher resting state SMR amplitudes than low
Acknowledgments
Funded by Deutsche Forschungsgemeinschaft (DFG) KU 1453/3-1. This work is also supported by the BMBF (Bundesministerium für Bildung und Forschung) Bernstein Center for Neurocomputation (Nr 01GQ0831), the European Research Council Grant (ERC 227632-BCCI) and the European ICT Programme (Project FP7-224631). This paper reflects the authors’ views only and funding agencies are not liable for any use that may be made of the information contained herein. We would like to thank Slavica von Hartlieb
References (76)
- et al.
Eeg mu rhythm and imitation impairments in individuals with autism spectrum disorder
Brain Cogn.
(2007) - et al.
Neurophysiological predictor of SMR-based BCI performance
Neuroimage
(2010) The neurophysiological basis of motor imagery
Behav. Brain Res.
(1996)- et al.
The timing of mentally represented actions
Behav. Brain Res.
(1989) - et al.
Testing anatomically specified hypotheses in functional imaging using cytoarchitectonic maps
Neuroimage
(2006) - et al.
Assignment of functional activations to probabilistic cytoarchitectonic areas revisited
Neuroimage
(2007) - et al.
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Neuroimage
(2005) The genesis of the EEG
Int. Rev. Neurobiol.
(1972)- et al.
Reading the mind in cartoons and stories: an fMRI study of ’theory of mind’ in verbal and nonverbal tasks
Neuropsychologia
(2000) - et al.
Functional neuroanatomical networks associated with expertise in motor imagery
Neuroimage
(2008)