Abstract
This study details a method to statistically determine, on a millisecond scale and for individual subjects, those brain areas whose activity differs between experimental conditions, using single-trial scalp-recorded EEG data. To do this, we non-invasively estimated local field potentials (LFPs) using the ELECTRA distributed inverse solution and applied non-parametric statistical tests at each brain voxel and for each time point. This yields a spatio-temporal activation pattern of differential brain responses. The method is illustrated here in the analysis of auditory-somatosensory (AS) multisensory interactions in four subjects. Differential multisensory responses were temporally and spatially consistent across individuals, with onset at ~50 ms and superposition within areas of the posterior superior temporal cortex that have traditionally been considered auditory in their function. The close agreement of these results with previous investigations of AS multisensory interactions suggests that the present approach constitutes a reliable method for studying multisensory processing with the temporal and spatial resolution required to elucidate several existing questions in this field. In particular, the present analyses permit a more direct comparison between human and animal studies of multisensory interactions and can be extended to examine correlation between electrophysiological phenomena and behavior.
References
Besle J, Fort A, Giard MH (2004) Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn Process 5:189–192
Calvert GA (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11:1110–1123
Fort A, Delpuech C, Pernier J, Giard MH (2002) Early auditory-visual interactions in human cortex during nonredundant target identification. Cogn Brain Res 14:20–30
Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE (2000) Multisensory auditory–somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10:77–83
Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM (2002) Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol 88:540–543
Foxe JJ, Molholm S, Mehta AS, Sehatpour P, Schwartz T (2004) Intracranial recordings in humans reveal auditory-visual multisensory interactions in early sensory cortices. In: 5th annual meeting of the international multisensory research forum. Sitges, Spain
Fu KMG, Foxe, JJ, Murray MM, Higgins BA, Javitt DC, Schroeder CE (2001) Cross-modality cued attention-dependent suppression of distracter visual input indexed by anticipatory parieto-occipital alpha-band oscillations. Cogn Brain Res 12:145–152
Fu KMG, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garraghty PE, Schroeder CE (2003) Auditory cortical neurons respond to somatosensory stimulation. J Neurosci 23:7510–7515
Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473–490
Gobbelé R, Schürmann M, Forss N, Juottonen K, Buchner H, Hari R (2003) Activation of the human posterior and temporoparietal cortices during audiotactile interaction. Neuroimage 20:503–511
Gonzalez Andino S, Michel CM, Thut G, Landis T, Grave de Peralta R (2005) Prediction of response speed by anticipatory high frequency oscillations in the human brain. Hum Brain Mapp 24:50–58
Grave de Peralta-Menendez R, Gonzalez-Andino SL (1998) A critical analysis of linear inverse solutions to the neuroelectromagnetic inverse problem. IEEE Trans Biomed Eng 45:440–448
Grave de Peralta Menendez R, Gonzalez Andino SL, Morand S, Michel CM, Landis T (2000) Imaging the electrical activity of the brain: ELECTRA. Hum Brain Mapp 9:1–12
Grave de Peralta Menendez R, Murray MM, Michel CM, Martuzzi R, Gonzalez Andino SL (2004) Electrical neuroimaging based on biophysical constraints. Neuroimage 21:527–539
Guthrie D, Buchwald JS (1991) Significance testing of difference potentials. Psychophysiology 28:240–244
Levänen S, Jousmäki V, Hari R (1998) Vibration-induced auditory-cortex activation in a congenitally deaf adult. Curr Biol 8:869–872
Lütkenhöner B, Lammertmann C, Simoes C, Hari R (2002) Magnetoencephalographic correlates of audiotactile interaction. Neuroimage 15:509–522
Matsuhashi M, Ikeda A, Ohara S, Matsumoto R, Yamamoto J, Takayama M, Satow T, Begum T, Usui K, Nagamine T, Mikuni N, Takahashi J, Miyamoto S, Fukuyama H, Shibasaki H (2004) Multisensory convergence at human temporo-parietal junction—epicortical recording of evoked responses. Clin Neurophysiol 115:1145–1160
Michel CM, Murray MM, Lantz G, Gonzalez S, Spinelli L, Grave de Peralta R (2004) EEG source imaging (invited review). Clin Neurophysiol 115:2195–2222
Miller J (1982) Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14:247–279
Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14:115–128
Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14:452–465
Murray MM, Foxe JJ, Higgins BA, Javitt DC, Schroeder CE (2001) Visuo-spatial neural response interactions in early visual cortical processing during a simple reaction time task: a high-density electrical mapping study. Neuropsychologia 39:828–844
Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2004a) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex doi:10.1093/cercor/bhh197
Murray MM, Michel CM, Grave de Peralta R, Ortigue S, Brunet D, Gonzalez Andino S, Schnider A (2004b) Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage 21:125–135
Murray MM, Foxe DM, Javitt DC, Foxe JJ (2004c) Setting boundaries: brain dynamics of modal and amodal illusory shape completion in humans. J Neurosci 24:6898–6903
Murray MM, Michel CM, Ortigue S, Blanke O, Spinelli L, Seeck M (2004d) Visuo-Somatosensory multisensory interactions: evidence from human intracranial recordings. In: 5th annual meeting of the international multisensory research forum. Sitges, Spain
Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97–113
Rivier F, Clarke S (1997) Cytochrome oxidase, acetylcholinesterase, and NADPH-Diaphorase staining in human supratemporal and isular cortex: evidence for multiple auditory areas. Neuroimage 6:288–304
Rorden C, Brett M (2000) Stereotaxic display of brain lesions. Behav Neurol 12:191–200
Schroeder CE, Foxe JJ (2002) The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res Cogn Brain Res 14:187–198
Schroeder CE, Lindsley RW, Specht C, Marcovici A, Smiley JF, Javitt DC (2001) Somatosensory input to auditory association cortex in the macaque monkey. J Neurophysiol 85:1322–1327
Schroeder CE, Smiiley J, Fu KMG, McGinnis T, O’Connell MN, Hackett TA (2003) Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int J Psychophysiol 50:5–18
Schroeder CE, Molholm S, Lakatos P, Ritter W, Foxe JJ (2004) Human-simian correspondence in the early cortical processing of multisensory cures. Cogn Process 5:140–151
Sokolov A, Pavlova M, Lutzenberger W, Birbaumer N (2004) Reciprocal modulation of neuromagnetic induced gamma activity by attention in the human visual and auditory cortex. Neuroimage 22:521–529
Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. Thieme, New York
Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14:106–114
Acknowledgements
The Swiss National Science Foundation (Grants 3152A0-100745, 3200BO-100606, and 3200BO-105680/1, IM2 White Paper on Brain Machines Interfaces) and NIMH (MH63434 and MH49334) provided financial support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gonzalez Andino, S.L., Murray , M.M., Foxe, J.J. et al. How single-trial electrical neuroimaging contributes to multisensory research. Exp Brain Res 166, 298–304 (2005). https://doi.org/10.1007/s00221-005-2371-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-005-2371-1