The Journal of Neuroscience, October 17, 2007, 27(42):11431-11441; doi:10.1523/JNEUROSCI.2252-07.2007
Previous Article | Next Article 
Behavioral/Systems/Cognitive
Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices
Toemme Noesselt,1,2
Jochem W. Rieger,2
Mircea Ariel Schoenfeld,2
Martin Kanowski,2
Hermann Hinrichs,2
Hans-Jochen Heinze,2 and
Jon Driver1
1UCL Institute of Cognitive Neuroscience, University College London, London WC1N 3AR, United Kingdom, and 2Department of Neurology II and Center for Advanced Imaging, Otto-von-Guericke-Universität, 39120 Magdeburg, Germany
Correspondence should be addressed to Dr. Toemme Noesselt, Center for Advanced Imaging, Haus 1, Leipziger Strasse 44, 39120 Magdeburg, Germany. Email: toemme{at}med.ovgu.de
The brain should integrate related but not unrelated information from different senses. Temporal patterning of inputs to different modalities may provide critical information about whether those inputs are related or not. We studied effects of temporal correspondence between auditory and visual streams on human brain activity with functional magnetic resonance imaging (fMRI). Streams of visual flashes with irregularly jittered, arrhythmic timing could appear on right or left, with or without a stream of auditory tones that coincided perfectly when present (highly unlikely by chance), were noncoincident with vision (different erratic, arrhythmic pattern with same temporal statistics), or an auditory stream appeared alone. fMRI revealed blood oxygenation level-dependent (BOLD) increases in multisensory superior temporal sulcus (mSTS), contralateral to a visual stream when coincident with an auditory stream, and BOLD decreases for noncoincidence relative to unisensory baselines. Contralateral primary visual cortex and auditory cortex were also affected by audiovisual temporal correspondence or noncorrespondence, as confirmed in individuals. Connectivity analyses indicated enhanced influence from mSTS on primary sensory areas, rather than vice versa, during audiovisual correspondence. Temporal correspondence between auditory and visual streams affects a network of both multisensory (mSTS) and sensory-specific areas in humans, including even primary visual and auditory cortex, with stronger responses for corresponding and thus related audiovisual inputs.
Key words: audiovisual; temporal integration; connectivity; fMRI; human multisensory
Received May 17, 2007;
revised Aug. 24, 2007;
accepted Sept. 6, 2007.
Correspondence should be addressed to Dr. Toemme Noesselt, Center for Advanced Imaging, Haus 1, Leipziger Strasse 44, 39120 Magdeburg, Germany. Email: toemme{at}med.ovgu.de
This article has been cited by other articles:

|
 |

|
 |
 
A. A. Ghazanfar, C. Chandrasekaran, and N. K. Logothetis
Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus Monkeys
J. Neurosci.,
April 23, 2008;
28(17):
4457 - 4469.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Alink, W. Singer, and L. Muckli
Capture of Auditory Motion by Vision Is Represented by an Activation Shift from Auditory to Visual Motion Cortex
J. Neurosci.,
March 12, 2008;
28(11):
2690 - 2697.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
O. Doehrmann
Listen to Your Visual Cortex: Effects of Occipital Transcranial Magnetic Stimulation on Auditory Stimulus Detection
J. Neurosci.,
January 2, 2008;
28(1):
1 - 2.
[Full Text]
[PDF]
|
 |
|