Elsevier

Neuroscience Letters

Volume 363, Issue 2, 10 June 2004, Pages 112-115
Neuroscience Letters

Time course of multisensory interactions during audiovisual speech perception in humans: a magnetoencephalographic study

https://doi.org/10.1016/j.neulet.2004.03.076Get rights and content

Abstract

During social interaction speech is perceived simultaneously by audition and vision. We studied interactions in the processing of auditory (A) and visual (V) speech signals in the human brain by comparing neuromagnetic responses to phonetically congruent audiovisual (AV) syllables with the arithmetic sum of responses to A and V syllables. Differences between AV and A+V responses were found bilaterally in the auditory cortices 150–200 ms and in the right superior temporal sulcus (STS) 250–600 ms after stimulus onset, showing that both sensory-specific and multisensory regions of the human temporal cortices are involved in AV speech processing. Importantly, our results suggest that AV interaction in the auditory cortex precedes that in the multisensory STS region.

Section snippets

Acknowledgments

We thank Professor Riitta Hari and Dr Iiro Jääskeläinen for the comments on the manuscript and Mika Seppä for help in data analysis. The MRIs were obtained at the Department of Radiology, Helsinki University Central Hospital. This study has been supported by the Academy of Finland and the Sigrid Juselius Foundation.

Cited by (0)

View full text