QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, June 22, 2005, 25(25):5884-5893; doi:10.1523/JNEUROSCI.0896-05.2005

This Article Full Text Full Text (PDF) Supplemental data Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (44) Citing Articles via Google Scholar Google Scholar Articles by Miller, L. M. Articles by D'Esposito, M. Search for Related Content PubMed PubMed Citation Articles by Miller, L. M. Articles by D'Esposito, M.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
Perceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech

Lee M. Miller¹ and Mark D'Esposito²

¹Section of Neurobiology, Physiology, and Behavior and Center for Mind and Brain, University of California, Davis, California 95616, and ²Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720

Human speech perception is profoundly influenced by vision. Watching a speaker's mouth movements significantly improves comprehension, both for normal listeners in noisy environments and especially for the hearing impaired. A number of brain regions have been implicated in audiovisual speech tasks, but little evidence distinguishes them functionally. In an event-related functional magnetic resonance imaging study, we differentiate neural systems that evaluate cross-modal coincidence of the physical stimuli from those that mediate perceptual binding. Regions consistently involved in perceptual fusion per se included Heschl's gyrus, superior temporal sulcus, middle intraparietal sulcus, and inferior frontal gyrus. Successful fusion elicited activity biased toward the left hemisphere, although failed cross-modal binding recruited regions in both hemispheres. A broad network of other areas, including the superior colliculus, anterior insula, and anterior intraparietal sulcus, were more involved with evaluating the spatiotemporal correspondence of speech stimuli, regardless of a subject's perception. All of these showed greater activity to temporally offset stimuli than to audiovisually synchronous stimuli. Our results demonstrate how elements of the cross-modal speech integration network differ in their sensitivity to physical reality versus perceptual experience.

Key words: cross modal; audiovisual; multisensory; speech; binding; fMRI

---

Received Dec 9, 2004; revised April 18, 2005; accepted May 16, 2005.

This article has been cited by other articles:

				S. Werner and U. Noppeney Superadditive Responses in Superior Temporal Sulcus Predict Audiovisual Benefits in Object Categorization Cereb Cortex, November 18, 2009; (2009) bhp248v1. [Abstract] [Full Text] [PDF]

				L. H. Arnal, B. Morillon, C. A. Kell, and A.-L. Giraud Dual Neural Routing of Visual Facilitation in Speech Processing J. Neurosci., October 28, 2009; 29(43): 13445 - 13453. [Abstract] [Full Text] [PDF]

				R. Peeters, L. Simone, K. Nelissen, M. Fabbri-Destro, W. Vanduffel, G. Rizzolatti, and G. A. Orban The Representation of Tool Use in Humans and Monkeys: Common and Uniquely Human Features J. Neurosci., September 16, 2009; 29(37): 11523 - 11539. [Abstract] [Full Text] [PDF]

				K. T. Hill and L. M. Miller Auditory Attentional Control and Selection during Cocktail Party Listening Cereb Cortex, July 2, 2009; (2009) bhp124v1. [Abstract] [Full Text] [PDF]

				J. Besle, C. Fischer, A. Bidet-Caulet, F. Lecaignard, O. Bertrand, and M.-H. Giard Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans J. Neurosci., December 24, 2008; 28(52): 14301 - 14310. [Abstract] [Full Text] [PDF]

				J. Hocking and C. J. Price The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing Cereb Cortex, October 1, 2008; 18(10): 2439 - 2449. [Abstract] [Full Text] [PDF]

				R. Campbell The processing of audio-visual speech: empirical and neural bases Phil Trans R Soc B, March 12, 2008; 363(1493): 1001 - 1010. [Abstract] [Full Text] [PDF]

				A. F. Rossi, N. P. Bichot, R. Desimone, and L. G. Ungerleider Top Down Attentional Deficits in Macaques with Lesions of Lateral Prefrontal Cortex J. Neurosci., October 17, 2007; 27(42): 11306 - 11314. [Abstract] [Full Text] [PDF]

				T. Noesselt, J. W. Rieger, M. A. Schoenfeld, M. Kanowski, H. Hinrichs, H.-J. Heinze, and J. Driver Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices J. Neurosci., October 17, 2007; 27(42): 11431 - 11441. [Abstract] [Full Text] [PDF]

				L. M. Romanski Representation and Integration of Auditory and Visual Stimuli in the Primate Ventral Lateral Prefrontal Cortex Cereb Cortex, September 1, 2007; 17(suppl_1): i61 - i69. [Abstract] [Full Text] [PDF]

				T. Sugihara, M. D. Diltz, B. B. Averbeck, and L. M. Romanski Integration of Auditory and Visual Communication Information in the Primate Ventrolateral Prefrontal Cortex J. Neurosci., October 25, 2006; 26(43): 11138 - 11147. [Abstract] [Full Text] [PDF]

				S. Molholm, P. Sehatpour, A. D. Mehta, M. Shpaner, M. Gomez-Ramirez, S. Ortigue, J. P. Dyke, T. H. Schwartz, and J. J. Foxe Audio-Visual Multisensory Integration in Superior Parietal Lobule Revealed by Human Intracranial Recordings J Neurophysiol, August 1, 2006; 96(2): 721 - 729. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help