The Journal of Neuroscience, July 25, 2007, 27(30):7881-7887; doi:10.1523/JNEUROSCI.1740-07.2007
Previous Article | Next Article 
Behavioral/Systems/Cognitive
Object Familiarity and Semantic Congruency Modulate Responses in Cortical Audiovisual Integration Areas
Grit Hein,1,2,4 *
Oliver Doehrmann,3
Notger G. Müller,1,2
Jochen Kaiser,3
Lars Muckli,2,5 and
Marcus J. Naumer2,3,5 *
1Cognitive Neurology Unit, 2Brain Imaging Center, and 3Institute of Medical Psychology, Johann Wolfgang Goethe-University, D-60528 Frankfurt am Main, Germany, 4Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720, and 5Department of Neurophysiology, Max Planck Institute for Brain Research, D-60528 Frankfurt am Main, Germany
Correspondence should be addressed to Dr. Marcus J. Naumer, Institut für Medizinische Psychologie, Johann Wolfgang Goethe-Universität, Heinrich-Hoffmann-Strasse 10 (Haus 93C), D-60528 Frankfurt am Main, Germany. Email: M.J.Naumer{at}med.uni-frankfurt.de
The cortical integration of auditory and visual features is crucial for efficient object recognition. Previous studies have shown that audiovisual (AV) integration is affected by where and when auditory and visual features occur. However, because relatively little is known about the impact of what is integrated, we here investigated the impact of semantic congruency and object familiarity on the neural correlates of AV integration. We used functional magnetic resonance imaging to identify regions involved in the integration of both (congruent and incongruent) familiar animal sounds and images and of arbitrary combinations of unfamiliar artificial sounds and object images. Unfamiliar object images and sounds were integrated in the inferior frontal cortex (IFC), possibly reflecting learning of novel AV associations. Integration of familiar, but semantically incongruent combinations also correlated with IFC activation and additionally involved the posterior superior temporal sulcus (pSTS). For highly familiar semantically congruent AV pairings, we again found AV integration effects in pSTS and additionally in superior temporal gyrus. These findings demonstrate that the neural correlates of object-related AV integration reflect both semantic congruency and familiarity of the integrated sounds and images.
Key words: multisensory integration; cross-modal; object recognition; familiarity; semantic congruency; functional magnetic resonance imaging; fMRI
Received Jan. 26, 2007;
accepted May 6, 2007.
Correspondence should be addressed to Dr. Marcus J. Naumer, Institut für Medizinische Psychologie, Johann Wolfgang Goethe-Universität, Heinrich-Hoffmann-Strasse 10 (Haus 93C), D-60528 Frankfurt am Main, Germany. Email: M.J.Naumer{at}med.uni-frankfurt.de
This article has been cited by other articles:

|
 |

|
 |
 
G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight
Temporal Characteristics of Audiovisual Information Processing
J. Neurosci.,
May 14, 2008;
28(20):
5344 - 5349.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Hocking and C. J. Price
The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing
Cereb Cortex,
February 14, 2008;
(2008)
bhn007v1.
[Abstract]
[Full Text]
[PDF]
|
 |
|