RT Journal Article
SR Electronic
T1 Reference Frame of the Ventriloquism Aftereffect
JF The Journal of Neuroscience
JO J. Neurosci.
FD Society for Neuroscience
SP 13809
OP 13814
DO 10.1523/JNEUROSCI.2783-09.2009
VO 29
IS 44
A1 Norbert Kopčo
A1 I-Fan Lin
A1 Barbara G. Shinn-Cunningham
A1 Jennifer M. Groh
YR 2009
UL http://www.jneurosci.org/content/29/44/13809.abstract
AB Seeing the image of a newscaster on a television set causes us to think that the sound coming from the loudspeaker is actually coming from the screen. How images capture sounds is mysterious because the brain uses different methods for determining the locations of visual versus auditory stimuli. The retina senses the locations of visual objects with respect to the eyes, whereas differences in sound characteristics across the ears indicate the locations of sound sources referenced to the head. Here, we tested which reference frame (RF) is used when vision recalibrates perceived sound locations. Visually guided biases in sound localization were induced in seven humans and two monkeys who made eye movements to auditory or audiovisual stimuli. On audiovisual (training) trials, the visual component of the targets was displaced laterally by 5–6°. Interleaved auditory-only (probe) trials served to evaluate the effect of experience with mismatched visual stimuli on auditory localization. We found that the displaced visual stimuli induced ventriloquism aftereffect in both humans (∼50% of the displacement size) and monkeys (∼25%), but only for locations around the trained spatial region, showing that audiovisual recalibration can be spatially specific. We tested the reference frame in which the recalibration occurs. On probe trials, we varied eye position relative to the head to dissociate head- from eye-centered RFs. Results indicate that both humans and monkeys use a mixture of the two RFs, suggesting that the neural mechanisms involved in ventriloquism occur in brain region(s) using a hybrid RF for encoding spatial information.