The midbrain contains an auditory map of space that is shaped by visual experience. When barn owls are raised wearing spectacles that horizontally displace the visual field, the auditory space map in the external nucleus of the inferior colliculus (ICX) shifts according to the optical displacement of the prisms. Topographic visual activity in the optic tectum could serve as the template that instructs the auditory space map. We studied the effects of a restricted, unilateral lesion in the portion of the optic tectum that represents frontal space. Here we show that such a lesion eliminates adaptive adjustments specifically in the portion of the auditory map that represents frontal space on the same side of the brain, while the rest of the map continues to adjust adaptively. Thus, activity in the tectum calibrates the auditory space map in a location-specific manner. Because the site of adaptive changes is the ICX, the results also indicate that the tectum provides a topographic instructive signal that controls adaptive auditory plasticity in the ICX.