Although the importance of the posterior parietal and prefrontal regions in spatial localization of visual stimuli is well established, their role in auditory space perception is less clear. Using positron emission tomography (PET) during auditory and visual spatial localization in the same subjects, modality-specific areas were identified in the superior parietal lobule, middle temporal and lateral prefrontal cortices. These findings suggest that, similar to the visual system, the hierarchical organization of the auditory system extends beyond the temporal lobe to include areas in the posterior parietal and prefrontal regions specialized in auditory spatial processing. Our results may explain the dissociation of visual and auditory spatial localization deficits following lesions involving these regions.