The Wechsler Adult Intelligence Scale (WAIS) assesses a wide range of cognitive abilities and impairments. Factor analyses have documented four underlying indices that jointly comprise intelligence as assessed with the WAIS: verbal comprehension (VCI), perceptual organization (POI), working memory (WMI), and processing speed (PSI). We used nonparametric voxel-based lesion-symptom mapping in 241 patients with focal brain damage to investigate their neural underpinnings. Statistically significant lesion-deficit relationships were found in left inferior frontal cortex for VCI, in left frontal and parietal cortex for WMI, and in right parietal cortex for POI. There was no reliable single localization for PSI. Statistical power maps and cross-validation analyses quantified specificity and sensitivity of the index scores in predicting lesion locations. Our findings provide comprehensive lesion maps of intelligence factors, and make specific recommendations for interpretation and application of the WAIS to the study of intelligence in health and disease.