The primate visual system consists of at least two processing streams, one passing ventrally into temporal cortex that is responsible for object vision, and the other running dorsally into parietal cortex that is responsible for spatial vision. How information from these two streams is combined for perception and action is not understood. Visually guided eye movements require information about both feature identity and location, so we investigated the topographic organization of visual cortex connections with frontal eye field (FEF), the final stage of cortical processing for saccadic eye movements. Multiple anatomical tracers were placed either in parietal and temporal cortex or in different parts of FEF in individual macaque monkeys. Convergence from the dorsal and ventral processing streams occurred in lateral FEF but not in medial FEF. Certain extrastriate areas with retinotopic visual field organizations projected topographically onto FEF. The dorsal bank of the superior temporal sulcus projected to medial FEF; the ventral bank, to lateral FEF, and the fundus, throughout FEF. Thus, lateral FEF, which is responsible for generating short saccades, receives visual afferents from the foveal representation in retinotopically organized areas, from areas that represent central vision in inferotemporal cortex and from other areas having no retinotopic order. In contrast, medial FEF, which is responsible for generating longer saccades, is innervated by the peripheral representation of retinotopically organized areas, from areas that emphasize peripheral vision or are multimodal and from other areas that have no retinotopic order or are auditory.