Primate inferotemporal cortex is subdivided into domains for biologically important categories, such as faces, bodies and scenes, as well as domains for culturally entrained categories, such as text or buildings. These domains are in stereotyped locations in most humans and monkeys. To ask what determines the locations of such domains, we intensively trained seven juvenile monkeys to recognize three distinct sets of shapes. After training, the monkeys developed regions that were selectively responsive to each trained set. The location of each specialization was similar across monkeys, despite differences in training order. This indicates that the location of training effects does not depend on function or expertise, but rather on some kind of proto-organization. We explore the possibility that this proto-organization is retinotopic or shape-based.