Behavioral responses to a sensory stimulus are often guided by associative memories. These associations remain intact even when other factors determine behavior. The substrates of associative memory should therefore be identifiable by neuronal responses that are independent of behavioral choices. We tested this hypothesis using a paired-associates task in which monkeys learned arbitrary associations between pairs of visual stimuli. We examined the activity of neurons in inferior temporal cortex as the animals prepared to choose a remembered stimulus from a visual display. The activity of some neurons (22%) depended on the monkey's behavioral choice; but for a novel class of neurons (54%), activity reflected the stimulus that the monkey was instructed to choose, regardless of the behavioral response. These neurons appear to represent memorized stimulus associations that are stable across variations in behavioral performance. In addition, many neurons (74%) were modulated by the spatial arrangement of the stimuli in the display.