 |
The Journal of Neuroscience, November 7, 2007, 27(45):12292-12307; doi:10.1523/JNEUROSCI.1897-07.2007
Previous Article | Next Article 
Behavioral/Systems/Cognitive
Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex
Davide Zoccolan,
Minjoon Kouh,
Tomaso Poggio, and
James J. DiCarlo
McGovern Institute for Brain Research, Department of Brain and Cognitive Sciences, Center for Biological and Computational Learning, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142
Correspondence should be addressed to James J. DiCarlo, McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139. Email: dicarlo{at}mit.edu
Object recognition requires both selectivity among different objects and tolerance to vastly different retinal images of the same object, resulting from natural variation in (e.g.) position, size, illumination, and clutter. Thus, discovering neuronal responses that have object selectivity and tolerance to identity-preserving transformations is fundamental to understanding object recognition. Although selectivity and tolerance are found at the highest level of the primate ventral visual stream [the inferotemporal cortex (IT)], both properties are highly varied and poorly understood. If an IT neuron has very sharp selectivity for a unique combination of object features ("diagnostic features"), this might automatically endow it with high tolerance. However, this relationship cannot be taken as given; although some IT neurons are highly object selective and some are highly tolerant, the empirical connection of these key properties is unknown. In this study, we systematically measured both object selectivity and tolerance to different identity-preserving image transformations in the spiking responses of a population of monkey IT neurons. We found that IT neurons with high object selectivity typically have low tolerance (and vice versa), regardless of how object selectivity was quantified and the type of tolerance examined. The discovery of this trade-off illuminates object selectivity and tolerance in IT and unifies a range of previous, seemingly disparate results. This finding also argues against the idea that diagnostic conjunctions of features guarantee tolerance. Instead, it is naturally explained by object recognition models in which object selectivity is built through AND-like tuning mechanisms.
Key words: inferotemporal cortex; monkey; object recognition; multiple objects; trade-off; tolerance
Received April 26, 2007;
revised Sept. 20, 2007;
accepted Sept. 24, 2007.
Correspondence should be addressed to James J. DiCarlo, McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139. Email: dicarlo{at}mit.edu
This article has been cited by other articles:

|
 |

|
 |
 
N. Li, D. D. Cox, D. Zoccolan, and J. J. DiCarlo
What Response Properties Do Individual Neurons Need to Underlie Position and Clutter "Invariant" Object Recognition?
J Neurophysiol,
July 1, 2009;
102(1):
360 - 376.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Grossberg
Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion and action
Phil Trans R Soc B,
May 12, 2009;
364(1521):
1223 - 1234.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Akrami, Y. Liu, A. Treves, and B. Jagadeesh
Converging Neuronal Activity in Inferior Temporal Cortex during the Classification of Morphed Stimuli
Cereb Cortex,
April 1, 2009;
19(4):
760 - 776.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
Y. Liu, S. O. Murray, and B. Jagadeesh
Time Course and Stimulus Dependence of Repetition-Induced Response Suppression in Inferotemporal Cortex
J Neurophysiol,
January 1, 2009;
101(1):
418 - 436.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. B. Issa and X. Wang
Sensory Responses during Sleep in Primate Primary and Secondary Auditory Cortex
J. Neurosci.,
December 31, 2008;
28(53):
14467 - 14480.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. D. Cox and J. J. DiCarlo
Does Learned Shape Selectivity in Inferior Temporal Cortex Automatically Generalize Across Retinal Position?
J. Neurosci.,
October 1, 2008;
28(40):
10045 - 10055.
[Abstract]
[Full Text]
[PDF]
|
 |
|
|

|