PT  - JOURNAL ARTICLE
AU  - Omri Barak
AU  - Mattia Rigotti
AU  - Stefano Fusi
TI  - The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-Off
AID  - 10.1523/JNEUROSCI.2753-12.2013
DP  - 2013 Feb 27
TA  - The Journal of Neuroscience
PG  - 3844--3856
VI  - 33
IP  - 9
4099  - http://www.jneurosci.org/content/33/9/3844.short
4100  - http://www.jneurosci.org/content/33/9/3844.full
SO  - J. Neurosci.2013 Feb 27; 33
AB  - Intelligent behavior requires integrating several sources of information in a meaningful fashion—be it context with stimulus or shape with color and size. This requires the underlying neural mechanism to respond in a different manner to similar inputs (discrimination), while maintaining a consistent response for noisy variations of the same input (generalization). We show that neurons that mix information sources via random connectivity can form an easy to read representation of input combinations. Using analytical and numerical tools, we show that the coding level or sparseness of these neurons' activity controls a trade-off between generalization and discrimination, with the optimal level depending on the task at hand. In all realistic situations that we analyzed, the optimal fraction of inputs to which a neuron responds is close to 0.1. Finally, we predict a relation between a measurable property of the neural representation and task performance.