Abstract
Decorrelation is a fundamental computation that optimizes the format of neuronal activity patterns. Channel decorrelation by adaptive mechanisms results in efficient coding, whereas pattern decorrelation facilitates the readout and storage of information. Mechanisms achieving pattern decorrelation, however, remain unclear. We developed a theoretical framework that relates high-dimensional pattern decorrelation to neuronal and circuit properties in a mathematically stringent fashion. For a generic class of random neuronal networks, we proved that pattern decorrelation emerges from neuronal nonlinearities and is amplified by recurrent connectivity. This mechanism does not require adaptation of the network, is enhanced by sparse connectivity, depends on the baseline membrane potential and is robust. Connectivity measurements and computational modeling suggest that this mechanism is involved in pattern decorrelation in the zebrafish olfactory bulb. These results reveal a generic relationship between the structure and function of neuronal circuits that is probably relevant for pattern processing in various brain areas.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Srivastava, V., Parker, D.J. & Edwards, S.F. The nervous system might 'orthogonalize' to discriminate. J. Theor. Biol. 253, 514–517 (2008).
French, R.M. Catastrophic forgetting in connectionist networks. Trends Cogn. Sci. 3, 128–135 (1999).
Itskov, V. & Abbott, L.F. Pattern capacity of a perceptron for sparse discrimination. Phys. Rev. Lett. 101, 018101 (2008).
Barlow, H.B. Possible principles underlying the transformations of sensory messages. in Sensory Communication (ed. W.A. Rosenblith) 217–234 (MIT Press, Cambridge, Massachusetts, 1961).
Barlow, H. Redundancy reduction revisited. Network 12, 241–253 (2001).
Lewicki, M.S. Efficient coding of natural sounds. Nat. Neurosci. 5, 356–363 (2002).
Olshausen, B.A. & Field, D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607–609 (1996).
Atick, J.J. & Redlich, A.N. Convergent algorithm for sensory receptive-field development. Neural Comput. 5, 45–60 (1993).
Vinje, W.E. & Gallant, J.L. Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287, 1273–1276 (2000).
Weinstein, E., Feder, M. & Oppenheim, A.V. Multi-channel signal separation by decorrelation. IEEE Trans. Speech Audio Process. 1, 405–413 (1993).
Amari, S., Cichocki, A. & Yang, H.H. Recurrent neural networks for blind separation of sources. in International Symposium on Nonlinear Theory and its Applications 37–42 (NOLTA'95, Las Vegas, 1995).
Brown, G.D., Yamada, S. & Sejnowski, T.J. Independent component analysis at the neural cocktail party. Trends Neurosci. 24, 54–63 (2001).
Parra, L.C. & Spence, C.D. Separation of non-stationary natural signals. in Independent Component Analysis: Principles and Practice (eds. S. Roberts & R. Everson) 135–157 (Cambridge University Press, Cambridge, Massachusetts, 2001).
Rolls, E.T. & Kesner, R.P. A computational theory of hippocampal function, and empirical tests of the theory. Prog. Neurobiol. 79, 1–48 (2006).
Hasselmo, M.E., Wilson, M.A., Anderson, B.P. & Bower, J.M. Associative memory function in piriform (olfactory) cortex: computational modeling and neuropharmacology. Cold Spring Harb. Symp. Quant. Biol. 55, 599–610 (1990).
Friedrich, R.W. & Laurent, G. Dynamic optimization of odor representations in the olfactory bulb by slow temporal patterning of mitral cell activity. Science 291, 889–894 (2001).
Friedrich, R.W. & Laurent, G. Dynamics of olfactory bulb input and output activity during odor stimulation in zebrafish. J. Neurophysiol. 91, 2658–2669 (2004).
Friedrich, R.W., Habermann, C.J. & Laurent, G. Multiplexing using synchrony in the zebrafish olfactory bulb. Nat. Neurosci. 7, 862–871 (2004).
Leutgeb, J.K., Leutgeb, S., Moser, M.B. & Moser, E.I. Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science 315, 961–966 (2007).
Marr, D. A theory of cerebellar cortex. J. Physiol. (Lond.) 202, 437–470 (1969).
de la Rocha, J., Doiron, B., Shea-Brown, E., Josic, K. & Reyes, A. Correlation between neural spike trains increases with firing rate. Nature 448, 802–806 (2007).
Jortner, R.A., Farivar, S.S. & Laurent, G. A simple connectivity scheme for sparse coding in an olfactory system. J. Neurosci. 27, 1659–1669 (2007).
Baum, R. The correlation function of Gaussian noise passed through nonlinear devices. IEEE Trans. Inf. Theory 15, 448–456 (1969).
Friedrich, R.W. & Korsching, S.I. Combinatorial and chemotopic odorant coding in the zebrafish olfactory bulb visualized by optical imaging. Neuron 18, 737–752 (1997).
Soucy, E.R., Albeanu, D.F., Fantana, A.L., Murthy, V.N. & Meister, M. Precision and diversity in an odor map on the olfactory bulb. Nat. Neurosci. 12, 210–220 (2009).
Meister, M. & Bonhoeffer, T. Tuning and topography in an odor map on the rat olfactory bulb. J. Neurosci. 21, 1351–1360 (2001).
Egger, V., Svoboda, K. & Mainen, Z.F. Dendrodendritic synaptic signals in olfactory bulb granule cells: local spine boost and global low-threshold spike. J. Neurosci. 25, 3521–3530 (2005).
Yaksi, E. & Friedrich, R.W. Reconstruction of firing rate changes across neuronal populations by temporally deconvolved Ca2+ imaging. Nat. Methods 3, 377–383 (2006).
Li, J. et al. Early development of functional spatial maps in the zebrafish olfactory bulb. J. Neurosci. 25, 5784–5795 (2005).
Urban, N.N. & Sakmann, B. Reciprocal intraglomerular excitation and intra- and interglomerular lateral inhibition between mouse olfactory bulb mitral cells. J. Physiol. (Lond.) 542, 355–367 (2002).
Christie, J.M. et al. Connexin36 mediates spike synchrony in olfactory bulb glomeruli. Neuron 46, 761–772 (2005).
Yaksi, E., Judkewitz, B. & Friedrich, R.W. Topological reorganization of odor representations in the olfactory bulb. PLoS Biol. 5, e178 (2007).
Fantana, A.L., Soucy, E.R. & Meister, M. Rat olfactory bulb mitral cells receive sparse glomerular inputs. Neuron 59, 802–814 (2008).
Willhite, D.C. et al. Viral tracing identifies distributed columnar organization in the olfactory bulb. Proc. Natl. Acad. Sci. USA 103, 12592–12597 (2006).
Kapoor, V. & Urban, N.N. Glomerulus-specific, long-latency activity in the olfactory bulb granule cell network. J. Neurosci. 26, 11709–11719 (2006).
Rinberg, D., Koulakov, A. & Gelperin, A. Sparse odor coding in awake behaving mice. J. Neurosci. 26, 8857–8865 (2006).
Yokoi, M., Mori, K. & Nakanishi, S. Refinement of odor molecule tuning by dendrodendritic synaptic inhibition in the olfactory bulb. Proc. Natl. Acad. Sci. USA 92, 3371–3375 (1995).
Hartline, H.K. & Ratliff, F. Inhibitory interaction of receptor units in the eye of Limulus. J. Gen. Physiol. 40, 357–376 (1957).
Isaacson, J.S. Mechanisms governing dendritic gamma-aminobutyric acid (GABA) release in the rat olfactory bulb. Proc. Natl. Acad. Sci. USA 98, 337–342 (2001).
Cleland, T.A. & Sethupathy, P. Non-topographical contrast enhancement in the olfactory bulb. BMC Neurosci. 7, 7 (2006).
Arevian, A.C., Kapoor, V. & Urban, N.N. Activity-dependent gating of lateral inhibition in the mouse olfactory bulb. Nat. Neurosci. 11, 80–87 (2008).
Hummel, R.A. Histogram modification techniques. Comp. Graph. Image Proc. 4, 209–224 (1975).
Wilson, R.I., Turner, G.C. & Laurent, G. Transformation of olfactory representations in the Drosophila antennal lobe. Science 303, 366–370 (2004).
Perez-Orive, J. et al. Oscillations and sparsening of odor representations in the mushroom body. Science 297, 359–365 (2002).
Wills, T.J., Lever, C., Cacucci, F., Burgess, N. & O'Keefe, J. Attractor dynamics in the hippocampal representation of the local environment. Science 308, 873–876 (2005).
Lisman, J.E. Relating hippocampal circuitry to function: recall of memory sequences by reciprocal dentate-CA3 interactions. Neuron 22, 233–242 (1999).
Braitenberg, V. & Schüz, A. Cortex: Statistics and Geometry of Neuronal Connectivity (Springer, Berlin, 1998).
Hahnloser, R.H., Seung, H.S. & Slotine, J.J. Permitted and forbidden sets in symmetric threshold-linear networks. Neural Comput. 15, 621–638 (2003).
Galassi, M. et al. Gnu Scientific Library: Reference Manual <http://www.gnu.org/software/gsl/manual/html_node/> (2009).
Bapat, R.B. & Raghavan, T.E.S. Nonnegative Matrices and Applications (Cambridge University Press, Cambridge, 1997).
Acknowledgements
We thank Y.-P. Zhang and O. Fajardo for help with histological procedures, T. Oertner, B. Roska and J.M. Stix for comments on the manuscript, and members of the Friedrich laboratory for discussions. This work was supported by the Novartis Research Foundation, the Max-Planck-Society, the Alexander-von-Humboldt Foundation, the National Science Foundation (DMS-0719944 to H.R.), the European Union (IST-507610 to R.W.F.) and the Deutsche Forschungsgemeinschaft (SFB 488; FOR 643 to R.W.F.).
Author information
Authors and Affiliations
Contributions
M.T.W. performed all of the mathematical analyses and computational modeling and wrote the manuscript. B.J. performed physiological experiments and was involved in early modeling work. H.R. was involved in early stages of theoretical work and wrote the manuscript. R.W.F. participated in modeling and data analysis and wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary Text and Figures
Supplementary Figures 1–16, Supplementary Table 1 and Supplementary Theory (PDF 1992 kb)
Rights and permissions
About this article
Cite this article
Wiechert, M., Judkewitz, B., Riecke, H. et al. Mechanisms of pattern decorrelation by recurrent neuronal circuits. Nat Neurosci 13, 1003–1010 (2010). https://doi.org/10.1038/nn.2591
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn.2591
This article is cited by
-
How connectivity rules and synaptic properties shape the efficacy of pattern separation in the entorhinal cortex–dentate gyrus–CA3 network
Nature Computational Science (2021)
-
Whitening of odor representations by the wiring diagram of the olfactory bulb
Nature Neuroscience (2020)
-
Mosaic representations of odors in the input and output layers of the mouse olfactory bulb
Nature Neuroscience (2019)
-
Parvalbumin+ interneurons obey unique connectivity rules and establish a powerful lateral-inhibition microcircuit in dentate gyrus
Nature Communications (2018)
-
A probabilistic approach to demixing odors
Nature Neuroscience (2017)