Skip to main content
SpringerLink
Log in

Learning and using specific instances

  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

A biologically plausible method for rapidly learning specific instances is described. It is contrasted with a formal model of classical conditioning (Rescorla-Wagner learning/perception training), which is shown to be relatively good for learning generalizations, but correspondingly poor for learning specific instances. A number of behaviorally relevant applications of specific instance learning are considered. For category learning, various combinations of specific instance learning and generalization are described and analyzed. Two general approaches are considered: the simple inclusion of Specific Instance Detectors (SIDs) as additional features during perception training, and specialized treatment in which SID-based categorization takes precedence over generalization-based categorization. Using the first approach, analysis and empirical results demonstrate a potential problem in representing feature presence and absence in a symmetric fashion when the frequencies of feature presence and absence are very different. However, it is shown that by using the proper representation, the addition of SIDs can only improve the convergence rate of perceptron training, the greatest improvement being achieved when SIDs are preferentially allocated for peripheral positive and negative instances. Some further improvement is possible if SIDs are treated in a specialized manner.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abraham WC, Goddard GV (1983) Asymmetric relations between homosynaptic long-term potentiation and heterosynaptic long-term depression. Nature (London) 305:717–719

    Article  Google Scholar 

  • Abraham WC, Goddard GV (1985) Multiple traces of neural activity in the hippocampus. In: Weinberger NM, McGaugh JL, Lynch G (eds) Memory systems of the brain. The Guilford Press, New York

    Google Scholar 

  • Alger BE, Teyler TJ (1976) Long-term and short-term plasticity in CA1, CA3 and dentate regions of the rat hippocampal slice. Brain Res 110:463–480

    Article  PubMed  Google Scholar 

  • Alkon DL (1986) Changes of membrane currents and calcium-dependent phosphorylation during associative learning. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York

    Google Scholar 

  • Anderson P, Sunberg SH, Sveen O, Swann JW, Wigstrom H (1980) Possible mechanisms for long-lasting potentiation of synaptic transmission in hippocampal slices from guineapigs. J Physiol 302:463–482

    PubMed  Google Scholar 

  • Barsalov LW, Bower GH (1984) Discrimination nets as psychological models. Cog Sci 8:1–26

    Article  Google Scholar 

  • Bellingham WP, Gillette-Bellingham K, Kehoe EJ (1985) Summation and configuration in patterning schedules with the rat and rabbit. Animal Learning Behav 13:152–164

    Google Scholar 

  • Bindman L, Lippold O (1981) The neurophysiology of the cerebral cortex. Texas Univ Press, Austin, Texas

    Google Scholar 

  • Bindman LJ, Prince CA (1986) Persistent changes in excitability and input resistance of cortical neurons in the rat. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York

    Google Scholar 

  • Bindman LJ, Lippold OCJ, Milne AR (1979) Prolonged changes in excitability of pyramidal tract neurons in the cat: a post-synaptic mechanism. J Physiol (London) 286:457–477

    Google Scholar 

  • Bliss TVP, Dolphin AC (1984) Where is the locus of long-term potentiation? In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York

    Google Scholar 

  • Brons JF, Woody CD (1980) Long-term changes in excitability of cortical neurons after Pavlovian conditioning and extinction. J Neurophysiol 44:605–615

    PubMed  Google Scholar 

  • Brons JF, Woody CD, Allon N (1982) Changes in the excitability of weak intensity electrical stimulation of units of the pericruciate cortex in cats. J Neurophysiol 47:377–388

    PubMed  Google Scholar 

  • Brown R, Kulik J (1977) Flashbulb memories. Cognition 5:73–99

    Article  Google Scholar 

  • Busemeyer JR, Dewey GI, Medin DL (1984) Evaluation of exemplar-based generalization and the abstraction of categorical information. J Exp Psychol: Learning Memory Cognition 10:638–648

    Article  Google Scholar 

  • Cohen NJ (1984) Preserved learning capacity in amnesia: evidence for multiple memory systems. In: Squire LR, Butters N (eds) Neuropsychology of memory. Guilford Press, New York

    Google Scholar 

  • Cohen NJ, Squire LR (1980) Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. Science 210:207–210

    PubMed  Google Scholar 

  • Crick FHC, Asanuma C (1986) Certain aspects of the anatomy and physiology of the cerebral cortex. In: McClelland JL, Rumelhart DE (eds) Parallel distributed processing v.2. MIT Press, Cambridge, MA

    Google Scholar 

  • Diamond DM, Weinberger NM (1984) Physiological plasticity of single neurons in auditory cortex of the cat during acquisition of the pupillary conditioned response. II. Secondary field (AII). Behav Neuroscience 98:182–210

    Google Scholar 

  • Disterhoft JF, Olds J (1972) Differential development of conditioned unit changes in thalamus and cortex of rat. J Neurophysiol 35:665–679

    PubMed  Google Scholar 

  • Disterhoft JF, Stuart DK (1976) Trial sequence of changed unit activity in auditory system of alert rat during conditioned response acquisition and extinction. J Neurophysiol 39:266–281

    PubMed  Google Scholar 

  • Duda R, Hart P (1973) Pattern classification and scene analysis. Wiley, New York

    Google Scholar 

  • Dunwiddie T, Lynch G (1978) Long-term potentiation and depression of synaptic responses in the rat hippocampus: localization and frequency dependency. J Physiol 276:353–367

    PubMed  Google Scholar 

  • Hampson SE (1983) A neural model of adaptive behavior. PhD dissertation, Information and Computer Science Dept. Univ. of Calif., Irvine Tech Rep 213

  • Hampson SE, Kibler DA (1983) A Boolean complete neural model of adaptive behavior. Biol Cybern 49:9–19

    Article  PubMed  Google Scholar 

  • Hampson SE, Volper D (1987) Disjunctive models of Boolean category learning. Biol Cybern 56:121–137

    Article  PubMed  Google Scholar 

  • Hampson SE, Volper D (1986) Linear function neurons: Structure and training. Biol Cybern 53:203–217

    Article  PubMed  Google Scholar 

  • Hawkins RD, Kandel ER (1984) Is there a cell-biological alphabet for simple forms of learning? Psychol Rev 91:375–391

    Article  PubMed  Google Scholar 

  • Hearst E (1978) Stimulus relationships and feature selection in learning and behavior. In: Hulse SH, Fowler H, Honig WK (eds) Cognitive processes in animal behavior. Lawrence Erlbaum, Hilldale NJ

    Google Scholar 

  • Hearst E (1984) Absence as information: some implications for learning, performance and representational processes. In: Roitblat HL, Bever TG, Terrace HS (eds) Animal cognition. Lawrence Erlbaum, Hillsdale NJ

    Google Scholar 

  • Herrnstein RJ (1985) Riddles of natural categorization. Philos Trans R Soc Lond B 308:129–144

    Google Scholar 

  • Hintzman DL (1986) “Schema abstraction” in a multiple-trace memory model. Psychol Rev 93:411–428

    Article  Google Scholar 

  • Hintzman DL, Ludlam G (1980) Differential forgetting of prototypes and old instances: simulation of an examplar based classification model. Memory Cognition 8:378–382

    PubMed  Google Scholar 

  • Homa D (1978) Abstraction of ill-defined form. Exp Psychol: Human Learning and Memory 4:407–416

    Article  Google Scholar 

  • Homa D, Chambliss D (1975) The relative contributions of common and distinctive information on the abstraction from ill-defined categories. J Exp Psychol: Human Learning and Memory 1:351–359

    Article  Google Scholar 

  • Homa D, Cross J, Cornell D, Goldman D, Schwartz S (1973) Prototype abstraction and classification of new instances. J Exp Psychol 101:116–122

    Google Scholar 

  • Homa D, Sterling S, Trepel L (1981) Limitations of exemplarbased generalization and the abstraction of categorical information. J Exp Psychol: Human Learning and Memory 7:418–439

    Article  Google Scholar 

  • Homa D, Vosburgh R (1976) Category breadth and the abstraction of prototypical information. J Exp Psychol: Human Learning and Memory 2:322–330

    Article  Google Scholar 

  • Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79:2554–2558

    PubMed  Google Scholar 

  • Jenkins HM, Sainbury RS (1970) Discrimination learning with the distinctive feature on positive and negative trials. In: Mostofsky D (ed) Attention: contemporary theory and analysis. Appleton Century Crafts, New York

    Google Scholar 

  • Kandel ER (1977) Neuronal plasticity and the modification of behavior. In: Kandel ER (ed) Handbook of physiology, the nervous system. Waverly Press Inc., Baltimore, MD

    Google Scholar 

  • Kandel ER, Schwartz J (1982) Molecular biology of learning: Modulation of transmitter release. Science 218:433–443

    PubMed  Google Scholar 

  • Kehoe EJ, Gormezano I (1980) Configuration and combination laws in conditioning with compound stimuli. Psych Bull 87:351–378

    Article  Google Scholar 

  • Kohonen T, Oja E, Lehtio P (1981) Storage and processing of information in distributed associative memory system. In: Hinton GE, Anderson JA (eds) Parallel models of associative memory. Lawrence Erlbaum, Hillsdale, NJ

    Google Scholar 

  • Kuffler SW, Nicholls JG, Martin AR (1984) From neuron to brain: a cellular approach to the function of the nervous system. Sinaver Associates, Sunderland, MA

    Google Scholar 

  • Livingston RB (1967b) Reinforcement. In: Quarton GC, Melnechuck T, Schmitt FO (eds) The neurosciences. Rockefeller Univ. Press, New York, pp 568–576

    Google Scholar 

  • Livingston RB (1967a) Brain circuitry relating to complex behavior. In: Quarton GC, Melnechuck T, Schmitt FO (eds) The neurosciences. Rockefeller Univ. Press, New York, pp 499–514

    Google Scholar 

  • Lund RD (1978) Development and plasticity of the brain. Oxford Univ. Press, New York

    Google Scholar 

  • Lynch G, Baudry M (1984) The biochemistry of memory: a new and specific hypothesis. Science 224:1057–1063

    Google Scholar 

  • Lynch GS, Dunwiddie T, Gribkoff V (1977) Heterosynaptic depression: a postsynaptic correlate of long-term potentiation. Nature 266:737–739

    Google Scholar 

  • McClelland JL, Rumelhart DE (1981) An interactive activation model of the effect of context in perception. Part I. An account of basic findings. Psychol Rev 88:375–407

    Article  Google Scholar 

  • Medin DL, Schaffer MM (1978) Context theory of classification learning. Psychol Rev 85:207–238

    Article  Google Scholar 

  • Medin DL, Altom MW, Murphy TD (1984) Given versus induced category representations: Use of prototype and exemplar information in classification. J Exp Psychol: Learning, Memory Cognition 10:333–352

    Google Scholar 

  • Minsky M, Papert S (1972) Perceptrons. MIT Press, Cambridge, MA

    Google Scholar 

  • Mishkin M, Malamut B, Bachevalier J (1984) Memories and habits: Two neural systems. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York

    Google Scholar 

  • Morris R, Baker M (1984) Does long-term potentiation/synaptic enhancement have anything to do with learning of memory. In: Squire LR, Butters N (eds) Neuropsychology of memory. Guilford Press, New York

    Google Scholar 

  • Movshon JA, Van Sluyters RC (1981) Visual neural development. Annu Rev Psychol 32:477–522

    Article  PubMed  Google Scholar 

  • Nilsson NJ (1965) Learning machines. McGraw-Hill, New York

    Google Scholar 

  • Nosofsky RM (1984) Choice, similarity, and the context theory of classification. J Exp Psychol: Learning Memory and Cognition 10:104–114

    Article  Google Scholar 

  • Nosofsky RM (1986) Attention, similarity, and the identification-categorization relationship. J Exp Psychol: General 115:39–57

    Article  Google Scholar 

  • O'Brien JH, Packham SC, Brunnhoelzl WW (1973) Features of spike train related to learning. J Neurophysiol 36:1051–1061

    PubMed  Google Scholar 

  • O'Keefe J, Nadel L (1978) The hippocampus as a cognitive map. Clarendon Press, Oxford, Eng.

    Google Scholar 

  • Olds J (1975) Unit recording during Pavlovian conditioning. In: Buchwald NA, Brazier MAB (eds) Brain mechanisms in mental retardation. Academic Press, New York

    Google Scholar 

  • Posner MI, Keele SW (1970) Retention of abstract ideas. J Exp Psychol 83:304–308 (1970)

    Google Scholar 

  • Rescorla RA (1972) “Configural” conditioning in discrete-trial bar pressing. J Comp Physiol Psychol 79:307–317

    PubMed  Google Scholar 

  • Rescorla RA (1973) Evidence for a “unique stimulus” account of configural conditioning. J Comp Physiol Psychol 85:331–338

    Google Scholar 

  • Rescorla RA (1980) Pavlovian second-order conditioning: studies in associative learning. Lawrence Erlbaum, Hilsdale, NJ

    Google Scholar 

  • Rescorla RA, Grau JW, Durlach PJ (1985) Analysis of the unique cue in configural discriminations. J Exp Psychol: Animal Behav Processes 11:356–366

    Article  Google Scholar 

  • Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning. In: Black AH, Prokasy WF (eds) Classical conditioning II. Appleton-Century-Crofts, New York

    Google Scholar 

  • Robbins D, Barresi J, Compton P, Furst A, Russo M, Smith MA (1978) The genesis and use of exemplar vs. prototype knowledge in abstact category learning. Memory Cognition 6:473–480

    Google Scholar 

  • Rumelhart DE, McClelland JL (1982) An interactive activation model of the effect of context in perception. Part II. The contextual enhancement effect and some tests and extensions of the model. Psychol Rev 89:60–94

    Article  PubMed  Google Scholar 

  • Sahley C, Rudy JW, Gelperin A (1981) An analysis of associative learning in a terrestrial mollusc. J Comp Physiol 144:1–8

    Article  Google Scholar 

  • Schwartzkroin PA, Taube JS (1986) Mechanisms underlying long-term potentiation. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York

    Google Scholar 

  • Seifert W (ed) (1983) Neurobiology of the hippocampus. Academic Press, New York

    Google Scholar 

  • Shepherd GM (1983) Neurobiology. Oxford Univ. Press, New York

    Google Scholar 

  • Singer W (1985) Hebbian modification of synaptic transmission as a common mechanism of experience-dependent maturation of cortical functions. In: Levy WB, Anderson JA, Lehmkuhle S (eds) Synaptic modification, neuron selectivity and nervous system organization. Lawrence Erlbaum, Hillsdale NJ

    Google Scholar 

  • Singer W (1984) Learning to see: Mechanisms in experience-dependent development. In: Marler P, Terrace HS (eds) The biology of learning. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Smith EE, Medin DL (1981) Categories and concepts. Harvard Univ. Press, Cambridge, MA

    Google Scholar 

  • Sokolov EN, Pakula A, Arakelov GG (1970) The aftereffects due to an intracellular electric stimulation of the giant neuron “A” in the left parietal ganglion of the mollusk Limnaea stagnalis. In: Pribram KH, Broadbent DE (eds) Biology of memory. Academic Press, New York

    Google Scholar 

  • Spencer WA, Thompson RF, Nielson DR Jr (1966) Decrement of ventral root electronic and intracellularly recorded PSPs produced by interated cutaneous afferent volleys. J Neurophysiol 29:253–274

    PubMed  Google Scholar 

  • Spinelli DN, Hirsch HVB, Phelps RW, Metzler J (1972) Visual experience as a determinant of the response characteristics of cortical receptive fields in cats. Exp Brain Res 15:289–304

    Article  PubMed  Google Scholar 

  • Spinelli DN, Jensen FE (1979) Plasticity: the mirror of experience. Science 203:75–78

    PubMed  Google Scholar 

  • Spinelli DN, Jensen FE (1982) Plasticity, experience and resource allocation in motor cortex and hypothalamus. In: Woody CD (ed) Advances in behavioral biology, vol 26. Plenum Press, New York

    Google Scholar 

  • Squire LR (1982) The neuropsychology of human memory. Annu Rev Neurosci 5:241–273

    Article  PubMed  Google Scholar 

  • Squire LR (1983) The hippocampus and the neuropsychology of memory. In: Seifert W (ed) Neurobiology of the hippocampus. Academic Press, New York

    Google Scholar 

  • Squire LR, Cohen NJ (1984) Human memory and amnesia. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York

    Google Scholar 

  • Squire LR, Cohen NJ, Nadel L (1984) The medial temporal region and memory consolidation: A new hypothesis. In: Weingartner H, Parker E (eds) Memory consolidation. Lawrence Erlbaum, Hillsdale, NJ

    Google Scholar 

  • Strange W, Kenney T, Kessel F, Jenkins J (1970) Abstraction over time of prototypes from distortions of random dot patterns. J Exp Psychol 83:508–510

    Google Scholar 

  • Teyler TJ, Discenna P (1984) Long-term potentiation as a candidate mnemonic device. Brain Res Rev 7:15–28

    Article  Google Scholar 

  • Thompson RF, Spencer WA (1966) Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychol Rev 173:16–43

    Google Scholar 

  • Volper DJ, Hampson SE (1986) Connectionistic models of Boolean category representation. Biol Cybern 54:393–406

    Article  PubMed  Google Scholar 

  • Woody CD (1982a) Memory, learning and higher mental function. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Woody CD (1982b) Neurophysiological correlates of latent facilitation. In: Woody CD (ed) Advances in behavioral biology, vol 26. Plenum Press, New York

    Google Scholar 

  • Woody CD (1984a) Studies of Pavlovian eyeblink conditioning in awake cats. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York

    Google Scholar 

  • Woody CD (1984b) The electrical excitability of nerve cells as an index of learned behavior. In: Alkon D, Farley J (eds) Primary neural substrates of learning and behavioral change. Cambridge Univ. Press, New York

    Google Scholar 

  • Woody CD (1986) Understanding the cellular basis of memory and learning. Annu Rev Psychol 37:433–493

    Article  PubMed  Google Scholar 

  • Woody CD, Buerger AA, Ungar RA, Levine DS (1976) Modeling aspects of learning by altering biophysical properties of a simulated neuron. Biol Cybern 23:73–82

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information and Computer Science, University of California, Irvine, 92717, Irvine, CA, USA

    D. J. Volper & S. E. Hampson

Authors
  1. D. J. Volper
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. E. Hampson
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Volper, D.J., Hampson, S.E. Learning and using specific instances. Biol. Cybern. 57, 57–71 (1987). https://doi.org/10.1007/BF00318716

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00318716

Keywords

Search

Navigation