Abstract
A biologically plausible method for rapidly learning specific instances is described. It is contrasted with a formal model of classical conditioning (Rescorla-Wagner learning/perception training), which is shown to be relatively good for learning generalizations, but correspondingly poor for learning specific instances. A number of behaviorally relevant applications of specific instance learning are considered. For category learning, various combinations of specific instance learning and generalization are described and analyzed. Two general approaches are considered: the simple inclusion of Specific Instance Detectors (SIDs) as additional features during perception training, and specialized treatment in which SID-based categorization takes precedence over generalization-based categorization. Using the first approach, analysis and empirical results demonstrate a potential problem in representing feature presence and absence in a symmetric fashion when the frequencies of feature presence and absence are very different. However, it is shown that by using the proper representation, the addition of SIDs can only improve the convergence rate of perceptron training, the greatest improvement being achieved when SIDs are preferentially allocated for peripheral positive and negative instances. Some further improvement is possible if SIDs are treated in a specialized manner.
Similar content being viewed by others
References
Abraham WC, Goddard GV (1983) Asymmetric relations between homosynaptic long-term potentiation and heterosynaptic long-term depression. Nature (London) 305:717–719
Abraham WC, Goddard GV (1985) Multiple traces of neural activity in the hippocampus. In: Weinberger NM, McGaugh JL, Lynch G (eds) Memory systems of the brain. The Guilford Press, New York
Alger BE, Teyler TJ (1976) Long-term and short-term plasticity in CA1, CA3 and dentate regions of the rat hippocampal slice. Brain Res 110:463–480
Alkon DL (1986) Changes of membrane currents and calcium-dependent phosphorylation during associative learning. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York
Anderson P, Sunberg SH, Sveen O, Swann JW, Wigstrom H (1980) Possible mechanisms for long-lasting potentiation of synaptic transmission in hippocampal slices from guineapigs. J Physiol 302:463–482
Barsalov LW, Bower GH (1984) Discrimination nets as psychological models. Cog Sci 8:1–26
Bellingham WP, Gillette-Bellingham K, Kehoe EJ (1985) Summation and configuration in patterning schedules with the rat and rabbit. Animal Learning Behav 13:152–164
Bindman L, Lippold O (1981) The neurophysiology of the cerebral cortex. Texas Univ Press, Austin, Texas
Bindman LJ, Prince CA (1986) Persistent changes in excitability and input resistance of cortical neurons in the rat. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York
Bindman LJ, Lippold OCJ, Milne AR (1979) Prolonged changes in excitability of pyramidal tract neurons in the cat: a post-synaptic mechanism. J Physiol (London) 286:457–477
Bliss TVP, Dolphin AC (1984) Where is the locus of long-term potentiation? In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York
Brons JF, Woody CD (1980) Long-term changes in excitability of cortical neurons after Pavlovian conditioning and extinction. J Neurophysiol 44:605–615
Brons JF, Woody CD, Allon N (1982) Changes in the excitability of weak intensity electrical stimulation of units of the pericruciate cortex in cats. J Neurophysiol 47:377–388
Brown R, Kulik J (1977) Flashbulb memories. Cognition 5:73–99
Busemeyer JR, Dewey GI, Medin DL (1984) Evaluation of exemplar-based generalization and the abstraction of categorical information. J Exp Psychol: Learning Memory Cognition 10:638–648
Cohen NJ (1984) Preserved learning capacity in amnesia: evidence for multiple memory systems. In: Squire LR, Butters N (eds) Neuropsychology of memory. Guilford Press, New York
Cohen NJ, Squire LR (1980) Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. Science 210:207–210
Crick FHC, Asanuma C (1986) Certain aspects of the anatomy and physiology of the cerebral cortex. In: McClelland JL, Rumelhart DE (eds) Parallel distributed processing v.2. MIT Press, Cambridge, MA
Diamond DM, Weinberger NM (1984) Physiological plasticity of single neurons in auditory cortex of the cat during acquisition of the pupillary conditioned response. II. Secondary field (AII). Behav Neuroscience 98:182–210
Disterhoft JF, Olds J (1972) Differential development of conditioned unit changes in thalamus and cortex of rat. J Neurophysiol 35:665–679
Disterhoft JF, Stuart DK (1976) Trial sequence of changed unit activity in auditory system of alert rat during conditioned response acquisition and extinction. J Neurophysiol 39:266–281
Duda R, Hart P (1973) Pattern classification and scene analysis. Wiley, New York
Dunwiddie T, Lynch G (1978) Long-term potentiation and depression of synaptic responses in the rat hippocampus: localization and frequency dependency. J Physiol 276:353–367
Hampson SE (1983) A neural model of adaptive behavior. PhD dissertation, Information and Computer Science Dept. Univ. of Calif., Irvine Tech Rep 213
Hampson SE, Kibler DA (1983) A Boolean complete neural model of adaptive behavior. Biol Cybern 49:9–19
Hampson SE, Volper D (1987) Disjunctive models of Boolean category learning. Biol Cybern 56:121–137
Hampson SE, Volper D (1986) Linear function neurons: Structure and training. Biol Cybern 53:203–217
Hawkins RD, Kandel ER (1984) Is there a cell-biological alphabet for simple forms of learning? Psychol Rev 91:375–391
Hearst E (1978) Stimulus relationships and feature selection in learning and behavior. In: Hulse SH, Fowler H, Honig WK (eds) Cognitive processes in animal behavior. Lawrence Erlbaum, Hilldale NJ
Hearst E (1984) Absence as information: some implications for learning, performance and representational processes. In: Roitblat HL, Bever TG, Terrace HS (eds) Animal cognition. Lawrence Erlbaum, Hillsdale NJ
Herrnstein RJ (1985) Riddles of natural categorization. Philos Trans R Soc Lond B 308:129–144
Hintzman DL (1986) “Schema abstraction” in a multiple-trace memory model. Psychol Rev 93:411–428
Hintzman DL, Ludlam G (1980) Differential forgetting of prototypes and old instances: simulation of an examplar based classification model. Memory Cognition 8:378–382
Homa D (1978) Abstraction of ill-defined form. Exp Psychol: Human Learning and Memory 4:407–416
Homa D, Chambliss D (1975) The relative contributions of common and distinctive information on the abstraction from ill-defined categories. J Exp Psychol: Human Learning and Memory 1:351–359
Homa D, Cross J, Cornell D, Goldman D, Schwartz S (1973) Prototype abstraction and classification of new instances. J Exp Psychol 101:116–122
Homa D, Sterling S, Trepel L (1981) Limitations of exemplarbased generalization and the abstraction of categorical information. J Exp Psychol: Human Learning and Memory 7:418–439
Homa D, Vosburgh R (1976) Category breadth and the abstraction of prototypical information. J Exp Psychol: Human Learning and Memory 2:322–330
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79:2554–2558
Jenkins HM, Sainbury RS (1970) Discrimination learning with the distinctive feature on positive and negative trials. In: Mostofsky D (ed) Attention: contemporary theory and analysis. Appleton Century Crafts, New York
Kandel ER (1977) Neuronal plasticity and the modification of behavior. In: Kandel ER (ed) Handbook of physiology, the nervous system. Waverly Press Inc., Baltimore, MD
Kandel ER, Schwartz J (1982) Molecular biology of learning: Modulation of transmitter release. Science 218:433–443
Kehoe EJ, Gormezano I (1980) Configuration and combination laws in conditioning with compound stimuli. Psych Bull 87:351–378
Kohonen T, Oja E, Lehtio P (1981) Storage and processing of information in distributed associative memory system. In: Hinton GE, Anderson JA (eds) Parallel models of associative memory. Lawrence Erlbaum, Hillsdale, NJ
Kuffler SW, Nicholls JG, Martin AR (1984) From neuron to brain: a cellular approach to the function of the nervous system. Sinaver Associates, Sunderland, MA
Livingston RB (1967b) Reinforcement. In: Quarton GC, Melnechuck T, Schmitt FO (eds) The neurosciences. Rockefeller Univ. Press, New York, pp 568–576
Livingston RB (1967a) Brain circuitry relating to complex behavior. In: Quarton GC, Melnechuck T, Schmitt FO (eds) The neurosciences. Rockefeller Univ. Press, New York, pp 499–514
Lund RD (1978) Development and plasticity of the brain. Oxford Univ. Press, New York
Lynch G, Baudry M (1984) The biochemistry of memory: a new and specific hypothesis. Science 224:1057–1063
Lynch GS, Dunwiddie T, Gribkoff V (1977) Heterosynaptic depression: a postsynaptic correlate of long-term potentiation. Nature 266:737–739
McClelland JL, Rumelhart DE (1981) An interactive activation model of the effect of context in perception. Part I. An account of basic findings. Psychol Rev 88:375–407
Medin DL, Schaffer MM (1978) Context theory of classification learning. Psychol Rev 85:207–238
Medin DL, Altom MW, Murphy TD (1984) Given versus induced category representations: Use of prototype and exemplar information in classification. J Exp Psychol: Learning, Memory Cognition 10:333–352
Minsky M, Papert S (1972) Perceptrons. MIT Press, Cambridge, MA
Mishkin M, Malamut B, Bachevalier J (1984) Memories and habits: Two neural systems. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York
Morris R, Baker M (1984) Does long-term potentiation/synaptic enhancement have anything to do with learning of memory. In: Squire LR, Butters N (eds) Neuropsychology of memory. Guilford Press, New York
Movshon JA, Van Sluyters RC (1981) Visual neural development. Annu Rev Psychol 32:477–522
Nilsson NJ (1965) Learning machines. McGraw-Hill, New York
Nosofsky RM (1984) Choice, similarity, and the context theory of classification. J Exp Psychol: Learning Memory and Cognition 10:104–114
Nosofsky RM (1986) Attention, similarity, and the identification-categorization relationship. J Exp Psychol: General 115:39–57
O'Brien JH, Packham SC, Brunnhoelzl WW (1973) Features of spike train related to learning. J Neurophysiol 36:1051–1061
O'Keefe J, Nadel L (1978) The hippocampus as a cognitive map. Clarendon Press, Oxford, Eng.
Olds J (1975) Unit recording during Pavlovian conditioning. In: Buchwald NA, Brazier MAB (eds) Brain mechanisms in mental retardation. Academic Press, New York
Posner MI, Keele SW (1970) Retention of abstract ideas. J Exp Psychol 83:304–308 (1970)
Rescorla RA (1972) “Configural” conditioning in discrete-trial bar pressing. J Comp Physiol Psychol 79:307–317
Rescorla RA (1973) Evidence for a “unique stimulus” account of configural conditioning. J Comp Physiol Psychol 85:331–338
Rescorla RA (1980) Pavlovian second-order conditioning: studies in associative learning. Lawrence Erlbaum, Hilsdale, NJ
Rescorla RA, Grau JW, Durlach PJ (1985) Analysis of the unique cue in configural discriminations. J Exp Psychol: Animal Behav Processes 11:356–366
Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning. In: Black AH, Prokasy WF (eds) Classical conditioning II. Appleton-Century-Crofts, New York
Robbins D, Barresi J, Compton P, Furst A, Russo M, Smith MA (1978) The genesis and use of exemplar vs. prototype knowledge in abstact category learning. Memory Cognition 6:473–480
Rumelhart DE, McClelland JL (1982) An interactive activation model of the effect of context in perception. Part II. The contextual enhancement effect and some tests and extensions of the model. Psychol Rev 89:60–94
Sahley C, Rudy JW, Gelperin A (1981) An analysis of associative learning in a terrestrial mollusc. J Comp Physiol 144:1–8
Schwartzkroin PA, Taube JS (1986) Mechanisms underlying long-term potentiation. In: Alkon DL, Woody CD (eds) Neural mechanisms of conditioning. Plenum Press, New York
Seifert W (ed) (1983) Neurobiology of the hippocampus. Academic Press, New York
Shepherd GM (1983) Neurobiology. Oxford Univ. Press, New York
Singer W (1985) Hebbian modification of synaptic transmission as a common mechanism of experience-dependent maturation of cortical functions. In: Levy WB, Anderson JA, Lehmkuhle S (eds) Synaptic modification, neuron selectivity and nervous system organization. Lawrence Erlbaum, Hillsdale NJ
Singer W (1984) Learning to see: Mechanisms in experience-dependent development. In: Marler P, Terrace HS (eds) The biology of learning. Springer, Berlin Heidelberg New York
Smith EE, Medin DL (1981) Categories and concepts. Harvard Univ. Press, Cambridge, MA
Sokolov EN, Pakula A, Arakelov GG (1970) The aftereffects due to an intracellular electric stimulation of the giant neuron “A” in the left parietal ganglion of the mollusk Limnaea stagnalis. In: Pribram KH, Broadbent DE (eds) Biology of memory. Academic Press, New York
Spencer WA, Thompson RF, Nielson DR Jr (1966) Decrement of ventral root electronic and intracellularly recorded PSPs produced by interated cutaneous afferent volleys. J Neurophysiol 29:253–274
Spinelli DN, Hirsch HVB, Phelps RW, Metzler J (1972) Visual experience as a determinant of the response characteristics of cortical receptive fields in cats. Exp Brain Res 15:289–304
Spinelli DN, Jensen FE (1979) Plasticity: the mirror of experience. Science 203:75–78
Spinelli DN, Jensen FE (1982) Plasticity, experience and resource allocation in motor cortex and hypothalamus. In: Woody CD (ed) Advances in behavioral biology, vol 26. Plenum Press, New York
Squire LR (1982) The neuropsychology of human memory. Annu Rev Neurosci 5:241–273
Squire LR (1983) The hippocampus and the neuropsychology of memory. In: Seifert W (ed) Neurobiology of the hippocampus. Academic Press, New York
Squire LR, Cohen NJ (1984) Human memory and amnesia. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York
Squire LR, Cohen NJ, Nadel L (1984) The medial temporal region and memory consolidation: A new hypothesis. In: Weingartner H, Parker E (eds) Memory consolidation. Lawrence Erlbaum, Hillsdale, NJ
Strange W, Kenney T, Kessel F, Jenkins J (1970) Abstraction over time of prototypes from distortions of random dot patterns. J Exp Psychol 83:508–510
Teyler TJ, Discenna P (1984) Long-term potentiation as a candidate mnemonic device. Brain Res Rev 7:15–28
Thompson RF, Spencer WA (1966) Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychol Rev 173:16–43
Volper DJ, Hampson SE (1986) Connectionistic models of Boolean category representation. Biol Cybern 54:393–406
Woody CD (1982a) Memory, learning and higher mental function. Springer, Berlin Heidelberg New York
Woody CD (1982b) Neurophysiological correlates of latent facilitation. In: Woody CD (ed) Advances in behavioral biology, vol 26. Plenum Press, New York
Woody CD (1984a) Studies of Pavlovian eyeblink conditioning in awake cats. In: Lynch G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press, New York
Woody CD (1984b) The electrical excitability of nerve cells as an index of learned behavior. In: Alkon D, Farley J (eds) Primary neural substrates of learning and behavioral change. Cambridge Univ. Press, New York
Woody CD (1986) Understanding the cellular basis of memory and learning. Annu Rev Psychol 37:433–493
Woody CD, Buerger AA, Ungar RA, Levine DS (1976) Modeling aspects of learning by altering biophysical properties of a simulated neuron. Biol Cybern 23:73–82
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Volper, D.J., Hampson, S.E. Learning and using specific instances. Biol. Cybern. 57, 57–71 (1987). https://doi.org/10.1007/BF00318716
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00318716