Abstract
We conducted three experiments to investigate the associative structure underlying the reinstatement of instrumental performance after extinction. In each experiment, rats were initially rewarded on two responses with different outcomes. At test, both responses were extinguished in order to assess the impact of a single noncontingent outcome delivery on response selection. Experiment 1 found evidence of outcome-selective reinstatement (i.e., more responses were performed on the lever that was trained with the reinstating outcome than on the other lever). Experiment 2 demonstrated that the outcome’s capacity to reinstate performance was not affected by a reduction in its motivational value. Experiment 3 found evidence that the reinstating outcome selectively retrieved the response it signaled rather than the response it followed during training. Together, these findings are consistent with the view that instrumental reinstatement depends on the discriminative stimulus properties of the reinstating outcome.
Article PDF
Similar content being viewed by others
References
Adams, C. D., &Dickinson, A. (1981). Instrumental responding following reinforcer devaluation.Quarterly Journal of Experimental Psychology,33B, 109–121.
Asratyan, E. A. (1974). Conditioned reflex theory and motivational behavior.Acta Neurobiologiae Experimentalis,34, 15–31.
Balleine, B. W., &Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates.Psychopharmacology,37, 407–419.
Bolles, R. C. (1972). Reinforcement, expectancy, and learning.Psychological Review,79, 394–409.
Capaldi, E. J. (1967). Sequential hypothesis of instrumental learning. In K. W. Spence & J. T. Spence (Eds.),The psychology of learning and motivation (Vol. 1, pp. 67–156). New York: Academic Press.
Colwill, R. M. (1994). Associative representations of instrumental contingencies. In D. L. Medin (Ed.),The psychology of learning and motivation (Vol. 31, pp. 1–72). New York: Academic Press.
Colwill, R. M., &Rescorla, R. A. (1985). Postconditioning devaluation of a reinforcer affects instrumental responding.Journal of Experimental Psychology: Animal Behavior Processes,11, 120–132.
Colwill, R. M., &Rescorla, R. A. (1986). Associative structures in instrumental conditioning. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 20, pp. 55–104). New York: Academic Press.
Colwill, R. M., &Rescorla, R. A. (1988). Associations between the discriminative stimulus and the reinforcer in instrumental learning.Journal of Experimental Psychology: Animal Behavior Processes,14, 155–164.
Colwill, R. M., &Rescorla, R. A. (1990). Effect of reinforcer devaluation on discriminative control of instrumental behavior.Journal of Experimental Psychology: Animal Behavior Processes,16, 40–47.
Delamater, A. R. (1997). Selective reinstatement of stimulus-outcome associations.Animal Learning & Behavior,25, 400–412.
Delamater, A. R., LoLordo, V. M., &Sosa, W. (2003). Outcomespecific conditioned inhibition in Pavlovian backward conditioning.Learning & Behavior,31, 393–402.
Franks, G. J., &Lattal, K. A. (1976). Antecedent reinforcement schedule training and operant response reinstatement in rats.Animal Learning & Behavior,4, 374–378.
Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation.Journal of Experimental Psychology: Animal Behavior Processes,30, 104–117.
Kruse, J. M., Overmier, J. B., Konz, W. A., &Rokke, E. (1983). Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific.Learning & Motivation,14, 165–181.
Leri, F., &Stewart, J. (2001). Drug-induced reinstatement to heroin and cocaine seeking: A rodent model of relapse in polydrug use.Experimental & Clinical Psychopharmacology,9, 297–306.
Mackintosh, N. J., &Dickinson, A. (1979). Instrumental (Type II) conditioning. In A. Dickinson & R. A. Boakes (Eds.),Mechanisms of learning and motivation (pp. 143–167). Hillsdale, NJ: Erlbaum.
Reid, R. L. (1958). The role of the reinforcer as a stimulus.British Journal of Psychology,49, 202–209.
Rescorla, R. A. (1992). Response-outcome versus outcome-response associations in instrumental learning.Animal Learning & Behavior,20, 223–232.
Rescorla, R. A. (1994). Transfer of instrumental control mediated by a devalued outcome.Animal Learning & Behavior,22, 27–33.
Rescorla, R. A., &Colwill, R. M. (1989). Associations with anticipated and obtained outcomes in instrumental learning.Animal Learning & Behavior,17, 291–303.
Rescorla, R. A., &Skucy, J. C. (1969). The effect of response-independent reinforcers during extinction.Journal of Comparative & Physiological Psychology,67, 381–389.
Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. H. Black & W. F. Prokasy (Eds.),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Author information
Authors and Affiliations
Corresponding author
Additional information
The present work was supported by National Institute of Mental Health Grant 56446.
Rights and permissions
About this article
Cite this article
Ostlund, S.B., Balleine, B.W. Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Animal Learning & Behavior 35, 43–52 (2007). https://doi.org/10.3758/BF03196073
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03196073