 |
||||
|
||||
|
||||
|
||||
|
||||
Previous Article | Next Article
Volume 17, Number 21, Issue of November 1, 1997 pp. 8093-8105
Copyright ©1997 Society for NeuroscienceContingent-Dependent Enhancement of Rhythmic Motor Patterns: An In Vitro Analog of Operant Conditioning
Romuald Nargeot, Douglas A. Baxter, and John H. Byrne Department of Neurobiology and Anatomy, The University of Texas Medical School at Houston, Houston, Texas 77030
ABSTRACT
Operant conditioning is characterized by the contingent reinforcement of a designated behavior. Previously, feeding behavior in Aplysia has been demonstrated to be modified by operant conditioning, and a neural pathway (esophageal nerve; E n.) that mediates some aspects of reinforcement has been identified. As a first step toward a cellular analysis of operant conditioning, we developed an in vitro buccal ganglia preparation that expressed the essential features of operant conditioning. Motor patterns that represented at least two different aspects of fictive feeding (i.e., ingestion-like and rejection-like motor patterns) were elicited by tonic stimulation of a peripheral buccal nerve (n.2,3). Three groups of preparations were examined. In a contingent-reinforcement group, stimulation of E n. was contingent on the expression of a specific type of motor pattern (i.e., either ingestion-like or rejection-like). In a yoke-control group, stimulation of E n. was not contingent on any specific pattern. In a control group, E n. was not stimulated. The frequency of the reinforced pattern increased significantly only in the contingent-reinforcement group. No changes were observed in nonreinforced patterns or in the motor patterns of the control and yoke-control groups. Contingent reinforcement of the ingestion-like pattern was associated with an enhancement of activity in motor neuron B8, and this enhancement was specific to the reinforced pattern. These results suggest that the isolated buccal ganglia expressed an essential feature of operant conditioning (i.e., contingent reinforcement modified a designated operant) and that this analog of operant conditioning is accessible to cellular analysis.
Key words: buccal ganglia; Aplysia californica; central pattern generator; operant conditioning; learning and memory; contingent reinforcement
INTRODUCTION
Operant conditioning, which was introduced by Thorndike (1911)
, is an example of associative learning in which an association is established between a specific behavior (the operant) and a stimulus (the reinforcement). A key feature of operant conditioning is the contingency of the reinforcement (i.e., the correlation between the expression of a designated operant behavior and the delivery of a reinforcement; Skinner, 1938
Rhythmic motor acts such as locomotion, feeding, respiration, and heart rate can be modified by operant conditioning (Skinner, 1938
To address this issue, we used the isolated buccal ganglia of Aplysia and developed an in vitro analog of operant conditioning. These ganglia contain the CPG that mediates several different consummatory feeding behaviors (Kupfermann, 1974b
A preliminary report of these results has appeared in abstract form (Nargeot et al., 1996
MATERIALS AND METHODS
Aplysia californica (150-250 gm) were obtained from Marinus (Westchester, CA), Marine Specimens Unlimited (Pacific Palisades, CA), and Alacrity Marine Biological (Redondo Beach, CA) and maintained in filtered artificial seawater (ASW) (Instant Ocean; Aquarium Systems, Mentor, OH) at 15°C.
Consummatory feeding behavior can be influenced by motivational states such as arousal or satiety (Kupfermann, 1974a
Electrophysiology. Pulses for extracellular nerve stimulation were generated by a digital pulse generator (WPI 1800, Sarasota, FL) and applied, via a stimulus isolator, to bipolar wire electrodes that were placed against appropriate nerves and isolated from the bath with Vaseline. Stimuli composed of brief (0.5 msec) pulses were delivered to the anterior branch of the esophageal nerve (E n.2) (see Fig. 1) and the ventral branch of buccal nerve (n.2,3) (see Fig. 1). In nondesheathed preparations, stimulation of n.2,3 was delivered with a frequency of 2 Hz and an intensity of 7 V. In preparations in which intracellular recordings were performed, a single ganglion was desheathed on the caudal surface (see below). In these desheathed preparations, stimulation of n.2,3 was less effective in inducing neural activity. Therefore, n.2,3 was stimulated with a frequency of 4 Hz and an intensity of 8.5 V. The n.2,3 that was selected for stimulation was always contralateral to the nerves and cells from which the recordings were made. In those preparations that were not desheathed, the E n.2 that was stimulated was ipsilateral to the nerves from which recordings were made. In desheathed preparations, the E n.2 that was stimulated was contralateral to the desheathed ganglion (i.e., contralateral to the cells and nerves recorded). Stimulation of E n.2 was delivered at 10 Hz for 6 sec with an intensity of 7 V in nondesheathed preparations and 8 V in desheathed preparations. Once electrodes were in place, brief stimulation was used to test the efficacy of the stimuli to elicit neural activity (Nargeot et al., 1995 
Fig. 1. The buccal ganglia and its peripheral nerves. A, Schematic representation of the buccal mass and the location of the buccal ganglia and its peripheral nerves. B, Schematic representation of in vitro buccal ganglia preparation showing the position of the recording electrodes (white triangles) on I2 n., n.2,1, and R n.1 and the stimulating electrodes (black triangles) on E n.2 and n.2,3. This schematic illustrates the placement of electrodes that was used in nondesheathed preparations (i.e., the E n.2 that was stimulated was ipsilateral to the nerves from which recordings were made). In desheathed preparations the E n.2 that was contralateral to the ganglion from which recordings were made was stimulated (data not shown). C-B conn., Cerebrobuccal connectives; E n., esophageal nerve; I2 n., nerve to intrinsic buccal muscle 2; n., buccal nerve; R n., radular nerve.[View Larger Version of this Image (32K GIF file)]
Extracellular recordings were made by using monopolar silver wire electrodes placed against appropriate nerves and isolated from the bath by Vaseline. Extracellular signals were filtered with 10 Hz high-pass and 1 kHz low-pass filters and were amplified by a differential AC amplifier (A-M Systems 1780, Everett, WA).
Intracellular recordings were made from the caudal side of the desheathed buccal ganglion with glass microelectrodes filled with 2 M potassium acetate (resistance 5-10 M ) and connected to an Axoclamp-2A electrometer. Desheathing was performed in the presence of high divalent cation ASW containing three times (i.e., 30 mM) the normal concentration of CaCl2 and three times (i.e., 90 mM) the normal concentration of MgCl2. To maintain an appropriate osmolarity, we decreased the NaCl concentration to 330 mM. High divalent cation ASW was used to decrease neural activity during desheathing (Byrne et al., 1978
Classification of the different motor patterns. Consummatory feeding behaviors of Aplysia are composed of ingestion (i.e., biting and swallowing) and rejection behaviors. In general terms, these behaviors have two phases (Kupfermann, 1974a
With the use of in vivo recordings from buccal nerves, it has been possible to identify neural correlates of consummatory feeding behaviors (Morton and Chiel, 1993a
In the present study the protraction phase was monitored in the isolated buccal ganglia by activity in the nerve to the intrinsic buccal muscle 2 (I2 n.) (Hurwitz et al., 1996
Cell identification. Motor neurons were identified by their axonal projections in peripheral nerves, by the phasic relationship of their activity to the patterned activity recorded in peripheral buccal nerves, and by their relative position in a buccal ganglion as described by Church and Lloyd (1991 
Fig. 3. Identification of neurons contributing to activity in I2 n., R n.1, and n.2,1. A, B, Simultaneous extra- and intracellular recordings during patterned activity elicited by stimulation of n.2,3. Cell B31/32 fires in phase with I2 n., cell B9 fires in phase with activity in n.2,1 (A), and cell B8 fires in phase with the large unit activity in R n.1 (B). C, A one-for-one relationship between intracellularly recorded action potentials from B31/32 and extracellular activity recorded from I2 n. (circle, C1) and antidromically activated action potentials in B31/32 elicited by stimulation of I2 n. C2 demonstrated that B31/32 projects through I2 n. Four oscilloscope traces triggered by intrasomatic action potentials recorded from B31/32 (C1) and six traces triggered by nerve stimulation (C2) were superimposed. D, A similar study as in C indicated that neuron B9 sends axons in both ipsilateral (i) and contralateral (c) n.2,1 (n.2,1i, n.2,1c; circles in D1 indicate the time-locked extracellular action potentials). Six oscilloscope traces triggered by intrasomatic action potentials recorded from B9 (D1) and five traces triggered by nerve stimulation (D2) were superimposed. E, Cell B8 projects bilaterally through the ipsilateral and contralateral R n.1 (R n.1i, R n.1c; circles in E1 indicate the time-locked extracellular action potentials). Five oscilloscope traces triggered by intrasomatic action potentials recorded from B8 (E1) and four traces triggered by nerve stimulation (E2) were superimposed.[View Larger Version of this Image (25K GIF file)]
Data analysis. The primary variable studied was the frequency of motor patterns expressed by the isolated buccal ganglia during tonic stimulation of n.2,3. Statistical comparisons between two paired samples were made with the Wilcoxon signed rank test. Comparisons among three unpaired samples were made with the Kruskal-Wallis test. Critical values of Kruskal-Wallis test (H) were approximated by critical values of 2 distribution (Zar, 1984
RESULTS
Rhythmic motor programs elicited by tonic stimulation of n.2,3
In freely moving animals, consummatory feeding behaviors involve rhythmic movements of the radula (i.e., protraction, retraction, and closure). The initiation and specific type of consummatory feeding behavior are all influenced by sensory information (Kupfermann, 1974a
In addition, we found that tonic (2-4 Hz) electrical stimulation of n.2,3 elicited patterned motor output from the isolated buccal ganglia. This neural activity, which was recorded in I2 n., n.2,1, and R n.1 (Fig. 1B), was composed of two successive phases. The first phase was represented by a burst of action potentials in I2 n. and the second phase by a burst of action potentials in n.2,1 (Fig. 2A). During this biphasic pattern, activity in R n.1 was recorded, and this activity was composed of at least two classes of action potentials, large- and small-amplitude activity (Fig. 2A). The large-amplitude activity in R n.1 started at approximately the same time as activity in I2 n. but terminated at various times after the termination of activity in I2 n. (i.e., there were varying degrees of overlap of R n.1 and n.2,1 activity; Fig. 2A). 
Fig. 2. Both patterns I and II were elicited by tonic stimulation of n.2,3. A, In both patterns I and II, a burst of spikes in I2 n. preceded a burst of spikes in n.2,1. Pattern I was defined as one in which 50% or more of the large-amplitude activity in the R n.1 occurred after the end of the I2 n. burst (dashed line). In pattern II, large-amplitude activity in R n.1 (black arrow), which can be distinguished from small-amplitude activity (white arrow), does not extend beyond the burst in I2 n. (dashed line). These examples of pattern I and II were recorded from the same preparation. An artifact of the tonic stimulation of n.2,3 appears in I2 n. and n.2,1 traces. B, The average phase relationship of activity in I2 n. (black), n.2,1 (gray), and the large-amplitude R n.1 activity (white) in pattern I (n = 46) and pattern II (n = 8) recorded during the test period in the 10 nondesheathed control preparations (see Fig. 4). The key distinguishing feature of patterns I and II was the duration of large-amplitude activity in R n.1 that extended beyond the termination of the I2 n. phase. In this and subsequent figures, the bars indicate the mean values ± SEM.[View Larger Version of this Image (23K GIF file)]
Based on the neural correlates of the consummatory feeding behaviors (e.g., ingestion-like and rejection-like motor patterns; Morton and Chiel, 1993a
The motor activity of the isolated buccal ganglia that was elicited by tonic stimulation of n.2,3 was a mix of pattern I, pattern II, and intermediate patterns. This mixture of motor patterns was expressed at a relatively high frequency (0.032 ± 0.002 Hz; mean ± SEM; n = 10) during the 10 first min of stimulation. This frequency decreased slowly during prolonged nerve stimulation. However, after >1 hr of stimulation, the frequency of evoked activity (0.008 ± 0.002 Hz) was still significantly higher than the frequency of spontaneous activity (0.0037 ± 0.0005 Hz; n = 10; T+ = 48, T =
7; p < 0.05). This ability of the tonic stimulation of n.2,3 to elicit a mix of the three different motor patterns at a high frequency indicated that the stimulation not only activated the CPG but also induced a state permissive for rapid switching among different functional configurations.
Insight into the possible behavioral relevance of the nerve activities elicited by tonic stimulation of n.2,3 was obtained by relating these activities to identified motor neurons that mediate different aspects of radula movement (i.e., protraction, retraction, and closure). For example, the action potentials in B31/32 cells contribute to the activity recorded from I2 n. (Fig. 3A,C). These cells function both as pattern initiators and protractor motor neurons (Susswein and Byrne, 1988 Contingent reinforcement enhanced the frequency of buccal motor programs
A key characteristic of operant conditioning is that the delivery of reinforcement is contingent on the expression of a given operant or behavior. In one study of operant conditioning of feeding behavior in Aplysia, the reinforcement was contingent on successful ingestion of food (Susswein et al., 1986
Three groups, each composed of 20 preparations, were used (i.e., a total of 60 preparations). In one-half of these preparations, one of the buccal ganglia was desheathed, and intracellular recordings were made from identified neurons. For all groups, rhythmic buccal motor programs were elicited by tonic stimulation of n.2,3 throughout the experiments (Fig. 4A). In a contingent-stimulation group, a phasic (10 Hz, 6 sec) stimulation of E n.2 was delivered after each pattern I (i.e., immediately after bursting activity in n.2,1) during a 10 min training period (Fig. 4A,B). The consequences of the contingency between stimulation of E n.2 and expression of pattern I were examined by comparing the contingent-reinforcement group with a yoke-control group. In the yoke-control group each preparation received stimulation of E n.2 (10 Hz, 6 sec) with the same timing as in a paired preparation from the contingent-reinforcement group (Fig. 4C). Thus, in a yoke-control experiment the delivery of the stimulation of E n.2 was determined by a previous contingent experiment rather than by ongoing activity in the yoked preparation. In a control group no stimulation other than the stimulation of n.2,3 was delivered (Fig. 4D). 
Fig. 4. Experimental paradigms for neural analog of operant conditioning. A, In all paradigms, tonic stimulation of n.2,3 (n.2,3 stim.) was delivered throughout the experiment. The type of patterned activity induced by stimulation of n.2,3 was represented by black circles (pattern I) or by white circles (pattern II and intermediate patterns). Experiments were divided into three periods: a pretraining period (Pre-Training), a 10 min training period (Training), and a 10 min test period (Test), which immediately followed the training period. In a single block of three matched preparations, each preparation received one of the different stimulus paradigms (i.e., Contingent Reinforcement, B; Yoke Control, C; Control, D). B, Contingent reinforcement. During the training period phasic (10 Hz, 6 sec) stimulation of E n.2 (black squares on E n.2 stim.) was delivered immediately after expression of each pattern I (black circles). In an experimental block the beginning of the training period was determined by the first occurrence of a pattern I and the contingent stimulation of E n.2. C, Yoke control. Stimulation of E n.2 (black squares in E n.2 stim.) was applied with the same parameters and the same timing as that in the contingent stimulation paradigm (compare E n.2 stim. with that in B). In this paradigm, however, E n.2 stimulation was not contingent with any specific pattern; rather, it was "yoked" to the previous contingent-stimulation preparation in the block. D, Control. In this paradigm, no stimulation of E n.2 was delivered.[View Larger Version of this Image (22K GIF file)]
The experiments were conducted in blocks of three preparations (i.e., a contingent-reinforcement, a yoke-control, and a control preparation) in which the beginning of the training period was determined by the occurrence of the first pattern I in the contingent reinforcement preparation. This training period lasted 10 min and was followed immediately by a 10 min test period (Fig. 4A). Thus, for all three preparations in a block, the test period began with the same delay after the onset of the tonic stimulation of n.2,3.
Because expression of pattern I was required for contingent reinforcement, we discarded preparations in which this pattern was not expressed during the experiment. In addition, only those preparations that received at least five reinforcements during the contingent training were used. This criterion was chosen for two independent reasons. First, we conducted a pilot study that indicated that the effect of contingent reinforcement depended on the number of reinforcements. Second, five training trials have been used in many in vivo and in vitro studies of nonassociative learning in Aplysia (Kandel and Schwartz, 1982
To evaluate the effect of the contingent reinforcement on the buccal motor program, we counted the number of motor patterns expressed during the 10 min test period immediately after the training period (Fig. 4A). Figure 5 illustrates typical recordings of the rhythmic motor activity expressed during the test period in a preparation from the control group (Fig. 5A), in a preparation from the contingent-reinforcement group (Fig. 5B), and in a preparation from the yoke-control group (Fig. 5C). The number of motor patterns expressed in the contingent-reinforcement preparations was higher than in preparations from either the control or yoke-control groups. In contrast, both control and yoke-control preparations expressed a comparable frequency of patterned activity. These observations were supported by statistical analyses (see below). 
Fig. 5. Representative recordings of rhythmic activity during the test period. The patterned activity (, pattern I;
, other patterns) recorded from I2 n., R n.1, and n.2,1 in nondesheathed preparations during a 10 min test period in a control (A), a contingent-reinforcement (B), and a yoke-control (C) preparation. The frequency of patterned activity was enhanced after contingent reinforcement, as compared with the control and yoke-control preparations.
[View Larger Version of this Image (42K GIF file)]
In nondesheathed preparations, comparison of the three groups indicated a significant difference in the number of occurrences of motor patterns (H = 10.133, df = 2; p < 0.006). Similar results were observed in desheathed preparations (H = 8.258, df = 2; p < 0.02). Post hoc pairwise comparisons indicated that the differences resulted from an increase in the number of patterns in the contingent-reinforcement group compared with either the control (q2 = 5.318, p < 0.001 in nondesheathed preparations; q3 = 3.915, p < 0.025 in desheathed preparations) or the yoke-control groups (q3 = 4.131, p < 0.01 in nondesheathed preparations; q2 = 4.196, p < 0.005 in desheathed preparations). No significant differences were observed between the control and the yoke-control groups (q2 = 0.829, control: 9.5 ± 0.8 and yoke control: 8.6 ± 2.1 in nondesheathed preparations; q2 = 1.630, control: 5.7 ± 0.8, and yoke control: 7.2 ± 0.9 in desheathed preparations).
These observations also were supported by pooling data from nondesheathed and desheathed preparations (Fig. 6). A significant difference in the number of occurrences of patterns was observed among groups (H = 17.200, df = 2; p < 0.001). Specifically, the contingent-reinforcement group expressed significantly more patterns than either the control (q2 = 7.536, p < 0.001) or the yoke-control groups (q3 = 5.077, p < 0.001). No significant difference in the number of occurrences of patterns was observed between the control and yoke-control groups (q2 = 0.048, control: 7.6 ± 0.7, yoke control: 7.9 ± 1.1). 
Fig. 6. Contingent reinforcement increased the frequency of the rhythmic activity. Statistical comparison of the number of patterns expressed during the 10 min test period in the control (white bar), in the contingent-reinforcement (black bar), and in the yoke-control (gray bar) groups from both nondesheathed and desheathed preparations (n = 20 in each group). A significantly higher frequency of rhythmic activity was expressed in the contingent-reinforcement group, as compared with the control (p < 0.001) or yoke-control groups (p < 0.001). This effect resulted from the contingency of the reinforcement because no significant difference (N.S.) was observed between the yoke-control and the control groups.[View Larger Version of this Image (27K GIF file)]
These results indicated that contingent stimulation of E n.2 enhanced the frequency of rhythmic activity expressed by the isolated buccal ganglia. This enhancement did not result from a nonspecific effect of stimulating the esophageal nerve because no significant difference was observed between the yoke-control group, which received noncontingent stimulation of E n.2, and the control group, which received no stimulation of E n.2. If the enhancement of the buccal activity depended specifically on the contingency of the stimulation of E n.2, one would predict that this increase should result from a selective enhancement of pattern I (i.e., the contingently reinforced pattern) with no change in the number of the nonreinforced patterns. Selective enhancement of a designated pattern
To determine whether the reinforced pattern (i.e., pattern I) was enhanced selectively, we counted the number of occurrences of each type of motor pattern (i.e., patterns I and II and intermediate patterns) during the test period in each preparation (Fig. 7A). A comparison of the number of occurrences of pattern I indicated a significant difference among the three groups of nondesheathed (H = 8.459, df = 2; p < 0.025) or desheathed preparations (H = 7.769, df = 2; p < 0.025). Post hoc pairwise comparisons indicated that the expression of pattern I was significantly higher in the contingent group than in either the control (q2 = 4.944, p < 0.001 in nondesheathed preparations and q2 = 4.971, p < 0.005 in desheathed preparations) or the yoke-control groups (q3 = 3.736, p < 0.025 in nondesheathed preparations and q3 = 3.448, p < 0.05 in desheathed preparations). In contrast, no significant differences in the number of occurrences of pattern I were observed between the control and the yoke-control groups in nondesheathed (q2 = 0.615, control: 4.6 ± 1.3, yoke control: 5.4 ± 2.3) or desheathed preparations (q2 = 0.160, control: 4.1 ± 0.9, yoke control: 3.9 ± 1.0). Similar results were observed by pooling data from nondesheathed and desheathed preparations (Fig. 7A1; H = 17.216, df = 2; p < 0.001). In the pooled data the contingent group expressed a significant enhancement of pattern I as compared with either the control (q2 = 7.288, p < 0.001) or the yoke-control groups (q3 = 5.224, p < 0.001). No significant difference was observed between the control and yoke-control groups (q2 = 0.516, control: 4.3 ± 0.8, yoke control: 4.7 ± 1.2). These results indicated that, when stimulation of E n.2 was contingent on the expression of pattern I, the frequency of this pattern was increased. This phenomenon was not attributable to a nonspecific effect of the esophageal stimulation because a similar increase was not observed in the yoke-control group.
Fig. 7. Only the reinforced pattern of activity was increased. A, Selective increase of pattern I. In both nondesheathed and desheathed preparations during a 10 min test period immediately after the training session in which stimulation of E n.2 was contingent on pattern I, the number of occurrences of pattern I was increased significantly in the contingent-reinforcement group (black bar), as compared with the control (white bar; p < 0.001) or the yoke-control groups (gray bar; p < 0.001), and no significant difference (N.S.) was observed between the control and yoke-control groups (A1). In contrast, in the same preparations and during the same test period the number of occurrences of other patterns (i.e., the nonreinforced patterns: pattern II and intermediate patterns) was not significantly different (N.S.) among the groups (A2). B, Selective increase of pattern II. In nondesheathed preparations contingent reinforcement of pattern II increased the number of occurrences of pattern II during the 10 min test period in the contingent-reinforcement group (black bar), as compared with the control (white bar; p < 0.05) or the yoke-control groups (gray bar; p < 0.005). No significant difference (N.S.) was observed between the control and yoke-control groups (B1), but in the same preparations and during the same test period the number of occurrences of the other patterns (i.e., the nonreinforced patterns: pattern I and intermediate patterns) was not significantly different among the groups (B2).[View Larger Version of this Image (28K GIF file)]
In the same preparations and during the same test period, we also compared the number of occurrences of the nonreinforced patterns (i.e., pattern II and intermediate patterns). As a first step in this analysis the numbers of pattern II and intermediate patterns were counted separately. In contrast to the enhancement of pattern I, no significant modification in the number of occurrences of pattern II (H = 2.181, df = 2, contingent reinforcement: 0.3 ± 0.2, yoke control: 1.3 ± 0.6, control: 0.8 ± 0.5 in nondesheathed preparations; H = 1.350, df = 2, contingent reinforcement: 0.7 ± 0.6, yoke control: 1.1 ± 0.7, control: 0.3 ± 0.2 in desheathed preparations) or the number of occurrences of intermediate patterns was observed among the different groups (H = 3.549, df = 2, contingent reinforcement: 3.7 ± 0.8, yoke control: 1.9 ± 0.8, control: 4.1 ± 0.9 in nondesheathed preparations; H = 2.690, df = 2, contingent reinforcement: 2.5 ± 0.8, yoke control: 2.2 ± 0.6, control: 1.3 ± 0.7 in desheathed preparations). Further analyses considered pattern II and intermediate patterns combined into a total number of "other patterns" (i.e., nonreinforced patterns). The data indicated that no significant difference in the number of occurrences of these other patterns was observed among groups (Fig. 7A2). This observation was obtained in nondesheathed (H = 2.074, df = 2, contingent reinforcement: 4.0 ± 0.8, yoke control: 3.2 ± 1.4, control: 4.9 ± 1.1) and desheathed preparations (H = 2.342, df = 2, contingent reinforcement: 3.2 ± 1.1, yoke control: 3.3 ± 1.0, control: 1.6 ± 0.7) as well as by pooling data from nondesheathed and desheathed preparations (H = 0.465, df = 2, contingent reinforcement: 3.6 ± 0.7, yoke control: 3.3 ± 0.8, control: 3.3 ± 0.7). Thus, contingent stimulation of E n.2 specifically increased the expression of pattern I but did not affect the expression of nonreinforced patterns elicited in the same test period.
To determine whether the modification of motor patterns by contingent stimulation of E n.2 is specific to pattern I or whether the same reinforcer (i.e., stimulation of E n.2) can modify different types of patterns depending on its contingency to the patterned activity, we conducted a separated series of experiments in which stimulation of E n.2 was made contingent on the expression of pattern II.
The experimental paradigm used is these experiments was similar to that described previously (see Fig. 4) except that the reinforced pattern in the contingent-reinforcement group was pattern II rather than pattern I. The group of preparations (contingent reinforcement, n = 12) that received stimulation of E n.2 contingent on expression of pattern II was compared with a yoke-control group (n = 12) and a control group (n = 12). In a 10 min test period immediately after the training period the number of occurrences of pattern II (i.e., the reinforced pattern) was significantly different among groups (Fig. 7B1; H = 7.597, df = 2; p < 0.025). The contingent-reinforcement group expressed significantly more occurrences of pattern II than the yoke-control group (q2 = 4.307, p < 0.005) and the control group (q3 = 3.439, p < 0.05). No significant difference in the number of occurrences of pattern II was observed between the yoke-control (0.8 ± 0.3) and the control groups (0.7 ± 0.3; q2 = 0.816). In contrast, in the same test period the number of occurrences of the nonreinforced patterns (i.e., pattern I or intermediate patterns) was not modified among the same groups of preparations (Fig. 7B2; H = 0.466, df = 2, contingent reinforcement: 3.3 ± 0.7, yoke control: 4.3 ± 0.7, control: 3.5 ± 0.7 for pattern I; H = 0.874, df = 2, contingent reinforcement: 2.8 ± 0.6, yoke control: 3.0 ± 0.6, control: 3.6 ± 0.7 for intermediate patterns; H = 0.592, df = 2, contingent reinforcement: 6.1 ± 1.0, yoke control: 7.3 ± 0.8, control: 7.1 ± 0.9 for pattern I and intermediate patterns pooled in a single category of nonreinforced patterns).
These results indicated that stimulation of E n.2 is a general reinforcer that can modify different types of motor patterns. However, the modifications of the motor activity are restricted to a given pattern when the reinforcer is applied contingently to this pattern. Thus, the modification of the buccal motor program induced in vitro depended on a key characteristic of operant conditioning, namely, the contingency of the reinforcement. To examine further the similarity between the associative neural plasticity exhibited by the buccal motor program and operant conditioning, we examined extinction and retention of the enhancement of pattern I. Extinction and retention of the induced modification
Extinction of the increased expression of a motor pattern should be observed if the contingent reinforcement is withheld despite the continued expression of this pattern. Retention of the induced modifications should occur after a rest period after the training session (i.e., in absence of nerve stimulation). To examine extinction of the neural modifications induced by the contingent reinforcement of pattern I, the motor activity expressed in the three groups of nondesheathed preparations described previously (i.e., contingent reinforcement, n = 10; yoke control, n = 10; and control, n = 10) was examined 1 hr after the training session. In this set of experiments the tonic stimulation of n.2,3 was delivered continuously to elicit the patterned activity during the intervening hour after the training session. No reinforcing stimulation was applied after the training period in any of the groups. Although a higher number of occurrences of pattern I was expressed during the test period immediately after the training session in the contingent-reinforcement group, in the same preparations the number of occurrences of pattern I was not significantly different among the three groups 1 hr after the training period (H = 0.044, df = 2, contingent-reinforcement: 4.0 ± 1.9, yoke control: 2.5 ± 0.9, control: 2.2 ± 1.0). There were no significant differences 1 hr after training in the number of occurrences of pattern II and intermediate patterns considered separately (H = 3.171, df = 2, contingent-reinforcement: 0.0 ± 0.0, yoke control: 1.0 ± 0.9, control: 0.6 ± 0.3 for pattern II; and H = 0.179, df = 2, contingent-reinforcement: 1.9 ± 0.6, yoke control: 1.6 ± 0.6, control: 1.9 ± 0.9 for intermediate patterns) or when they were combined into a single group of nonreinforced patterns (H = 0.006, df = 2, contingent-reinforcement group: 1.9 ± 0.6, yoke-control group: 2.6 ± 1.3, control group: 2.5 ± 1.1). Thus, the neural modifications that previously were induced by the contingent reinforcement "extinguished" during the 1 hr of nonreinforced activity that followed the training session.
The extinction of the induced modifications did not result from an inability of the isolated buccal ganglia to retain the neural changes for 1 hr. In a separate set of experiments we investigated the retention of the contingent-dependent modifications in the isolated buccal ganglia by comparing the neural activity expressed in contingent-reinforcement (n = 5), control (n = 5) and yoke-control groups (n = 5) 1 hr after training. In contrast to the stimulation paradigm used to study extinction, in this set of experiments the tonic stimulation of the n.2,3 was discontinued for 1 hr at the end of the training period. The spontaneous frequency of pattern I expressed during this post-training period was very low in the three groups of preparations (contingent reinforcement, 0.0006 ± 0.0003 Hz; control, 0.0015 ± 0.0007 Hz; yoke, 0.0003 ± 0.0001 Hz). One hour after the training session, the tonic stimulation of n.2,3 was restarted for 20 min, and the induced patterned activity was compared in the three groups of preparations during a 10 min test period beginning 10 min after the onset of the stimulation.
A comparison of the number of the different patterns indicated a significant enhancement of pattern I (i.e., the reinforced pattern) 1 hr after training (Fig. 8A; H = 8.874, df = 2; p < 0.03). The frequency of pattern I was significantly higher in the contingent-reinforcement group, as compared with the control (q2 = 4.948, p < 0.001) and the yoke-control groups (q3 = 3.550, p < 0.05). No significant difference was observed between the number of occurrences of pattern I expressed in the control (0.6 ± 0.4) and yoke-control groups (0.6 ± 0.6, q2 = 0.295). In addition, no significant difference in the frequency of pattern II (H = 2.041, df = 2, contingent reinforcement: 0.0 ± 0.0, yoke control: 1.0 ± 1.0, control: 0.4 ± 0.2) and intermediate patterns was observed among the three groups (H = 1.734, df = 2, contingent reinforcement: 0.4 ± 0.4, yoke control: 0.6 ± 0.6, control: 1.6 ± 1.1). A similar result was obtained by combining the nonreinforced patterns (i.e., pattern II and intermediate patterns) in a single category of "other patterns" (Fig. 8B; H = 2.487, df = 2, contingent reinforcement: 0.4 ± 0.4, yoke control: 1.6 ± 1.0, control: 2.0 ± 1.0). These results indicated that the specific enhancement of the reinforced pattern by just 10 min of training can be retained in vitro for >1 hr after the training session. Thus, the effect of the contingent stimulation of E n.2 appears to be long-lasting. 
Fig. 8. Long-lasting effects of the contingent reinforcement. During a 10 min test period that began 1 hr after the training session, the contingent-reinforcement group (black bar) expressed a significantly greater number of occurrences of the reinforced pattern (pattern I, A), but not of the nonreinforced patterns (pattern II and intermediate, B), than in the control (white bar; p < 0.001) and the yoke-control groups (gray bar; p < 0.05). The effects of the contingent reinforcement persisted for >1 hr. Five nondesheathed preparations in each group were used.[View Larger Version of this Image (16K GIF file)]
Cellular modifications induced by contingent reinforcement
As a first step toward investigating the mechanisms underlying contingent-dependent modulation of the buccal CPG, we have begun to search for changes in the activity of identified cells that might be correlated with the effects of the contingent reinforcement of pattern I. Because the reinforcing stimulation specifically increased the occurrence of pattern I, we focused our attention on cellular activities that were specifically expressed during this pattern. The closure motor neurons B8 can be active primarily during either the protraction phase (see Fig. 3B) or the retraction phase of the pattern (Figs. 3A, 9A). Previous studies (Morton and Chiel, 1993b
Fig. 9. Neural modification induced by contingent reinforcement. A, The phase relationship of the discharge in the closure motor neuron B8 relative to the burst of activity in I2 n. can vary from one pattern to another. In some B8 bursts at least 50% of the activity occurred after termination of burst in I2 n. In this case the majority of activity in B8 was out of phase with activity in I2 n. B, The number of occurrences of bursts in B8 characterized in A and that were associated with expression of pattern I significantly increased in the contingent-reinforcement group (black bar), as compared with the control (white bar; p < 0.001) and yoke-control groups (gray bar; p < 0.05). No significant difference (N.S.) was observed between the control and the yoke-control groups. The contingent reinforcement specifically enhanced the discharge of B8 during the retraction phase (i.e., after the burst in I2 n. terminated).[View Larger Version of this Image (21K GIF file)]
Using simultaneous intracellular and extracellular recordings, we characterized B8 activity during each occurrence of pattern I in the contingent-reinforcement, control, and yoke-control groups. The activity in B8 was characterized by using the same criterion that was used to distinguish the different motor patterns (i.e., the percentage of activity occurring after a burst in I2 n.; Fig. 9A). The number of occurrences of B8 bursts in which at least 50% of the activity occurred after the burst in I2 n. (i.e., after the protraction phase) was significantly different among groups (Fig. 9B; n = 10 in each group, H = 7.300, df = 2; p < 0.03). The number of occurrences of B8 bursts that met the criterion was higher in the contingent-reinforcement group, as compared with the control (q2 = 4.784, p < 0.001) and yoke-control groups (q3 = 3.359, p < 0.05), and no significant difference was observed between the control (3.6 ± 0.9) and the yoke-control groups (q2 = 0.214, 3.4 ± 1.0). These results indicated that contingent reinforcement of pattern I enhanced the discharge of B8 during the retraction phase of the pattern. We do not know whether the increase activity in B8 during the retraction phase represented a change in the cellular properties of B8 or the presynaptic inputs to B8.
DISCUSSION
The isolated buccal ganglia in Aplysia contain a CPG that produces different motor patterns (i.e., pattern I, pattern II, and intermediate patterns) similar to those previously described in vivo during the consummatory feeding behaviors. The motor activity expressed by this multifunctional circuit can be modified by contingent reinforcement, and this contingent-dependent modification can persist for at least 1 hr after training. In particular, when stimulation of an esophageal nerve (E n.2) was made contingent on the expression of one of the motor patterns, the frequency of this pattern was enhanced. At least for the enhancement of pattern I, the modification was correlated with a change in the activity of the closure motor neuron B8.Neural analog of operant conditioning
Modifications of behaviors by operant conditioning have been demonstrated in both vertebrates (Thorndike, 1911
CPGs underlying rhythmic motor behaviors may be advantageous preparations to determine how a neural network can be changed by operant conditioning. Significant progress has been made in understanding the cellular, synaptic, and network processes that underlie several rhythmic motor behaviors (Selverston and Moulins, 1985
Consummatory feeding behaviors in Aplysia can be conditioned operantly by positive or negative reinforcement, respectively, increasing or decreasing aspects of these rhythmic behaviors (Susswein et al., 1986 Selective enhancement of a specific pattern of neural activity
In operant conditioning a relevant operant designated by the delivery of contingent reinforcement is durably modified relative to irrelevant operants that do not provide the reinforcement. This phenomenon is referred to as the "law of effect" (Thorndike, 1933
Investigating contingent-dependent modifications of a designated motor pattern in a multifunctional circuit may help to determine the neural processes underlying the selection of a specific motor output. The neural circuit of the buccal ganglia mediates rhythmic motor programs composed of at least three distinct patterns (i.e., pattern I, pattern II, and intermediate patterns), which in turn have been correlated previously with different aspects of feeding (e.g., ingestion and rejection; Morton and Chiel, 1993a Cellular mechanisms of contingent-dependent neural plasticity
The present study indicates that contingent-dependent plasticity induced by stimulation of E n.2 was expressed as an enhancement of the frequency of the buccal motor output and that this increased motor activity was associated with a specific enhancement of the number of occurrences of the reinforced pattern. These observations suggest that at least two features of the CPG are modulated: (1) the cellular mechanisms underlying pattern initiation, and (2) the cellular mechanisms underlying pattern selection. Presently, it is not known whether these two processes are mediated by common or distinct cellular loci. Potential loci might include elements of afferent pathways to the CPG, elements of the CPG, and elements of the efferent pathway.
Our study did not investigate the possibility that the n.2,3 pathway that elicited the rhythmic activity was modified by contingent stimulation of E n.2. A change in the efficacy of this pathway to the CPG by the stimulation of E n.2 could explain an increase in the patterned activity. Moreover, if different subtypes of afferents in n.2,3 elicited specific motor patterns, then modification of specific subtypes of afferents could explain the modification of a designated pattern. However, comparison of the control and the yoke-control groups indicated that patterned activity elicited by stimulation of n.2,3 was statistically similar when stimulation of E n.2 was delivered (i.e., yoke control) or not (i.e., control). Thus, stimulation of E n.2 appears to have no long-lasting effect on n.2,3 that elicited patterned activity. Moreover, because n.2,3 was stimulated tonically, there is no relationship between the reinforcing stimulation of E n.2 and stimulation of n.2,3 that could explain the contingent-dependent modification observed between the yoke-control and the contingent-reinforcement groups. Although we cannot totally exclude that a change in the afferent n.2,3 pathway occurs, it is unlikely that such a modification could, by itself, explain the contingent-dependent change in the motor output.
In contrast, the results indicated that contingent reinforcement was associated with a modification in the firing activity of a key element in the efferent pathway, the motor neuron B8. In particular, after contingent reinforcement, the activity of B8 during the retraction phase of the pattern I was increased. We cannot exclude the possibility that this modification resulted from a change in the intrinsic properties of the B8 neurons. However, B8 neurons are involved in each of three types of motor pattern (Morton and Chiel, 1993b
Our data are consistent with the hypothesis that an element of the CPG presynaptic to B8 is responsible for the contingent-dependent plasticity. Recent evidence suggests that neurons can be recruited dynamically into a CPG and thereby allow the expression of a particular motor pattern (Hooper and Moulins, 1989
FOOTNOTES
Received June 30, 1997; accepted Aug. 11, 1997.
This research was supported by a grant from the Fyssen Foundation, Air Force Office of Scientific Research Grant F49620-97-1-0049, Grant 011618-048 from The Texas Higher Education Coordinating Board, and National Institute of Mental Health Award K05 MH00649. We thank G. W. Patterson for his assistance with some of the experiments, J. Selcher for rescoring the data in a blind procedure, and H. Lechner and D. Mongeluzi for their comments on an earlier draft of this manuscript.
Correspondence should be addressed to Dr. John H. Byrne, Department of Neurobiology and Anatomy, The University of Texas Medical School at Houston, P.O. Box 20708, Houston, TX 77225.
REFERENCES
- Alberini CM, Ghirardi M, Metz R, Kandel ER (1994) C/EBP is an immediate-early gene required for the consolidation of long-term facilitation in Aplysia. Cell 76:1099-1114[Web of Science][Medline].
- Baxter DA, Cushman SJ, Kabotyanski EA, Byrne JH (1995) Characterization of the motor programs generated in the isolated buccal ganglia of Aplysia and their modulation by biogenic amines. Soc Neurosci Abstr 21:1766.
- Beecher MD (1971) Operant conditioning in the bat Phyllostomus hastatus. J Exp Anal Behav 16:219-223[Web of Science][Medline].
- Berger RJ (1968) Operant conditioning of eye movement in the monkey (Macaca nemestrina). J Exp Anal Behav 11:311-320[Web of Science][Medline].
- Booker R, Quinn WG (1981) Conditioning of leg position in normal and mutant Drosophila. Proc Natl Acad Sci USA 78:3940-3944
[Abstract/Free Full Text] .- Byrne JH (1987) Cellular analysis of associative learning. Physiol Rev 67:329-439
[Free Full Text] .- Byrne JH, Castellucci VF, Kandel ER (1978) Contribution of individual mechanoreceptor sensory neurons to defensive gill-withdrawal reflex in Aplysia. J Neurophysiol 41:418-431
[Abstract/Free Full Text] .- Byrne JH, Baxter DA, Buonomano DV, Cleary LJ, Eskin A, Goldsmith JR, McClendon E, Nazif FA, Noel F, Scholz KP (1991) Neural and molecular bases of nonassociative and associative learning in Aplysia. Ann NY Acad Sci 627:124-149[Web of Science][Medline].
- Church PJ, Lloyd PE (1991) Expression of diverse neuropeptide cotransmitters by identified motor neurons in Aplysia. J Neurosci 11:618-625[Abstract].
- Church PJ, Lloyd PE (1994) Activity of multiple identified motor neurons recorded intracellularly during evoked feedinglike motor programs in Aplysia. J Neurophysiol 72:1794-1809
[Abstract/Free Full Text] .- Church PJ, Cohen KP, Scott ML, Kirk MD (1991) Peptidergic motoneurons in the buccal ganglia of Aplysia californica: immunocytochemical, morphological, and physiological characterizations. J Comp Physiol [A] 168:323-336[Medline].
- Cook DG, Carew TJ (1986) Operant conditioning of head-waving in Aplysia. Proc Natl Acad Sci USA 83:1120-1124
[Abstract/Free Full Text] .- Cook DG, Carew TJ (1989) Operant conditioning of head-waving in Aplysia. II. Contingent modification of electromyographic activity in identified muscles. J Neurosci 9:3107-3114[Abstract].
- Cropper EC, Kupfermann I, Weiss KR (1990) Differential firing patterns of the peptide-containing cholinergic motor neurons B15 and B16 during feeding behavior in Aplysia. Brain Res 522:176-179[Web of Science][Medline].
- Dale N, Kandel ER, Schacher S (1987) Serotonin produces long-term changes in the excitability of Aplysia sensory neurons in culture that depend on new protein synthesis. J Neurosci 7:2232-2238[Abstract].
- Delcomyn F (1980) Neuronal basis of rhythmic behavior in animals. Science 210:492-498
[Abstract/Free Full Text] .- Dickinson PS (1995) Interactions among neural networks for behavior. Curr Opin Neurobiol 5:792-798[Web of Science][Medline].
- Dickinson PS, Moulins M (1992) Interactions and combinations between different networks in the stomatogastric nervous system. In: Dynamic biological networks (Harris-Warrick RM, Marder E, Selverston AI, Moulins M, eds), pp 139-160. Cambridge, MA: MIT.
- Dickinson PS, Mecsas C, Marder E (1990) Neuropeptide fusion of two motor-pattern generator circuits. Nature 344:155-158[Medline].
- Engel BT, Schneiderman N (1984) Operant conditioning and the modulation of cardiovascular function. Annu Rev Physiol 46:199-210[Web of Science][Medline].
- Feng-Chen KC, Wolpaw JR (1996) Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons. Proc Natl Acad Sci USA 93:9206-9211
[Abstract/Free Full Text] .- Getting PA (1989) Emerging principles governing the operation of the neural networks. Annu Rev Neurosci 12:185-204[Web of Science][Medline].
- Getting PA, Dekin MS (1985) Tritonia swimming: a model system for integration within rhythmic motor systems. In: Model neural networks and behavior (Selverston AI, ed), pp 3-20. New York: Plenum.
- Green CS, Soffe SR (1996) Transitions between two different motor patterns in Xenopus embryos. J Comp Physiol [A] 178:279-291[Medline].
- Harris-Warrick RM, Marder E (1991) Modulation of neural networks for behavior. Annu Rev Neurosci 14:39-57[Web of Science][Medline].
- Hawkins R, Clark G, Kandel ER (1985) Operant conditioning and differential classical conditioning of gill withdrawal in Aplysia. Soc Neurosci Abstr 11:796.
- Heinzel H-G (1988) Gastric mill activity in the lobster. I. Spontaneous modes of chewing. J Neurophysiol 59:528-550
[Abstract/Free Full Text] .- Hooper SL, Moulins M (1989) Switching of a neuron from one network to another by sensory-induced changes in membrane properties. Science 244:1587-1589
[Abstract/Free Full Text] .- Horridge GA (1962) Learning of leg position by headless insects. Nature 193:697-698[Medline].
- Hoyle G (1980) Learning, using natural reinforcement, in insect preparations that permit cellular neuronal analysis. J Neurobiol 11:323-354[Web of Science][Medline].
- Hurwitz I, Susswein AJ (1996) B64, a newly identified central pattern generator element producing a phase switch from protraction to retraction in buccal motor programs of Aplysia californica. J Neurophysiol 75:1327-1344
[Abstract/Free Full Text] .- Hurwitz I, Neustadter D, Morton DW, Chiel HJ, Susswein AJ (1996) Activity patterns of the B31/32 pattern initiators innervating the I2 muscle of the buccal mass during normal feeding movements in Aplysia californica. J Neurophysiol 75:1309-1326
[Abstract/Free Full Text] .- Jaeger BJ, Olivares SA, Wetzel MC (1987) Operant conditioning in relation to natural EMG during rapid human walking. Am J Phys Med 66:59-76[Web of Science][Medline].
- Jaffard R, Jeantet Y (1981) Posttraining changes in excitability of the commissural path-CA1 pyramidal cell synapse in the hippocampus of mice. Brain Res 220:167-172[Web of Science][Medline].
- Kaang BK, Kandel ER, Grant SGN (1993) Activation of cAMP-responsive genes by stimuli that produce long-term facilitation in Aplysia sensory neurons. Neuron 10:427-435[Web of Science][Medline].
- Kabotyanski EA, Baxter DA, Byrne JH (1995) Dopamine (DA) and serotonin (5HT) coordinate different aspects of consummatory feeding behavior in Aplysia. Soc Neurosci Abstr 21:1766.
- Kandel ER, Schwartz JH (1982) Molecular biology of learning: modulation of transmitter release. Science 218:433-443
[Abstract/Free Full Text] .- Kennedy TE, Kuhl D, Barzilai A, Sweatt JD, Kandel ER (1992) Long-term sensitization training in Aplysia leads to an increase in calreticulin, a major presynaptic calcium-binding protein. Neuron 9:13-24.
- Konorski J (1948) In: Conditioned reflexes and neuronal organization. Cambridge, UK: Cambridge UP.
- Kupfermann I (1974a) Feeding behavior in Aplysia: a simple system for the study of motivation. Behav Biol 10:1-26[Web of Science][Medline].
- Kupfermann I (1974b) Dissociation of the appetitive and consummatory phases of feeding behavior in Aplysia: a lesion study. Behav Biol 10:89-97[Web of Science][Medline].
- Lukowiak L, Ringseis E, Spencer G, Wildering W, Naweed S (1996) Operant conditioning of the aerial respiratory behavior in Lymnaea stagnalis. J Exp Biol 199:683-691[Abstract].
- Mahajan DS, Desiraju T (1988) Alterations of dendritic branching and spine densities of hippocampal CA3 pyramidal neurons induced by operant conditioning in the phase of brain growth spurt. Exp Neurol 100:1-15[Web of Science][Medline].
- McClellan AD (1982) Movements and motor patterns of the buccal mass of Pleurobranchaea during feeding, regurgitation, and rejection. J Exp Biol 98:213-228
[Abstract/Free Full Text] .- Meyrand P, Simmers J, Moulins M (1991) Construction of a pattern-generating circuit with neurons of different networks. Nature 351:60-63[Medline].
- Meyrand P, Simmers J, Moulins M (1994) Dynamic construction of a neural network from multiple pattern generators in the lobster stomatogastric nervous system. J Neurosci 14:630-644[Abstract].
- Miller NE (1969) Learning of visceral and glandular responses. Science 163:434-445
[Free Full Text] .- Mortin LI, Stein PSG (1989) Spinal cord segments containing key elements of the central pattern generators for three forms of scratch reflex in the turtle. J Neurosci 9:2285-2296[Abstract].
- Mortin LI, Keifer J, Stein PSG (1985) Three forms of the scratch reflex in the spinal turtle: movement analyses. J Neurophysiol 53:1501-1516
[Abstract/Free Full Text] .- Morton DW, Chiel HJ (1993a) In vivo buccal nerve activity that distinguishes ingestion from rejection can be used to predict behavioral transitions in Aplysia. J Comp Physiol [A] 172:17-32[Medline].
- Morton DW, Chiel HJ (1993b) The timing of activity in motor neurons that produce radula movements distinguishes ingestion from rejection in Aplysia. J Comp Physiol [A] 173:519-536[Medline].
- Nargeot R, Baxter DA, Byrne JH (1995) Afferent control of buccal motor programs in Aplysia. Soc Neurosci Abstr 21:1766.
- Nargeot R, Baxter DA, Byrne JH (1996) Neural analogue of operant conditioning of feeding behavior in Aplysia. Soc Neurosci Abstr 22:596.
- Noel F, Nuñez-Regueiro M, Cook R, Byrne JH, Eskin A (1993) Long-term changes in synthesis of intermediate filament protein, actin, and other proteins in pleural sensory neuron of Aplysia produced by an in vitro analogue of sensitization training. Mol Brain Res 19:203-210[Medline].
- Norris BJ, Coleman MJ, Nusbaum MP (1994) Recruitment of a projection neuron determines gastric mill motor pattern selection in the stomatogastric nervous system of the crab, Cancer borealis. J Neurophysiol 72:1451-1463
[Abstract/Free Full Text] .- Oku Y, Tanaka I, Ezure K (1994) Activity of bulbar respiratory neurons during fictive coughing and swallowing in the decerebrate cat. J Physiol (Lond) 480:309-324
[Abstract/Free Full Text] .- Plummer MR, Kirk MD (1990) Premotor neurons B51 and B52 in the buccal ganglia of Aplysia californica: synaptic connections, effect on ongoing motor rhythms, and peptide modulation. J Neurophysiol 63:539-558
[Abstract/Free Full Text] .- Rosen SC, Weiss KR, Cohen JL, Kupfermann I (1982) Interganglionic cerebral-buccal mechanoafferents of Aplysia: receptive fields and synaptic connections to different classes of neurons involved in feeding behavior. J Neurophysiol 48:271-288
[Free Full Text] .- Schwarz M, Susswein AJ (1986) Identification of the neural pathway for reinforcement of feeding when Aplysia learn that food is inedible. J Neurosci 6:1528-1536[Abstract].
- Selverston AI, Moulins M (1985) Oscillatory neural networks. Annu Rev Physiol 47:29-48[Web of Science][Medline].
- Simmers J, Bush BMH (1983) Motor program switching in the ventilatory system of Carcinus maenas: the neuronal basis of bimodal scaphognatite beating. J Exp Biol 97:153-168
[Abstract/Free Full Text] .- Skelton W, Scarth AS, Wilkie DM, Miller JJ, Phillips AG (1987) Long-term increases in dentate granule cell responsivity accompany operant conditioning. J Neurosci 7:3081-3087[Abstract].
- Skinner BF (1938) In: The behavior of organisms: an experimental analysis. New York: Appleton-Century-Crofts.
- Soffe SR (1993) Two distinct rhythmic motor patterns are driven by common premotor and motor neurons in a simple vertebrate spinal cord. J Neurosci 13:4456-4469[Abstract].
- Stein PSG Grillner S Selverston AI Stuart DG editors (1997) In: Neuron, networks, and motor behavior. Cambridge, MA: MIT.
- Susswein AJ, Byrne JH (1988) Identification and characterization of neurons initiating patterned neural activity in the buccal ganglia of Aplysia. J Neurosci 8:2049-2061[Abstract].
- Susswein AJ, Schwarz M, Feldman E (1986) Learned changes of feeding behavior in Aplysia in response to edible and inedible foods. J Neurosci 6:1513-1527[Abstract].
- Syed NI, Bulloch AGM, Lukowiak K (1990) In vitro reconstruction of the respiratory central pattern generator of the mollusk Lymnaea. Science 250:282-285
[Abstract/Free Full Text] .- Thorndike EL (1911) In: Animal intelligence: experimental studies. New York: Macmillan.
- Thorndike EL (1933) A proof of the law of effect. Science 77:173-175
[Free Full Text] .- Willows AOD, Hoyle G (1969) Neuronal network triggering a fixed action pattern. Science 166:1549-1551
[Abstract/Free Full Text] .- Wolpaw JR (1987) Operant conditioning of primate spinal reflexes: the H-reflex. J Neurophysiol 57:443-459
[Abstract/Free Full Text] .- Woollacott M, Hoyle G (1977) Neural events underlying learning in insects: changes in pacemaker. Proc R Soc Lond [Biol] 195:395-415[Medline].
- Wyler AR (1985) Synchrony between cortical neurons during operant conditioning. Brain Res 341:66-72[Web of Science][Medline].
- Zar JH (1984) In: Biostatistical analysis. Englewood Cliffs, NJ: Prentice-Hall.
Copyright ©1997 Society for Neuroscience 0270-6474/1997/178093-13$05.00/0
This article has been cited by other articles:
F. H. Sieling, C. C. Canavier, and A. A. Prinz
Predictions of Phase-Locking in Excitatory Hybrid Networks: Excitation Does Not Promote Phase-Locking in Pattern-Generating Networks as Reliably as Inhibition
J Neurophysiol, July 1, 2009; 102(1): 69 - 84.
[Abstract] [Full Text] [PDF]
K. Sasaki, J. Jing, M. R. Due, and K. R. Weiss
An Input-Representing Interneuron Regulates Spike Timing and Thereby Phase Switching in a Motor Network
J. Neurosci., February 20, 2008; 28(8): 1916 - 1928.
[Abstract] [Full Text] [PDF]
J.-s. Wu, M. R. Due, K. Sasaki, A. Proekt, J. Jing, and K. R. Weiss
State Dependence of Spike Timing and Neuronal Function in a Motor Pattern Generating Network
J. Neurosci., October 3, 2007; 27(40): 10818 - 10831.
[Abstract] [Full Text] [PDF]
R. Nargeot, C. Petrissans, and J. Simmers
Behavioral and In Vitro Correlates of Compulsive-Like Food Seeking Induced by Operant Conditioning in Aplysia
J. Neurosci., July 25, 2007; 27(30): 8059 - 8070.
[Abstract] [Full Text] [PDF]
G. E. Serrano, C. Martinez-Rubio, and M. W. Miller
Endogenous Motor Neuron Properties Contribute to a Program-Specific Phase of Activity in the Multifunctional Feeding Central Pattern Generator of Aplysia
J Neurophysiol, July 1, 2007; 98(1): 29 - 42.
[Abstract] [Full Text] [PDF]
H.-Y. Koh and K. R. Weiss
Activity-Dependent Peptidergic Modulation of the Plateau-Generating Neuron B64 in the Feeding Network of Aplysia
J Neurophysiol, February 1, 2007; 97(2): 1862 - 1867.
[Abstract] [Full Text] [PDF]
D. A. Baxter and J. H. Byrne
Feeding behavior of Aplysia: A model system for comparing cellular mechanisms of classical and operant conditioning
Learn. Mem., November 1, 2006; 13(6): 669 - 680.
[Abstract] [Full Text] [PDF]
T. Inoue, M. Murakami, S. Watanabe, Y. Inokuma, and Y. Kirino
In Vitro Odor-Aversion Conditioning in a Terrestrial Mollusk
J Neurophysiol, June 1, 2006; 95(6): 3898 - 3903.
[Abstract] [Full Text] [PDF]
M. Diaz-Rios and M. W. Miller
Target-Specific Regulation of Synaptic Efficacy in the Feeding Central Pattern Generator of Aplysia: Potential Substrates for Behavioral Plasticity?
Biol. Bull., June 1, 2006; 210(3): 215 - 229.
[Abstract] [Full Text] [PDF]
R. D. Hawkins, G. A. Clark, and E. R. Kandel
Operant Conditioning of Gill Withdrawal in Aplysia
J. Neurosci., March 1, 2006; 26(9): 2443 - 2448.
[Abstract] [Full Text] [PDF]
C. S. Lum, Y. Zhurov, E. C. Cropper, K. R. Weiss, and V. Brezina
Variability of Swallowing Performance in Intact, Freely Feeding Aplysia
J Neurophysiol, October 1, 2005; 94(4): 2427 - 2446.
[Abstract] [Full Text] [PDF]
Y. Zhurov, K. R. Weiss, and V. Brezina
Tight or Loose Coupling Between Components of the Feeding Neuromusculature of Aplysia?
J Neurophysiol, July 1, 2005; 94(1): 531 - 549.
[Abstract] [Full Text] [PDF]
F. D. Reyes, R. Mozzachiodi, D. A. Baxter, and J. H. Byrne
Reinforcement in an in vitro analog of appetitive classical conditioning of feeding behavior in Aplysia: Blockade by a dopamine antagonist
Learn. Mem., May 1, 2005; 12(3): 216 - 220.
[Abstract] [Full Text] [PDF]
M. Diaz-Rios and M. W. Miller
Rapid Dopaminergic Signaling by Interneurons That Contain Markers for Catecholamines and GABA in the Feeding Circuitry of Aplysia
J Neurophysiol, April 1, 2005; 93(4): 2142 - 2156.
[Abstract] [Full Text] [PDF]
Y. Zhurov, A. Proekt, K. R. Weiss, and V. Brezina
Changes of Internal State Are Expressed in Coherent Shifts of Neuromuscular Activity in Aplysia Feeding Behavior
J. Neurosci., February 2, 2005; 25(5): 1268 - 1280.
[Abstract] [Full Text] [PDF]
C. C. Horn, Y. Zhurov, I. V. Orekhova, A. Proekt, I. Kupfermann, K. R. Weiss, and V. Brezina
Cycle-to-Cycle Variability of Neuromuscular Activity in Aplysia Feeding Behavior
J Neurophysiol, July 1, 2004; 92(1): 157 - 180.
[Abstract] [Full Text] [PDF]
B. Brembs, D. A. Baxter, and J. H. Byrne
Extending In Vitro Conditioning in Aplysia to Analyze Operant and Classical Processes in the Same Preparation
Learn. Mem., July 1, 2004; 11(4): 412 - 420.
[Abstract] [Full Text] [PDF]
R. Kawai, T. Horikoshi, and M. Sakakibara
Involvement of the Ryanodine Receptor in Morphologic Modification of Hermissenda Type B Photoreceptors After In Vitro Conditioning
J Neurophysiol, February 1, 2004; 91(2): 728 - 735.
[Abstract] [Full Text] [PDF]
R. Mozzachiodi, H. A. Lechner, D. A. Baxter, and J. H. Byrne
In Vitro Analog of Classical Conditioning of Feeding Behavior in Aplysia
Learn. Mem., November 1, 2003; 10(6): 478 - 494.
[Abstract] [Full Text] [PDF]
N. C. Dembrow, J. Jing, A. Proekt, A. Romero, F. S. Vilim, E. C. Cropper, and K. R. Weiss
A Newly Identified Buccal Interneuron Initiates and Modulates Feeding Motor Programs in Aplysia
J Neurophysiol, October 1, 2003; 90(4): 2190 - 2204.
[Abstract] [Full Text] [PDF]
I. Hurwitz, I. Kupfermann, and K. R. Weiss
Fast Synaptic Connections From CBIs to Pattern-Generating Neurons in Aplysia: Initiation and Modification of Motor Programs
J Neurophysiol, April 1, 2003; 89(4): 2120 - 2136.
[Abstract] [Full Text] [PDF]
A. Katzoff, T. Ben-Gedalya, and A. J. Susswein
Nitric Oxide Is Necessary for Multiple Memory Processes after Learning That a Food Is Inedible in Aplysia
J. Neurosci., November 1, 2002; 22(21): 9581 - 9594.
[Abstract] [Full Text] [PDF]
J. Jing and K. R. Weiss
Interneuronal Basis of the Generation of Related but Distinct Motor Programs in Aplysia: Implications for Current Neuronal Models of Vertebrate Intralimb Coordination
J. Neurosci., July 15, 2002; 22(14): 6228 - 6238.
[Abstract] [Full Text] [PDF]
B. Brembs, F. D. Lorenzetti, F. D. Reyes, D. A. Baxter, and J. H. Byrne
Operant Reward Learning in Aplysia: Neuronal Correlates and Mechanisms
Science, May 31, 2002; 296(5573): 1706 - 1709.
[Abstract] [Full Text] [PDF]
S. Sangha, C. McComb, A. Scheibenstock, C. Johannes, and K. Lukowiak
The effects of continuous versus partial reinforcement schedules on associative learning, memory and extinction in Lymnaea stagnalis
J. Exp. Biol., April 15, 2002; 205(8): 1171 - 1178.
[Abstract] [Full Text] [PDF]
C. J. H. Elliott and A. J. Susswein
Comparative neuroethology of feeding control in molluscs
J. Exp. Biol., April 1, 2002; 205(7): 877 - 896.
[Abstract] [Full Text] [PDF]
J. Jing and K. R. Weiss
Neural Mechanisms of Motor Program Switching in Aplysia
J. Neurosci., September 15, 2001; 21(18): 7349 - 7362.
[Abstract] [Full Text] [PDF]
I. V. Orekhova, J. Jing, V. Brezina, R. A. DiCaprio, K. R. Weiss, and E. C. Cropper
Sonometric Measurements of Motor-Neuron-Evoked Movements of an Internal Feeding Structure (the Radula) in Aplysia
J Neurophysiol, August 1, 2001; 86(2): 1057 - 1061.
[Abstract] [Full Text] [PDF]
Y. Xin, J. Koester, J. Jing, K. R. Weiss, and I. Kupfermann
Cerebral-Abdominal Interganglionic Coordinating Neurons in Aplysia
J Neurophysiol, January 1, 2001; 85(1): 174 - 186.
[Abstract] [Full Text] [PDF]
D. Deodhar and I. Kupfermann
Studies of Neuromodulation of Oscillatory Systems in Aplysia, by Means of Genetic Algorithms
Adaptive Behavior, June 1, 2000; 8(3-4): 267 - 296.
[Abstract] [PDF]
H. A. Lechner, D. A. Baxter, and J. H. Byrne
Classical Conditioning of Feeding in Aplysia: I. Behavioral Analysis
J. Neurosci., May 1, 2000; 20(9): 3369 - 3376.
[Abstract] [Full Text] [PDF]
H. A. Lechner, D. A. Baxter, and J. H. Byrne
Classical Conditioning of Feeding in Aplysia: II. Neurophysiological Correlates
J. Neurosci., May 1, 2000; 20(9): 3377 - 3386.
[Abstract] [Full Text] [PDF]
B. Brembs and M. Heisenberg
The Operant and the Classical in Conditioned Orientation of Drosophila melanogaster at the Flight Simulator
Learn. Mem., March 1, 2000; 7(2): 104 - 115.
[Abstract] [Full Text]
E. A. Kabotyanski, D. A. Baxter, S. J. Cushman, and J. H. Byrne
Modulation of Fictive Feeding by Dopamine and Serotonin in Aplysia
J Neurophysiol, January 1, 2000; 83(1): 374 - 392.
[Abstract] [Full Text] [PDF]
R. Nargeot, D. A. Baxter, G. W. Patterson, and J. H. Byrne
Dopaminergic Synapses Mediate Neuronal Changes in an Analogue of Operant Conditioning
J Neurophysiol, April 1, 1999; 81(4): 1983 - 1987.
[Abstract] [Full Text] [PDF]
R. Nargeot, D. A. Baxter, and J. H. Byrne
In Vitro Analog of Operant Conditioning in Aplysia. I. Contingent Reinforcement Modifies the Functional Dynamics of an Identified Neuron
J. Neurosci., March 15, 1999; 19(6): 2247 - 2260.
[Abstract] [Full Text] [PDF]
R. Nargeot, D. A. Baxter, and J. H. Byrne
In Vitro Analog of Operant Conditioning in Aplysia. II. Modifications of the Functional Dynamics of an Identified Neuron Contribute to Motor Pattern Selection
J. Neurosci., March 15, 1999; 19(6): 2261 - 2272.
[Abstract] [Full Text] [PDF]
G. E. Spencer, N. I. Syed, and K. Lukowiak
Neural Changes after Operant Conditioning of the Aerial Respiratory Behavior in Lymnaea stagnalis
J. Neurosci., March 1, 1999; 19(5): 1836 - 1843.
[Abstract] [Full Text] [PDF]
D. Botzer, S. Markovich, and A. J. Susswein
Multiple Memory Processes Following Training That a Food Is Inedible in Aplysia
Learn. Mem., July 1, 1998; 5(3): 204 - 219.
[Abstract] [Full Text]
E. A. Kabotyanski, D. A. Baxter, and J. H. Byrne
Identification and Characterization of Catecholaminergic Neuron B65, Which Initiates and Modifies Patterned Activity in the Buccal Ganglia of Aplysia
J Neurophysiol, February 1, 1998; 79(2): 605 - 621.
[Abstract] [Full Text] [PDF]
J. A. D. Sanchez and M. D. Kirk
Short-Term Synaptic Enhancement Modulates Ingestion Motor Programs of Aplysia
J. Neurosci., July 15, 2000; 20(14): RC85 - RC85.
[Abstract] [Full Text] [PDF]
This Article Abstract 
Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager 
Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (56) Citing Articles via Google Scholar Google Scholar Articles by Nargeot, R. Articles by Byrne, J. H. Search for Related Content PubMed PubMed Citation Articles by Nargeot, R. Articles by Byrne, J. H.
ABSTRACT
|
|
|
|
 |
|