Abstract
Many forms of learning require temporally ordered stimuli. In Pavlovian eyeblink conditioning, a conditioned stimulus (CS) must precede the unconditioned stimulus (US) by at least about 100 ms for learning to occur. Conditioned responses are learned and generated by the cerebellum. Recordings from the cerebellar cortex during conditioning have revealed CS-triggered pauses in the firing of Purkinje cells that likely drive the conditioned blinks. The predominant view of the learning mechanism in conditioning is that long-term depression (LTD) at parallel fiber (PF)–Purkinje cell synapses underlies the Purkinje cell pauses. This raises a serious conceptual challenge because LTD is most effectively induced at short CS–US intervals, which do not support acquisition of eyeblinks. To resolve this discrepancy, we recorded Purkinje cells during conditioning with short or long CS–US intervals. Decerebrated ferrets trained with CS–US intervals ≥150 ms reliably developed Purkinje cell pauses, but training with an interval of 50 ms unexpectedly induced increases in CS-evoked spiking. This bidirectional modulation of Purkinje cell activity offers a basis for the requirement of a minimum CS–US interval for conditioning, but we argue that it cannot be fully explained by LTD, even when previous in vitro studies of stimulus-timing-dependent LTD are taken into account.
Introduction
Early theories of associative learning and synaptic plasticity emphasized temporal contiguity of neural activity (Hebb, 1949), but these concepts fail to account for learning that requires stimuli with a prescribed temporal order (Gallistel, 1990). To account for such learning, spike-timing-dependent plasticity (STDP) has been proposed as a mechanism (Dan and Poo, 2006; Citri and Malenka, 2008). However, most studies of STDP have been done in vitro, so the relationship between synaptic plasticity and timing-dependent behavioral learning has not been investigated for most neural circuits.
A well-known example of timing-dependent learning is eyeblink conditioning where pairing a neutral conditioned stimulus (CS) with a blink-eliciting unconditioned stimulus (US) leads to the acquisition of an adaptively timed conditioned response (CR) that reaches its maximum close to the expected onset of the US (Kehoe and Macrae, 2002). Eyeblink conditioning requires a minimum CS–US interval [interstimulus interval (ISI)] of about 100 ms. At shorter ISIs, learning is unreliable or absent (Schneiderman and Gormezano, 1964; Smith, 1968; Smith et al., 1969; Salafia et al., 1980).
The cerebellar cortex is required for the acquisition of well-timed eyeblink CRs (Hesslow and Yeo, 2002; Kellett et al., 2010). Mossy (MF) and climbing fiber (CF) inputs to the cerebellum transmit information about the CS and US, respectively (Hesslow and Yeo, 2002). Conditioning with an ISI of >200 ms causes cerebellar Purkinje cells to develop a suppression of simple spike firing in response to the CS (Hesslow and Ivarsson, 1994; Jirenhed et al., 2007). This pause in Purkinje cell firing, the Purkinje cell CR, is required for an overt CR (Hesslow, 1994b) and shares important properties with it such as adaptive timing, extinction, and savings (Jirenhed et al., 2007; Svensson et al., 2010; Jirenhed and Hesslow, 2011a,b). However, proposed cellular mechanisms for learning Purkinje cell CRs cannot fully account for the requirement of a minimum ISI for conditioning.
The Marr (1969), Albus (1971), and Ito et al. (1982) theory of motor learning proposes that convergent CF and PF input to Purkinje cells leads to long-term depression (LTD) of PF synapses on Purkinje cells. A wealth of evidence supports the existence of LTD, and it is a widely shared assumption that LTD is the mechanism behind the Purkinje cell pause response (Yamazaki and Tanaka, 2009). This creates a serious conceptual challenge. LTD is induced by PF and CF inputs that are simultaneous or close together in time (Ito, 2001). Some in vitro studies suggest that LTD is strongest for PF–CF intervals of ∼100 ms (Chen and Thompson, 1995; Wang et al., 2000; Safo and Regehr, 2008), but these studies also find LTD with simultaneous PF–CF input. Thus, if LTD is the synaptic mechanism underlying conditioning, training at short ISIs would be expected to lead to acquisition of CRs. Thus, either no Purkinje cell CRs develop with short ISIs, or they do occur but are not expressed as overt behavior (Wetmore et al., 2008). To address this paradox, we recorded Purkinje cells in decerebrate ferrets during conditioning with various ISIs.
Materials and Methods
Subjects for Purkinje cell recording experiments were 48 male ferrets (4–12 months, 1–2 kg) decerebrated under propofol anesthesia (10 mg/ml Diprivan; AstraZeneca). Subsequent Purkinje cell recordings occurred without anesthesia. The experimental setup is illustrated in Figure 1A. Techniques for the surgery, mapping of cerebellar cortex, placement of stimulation electrodes, choice of stimulation parameters, and Purkinje cell recording were as described in previous work from our lab (Jirenhed et al., 2007; Jirenhed and Hesslow, 2011a). MF stimulation consisted of 0.1 ms pulses at 50 Hz for 300 ms (70–150 μA). CF stimulation consisted of two sets of five 0.1 ms (50–700 μA) pulses at 500 Hz, with 20 ms between the onsets. The total US duration was therefore 28 ms. Trials were delivered with an intertrial interval of 15 s. Purkinje cell responses to the CS were probed with 40 CS-alone trials before training and between paired CS–US sessions that lasted 15–60 min.
The analysis workflow for Purkinje cell firing data included several steps. First, Purkinje cell spikes were identified with Spike2 software after high-pass filtering with a cutoff frequency of 1 kHz (Cambridge Electronic Design). Simple and complex spike data were combined for analysis with custom MATLAB programs. Purkinje cell firing is variable, so spike data from each trial were smoothed with a Gaussian distribution (σ = 20 ms), and then averaged across all trials of a CS-alone session to estimate the CS-evoked firing rate, m(t). In some cases, spontaneous Purkinje cell firing varied between CS-alone sessions, so all m(t) were normalized for across-session comparison according to q(t) = m(t)/b − 1, where b = Σδ(t − t′)/0.2 for −0.2 s < t′ < 0 s, and t = 0 is defined as CS onset. To quantify changes in CS-evoked Purkinje cell firing after training, we computed r = [(cn/bn − c1/b1) − 1], where b is the baseline spike rate as defined above, c is the spike rate during the CS defined as for b, with 0 s < t′ < 0.2 s, and the final CS-alone session recorded is designated by the subscript n. The time course of modulation after training was derived from smoothed, averaged, and normalized data from pretraining and posttraining CS-alone sessions according to g(t) = q(t)n − q(t)1. We estimated the population response among a group of Purkinje cells recorded using the same ISI condition by averaging all g(t).
Some data for 200 and 300 ms ISIs were taken from previously published data sets that did not always include CS-alone sessions (Jirenhed et al., 2007; Jirenhed and Hesslow, 2011b). We analyzed data from paired training sessions and masked spikes beginning 20 ms before US onset for these ISIs to exclude US-evoked spiking from the analysis.
For eyeblink conditioning studies, animals were decerebrated, but the cerebellar dura remained intact. The animals received no muscle relaxants. Pairs of insulated stainless-steel wires were used for recording eyelid electromyogram (EMG) and for delivering a forelimb CS (1 ms pulse width, 50 Hz, 300 ms, 1.0–1.5 mA) and periocular US (1 ms pulse width, 500 Hz, 10 ms, 3.0 mA). Animals were trained with 45 and 145 ms ISIs. For eyelid and forelimb stimuli, the transduction of CF activity to the cerebellar cortex is delayed by ∼5 ms more than that of MF activity, so these ISIs correspond to 50 and 150 ms ISIs in Purkinje cell recording studies that used direct MF and CF stimulation.
Three ferrets were trained with the long ISI first, followed by the short ISI. Two other animals were trained with the reverse ordering. Animals were trained until eyeblink CRs occurred on at least ∼70% of trials (2–7 h per ISI). Each 30 min training block was composed of 12 sets of 10 trials (9 paired, 1 CS-alone), followed by 10 CS-alone trials. High-pass filtered EMG recordings (1 kHz) were rectified, binned (10 ms bin width), and normalized to the mean EMG value during the 200 ms preceding trial onset. Conditioning was quantified for the period extending from 50 ms before to 50 ms after expected US onset in a block of CS-alone trials. All p values are from two-sample, two-tailed t tests with no assumption of equal population variances.
Results
Eyeblink conditioning in decerebrate ferrets
In rabbits, acquisition of a CR requires a minimum ISI of ∼100 ms (Fig. 1B), but short ISIs have not been tested in other species. To confirm that the principle of a minimum ISI applies in decerebrate ferrets, we performed eyeblink conditioning with a mild electrical forelimb CS and strong electrical blink-inducing US without Purkinje cell recordings (Fig. 1A).
We conditioned five animals with a short ISI of 45 ms that does not support CR acquisition in rabbits and a long ISI of 145 ms that does (Fig. 1B). CF activity is delayed by ∼5 ms relative to MF activity for peripheral stimuli used in behavioral experiments, so these ISIs correspond to the 50 and 150 ms ISI training conditions used in subsequent Purkinje cell recording experiments for which training stimuli were delivered by direct MF and CF stimulation.
In an exemplar animal before training, the CS did not elicit a motor response, and a large CS-evoked motor response developed after training with an ISI of 145 ms (Fig. 1C). The CR was extinguished after subsequent training with a short ISI of 45 ms. All five animals exhibited significant CRs after training with an ISI of 145 ms (two-sample, two-tailed t test with no assumption of equal population variances, p < 0.05), but not after training with a short ISI of 45 ms (p > 0.05; Fig. 1D). These results are consistent with the requirement of an ISI ∼100 ms or longer for eyeblink conditioning in decerebrate ferrets.
Purkinje cell recordings during long and short ISI training
Purkinje cell activity was recorded from the cerebellar C3 eyeblink region (Hesslow, 1994a,b; Mostofi et al., 2010). In animals trained with long ISIs (200–600 ms), Purkinje cells in this area exhibit CS-evoked pauses in firing (Jirenhed et al., 2007; Jirenhed and Hesslow, 2011a). We recorded blink-related Purkinje cells in animals trained with a 150 ms ISI using direct stimulation of MFs and CFs as the CS and US, respectively. Before training, the naive response was characterized with CS-alone trials. Thereafter, paired CS–US training sessions were interleaved with CS-alone sessions to quantify learned changes in CS-evoked Purkinje cell firing.
For one representative Purkinje cell, 150 ms ISI training caused a pause in firing at a short latency after CS onset and peak modulation that preceded the timing of the expected US. Before training, the baseline CS-evoked response did not vary significantly relative to pretrial spontaneous activity (Fig. 2A,B). After 45 min of paired training, the cell exhibited a short pause in firing during the CS (Fig. 2C), which became more pronounced after an additional 20 min of paired training (Fig. 2D–F). These results are consistent with behavioral data that indicate that a 150 ms ISI supports reliable CR acquisition.
In a different animal, we recorded a Purkinje cell during training with an ISI of 50 ms, which is ineffective for behavioral CR acquisition. Before training, the Purkinje cell exhibited a modest increase in firing during the CS (Fig. 2G,H). After training with an ISI of 50 ms, the Purkinje cell gradually responded with increased firing to the CS (Fig. 2I–L). After 180 min of training, the mean CS-evoked firing rate was approximately twice the pretrial background rate (Fig. 2M).
ISI dependence of learned changes in Purkinje cell activity
To determine the effect of training with different ISIs on the direction and amplitude of Purkinje cell modulation, we recorded Purkinje cells in ferrets trained with ISIs of 0, 50, 100, 150, 200, and 300 ms. For each cell, we quantified learning-related changes in Purkinje cell firing during the CS by computing the difference between mean firing rates during pretraining and posttraining CS-alone sessions (Fig. 3A; 55 cells, 63 training conditions). Cells recorded in ferrets trained with 50 or 100 ms ISIs exhibited increased CS-evoked firing, and longer ISIs produced CS-evoked pauses in firing (Fig. 3B). The direction and amplitude of modulation did not differ significantly between cells for which recording began before training, after some training at the same ISI, or after previous training at another ISI (Fig. 3B).
Population codes among neighboring Purkinje cells may be important for cerebellar processing due to downstream convergence. We estimated learning-related changes by averaging across all Purkinje cells for each ISI. The mean amplitude and direction of modulation during the CS for cells trained at a particular ISI corresponded to the temporal asymmetry of eyeblink conditioning (Fig. 3C).
Both conditioned eyeblink responses and learned pauses in Purkinje firing are well timed, so we investigated the time course of learned changes in Purkinje cell firing for each training ISI. The mean CS-evoked firing of cells recorded in animals trained with a long ISI of 150, 200, or 300 ms was reduced after training, and the peak responses were approximately timed to the ISI (Fig. 3D). Cells trained with a shorter ISI of 50 or 100 ms showed an increase in posttraining CS-evoked firing. The mean response of cells trained with an ISI of 0 ms did not show significant modulation after training.
To better visualize the contribution of US timing on learned changes in Purkinje cell firing, we realigned the mean population waveforms to the timing of US onset (Fig. 3E). If spike-timing-dependent plasticity at PF synapses on Purkinje cells exclusively determines the time course of Purkinje cell modulation, the direction and amplitude of the modulation should be fixed for a given PF–CF delay. However, at a fixed delay relative to US onset, we observed that the amplitude and direction of the modulation differ markedly between populations of cells recorded under different training ISIs. For training ISIs ≥150 ms that support CR acquisition and lead to CS-evoked pauses in Purkinje cell firing, peak modulation occurred 50 to 100 ms before US onset (Fig. 3F, bottom left). In contrast, the peak increase of Purkinje cells recorded from animals trained with a 50 or 100 ms ISI occurred after US onset (Fig. 3F, top right). Data for 0 ms ISI are not plotted, because this population of cells did not vary significantly from pretrial baseline firing. These results support an alternative or supplementary biophysical mechanism to PF–Purkinje cell LTD for enforcing the observed temporal asymmetry of behavior.
The direction of Purkinje cell modulation changes when the ISI is switched
To confirm that observed effects were due to the training ISI, rather than an artifact of cell selection, we trained with both long and short ISIs sequentially in a subset of Purkinje cells.
Long, stable recordings permitted training of Purkinje cells with multiple ISIs in 12 cells. One exemplar cell exhibited a modest CS-evoked reduction in firing before training, and then developed a large CS-evoked increase in firing after training with a 50 ms ISI (Fig. 4A). Subsequent training with a 300 ms ISI caused a pause response that reverted to an increase in CS-evoked firing after switching back to 50 ms ISI training. The mean CS-evoked spike rate relative to pretrial firing was significantly higher than before training for both periods of 50 ms ISI training, and significantly less than before training for the 300 ms ISI condition (p < 0.01; Fig. 4B).
Reversible bidirectional modulation was also observed when first training with a long ISI that supports the acquisition of a behavioral CR. In a cell recorded in a different ferret, a CS-evoked pause that developed after training with a 150 ms ISI was reduced in amplitude after subsequent training with an ISI of 100 ms, and then reappeared after training again with an ISI of 150 ms (Fig. 4C). Significant changes in CS-evoked Purkinje cell firing developed despite a relative shift of just 50 ms in CS and US timing (Fig. 4D; p < 0.01). Previous training with a different ISI did not influence the direction of Purkinje modulation in any recorded cell (data not shown), confirming that individual cells can acquire both increases and decreases in CS-evoked firing.
Discussion
Relationship between behavioral and Purkinje cell conditioning
The motivation behind this study was the apparent conflict between the fact that learning of overt conditioned responses does not occur with short ISIs (Schneiderman and Gormezano, 1964; Smith, 1968; Smith et al., 1969; Salafia et al., 1980) and the hypothesis that the synaptic learning mechanism in conditioning is LTD at the PF-to-Purkinje cell synapse, a process that would be expected to occur at short ISIs.
Our main finding is that the acquisition of Purkinje cell CRs satisfies the same temporal requirements as the overt behavior. Consistent with previous behavioral studies and with our behavioral data from decerebrate ferrets (Fig. 1C,D), we observed CS-evoked pauses in Purkinje cell spiking after training with CS–US intervals ≥150 ms (Jirenhed et al., 2007; Jirenhed and Hesslow, 2011a,b). Unexpectedly, we observed substantial increases in CS-evoked Purkinje cell spiking when training with short ISIs of 50 ms.
The correspondence between our Purkinje cell data and previously published behavioral data from rabbits is illustrated in Figure 3C. For an ISI of 0 ms, Purkinje cells did not acquire CS-evoked learned responses, and no overt CRs occurred. At an ISI of 50 ms, the CS elicits a strong increase in Purkinje cell firing that would be expected to prevent overt CRs. There is a small discrepancy around 100 ms. Behavioral studies report ∼50% CRs at a 100 ms ISI, but there was no change in average Purkinje cell firing with this ISI. There are several possible explanations. One possibility is that the effective ISI for rabbit behavioral studies is greater due to a longer US (50 ms, 60 Hz) relative to our experiments (28 ms). Behavioral data show that a small change in ISI near 100 ms impacts the learning significantly. An effective ISI ∼20 ms longer in these rabbit experiments could account for the observed difference. Unfortunately, the temporal resolution of both the Purkinje cell and the behavioral data is insufficient to evaluate this possibility. Patterson (1970) reported CR acquisition with an ISI of 50 ms, but the US used in this study was an air puff, which has a slower onset than the electrical stimuli used by others. The latencies of unconditioned blinks to air puff are considerably longer than to electrical stimuli (Marshall-Goodell et al., 1992), suggesting that the effective ISI in the study by Patterson (1970) may have been longer than 50 ms.
We showed previously that the Purkinje cell CR matches several features of the behavioral CR. Purkinje cell CRs are acquired during paired CS–US presentations and extinguished during CS-alone presentations. It reappears with considerable savings when paired stimulation is resumed after extinction (Jirenhed et al., 2007). The timing of the Purkinje cell CR depends on the ISI in the same way as the overt CR and is changed in the same way by changes in CS parameters (Svensson et al., 2010; Jirenhed and Hesslow, 2011a,b). The addition to this list of the minimum ISI requirement further strengthens the hypothesis that the Purkinje cell CR is the main driver of the overt CR.
The nature of the excitatory Purkinje cell response
The learned excitatory Purkinje cell response we observed at short ISIs has not been reported previously. There are many unanswered questions about the properties of this form of modulation and the conditions under which it occurs. We did not test for associativity with traditional criteria such as unpaired CS–US presentations (Kehoe and Macrae, 2002). However, in previous studies where the CS was repeatedly presented alone for long periods of time, we never observed excitatory responses (Jirenhed et al., 2007). Development of these responses seems to require paired CS–US presentations at a specific range of ISIs. The excitatory responses did not develop at an ISI of 0 ms. Thus, it is unlikely that they are caused by the kind of long-term potentiation described previously after PF stimulation without concomitant CF activation (Jörntell and Ekerot, 2002).
What is the mechanism of the minimum ISI requirement?
The standard view of the synaptic mechanism underlying conditioning is that it is mediated by PF–Purkinje cell LTD (Koekkoek et al., 2003; Yamazaki and Tanaka, 2009). However, LTD as traditionally conceived cannot easily account for the results, because LTD would be effective at short delays between PF and CF input. A large number of studies have confirmed that PF–Purkinje cell LTD is most pronounced for PF–CF delays close to zero (Ekerot and Kano, 1989; Karachot et al., 1994).
A resolution of this paradox might be provided by three studies that have reported PF–Purkinje cell LTD to be most effective when PFs are activated ∼100 ms before CFs (Chen and Thompson, 1995; Wang et al., 2000; Safo and Regehr, 2008). These findings fit with behavioral studies using gain adaptation of the vestibulo-ocular reflex (Raymond and Lisberger, 1998) and would seem to strengthen the case for LTD as a mechanism for conditioning. However, there are difficulties with this interpretation.
Although they report that LTD is strongest when the PF–CF delay is ∼100 ms, all three studies found some LTD when the delay was zero. It could be argued that weak LTD at short ISIs would be consistent with weak conditioning at such ISIs. However, our data did not just show weaker Purkinje cell suppression at short ISIs, but rather a strong increase in firing. Chen and Thompson (1995) found strong LTD when the PF–CF interval was 250 ms in 100 trials, but no LTD when the inputs were simultaneous. However, with 600 trials, which is actually closer to what is required for overt conditioning, LTD also occurred with both zero and negative PF–CF delays. Safo and Regehr (2008) used a protocol that was closer to those used for conditioning in intact animals. The CS was a burst of seven PF pulses (100 Hz) followed by a single CF pulse repeated 30 times every 10 s. The authors found that a PF–CF delay of ∼80 ms was optimal for obtaining LTD. However, they also found substantial LTD with a zero and even negative ISIs and almost no LTD at 330 ms, which is close to optimal for eyeblink conditioning. Another problematic aspect of this study is the rate of learning. For instance, with the 80 ms PF–CF delay, the full LTD effect was present after only 5 min of training with 30 trials. In contrast, hours of training with hundreds of trials are necessary to obtain blink CRs or Purkinje cell CRs in vivo.
The paper by Wang et al. (2000) has problems similar to those of the other studies. There was clear LTD with an ISI of <0 ms with intertrial intervals of only 2 s. The learning was also orders of magnitude faster than that seen during conditioning.
A large number of discrepancies between LTD and conditioning have been reported to date (Hesslow et al., 2013). For instance, LTD is much faster than conditioning, it cannot account for the timing of CRs, and PF-Purkinje cell synapses are not depressed after conditioning (Jirenhed and Hesslow, 2011b). We also recently showed that, although LTD is normally induced by single CF stimuli, USs consisting of single CF impulses do not support conditioning, which requires bursts of olivary impulses (Rasmussen et al., 2013). We can now add the minimum ISI requirement for acquisition of Purkinje cell CRs.
Direct comparison between the timing-dependent plasticity studied in vitro and the effects observed in the present in vivo work is problematic, and not only because of the difference between the preparations. In the standard conditioning protocol we used, the mossy fiber CS, and consequently the PF inputs to neurons in the cerebellar cortex, continues throughout and often far beyond the ISI (Jirenhed and Hesslow, 2011a,b). Therefore, the first PF input precedes the CF input by the full ISI, but during the remainder of the CS, PF inputs precede the CF inputs at gradually decreasing intervals until they become concurrent. When the CS outlasts the ISI, as in experiments reported here, CF input will precede the later parts of the PF input. Thus, many PF–CF delays, both positive and negative, will actually be represented in the same trials in a standard conditioning protocol. Yet the direction and amplitude of learned changes in Purkinje cell spiking is determined by the ISI, suggesting that the cerebellar circuits recognize the onset of these stimulus trains for the purpose of inducing plasticity and acquiring Purkinje CRs. Plasticity studies in vitro are generally not designed to measure this temporal profile of activity, thus limiting the conclusions that can be drawn from the in vitro work discussed here.
In short, our findings suggest that LTD of the parallel fiber–Purkinje cell synapses is unlikely to be the primary mechanism underlying conditioning, a conclusion that is also supported by recent evidence from genetically modified mice (Schonewille et al., 2011).
An alternative to LTD that we are currently addressing in our laboratory is long-term potentiation of the inhibitory action of molecular layer interneurons, a mechanism that has been demonstrated previously in vivo (Jörntell and Ekerot, 2002; Jirenhed et al., 2013). The temporal properties of this form of plasticity are not well studied, but we suspect that that it would raise the same problems of timing and minimum ISI as Purkinje cell LTD. A full understanding of conditioning at the neural circuit level may require consideration of other forms of plasticity, perhaps in combination (Gao et al., 2012), as well as the effects of more subtle aspects of the stimulus patterns than have hitherto been recognized.
Footnotes
This work was supported by grants from the Swedish Research Council to the Linnaeus Centre for Cognition, Communication and Learning at Lund University (349-2007-8695) and G.H. (09899), grants from the Söderberg and Crafoord foundations to G.H., a National Science Foundation predoctoral fellowship to D.Z.W., a Swedish Research Council postdoctoral fellowship for work on the cerebellum to D.-A.J., and grants from the NIH and the Klingenstein, Sloan, and Packard Foundations to M.J.S.
- Correspondence should be addressed to Germund Hesslow at the above address. germund.hesslow{at}med.lu.se