Abstract
Recent findings suggest that novel associations can be learned during sleep. However, whether associative learning during sleep can alter later waking behavior and whether such behavioral changes last for minutes, hours, or days remain unknown. We tested the hypothesis that olfactory aversive conditioning during sleep will alter cigarette-smoking behavior during ensuing wakefulness. A total of 66 human subjects wishing to quit smoking participated in the study (23 females; mean age, 28.7 ± 5.2 years). Subjects completed a daily smoking diary detailing the number of cigarettes smoked during 7 d before and following a 1 d or night protocol of conditioning between cigarette odor and profoundly unpleasant odors. We observed significant reductions in the number of cigarettes smoked following olfactory aversive conditioning during stage 2 and rapid eye movement (REM) sleep but not following aversive conditioning during wakefulness (p < 0.05). Moreover, the reduction in smoking following aversive conditioning during stage 2 (34.4 ± 30.1%) was greater and longer lasting compared with the reduction following aversive conditioning during REM (11.9 ± 19.2%, p < 0.05). Finally, the reduction in smoking following aversive conditioning during sleep was significantly greater than in two separate control sleep experiments that tested aversive odors alone and the effects of cigarette odors and aversive odors without pairing. To conclude, a single night of olfactory aversive conditioning during sleep significantly reduced cigarette-smoking behavior in a sleep stage-dependent manner, and this effect persisted for several days.
- aversive conditioning
- olfaction
- sleep
Introduction
Sleep is highly beneficial for learning and memory (Born et al., 2006; Dudai, 2012; Stickgold and Walker, 2013). Consolidation and reactivation of memories during sleep have been observed across a wide range of modalities and learning forms (Walker and Stickgold, 2006; Diekelmann and Born, 2010; Spoormaker et al., 2013; Ackermann and Rasch, 2014; Landmann et al., 2014). Moreover, recent studies have implied not only modification of previously acquired memories, but also implicit acquisition of entirely new associations during sleep (Arzi et al., 2012; Hauner et al., 2013). These new associations can drive altered physiological and neuronal responses during the same night of sleep and immediately upon ensuing wakefulness (Arzi et al., 2012; Hauner et al., 2013), but whether such sleep-learning can drive long-term behavioral modifications remains unclear.
To test whether implicit associative learning during sleep can alter long-term ensuing behavior, we applied olfactory aversive conditioning to sleeping smokers. We paired between the smell of cigarettes and aversive odors during sleep, and then followed participants' smoking behavior over 7 ensuing days. This paradigm is particularly attractive for the study of behavioral changes following sleep-learning for several reasons. First, cigarette smoking provides a recurring behavior that we can monitor over time. Second, unlike the wake-inducing powers of aversive sounds (Thiessen, 1978; Horne et al., 1994; Carter et al., 2002) or aversive airborne chemicals that stimulate the trigeminal nerve (Carskadon and Herz, 2004; Stuck et al., 2007; Grupp et al., 2008; Heiser et al., 2012), aversive odorants that stimulate the olfactory nerve alone do not awaken sleeping subjects (Badia et al., 1990; Carskadon and Herz, 2004; Stuck et al., 2007; Grupp et al., 2008; Arzi et al., 2010). Finally, given that implicit learning is an effective path to long-term modification of behavior (Dew and Cabeza, 2011; Janacsek and Nemeth, 2012; Reber, 2013) and is sometimes more effective than explicit learning (Reber and Squire, 1998; Reber et al., 1999; Willingham and Goedert-Eschmann, 1999; Robertson et al., 2004; Li et al., 2007), the inherently implicit nature of sleep-learning may render it particularly effective for modulating behavior.
With all the above in mind, we set out to ask whether conditioning between cigarette odor and profoundly unpleasant odors during sleep would reduce cigarette-smoking behavior compared with similar conditioning during wakefulness. Moreover, given compelling evidence that learning is sleep-stage dependent (Walker and Stickgold, 2006; Diekelmann and Born, 2010; Landmann et al., 2014), we set out to separately test conditioning during stage 2 sleep and rapid eye movement (REM) sleep.
Materials and Methods
Participants.
Seventy-six otherwise healthy smokers wishing to quit smoking (mean age, 28.7 ± 5.2 years; 26 women) participated in the study after providing written informed consent to procedures approved by the Lowenstein Hospital Helsinki Committee. Participants were screened before the procedure in the laboratory for chronic use of medication, history of nasal insults, sleep disorders, or abnormal sleep habits based on self-report. In addition, postexperimental (PE) subject data were screened for sleep disorders, specifically for obstructive sleep apnea using standard polysomnography and respiration criteria. All subjects were told the intervention could potentially reduce smoking, but they were not informed on intervention specifics. Sleep subjects were told that they might or might not receive odors during the night, but they were not informed on experimental procedures or conditions (implicit). Awake subjects were informed about the specific experimental procedure (explicit). Overall, 10 subjects were excluded following insufficient continuous sleeping time such that no odors were delivered (n = 4), technical problems with odor delivery (n = 1), or failure to fully follow the protocol (n = 5). The remaining 66 subjects had a mean cigarette consumption of 13.9 ± 5.4 cigarettes per day over the past 11.5 ± 5.8 years.
Odorants and delivery.
All experiments were conducted in a designated olfaction sleep laboratory. The experimental room was coated in stainless steel to prevent ambient odor adhesion and was subserved by high-efficiency particulate air and carbon filtration to further assure an odor-free environment. Cigarette odor was extracted from smoked cigarette filters dissolved in propylene glycol (CAS 57-55-6, Sigma-Aldrich) and stirred at 65°C for several hours. Unpleasant odorants were ammonium sulfide 1% dissolved in water (AmSu; CAS 12135-76-1, Sigma-Aldrich) and a scent emulating rotten fish (RF; Sensale) that we have used before in sleep experiments and found that it did not awaken or arouse the subjects (Arzi et al., 2012). All odors were delivered through a nasal mask at low, nontrigeminal concentrations by a computer-controlled air-dilution olfactometer placed in an adjacent room. The olfactometer generated no visual, auditory, tactile, humidity, or thermal cues as to the alteration between odor and clean air (Johnson and Sobel, 2007). Cigarette odor duration was 5 s, unpleasant odor duration was 3 s, and these were embedded within a constant clean airflow of 6 L per minute.
Polysomnography.
Sleep was recorded by standard polysomnography (Iber, 2007). Electroencephalogram (EEG; obtained from C3 and C4, referenced to opposite mastoid), electro-oculogram (placed 1 cm above or below and laterally of each eye, referenced to opposite mastoid), electromyogram (located bilaterally at the chin), and respiration were all recorded (Power-Lab 16SP and Octal Bio Amp ML138, ADInstruments) at 1 kHz (Arzi et al., 2010, 2012). Nasal respiration was measured using a spirometer (ML141, ADInstruments) and high-sensitivity pneumotachometer (#4719, Hans Rudolph) in line with the vent ports of the nasal mask (Johnson et al., 2006).
Nasal airflow analysis.
Nasal airflow is sensitive to sleep stage (Douglas et al., 1982; Krieger, 1985; Pagliardini et al., 2012). To prevent sleep-stage bias and to enable a comparison of the sniff response between sleep stages, we normalized the nasal inhalation duration for each event as in previous studies (Arzi et al., 2010, 2012). Specifically, for each trial, we calculated during sleep the baseline sniff duration by averaging the duration of three nasal inhalations preceding trial onset. We then divided the sniff response for each trial by the trial baseline.
EEG analysis.
EEG absolute power spectral analysis in the δ (0.5–4 Hz), θ (4–8 Hz), α (8–12 Hz), σ (11–16 Hz), and β (12–24 Hz) ranges was conducted using Matlab functions for fast Fourier transform of 20 s windows before and after odor onset. Because there was no difference in effects between C3 and C4, data were collapsed across electrodes for final analysis and presentation.
Procedures.
On each day for 7 d before the experimental procedure, subjects completed a smoking diary, detailing the number of cigarettes smoked, and a smoking habits questionnaire, evaluating their addiction level (Etter et al., 2003). On the experimental night, subjects in the sleep implicit group arrived at the olfactory sleep laboratory at a self-selected time, based on their usual sleep pattern, typically at 11:00 P.M., and were fitted with polysomnography devices. Then, each subject rated the intensity and pleasantness of the odorants using a visual-analog scale (VAS). The VAS line was 145 mm long, and later analysis relates to the millimetric point of line crossing. Subjects also judged the authenticity of the cigarette odor by VAS, rating its similarity to cigarettes. Next, subjects were left alone in the darkened room to be observed from the neighboring control room via infrared video camera and one-way observation window. The experimenters observed the real-time polysomnography reading, and initiated the experimental protocol ≥1 h after the subject fell asleep and after they determined that the subject had entered the desired sleep stage.
Subjects in the wake explicit group arrived at the olfactory sleep laboratory at a self-selected time between 9:00 A.M. and 7:00 P.M. They were comfortably seated in an armchair in front of a computer screen and rated the intensity and pleasantness of the odorants in addition to the similarity of the cigarette odor. Subjects were then left alone in the room to be observed from the neighboring control room via video camera and one-way observation window. To prevent the subjects from falling asleep, an emotionally neutral nature video film was presented on the monitor in front of them.
The olfactory aversive conditioning protocol consisted of partial-reinforcement trace conditioning in which cigarette odor was followed by unpleasant odors. The conditioned (cigarette odor) and nonconditioned (unpleasant odors) stimuli were partially reinforced at a ratio of 2:1 (Fig. 1A); on reinforced trials (two-thirds of trials), a 5 s cigarette odor was triggered by the respiratory trace and paired with a 3 s unpleasant odor (either AmSu or RF) also triggered by the respiratory trace. Respiratory trace triggering of the odor was by exhalation, as this promised consistent odor exposure at next inhalation onset. Trace duration (the time between cigarette odor offset and unpleasant odor onset) was variable (3.7 ± 3.3 s) because of triggering off of respiration, which is intrinsically variable across subjects. On nonreinforced trials (one-third of trials), cigarette odor was generated without an ensuing unpleasant odorant (cigarette odor alone). Stimuli were generated in blocks of 30 trials (10 trials reinforced with AmSu, 10 reinforced with RF, and 10 nonreinforced with cigarette odor only, randomized across the block). This protocol was initiated in stage 2 sleep (n = 12), in REM sleep (n = 12), and in wakefulness (n = 10).
The “unpleasant odors alone” control protocol (Fig. 1B) contained the same experimental paradigm as the olfactory aversive conditioning, yet cigarette odor (the conditioned stimulus) was replaced by clean air. This protocol was initiated in either stage 2 (n = 11) or REM (n = 11) sleep.
The “nonconditioned” control protocol (Fig. 1C) contained the same number of odor exposures as in the olfactory aversive conditioning protocol (30 trials of cigarette odor, 10 trials of AmSu, and 10 trials of RF), yet they were presented in randomized order. This protocol was initiated in stage 2 sleep (n = 10).
In all sleep experiments, if an arousal or awakened state was detected in the ongoing polysomnographic recording, the experiment was immediately stopped until stable sleep was resumed and then continued until the end of the block. Because the experiment was halted following arousal or wakefulness, different subjects had different numbers of trials with different intertrial-interval durations (non-normal distribution with a median of 66 s). Intertrial interval was 132 ± 189 s, and there were 10.0 ± 4.6 presentations per condition.
The experienced technician who halted and started the experiment on-line was not the same technician who later blindly scored sleep off-line. Approximately 30 min after awakening in the morning, subjects again rated the intensity and pleasantness of the odorants in addition to the similarity of the cigarette odor. Finally, subjects completed a smoking diary on each of the 7 d after coming to the sleep laboratory, detailing the number of cigarettes smoked each day.
Results
The odorants used were unpleasant as intended
An ANOVA on VAS pleasantness rankings with conditions of odor (cigarettes, AmSu, RF) and group (conditioning stage 2, conditioning REM, conditioning wake, unpleasant odors stage 2, unpleasant odors REM, nonconditioned stage 2), revealed a main effect of odor (F(2,120) = 32.85, p < 0.0005; Fig. 2A) reflecting that both AmSu and RF were significantly less pleasant than cigarette odor (cigarettes, 48 ± 34 mm; AmSu, 18 ± 21 mm; RF, 21 ± 24 mm; all t(65) > 6.13, all p < 0.000005), no main effect of group (F(5,60) = 1.21, p > 0.32), and no interaction between group and odor (F(10,120) = 1.24, p > 0.27). Given that the VAS ranged from very unpleasant (0 mm) to very pleasant (145 mm), with the middle (72.5 mm) denoting neutral, we asked whether the odors were significantly different from neutral. We found that all three odors were significantly less pleasant than neutral (cigarette t(65) = 5.73, p < 3*e−7; AmSu t(65) = 20.83, p < 2*e−28; RF t(65) = 17.67, p < 4*e−24).
The same ANOVA on intensity rankings revealed a main effect of odor (F(2,120) = 28.01, p < 0.0005; Fig. 2B), reflecting that the unpleasant odors were significantly more intense compared with the cigarette odor (cigarettes, 69 ± 39 mm; AmSu, 107 ± 38 mm; RF, 112 ± 34 mm; all t(65) > 5.26, all p < 6*e−8), and there was no main effect of group or interaction (all F < 0.98, all p > 0.44).
The odorants used did not awaken subjects
Several studies have indicated that nontrigeminal odorants presented during sleep do not awaken subjects (Badia et al., 1990; Carskadon and Herz, 2004; Stuck et al., 2007; Arzi et al., 2010). To verify that this was the case here, an experienced sleep technician who was not the same sleep technician that ran the experiment, applied polysomnography standards for arousal and wakefulness (Iber, 2007). Of 1690 trials in 56 subjects, 177 trials (10.5%) were followed by an observable arousal or awakening within 30 s of trial onset. Seven subjects had no arousals surrounding any trial, and the remaining subjects had between 1 and 10 arousals (mean, 3.2 ± 2). All trials preceded or followed by an arousal or wakefulness were omitted from ensuing analyses. An additional 145 trials out of the 1690 trials (8.6%) were omitted due to recording artifacts.
To further characterize the brain response to odors during sleep, we analyzed the EEG spectral properties in all sleep subjects in artifact-free 20 s epochs before and after odor onset in the following frequency bands: δ (0.5–4 Hz), θ (4–8 Hz), α (8–12 Hz), σ (11–16 Hz), and β (12–24 Hz). Two participants were excluded from this analysis due to noisy EEG recordings, and two participants had no artifact-free trials in the unpleasant odors conditions. We analyzed the EEG power in 20 s epochs before trial onset and 20 s epochs after each unpleasant odor onset (AmSu or RF), then calculated the percentage change [(power after − power before)/power before] and conducted an ANOVA on the EEG power percentage change with conditions of odor (AmSu, RF), sleep stage (stage 2, REM), and frequency [δ (0.5–4 Hz), θ (4–8 Hz), α (8–12 Hz), σ (11–16 Hz), and β (12–24 Hz)]. We found a main effect of frequency (F(4,200) = 8.87, p < 0.001), reflecting an increase in the power of the δ frequency band, no main effect of odor (F(1,50) = 0.02, p > 0.88), no main effect of stage (F(1,50) = 2.37, p > 0.13), and a significant interaction between frequency and stage (F(4,200) = 2.52, p < 0.05), reflecting higher percentage change during REM. No other significant interactions were found (all p > 0.72). In addition, in the groups that were exposed to cigarette odor (conditioning and nonconditioned groups only), we repeated the same ANOVA but with condition of odor including cigarette odor (cigarettes, AmSu, RF). Again, we found a main effect of frequency (F(4,124) = 5.42, p < 0.0001; Fig. 3), reflecting an increase in the power of the δ frequency band, no main effect of odor (F(2,62) = 0.27, p > 0.77), no main effect of stage (F(1,31) = 0.01, p > 0.77), and no significant interactions (all p > 0.08). Planned comparisons revealed a significant enhancement in δ power following RF (11.6 ± 41.0%, t(51) = 2.30, p < 0.05; Fig. 3A) and AmSu (10.5 ± 35.9%, t(51) = 2.12, p < 0.05; Fig. 3B), and a trend following cigarette odor (10.1 ± 32.6%, t(33) = 1.81, p = 0.08; Fig. 3C). In addition there was a trend in σ following RF (−4.2 ± 16.7%, t(51) = 1.81, p = 0.08). There was no significant change in any of the other frequency bands following odor administration (all p > 0.14). These results are consistent with previous studies and imply that odors did not awaken the subject. Moreover, the odor induced δ-wave enhancement, which may imply sleep-protective odor properties.
Odorant properties were reflected in the sniff response during sleep
Given that the odors did not awaken the subject, one may ask whether there is any evidence of the brain at all registering the odors, as this is likely necessary for conditioning. Although nontrigeminal odors do not awaken the subject, they nevertheless modify the sniff response in a predicted manner, driving weaker sniffs for unpleasant odors (Arzi et al., 2012). To ask whether this was also the case here, we compared sniffs following the unpleasant odorants during sleep.
We calculated sniff duration for three nasal inhalations before each trial onset (averaged for a single baseline for each trial) and for three sniffs after each unpleasant odor onset. Then we normalized the sniff duration by dividing each of the three sniffs after unpleasant odor onset by trial baseline. An ANOVA on sniff duration for the condition of sniff (Sniff1, Sniff2, Sniff3) revealed a main effect of sniff (F(2,54) = 4.44, p < 0.05). Planned comparisons showed a significant reduction from baseline in the first sniff after odor onset (percentage change, 3.8%; t(54) = 2.86, p < 0.01; Fig. 4), but not in the second and third sniff after odor onset (all t(54) < 0.44, all p > 0.66). These odor-induced sniffing patterns of reduced sniffs for the unpleasant odors during sleep are consistent with previous studies, and imply that the sleeping brain indeed registered odor presence and quality.
Conditioning during sleep reduced cigarette-smoking behavior but conditioning in wakefulness did not
Given that the odors did not awaken the subject, but were likely registered by the brain as evidenced in the odor-specific sniff response, we set out to ask whether olfactory aversive trace conditioning during stage 2 sleep, REM sleep, and wakefulness influenced later smoking behavior. We calculated a baseline smoking rate for each subject reflecting the average number of smoked cigarettes across the 7 d preceding the study. There was no difference between groups in baseline smoking rate (stage 2, 13.3 ± 6.3 cigarette per day; REM, 12.7 ± 3.7 cigarette per day; wake, 12.7 ± 6.0 cigarette per day; all t < 0.25, all p > 0.80) or addiction level (stage 2, 43.8 ± 6.4; REM, 46.2 ± 4.8; wake, 43.5 ± 7.7; all t < 1.0, all p > 0.33). Next, we calculated for each subject the average percentage change from baseline of smoked cigarettes across the 7 d following the study and conducted an ANOVA with condition of group (stage 2 sleep, REM sleep, wake). We found a main effect of group (F(2,31) = 3.77, p < 0.05) reflecting a significant reduction in smoking following conditioning during stage 2 sleep (−34.4 ± 30.9%, t(11) = 3.92, p < 0.005) and REM (−11.9 ± 19.2%, t(11) = 2.35, p < 0.05), but not wake (−6.6 ± 25.3%, t(9) = 0.85, p > 0.42), and a larger reduction in smoking following conditioning during stage 2 sleep compared with REM (t(11) = 2.14, p < 0.05) and wake (t(11) = 2.27, p < 0.05). In addition, planned comparisons revealed that in the stage 2 group there was a significant reduction in the number of smoked cigarettes between the baseline and PE days 1–7 [PE day 1 reduction, −47.9 ± 38.6%; PE day 2 reduction, −40.8 ± 33.2%; PE day 3 reduction, −42.1 ± 31.5%; PE day 4 reduction, −36.0 ± 36.3%; PE day 5 reduction, −23.9 ± 38.6%; PE day 6 reduction, −25.6 ± 47.2%; PE day 7 reduction, −27.8 ± 33.4%; all p < false discovery rate (FDR) α; Fig. 5A]. In the REM group there was a significant reduction in PE days 2 and 4 (PE day 2 reduction, −33.3 ± 28.6%; PE day 4 reduction, −17.6 ± 22.7%; all p < FDR α; Fig. 5A), a trend in PE days 1 and 3 (PE day 1 reduction, −20.8 ± 36.2%, p = 0.058; PE day 3 reduction, −17.3 ± 27.2%, p = 0.062), and no reduction from baseline in PE days 5–7 (PE day 5 reduction, −5.3 ± 25.7%; PE day 6 reduction, −3.1 ± 32.4%; PE day 7 reduction, −7.7 ± 36.0%; all p > FDR α; Fig. 5A). In the wake group there was no significant reduction in the number of smoked cigarettes between the baseline and any of the following 7 PE days (PE day 1 reduction, −15.7 ± 32.2%; PE day 2 reduction, −4.3 ± 36.1%; PE day 3 reduction, −12.0 ± 26.2%; PE day 4 reduction, −3.6 ± 36.1%; PE day 5 reduction, −3.3 ± 35.5%; PE day 6 reduction, −3.3 ± 23.6%; PE day 7 reduction, −3.9 ± 22.2%; all p > FDR α; Fig. 5A).
To characterize the influence of time on the reduction in smoking, we calculated the percentage change of smoked cigarettes from baseline in the first half (PE days 1–3) and second (PE days 5–7) half of the experiment, and conducted an ANOVA with conditions of group (stage 2 sleep, REM sleep, wake) and time (first half, second half). We found a main effect of time (F(1,31) = 28.87, p < 0.0001; Fig. 5B) reflecting a greater reduction in smoking in the first half, a main effect of group (F(2,31) = 3.66, p < 0.05; Fig. 5B), and no interaction between time and group (F(2,31) = 2.79, p = 0.77). Planned comparisons revealed that following conditioning during stage 2 sleep there was a significant reduction in smoking in the first half (−43.6 ± 31.1%, t(11) = 4.23, p < 0.005) and second half (−24.3 ± 33.6%, t(11) = 2.98, p < 0.05) of the experiment. However, following conditioning during REM, there was a significant reduction only in the first half (−23.8 ± 21.8%, t(11) = 3.42, p < 0.01) but not in the second half (1.8 ± 24.4%, t(11) = 0.40, p > 0.69) of the experiment, and that the reduction in the second half was significantly greater following conditioning during stage 2 compared with REM (t(22) = 2.17, p < 0.05; Fig. 5B). In addition, conditioning during wakefulness did not reduce smoking in either the first half (−10.7 ± 25.5%, t(9) = 1.31, p > 0.22) or second half (−3.5 ± 24.9%, t(9) = 0.48, p > 0.64) of the experiment.
To characterize the influence of olfactory aversive conditioning on cigarette smoking across the 7 d period following conditioning, we calculated the percentage change of smoked cigarettes from baseline for each of the 7 d after conditioning. Then we applied a linear fit for each subject on these percentage change values and extracted the intercept, reflecting the effect size of the change in smoked cigarettes, and slope, reflecting the change during 7 d after the experiment in smoked cigarettes. We found a significantly greater intercept following conditioning during stage 2 sleep compared with wake (stage 2 intercept, −52.04 ± 34.92; wake intercept, −13.21 ± 30.48; t(20) = 2.7, p < 0.05; Fig. 5C), reflecting a larger reduction in the number of smoked cigarettes in stage 2, and a trend in the same direction for the slope (stage 2 slope, 4.54 ± 4.33; wake slope, 1.64 ± 2.33; t(20) = 1.9, p = 0.073; Fig. 5D). In addition, there was a significantly greater slope following conditioning during REM sleep compared with wake (REM slope, 6.09 ± 6.07; wake slope, 1.64 ± 2.33; t(20) = 2.2, p < 0.05; Fig. 5D), reflecting a steeper change in the number of smoked cigarettes during the 7 PE days in REM, and a trend in the same direction for the intercept (REM intercept, −36.29 ± 0.29; wake intercept, 13.21 ± 30.48; t(20) = 1.8, p = 0.085; Fig. 5C). There were no differences between stage 2 and REM in either the slope or intercept (all t(22) < 1.2, p > 0.24; Fig. 5C,D).
To verify that the differences in smoking reduction following conditioning during stage 2 and REM sleep did not result from differences in sleep architecture, number of trials, or the time of night when conditioning was delivered, we compared these parameters between the groups. The stage 2 and REM groups did not differ in total sleep time (stage 2, 346.53 ± 48.94 min; REM, 368.95 ± 56.19 min; t(1,22) = 0.78, p > 0.44; Table 1), amount of time spent in each sleep stage (all p > 0.30; Table 1), number of trials (stage 2, 27.42 ± 4.54 trials; REM, 25.50 ± 6.54 trials; t(1,22) = 0.78, p > 0.44; Table 1) or latency between sleep onset and first trial onset (stage 2, 185.37 ± 17.37 min; REM, 198.52 ± 74.52 min; t(1,22) = 0.78, p > 0.44; Table 1).
These findings suggest that implicit olfactory aversive conditioning during sleep significantly reduced smoking behavior, yet explicit olfactory aversive conditioning during wakefulness did not. Furthermore, reduction in smoking was observed following olfactory aversive conditioning during stage 2 and REM sleep. However, the smoking reduction magnitude and duration was sleep stage-dependent with an enhanced and longer-lasting reduction following stage 2 conditioning.
The effectiveness of conditioning was not associated with altered sensory perception
To ask whether successful conditioning during sleep was associated with changes in perception of cigarette odor alone, we compared cigarette odor rankings from before and after conditioning. An ANOVA on pleasantness ranking with conditions of ranking time (before, after) and group (stage 2 sleep, REM sleep, wake) revealed no main effect of ranking time (F(1,25) = 0.54, p > 0.47), no main effect of group (F(1,17) = 0.08, p > 0.79), and a trend in the interaction between ranking time and group (F(2,25) = 2.91, p = 0.073). The same ANOVA on intensity and similarity ranking revealed no main effects or interactions (all F < 0.66, all p > 0.20). These results suggest that olfactory aversive conditioning did not change the perception of cigarette odor, and implies that the ensuing influence on cigarette-smoking behavior was not the result of altered sensory perception alone.
Conditioning reduced cigarette-smoking behavior more than sensory exposure alone
A previous study suggested that exposure to pleasant and unpleasant odors could reduce the urge to smoke regardless of a conditioning paradigm (Sayette and Parrott, 1999). To test whether the observed reduction in smoking following olfactory aversive conditioning during sleep resulted from the pairing between cigarette odor and unpleasant odors, or from the administration of unpleasant odors alone, we conducted a control experiment in which we replicated the conditioning paradigm but used clean air instead of cigarette odor (unpleasant odor group). In this experiment participants were exposed to unpleasant odors alone during stage 2 (n = 11) or REM (n = 11) sleep. We compared these results to the original stage 2 and REM conditioning groups. First, we compared the baseline smoking rate and addiction level between the original conditioning groups (stage 2 and REM combined) and the unpleasant odor groups (stage 2 and REM combined) and found no differences (smoking rate: conditioning, 13.0 ± 5.1 cigarette per day; unpleasant odors, 14.5 ± 4.9 cigarette per day; t(44) = 0.20, p > 0.33; Fig. 6A; addiction level: conditioning, 45.0 ± 5.9; unpleasant odors, 44.8 ± 8.6; t(44) = 0.06, p > 0.94). Next we calculated the percentage change of smoked cigarettes from baseline in the first half (PE days 1–3) and second half (PE days 5–7) of the experiment, and conducted an ANOVA with conditions of group (conditioning, unpleasant odors) and time (first half, second half). We found a main effect of time (F(1,44) = 8.48, p < 0.01; Fig. 6B), reflecting a greater reduction in smoking in the first half, no main effect of group (F(1,44) = 1.51, p > 0.23), but a significant interaction between time and group (F(1,44) = 5.3, p < 0.05; Fig. 6B), reflecting a larger reduction in smoking in the first half of the experiment in the conditioning group. Planned comparison revealed that in the first half there was a significant reduction in smoking following conditioning (33.7 ± 28.1%, t(23) = 8.87, p < 0.00005) and also following unpleasant odors (14.4 ± 27.3%, t(21) = 2.48, p < 0.05). However, the reduction following conditioning was significantly greater (t(44) = 2.36, p < 0.05; Fig. 6B). There was no significant reduction in the second half of the experiment following conditioning (t(23) = 1.74, p > 0.096) or unpleasant odor (t(21) = 1.69, p > 0.10) administration during sleep.
Next, we calculated the percentage change from baseline in the number of cigarettes smoked for each day following the night in the laboratory, applied a linear fit, and extracted the intercept and slope for each subject as before. We found a greater intercept and slope in the conditioning group compared with unpleasant odors group (conditioning intercept, −44.17 ± 32.51; unpleasant odors intercept, −15.21 ± 33.35; t(44) = 2.98, p < 0.005; conditioning slope, 5.31 ± 5.21; unpleasant odors slope, 0.63 ± 7.46; t(44) = 2.48, p < 0.05; Figure 7C,D). These results imply that both olfactory aversive conditioning and unpleasant odor administration alone during sleep reduced smoking behavior, yet the reduction in smoking following olfactory aversive conditioning was approximately double in magnitude of that following unpleasant odors alone.
Last, to verify that the increased reduction in smoking indeed resulted from the pairing between cigarette odor and unpleasant odors, and not from the administration of cigarette odor or from the different number of odor exposures between the unpleasant odor group (unpleasant odor group: 10 AmSu and 10 RF presentation; 20 total exposures) and the olfactory aversive conditioning group (30 cigarette odor, 10 AmSu, and 10 RF presentation; 50 total exposures), we conducted an additional control experiment in which we delivered the same number of aversive and cigarette odors as in the conditioning, but in randomized order rather than paired (nonconditioned group). Because a greater and longer-lasting reduction was evident following conditioning during stage 2 sleep compared with REM sleep, we conducted this control during stage 2 sleep only (n = 10) and compared the results to the results of the olfactory aversive conditioning during stage 2. We found no differences in baseline smoking rate (conditioning, 13.3 ± 6.3 cigarette per day; nonconditioned, 15.9 ± 6.9 cigarette per day; t(20) = 0.26, p > 0.83; Fig. 7A) or addiction level (conditioning, 43.8 ± 6.0; nonconditioned, 43.4 ± 7.7; t(20) = 0.13, p > 0.89) between groups. An ANOVA with conditions of group (conditioning, nonconditioned) and time (first half, second half) revealed a main effect of time (F(1,20) = 6.84, p < 0.05; Fig. 7B), reflecting a greater reduction in smoking in the first half, no main effect of group (F(1,20) = 2.62, p > 0.12), and no significant interaction (F(1,20) = 2.78, p > 0.11). Planned comparison revealed that there was no significant reduction in smoking following nonconditioned odors in either the first half (t(9) = 1.3, p > 0.20) or second half (t(9) = 1.0, p > 0.33) of the experiment. However, as reported before, there was a significant reduction in smoking following conditioning in the first half (43.6 ± 31.1%, t(11) = 4.23, p < 0.005) and second half (24.3 ± 33.6%, t(11) = 2.98, p < 0.05), and that the reduction in the first half of the experiment following conditioning was significantly greater following olfactory aversive conditioning compared with nonconditioned odors (t(20) = 2.10, p < 0.05; Fig. 7B). In addition, linear fit for the percentage change in smoking reduction revealed a greater intercept in the conditioning compared with the nonconditioned group (conditioning group intercept, −52.04 ± 34.92; nonconditioned group intercept, −21.25 ± 34.80; t(20) = 2.06, p = 0.052), and no effect in the slope (conditioning group slope, 4.54 ± 4.33; nonconditioned group slope, 1.74 ± 4.65; t(20) = 2.06, p > 0.14). These results imply that the greater reduction in smoking following olfactory aversive conditioning during sleep compared with odor exposure alone resulted from the pairing between cigarette odor and unpleasant odors and not from the administration of the cigarette odor or due to fewer exposures to odor.
Discussion
We found that a single night of implicit olfactory aversive conditioning between cigarette odor and profoundly unpleasant odors during stage 2 and REM sleep drove a significant reduction in smoking behavior over the ensuing week. Moreover, the reduction in smoking behavior was greater and longer lasting following conditioning in stage 2 versus REM sleep. In contrast, explicit olfactory aversive conditioning during wakefulness did not alter smoking behavior. Consistent with previous findings, presentation of aversive odors alone also reduced ensuing smoking behavior (Sayette and Parrott, 1999), yet this reduction was approximately half of that following conditioning during sleep. Thus, these findings further support the hypothesis that new associations learned during sleep can modify cigarette-smoking behavior.
The different effects of associative learning during wakefulness and sleep are in keeping with several recent studies. For example, using olfactory stimuli for memory reactivation during sleep stabilized memories whereas the same procedure during wakefulness destabilized memories (Diekelmann et al., 2011). In addition, extinction of olfactory contextual fear conditioning was greater when re-exposure to the odorant context occurred during sleep compared with wakefulness (Hauner et al., 2013). Moreover, consolidation of emotional memories, though not neutral memories, is more enhanced during sleep than during wakefulness (Hu et al., 2006; Wagner et al., 2006; Payne et al., 2008; Baran et al., 2012). Finally, memory reactivation during sleep both strengthened and linked categorically related memories together, while equivalent wake reactivation only strengthened individual memories (Oudiette et al., 2013). Together, our results dovetail with those of these studies to suggest stronger implicit learning in sleep over explicit learning during wakefulness.
Compelling evidence suggests an interaction between sleep stage and learning in general (Walker and Stickgold, 2006; Diekelmann and Born, 2010; Spoormaker et al., 2013; Ackermann and Rasch, 2014; Landmann et al., 2014) and in the specific context of novel conditioning during sleep (Arzi et al., 2012). Here we found that olfactory aversive conditioning during stage 2 resulted in a greater reduction in smoking behavior that lasted for a longer time compared with reduction following similar conditioning in REM sleep. The increased effect in stage 2 is consistent with the expanding literature regarding the role of slow-wave oscillations in memory consolidation of general and olfactory-specific information (Wilson and Yan, 2010; Barnes and Wilson, 2014). In turn, the reduced effect in REM may be viewed as consistent with the rapid forgetting of REM-related memories (dream amnesia; Nir and Tononi, 2010).
Given our attribution of increased learning effects to slow-wave oscillations, one may ask why the experiment was not conducted during slow-wave sleep (SWS) rather than in stage 2, given that SWS is particularly rich in slow oscillations (Iber, 2007). This decision reflected a tradeoff between the increased prevalence of slow waves in SWS versus the reduced overall time of SWS that occupied in this experiment: only ∼17% of sleep time compared with ∼50% of sleep time in stage 2 (Table 1). Moreover, although SWS clearly plays a role in memory consolidation and reactivation (Plihal and Born, 1999; Gais and Born, 2004; Marshall et al., 2004; Mölle et al., 2004; Peigneux et al., 2004; Rasch et al., 2007; Aeschbach et al., 2008; Antony et al., 2012; Mascetti et al., 2013), such a role is also documented for stage 2 sleep (Gais et al., 2002; Schabus et al., 2004; Clemens et al., 2007; Nishida and Walker, 2007; Andrade et al., 2011; Arzi et al., 2012; Mednick et al., 2013; Tamminen et al., 2013). For example, the amount of improvement in motor skill was significantly correlated with the time spent in stage 2 (Nishida and Walker, 2007). In addition, sleep spindle density, a burst of activity at ∼11–16 Hz that typically occurs during stage 2 (Iber, 2007), increases following declarative learning and correlates with recall performance (Gais et al., 2002). Moreover, pharmacologically modified sleep with increased sleep spindles produced significantly better verbal memory (Mednick et al., 2013). Given that the primary goal of this study was to ask whether sleep conditioning induces behavioral modifications that persist over time, and considering the increased number of events we could expect in stage 2 versus SWS, we concluded that stage 2 conditioning is a safer path for us to test.
Several aspects of olfaction may have rendered it particularly effective for implicit learning in general, and for implicit sleep-learning specifically. First, learning without awareness may be typical for olfaction (Stevenson, 2009): human odor learning can occur with no awareness for the learning process (Stevenson et al., 2000), no awareness about what was learned (Stevenson et al., 2005), and no awareness of the contingent relationship between stimuli (De Houwer et al., 2001; Yeomans and Mobini, 2006). Second, consciously unperceived odorants can have a greater effect on perception and learning compared with perceived odors (Willingham and Goedert-Eschmann, 1999; Li et al., 2007; Sela and Sobel, 2010). Third, unlike sensory stimuli of other senses, purely olfactory and mildly trigeminal odorants do not awaken subjects (Carskadon and Herz, 2004; Stuck et al., 2007; Grupp et al., 2008; Arzi et al., 2010). Last, cortical processing of olfaction does not initially rely on a thalamic relay (Price, 1990; Sela et al., 2009; Courtiol and Wilson, 2014) and, although a thalamic-type gating function may be implemented in primary olfactory cortex itself (Murakami et al., 2005), the thalamic circumvention may nevertheless provide special status for olfactory information obtained in sleep (Plailly et al., 2008). It is likely that the combination of these characteristics optimized a framework for effective olfactory implicit learning during sleep with later behavioral influences.
Olfaction may have a privileged role not only for implicit learning in general, but also more specifically in the context of addictive behavior, such as smoking. Addiction is associated with direct activation of the reward system (Hyman et al., 2006; Ikemoto et al., 2006; Volkow et al., 2006; Wang et al., 2007; Koob, 2009; Koob and Volkow, 2010). The reward system comprises a highly interconnected network of brain regions, including orbitofrontal cortex, amygdala, striatum, nucleus accumbens, and ventral tegmental area (Wise, 1996; O'Doherty, 2004; Pierce and Kumaresan, 2006), and has an important role in reinforcement and aversive learning (Murray, 2007; Bromberg-Martin et al., 2010). The brain circuits of reward and olfaction are highly overlapping. There is a direct connection from the primary olfactory cortex, the piriform cortex, to the amygdala and the orbitofrontal cortex (Haberly, 2001). Moreover, these regions are activated during olfactory processing and also during olfactory aversive conditioning (Gottfried et al., 2002; Gottfried and Dolan, 2004). Furthermore, the functional connectivity between the primary olfactory cortex and the integral parts of the reward system, such as the amygdala, is enhanced during sleep compared with wakefulness (Barnes and Wilson, 2014). The shared anatomy and the enhanced connectivity during sleep between the two systems may enable olfaction to play a role as a unique pathway to modulate reward-related behavior in general and during sleep in particular. All that said, this does not imply direct applicability of our results to the treatment of addiction. This is because treatments of addiction are typically assessed by duration of ensuing abstinence (Shiffman et al., 2008; Pollock et al., 2009; Laniado-Laborín, 2010; Pickens et al., 2011; Stead and Lancaster, 2012; Schlam and Baker, 2013), yet here we merely measured smoking frequency over 7 d. Moreover, although self-report of smoking behavior is considered a largely reliable measure (Patrick et al., 1994), for clinical applications in cigarette addiction the gold standard for smoking behavior includes application of biological markers for nicotine (Chenoweth et al., 2014; Cropsey et al., 2014; Won et al., 2014), and we did not use those here. Thus, future studies may assess the direct applicability of aversive conditioning during sleep to the treatment of addiction. Therefore, we conclude in highlighting our findings as they relate to learning and memory during sleep alone. Here, a single night of olfactory aversive conditioning was followed by reduced smoking behavior that persisted for several days. These results imply that new associations learned during sleep persist over time.
Footnotes
- Received June 5, 2014.
- Revision received September 22, 2014.
- Accepted September 26, 2014.
This work was supported by a grant from the Lulu P. & David J. Levidow Fund for Alzheimer's Disease and Neuroscience Research. Additional funding came from the James S. McDonnell Foundation and from the Israeli Center for Excellence in Cognitive Science.
The Weizmann Office for Technology Licensing is currently deliberating whether to file for a patent regarding a treatment for addiction based on the currently described results. The authors declare no other competing financial interests.
- Correspondence should be addressed to Anat Arzi, Department of Neurobiology, Weizmann Institute of Science, Rehovot, 7610001, Israel. Anat.arzi{at}gmail.com
- Copyright © 2014 the authors 0270-6474/14/3315382-12$15.00/0