Articles, Behavioral/Cognitive

Impaired Neural Response to Negative Prediction Errors in Cocaine Addiction

Muhammad A. Parvaz, Anna B. Konova, Greg H. Proudfit, Jonathan P. Dunning, Pias Malaker, Scott J. Moeller, Tom Maloney, Nelly Alia-Klein and Rita Z. Goldstein
Journal of Neuroscience 4 February 2015, 35 (5) 1872-1879; DOI: https://doi.org/10.1523/JNEUROSCI.2777-14.2015

Abstract

Learning can be guided by unexpected success or failure, signaled via dopaminergic positive reward prediction error (+RPE) and negative reward-prediction error (−RPE) signals, respectively. Despite conflicting empirical evidence, RPE signaling is thought to be impaired in drug addiction. To resolve this outstanding question, we studied as a measure of RPE the feedback negativity (FN) that is sensitive to both reward and the violation of expectation. We examined FN in 25 healthy controls; 25 individuals with cocaine-use disorder (CUD) who tested positive for cocaine on the study day (CUD+), indicating cocaine use within the past 72 h; and in 25 individuals with CUD who tested negative for cocaine (CUD−). EEG was acquired while the participants performed a gambling task predicting whether they would win or lose money on each trial given three known win probabilities (25, 50, or 75%). FN was scored for the period in each trial when the actual outcome (win or loss) was revealed. A significant interaction between prediction, outcome, and group revealed that controls showed increased FN to unpredicted compared with predicted wins (i.e., intact +RPE) and decreased FN to unpredicted compared with predicted losses (i.e., intact −RPE). However, neither CUD subgroup showed FN modulation to loss (i.e., impaired −RPE), and unlike CUD+ individuals, CUD− individuals also did not show FN modulation to win (i.e., impaired +RPE). Thus, using FN, the current study directly documents −RPE deficits in CUD individuals. The mechanisms underlying −RPE signaling impairments in addiction may contribute to the disadvantageous nature of excessive drug use, which can persist despite repeated unfavorable life experiences (e.g., frequent incarcerations).

Introduction

Reinforcement-learning theories posit that a reward-prediction error (RPE) signal reflects a discrepancy between a predicted and actual rewarding outcome that is used to update the expected value of the stimulus/action leading to the rewarding outcome (Schultz, 1998; Glimcher, 2011). According to both preclinical and human neuroimaging studies, these RPEs are produced by phasic dopaminergic signaling in the midbrain projecting to other regions within the mesostriatocortical network that increases in response to the delivery of an unpredicted reward [positive RPE (+RPE)] and decreases in response to either the omission of a predicted reward or delivery of negative outcome [negative RPE (−RPE); Mirenowicz and Schultz, 1994; Hollerman and Schultz, 1998; McClure et al., 2003; Liu et al., 2007; Cohen et al., 2012; Hart et al., 2014]. Consequently, these signals drive learning (Reynolds et al., 2001) that guides future behavior (Montague et al., 2004; Frank and Claus, 2006).

In the course of developing drug addiction, the pharmacologic actions of drugs of abuse enhance +RPE signal (Jones et al., 1995), facilitating pathological overlearning of drug-related cues (Di Chiara, 1998). The mechanism invokes dysregulated corticostriatal dopamine transmission (Rice and Cragg, 2004) that facilitates unrestricted habitual drug use (Everitt and Robbins, 2005) and results in gradual decline in dopaminergic functions (Koob and Le Moal, 2001), including reward prediction (Watanabe, 1996) and movement initiation (Schultz and Romo, 1992). Using associative learning and guessing/financial decision-making tasks, some studies have shown reduced RPE signals in nicotine (Rose et al., 2012), polysubstance (Tanabe et al., 2013), and stimulant (Rose et al., 2014) users, whereas others have shown intact RPE signals in alcohol (Park et al., 2010), nicotine (Chiu et al., 2008), and opioid (Gradin et al., 2014) users. Thus, whether RPE signaling is globally impaired in addiction remains an open question.

The feedback-related negativity [feedback negativity (FN), feedback-related negativity, feedback-error-related negativity, or medial-frontal negativity] component of the event-related potentials (ERPs) originates from the medial prefrontal cortex and the major termini of mesencephalic dopaminergic projections (Nieuwenhuis et al., 2004a; Carlson et al., 2011). FN is reported to be sensitive to phasic corticostriatal dopaminergic activity (Hauser et al., 2014) and tracks bidirectional (±)RPE signaling (Holroyd et al., 2003; Pfabigan et al., 2011). Previous studies in addiction have investigated FN as a marker of sensitivity to reward expectation (Franken et al., 2010; Euser et al., 2011; Muñoz et al., 2012) or of outcome evaluation (Fein and Chang, 2008; Euser et al., 2013), but importantly never as a marker of RPE.

Here, we reasoned that a targeted task could leverage FN to index RPE in addiction. Therefore, we evoked FN using a gambling task and hypothesized that cocaine-use disorder (CUD) will manifest deficits in computing both positive RPE (+RPE) and negative RPE (−RPE). Given previous reports of more severe executive function (Woicik et al., 2009) and reward processing impairments (Parvaz et al., 2012) in addicted individuals with less-recent drug use (i.e., CUD individuals with longer current abstinence length and less-frequent current drug use), we further hypothesized that less-recent cocaine use will be associated with more-severe RPE deficits.

Materials and Methods

Participants.

Fifty CUD individuals (46 male) and 25 healthy controls (23 male) were recruited through advertisements in local newspapers, word of mouth, and local treatment facilities. All participants underwent full physical and neurological examinations by a neurologist and a diagnostic interview by a clinical psychologist. The diagnostic interview included the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Axis I Disorders (First et al., 1996); the Addiction Severity Index (McLellan et al., 1992); the Cocaine Selective Severity Assessment Scale (Kampman et al., 1998); the Cocaine Craving Questionnaire (Tiffany et al., 1993); and the Severity of Dependence Scale (Gossop et al., 1992). Based on this interview, all CUD individuals were classified as meeting diagnostic criteria for current cocaine dependence.

Participants were further screened to exclude for the following: (1) history of head trauma or loss of consciousness (>30 min) or any other neurological disease; (2) abnormal vital signs at time of screening and history of major medical conditions; (3) history of major psychiatric disorders, including current dependence or abuse of any substance (other than cocaine abuse or dependence for CUD and/or nicotine dependence for all participants); (4) severe levels of self-reported depression (Beck Depression Inventory; Beck et al., 1996; scores, >20); (5) history of gambling as measured with the South Oaks Gambling Scale (Lesieur and Blume, 1987; scores, ≥5); (6) except for cocaine in the CUD participants, positive urine screens for any other psychoactive drugs; and (7) current use of any medication, including psychotropic medications.

Similar to our previous studies (Moeller et al., 2010, 2013; Dunning et al., 2011; Parvaz et al., 2012), recent use of cocaine was objectively indexed by urine screening on study day using the triage urine panel (Biopsych), which detects drug use within the past 72 h. Individuals positive for cocaine in urine, though not currently intoxicated, were classified as CUD+ (N = 25), while those negative for cocaine in urine were classified as CUD− (N = 25). All CUD individuals used crack/cocaine in the previous 90 d. As anticipated, the two CUD subgroups differed on frequency of recent cocaine use (days per week in past 30 d, p < 0.001), duration of current abstinence (p < 0.001), self-reported craving (p < 0.001), and withdrawal from cocaine (p = 0.006; Table 1). With the exception of cigarette smoking, the combined group of CUD individuals and controls did not differ on any demographic characteristics (Table 1). Only 5 (of 25) controls were current smokers compared with the majority (32 of 50) of CUD individuals, and this represented a significant difference (p = 0.001). However, daily cigarette use among the current smokers did not differ between the groups. Cigarette smokers were not required to abstain from smoking to avoid acute nicotine withdrawal effects. Participants were fully informed of all study procedures and risks and provided written consent in accordance with the Stony Brook University's Institutional Review Board.

View this table:
Table 1.

Demographics and drug use-related measures of all study participantsa

Task.

The overall design of the task is similar to Experiment 2 reported in a previous study by Hajcak et al. (2007). The task was administered using Presentation software (Neurobehavioral Systems) to control the presentation and timing of all stimuli. Participants' primary objective on each trial was to guess which of four doors presented horizontally in a color graphic hid a prize by pressing one of four keys on a keypad corresponding to each door (Fig. 1A). At the beginning of each trial, a white “1,” “2,” or “3” appeared on the screen for 1000 ms to inform participants the number of doors (out of four) that contained a monetary prize (60¢); thus, these cues indicated the probability of reward on the upcoming trial (25, 50, and 75%, respectively). The graphic of the doors appeared 1500 ms after cue offset, and remained until the participant made a selection to indicate their prediction of the winning door. Immediately following their choice, the question “Do you think you won or lost in this trial?” appeared on the screen and remained there until participants indicated via button press a predicted win or loss. Thus, participants were first presented with a cue that conveyed the objective probability of reward on the upcoming trial, then asked to make a choice and, finally, predicted whether or not they thought they chose correctly. Five hundred milliseconds following their prediction, a feedback stimulus appeared on the screen for 1000 ms: a green arrow pointing upward indicated a win (i.e., a win of 60¢), and a red arrow pointing downward indicated a loss (i.e., a loss of 30¢; Fig. 1A). Winning probability was always consistent with the cue type (e.g., 75% winning probability for three-cue trials). Participants' prediction on each trial was recorded and subsequently analyzed to validate the success of the task manipulations in biasing reward prediction. Such a task design specifically allows for modulating valence-related variability in FN by explicit prediction errors (Hajcak et al., 2007).

All stimuli were positioned in the center of the screen. The cue and feedback stimuli occupied ∼21° of visual angle horizontally and 21° vertically. A fixation cross was then presented in the intertrial interval for 1000 ms. The task consisted of six blocks of 50 pseudorandom trials (i.e., a total of 300 trials; 100 trials per cue type) interspaced by a brief break. Participants were told that the task earnings would be given to them at the end of the EEG session. Unbeknownst to the participants, the task earnings were not dependent on their choice and they were always paid $75 for the task.

Electroencephalogram recording and data reduction.

Electroencephalogram (EEG; Neuroscan) recordings were obtained using a 64 silver–silver chloride electrode cap positioned according to the International 10/20 system. Electro-oculogram electrodes at the left supraorbital and infraorbital sites and the right and left outer canthi recorded the blinks (and vertical eye movements) and horizontal eye movements, respectively. EEG recordings were sampled at 500 Hz and bandpass filtered from DC to 70 Hz. Electrode impedances were kept <10 kΩ.

Offline preprocessing of the EEG signal was performed using SPM8 (Wellcome Department of Cognitive Neurology, London, UK; http://www.fil.ion.ucl.ac.uk/spm) and custom Matlab (The MathWorks) scripts. Data were first bandpass filtered (0.01–30 Hz) and rereferenced to the averaged electrical activity from all 64 scalp sites. To evaluate the effect of participant's actual predictions on the feedback-locked ERP and to maximize the number of trials for each analysis, across the objective winning probabilities (25, 50, and 75%), averaged waveforms were created for all four feedback trial types (i.e., predicted win, unpredicted win, predicted loss, and unpredicted loss). Therefore, the continuous EEG data were segmented beginning 200 ms before the feedback onset and continuing for 1000 ms. For each trial, the 200 ms baseline was subtracted from the poststimulus data for baseline correction. Eye-blink and ocular corrections were performed using the partial signal space projection method proposed by Nolte and Hämäläinen (2001), such that the contribution to the estimated spatial structure of eye-blink artifact was removed only from the artifact-ridden epochs, leaving as much information as possible in the data (Nolte and Hämäläinen, 2001). This artifact-rejection procedure identified a voltage step of >75 μV between sample points and a peak-to-peak voltage difference of 150 μV within an epoch. Additional artifacts were identified through visual inspection, and the contaminated epochs were subsequently rejected. Finally, robust averaging was used to create artifact-free ERPs (Wager et al., 2005) separately for each of the four conditions.

Based on the scalp topography of the grand-averaged difference waveforms (loss minus win for predicted and unpredicted conditions; Hajcak et al., 2007), the FN was defined as the averaged maximum negative amplitude at the Fz, FC1, FCz, and FC2 electrode sites from 200 to 350 ms following feedback onset. FN was scored in two different ways: (1) based on subjective prediction and outcome (i.e., predicted win, unpredicted win, predicted loss, and unpredicted loss); and (2) based on objective win probability and outcome (i.e., 25% win, 25% loss, 50% win, 50% loss, 75% win, and 75% loss). We expected the former, but not the latter, to specifically target RPE as there might be incongruencies in objective win probability and the participants' own expectation of reward. Additionally, to show that RPE uniquely modulates FN, P300 was also isolated for each outcome based on winning probability and prediction type at sites where P300 was maximal (i.e., F1, Fz, F2, FCz sites). The P300 was defined as the most positive peak in the 400–600 ms window following feedback onset.

Using SPSS (version 20), task behavior (subjective win/loss prediction) was analyzed with a 3 [Winning probability (25, 50, and 75%)] × 2 [Predicted outcome (wins and losses)] × 3 [Group (Controls, CUD+, and CUD−)] mixed-model ANOVA. In contrast, FN and P300 amplitudes were each analyzed with (1) 2 [Prediction (predicted and unpredicted)] × 2 [Outcome (wins and losses)] × 3 [Group (Controls, CUD+, and CUD−)] mixed-model ANOVA, to specifically assess the RPE signaling; and (2) 3 [Winning probability (25, 50, and 75%)] × 2 [Outcome (wins and losses)] × 3 [Group (Controls, CUD+, and CUD−)] mixed-model ANOVA, to assess the specificity of objective win probability to target RPE. In instances where the sphericity assumption was violated, the Greenhouse–Geisser correction was applied. All significant main effects and interactions were followed with pairwise t tests.

Finally, due to our a priori hypothesis regarding more severe impairments as a function of longer current abstinence length and less-frequent current drug use, correlations between the dependent measures (ERPs and behavior) and variables indexing recent drug-use history and related symptoms (listed in Table 1) were examined within each CUD subgroup.

Results

Behavioral results

The 3 (Winning probability: 25, 50, and 75%) × 2 (Predicted outcome: Win and Loss) × 3 (Group: Controls, CUD+, and CUD−) mixed ANOVA revealed a significant main effect of predicted outcome (Win > Loss: F(1,72) = 54.22, p < 0.001) and a winning probability-by-predicted outcome interaction (F(2,71) = 58.54, p < 0.001), while all other main effects and interactions did not reach significance (p > 0.1). Follow-up paired t tests showed that all participants predicted losing more often than winning for the 25% winning probability (t(74) = 3.30, p = 0.002) and predicted winning more often than losing for both the 50% (t(74) = 6.83, p < 0.001) and 75% (t(74) = 12.00, p < 0.001) winning probabilities, confirming that the task manipulations were successful in biasing reward prediction (Fig. 1B).

Figure 1.
Figure 1.

A, Sequence of events during a win trial of the gambling task. Based on a cue, the participants select a door and then identify if they expect to win or lose in that trial. A feedback of their accuracy was provided at the end of each trial. B, Graph showing the proportion of win prediction for each cue type separately for each group. The pattern provides a behavioral validation of the effectiveness of task manipulations the study groups. The error bars show the standard error of mean (SEM).

ERP results

FN

The 2 (Prediction: Predicted and Unpredicted) × 2 (Outcome: Win and Loss) × 3 (Group: Controls, CUD+, and CUD−) mixed ANOVA for FN amplitude indicated a significant main effect for outcome (Win > Loss: F(1,72) = 102.4, p < 0.001), a significant prediction-by-outcome interaction (F(1,72) = 10.64, p = 0.002), and a significant prediction-by-outcome-by-group interaction (F(2,72) = 5.58, p = 0.006). Follow-up comparisons revealed that, in controls only, FN amplitude was significantly higher for unpredicted versus predicted wins (Unpredicted Win > Predicted Win: t(24) = 3.12, p = 0.005) and significantly lower for unpredicted versus predicted losses (Unpredicted Loss < Predicted Loss; t(24) = 2.50, p = 0.020) as would be expected if the FN was tracking both +RPEs and −RPEs.

CUD+ individuals also showed significantly higher FN amplitude for unpredicted versus predicted wins (Unpredicted Win > Predicted Win; t(24) = 2.38, p = 0.026) but no significant effects were observed for unpredicted versus predicted losses (p = 0.337). CUD− individuals did not show FN differences either between unpredicted and predicted wins (p = 0.719), or between unpredicted and predicted losses (p = 0.203). Thus, the current results show that, compared with healthy controls, both CUD subgroups manifest impairments in −RPE signaling as indexed by the lack of FN amplitude modulation to unpredicted versus predicted losses; CUD− individuals show additional impairments in +RPE signaling as indexed by the lack of FN amplitude modulation by unpredicted versus predicted wins (Table 2; Fig. 2A–D).

View this table:
Table 2.

FN amplitudes as a function of condition for all study groupsa

Figure 2.
Figure 2.

A–C, Grand averaged ERP waveforms at the FCz electrode for Predicted Win, Unpredicted Win, Predicted Loss, and Unpredicted Loss conditions separately for (A) Controls, (B) CUD+, and (C) CUD−. The highlighted window represents the temporal region of interest from where FN amplitude was scored. A–C also show P300 amplitude (∼400 ms) that is higher for unpredicted relative to predicted outcomes. D, Bar graphs with electrocortical markers of +RPE (unpredicted minus predicted reward) and −RPE (unpredicted minus predicted loss) signaling showing intact RPE signaling in healthy controls and impaired signaling in CUD individuals. Asterisk designates significant differences (p < 0.05) between unpredicted and predicted outcomes.

The exploratory 3 (Winning probability: 25, 50, and 75%) × 2 (Outcome: Win and Loss) × 3 (Group: Controls, CUD+, and CUD−) mixed ANOVA revealed a significant main effect of outcome (Win > Loss: F(1,72) = 69.72, p < 0.001) and a winning probability-by-outcome interaction (F(2,71) = 7.24, p = 0.001), while all other main effects and interactions did not reach significance (p > 0.1). Follow-up paired t tests showed that the loss minus win differential FN amplitude was significantly higher for the 50% condition compared with the amplitude for the 75% condition across all participants (t(74) = 3.82, p < 0.001).

P300

The 2 (Prediction: Predicted and Unpredicted) × 2 (Outcome: Win and Loss) × 3 (Group: Controls, CUD+, and CUD−) mixed ANOVA for P300 amplitude indicated a significant main effect for prediction (Unpredicted > Predicted: F(1,72) = 15.42, p < 0.001). All other main effects and other interactions did not reach significance.

The 3 (Winning probability: 25, 50, and 75%) × 2 (Outcome: Win and Loss) × 3 (Group: Controls, CUD+, and CUD−) mixed ANOVA revealed a significant winning probability-by-outcome interaction (F(2,71) = 17.6, p < 0.001), while all other main effects and interactions did not reach significance (p > 0.1). Follow-up paired t tests showed higher P300 amplitude to win compared with loss for the 25% winning probability (t(74) = 3.30, p = 0.002), no difference for the 50% condition (p = 0.65), and higher P300 amplitude to loss compared with win for the 75% winning probability across all participants (t(74) = 4.79, p < 0.001).

Examination of potential confounds

History of cigarette smoking significantly differed between the groups such that most CUD individuals (32 of 50) were current smokers, whereas only 5 of 25 healthy controls were current smokers. Therefore, a subanalysis was performed only in currently nonsmoking participants (20 controls and 18 CUD individuals). In this analysis CUD+ and CUD− individuals were assessed together as a CUD group due to statistical power constraints. For analyses based on subjective prediction, the results were consistent with findings in the entire sample such that there was a significant main effect for outcome (Win > Loss: F(1,36) = 42.05, p < 0.001) and a significant prediction-by-outcome interaction (F(1,36) = 7.81, p = 0.008). The three-way prediction-by-outcome-by-group interaction (F(1,36) = 2.74, p = 0.11) showed a trend in the same direction as in the larger sample, but did not reach significance, likely due to reduced power and fewer degrees of freedom (i.e., the group factor was reduced from three levels to two). Similarly, for analyses based on the objective win probability, the 3 × 2 × 2 mixed ANOVA revealed a significant main effect of outcome (Win > Loss: F(1,36) = 22.16, p < 0.001) and a winning probability-by-outcome interaction (F(1,36) = 3.70, p = 0.038), while all other main effects and interactions did not reach significance (p > 0.1).

Discussion

The current study examined +RPE and −RPE signaling as indexed by the modulation of the FN component of the ERPs by predicted and unpredicted wins and losses and the component's putative impairment in drug addiction. Our results showed increased FN amplitude in response to unpredicted reward relative to predicted reward and decreased FN amplitude in response to unpredicted loss relative to predicted loss in healthy controls, which is consistent with the proposed biphasic corticostriatal dopaminergic activity underlying RPEs (Liu et al., 2007; Maia and Frank, 2011). Indeed, these results corroborate previous findings of FN modulation by unpredicted wins or losses compared with predicted wins or losses (Hajcak et al., 2007; Oliveira et al., 2007; Holroyd et al., 2008) and strengthen the developing literature that highlights sensitivity of the FN amplitude to the bidirectional RPE computation in health (Wu and Zhou, 2009; Pfabigan et al., 2011; also see, Talmi et al., 2013).

The novel results of the current study show impaired RPE signaling in CUD individuals. Specifically, the current results show that FN amplitude in CUD individuals with less-frequent current cocaine use and longer abstinence (i.e., CUD−) did not differ in response to predicted and unpredicted outcomes (i.e., wins and losses), indicative of an overall deficit in RPE computation. Those individuals with more-frequent recent cocaine use and shorter abstinence (i.e., CUD+) showed intact +RPE computation similar to that of healthy controls and impaired −RPE similar to that of CUD− individuals. The results in CUD− individuals are consistent with those of a recent fMRI study that reported attenuated medial orbitofrontal cortex response to a computationally modeled absolute RPE measure in abstinent polysubstance users compared with controls (Tanabe et al., 2013).

The +RPE deficits in CUD− individuals perhaps point to an underlying reduction of tonic dopaminergic transmission in the striatum and reduced dopamine receptor availability resulting in reduced excitability of the reward system, as indicated by an increase in the threshold for brain stimulation for reward (Melis et al., 2005). Acute cocaine administration (as in CUD+ individuals) yields an enhanced dopamine surge, which lowers the threshold for exciting the reward system (Koob et al., 1998) and therefore may also normalize +RPE signaling in the addicted individuals with the most-frequent and most-recent cocaine use. Therefore, the current +RPE results in CUD individuals are consistent with the self-medication hypothesis of addiction (Khantzian, 1997). The temporary suppression of processing deficits by acute cocaine use is not surprising given similar prior results when acutely administering cocaine (Garavan et al., 2008) or methylphenidate (a dopamine partial agonist; Goldstein et al., 2010) to cocaine-addicted individuals. These results also extend our previous findings of more-severe deficits in executive functioning (Woicik et al., 2009) and reward-magnitude sensitivity (Parvaz et al., 2012) in CUD− individuals compared with CUD+ individuals. Note that these results cannot be attributed to more withdrawal in the CUD− individuals as craving and withdrawal were higher in CUD+ individuals.

Most interestingly, the current results highlight deficits in −RPE across all CUD individuals; that is, regardless of the frequency and recency of current cocaine use, there was no impact of prediction on the neural response to loss in CUD individuals. Although novel, these results are not surprising given previous neurochemical reports of sluggish activity in dopaminergic neurons (Volkow et al., 1997; Martinez et al., 2009), further contributing to individual vulnerability to relapse (Hyman et al., 2006; Schultz, 2011). This vulnerability may become more severe with longer abstinence (Tran-Nguyen et al., 1998; Ciccocioppo et al., 2001). Indeed, an impaired response to unpredicted loss in CUD individuals is consistent with findings in other disorders of inhibitory control, such as gambling, where, compared with healthy controls, pathological gamblers show reduced frontostriatal activity on a modified monetary incentive delay task specifically to a loss versus a neutral condition (Balodis et al., 2012).

Alternatively, dysregulation in the serotonin system may also underlie −RPE deficits in CUD individuals. It has previously been suggested that dopamine codes positive and negative prediction errors in tandem with a second opponent system specialized for the negative component of the prediction error, the dorsal raphe serotonin system (Daw et al., 2002). Acute tryptophan depletion, which reduces the availability of central serotonin (5-HT), selectively potentiates punishment prediction (i.e., leaving reward prediction intact; Cools et al., 2008). Interestingly, cocaine-dependent individuals exhibit reduced 5-HT1B receptor availability in several cortical and subcortical regions relative to controls (Matuskey et al., 2014), which may possibly reflect increased endogenous 5-HT levels or 5-HT1B receptor downregulation. Thus, impaired −RPE in CUD individuals may also reflect a primary dysfunction in the serotonin system, or in its interaction with the dopamine system. Lateral habenula (LHb) is one such extrastriatal region that is posited to influence both serotonin (Stern et al., 1981) and striatal dopamine, specifically in dynamic trial-by-trial aversive learning in humans (Lawson et al., 2014) and in nonhuman primates (Matsumoto and Hikosaka, 2007). Thus, the current results of −RPE deficits in CUD individuals are also consistent with recently implicated dysfunctional LHb activity in drug addiction (Velasquez et al., 2014).

Together, the −RPE deficits in both CUD subgroups may reflect an underlying impairment in dopaminergic regulation of learning from disadvantageous experiences, regardless of the recent drug-use pattern. Additionally, this dysregulated dopamine activity may contribute to problems in executive function, such as impaired cognitive control/flexibility (Schoenbaum et al., 2004; Ersche et al., 2008; Liu et al., 2008) and working memory (Tomasi et al., 2007; George et al., 2008; Porter et al., 2011) that are frequently reported in drug addiction. Unlike +RPE signaling, which was intact in CUD+ individuals, deficits in −RPE in all CUD individuals could highlight predisposing factors that may enhance an individual's proclivity toward drug addiction. Alternatively, impaired −RPE could also be a consequence of chronic drug use, but one that is not affected by recent drug use. Future studies could probe the fidelity of −RPE signaling in young adults and at-risk populations to explore whether there are RPE-related deficits that exist before the initiation of drug use or the transition to drug addiction. If this hypothesis is ultimately supported, −RPE could potentially serve as a biomarker for the propensity to develop addiction.

A potential limitation of the current study is that the 25 and 75% winning probability conditions greatly biased the prediction toward predicted loss and predicted win, respectively, and yielded very few unpredicted loss trials for the 25% condition and unpredicted win trials for the 75% condition. Future studies may use other winning probabilities (such as 0, 30, 60, 90, and 100%) to allow increased variation per condition so that RPEs could be evaluated separately for each probability. Second, the task requirement of making a dichotomous prediction on each trial may have changed the meaning of the feedback. For example, when participants correctly predicted a loss, the subsequent negative feedback could simultaneously indicate a correct prediction as well as a loss. However, previous studies have shown that while FN tracks the monetary value of the feedback, it is insensitive to its performance-related aspect (Nieuwenhuis et al., 2004b; Hajcak et al., 2007). Nevertheless, these are the first results using electrocortical biomarkers to elucidate RPE-related disruption in CUD individuals and its association with current drug use. This is important because the increased temporal resolution of neuronal activity afforded by EEG compared with fMRI may be particularly well suited to capture phasic neural processes, such as RPE.

In sum, the current results show absence of a modulation of a direct electrocortical measure of RPE (i.e., the FN) by the prediction of loss in CUD individuals. Similar deficits in both active and abstinent users may be indicative of an underlying trait-like vulnerability to addiction, although this speculation needs to be verified in future longitudinal studies. These results are consequential, as they reflect the neurophysiology underlying persistent disadvantageous behaviors in addicted individuals, such as frequent imprisonment, loss of family and friends, and relapse to drug use, which may reflect the inability of these individuals to learn from unfavorable outcomes. Although most reward processing-related studies investigate the underlying mechanisms of positive prediction error in addiction, the current results highlight the importance of investigating mechanisms underlying the processing of negative prediction error. Moreover, FN modulation by positive reward prediction differed as a function of recency of cocaine use such that it was intact in active users but impaired in cocaine-addicted individuals with recent abstinence. These deficits may thus contribute to relapse risk; that is, to the extent that cocaine may temporarily normalize underlying cognitive, behavioral, and emotional disruptions, abstinent users may revert back to drug use to normalize these impairments.

Footnotes

  • This work was supported by grants from the National Institute on Drug Abuse (F32DA033088 to M.A.P.; R21DA034954 to R.Z.G.) and from the National Institute on Mental Health (5T32MH019524 to A.B.K.; R01MH090134 to N.A.K.).

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Rita Z. Goldstein, One Gustave Levy Place, New York, NY 10029. rita.goldstein{at}mssm.edu

References

  1. ↵
    1. Balodis IM,
    2. Kober H,
    3. Worhunsky PD,
    4. Stevens MC,
    5. Pearlson GD,
    6. Potenza MN
    (2012) Diminished frontostriatal activity during processing of monetary rewards and losses in pathological gambling. Biol Psychiatry 71:749–757, doi:10.1016/j.biopsych.2012.01.006, pmid:22336565.
    OpenUrlCrossRefPubMed
  2. ↵
    1. Beck AT,
    2. Steer RA,
    3. Ball R,
    4. Ranieri W
    (1996) Comparison of Beck Depression Inventories-IA and -II in psychiatric outpatients. J Pers Assess 67:588–597, doi:10.1207/s15327752jpa6703_13, pmid:8991972.
    OpenUrlCrossRefPubMed
  3. ↵
    1. Carlson JM,
    2. Foti D,
    3. Mujica-Parodi LR,
    4. Harmon-Jones E,
    5. Hajcak G
    (2011) Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: a combined ERP and fMRI study. Neuroimage 57:1608–1616, doi:10.1016/j.neuroimage.2011.05.037, pmid:21624476.
    OpenUrlCrossRefPubMed
  4. ↵
    1. Chiu PH,
    2. Lohrenz TM,
    3. Montague PR
    (2008) Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task. Nat Neurosci 11:514–520, doi:10.1038/nn2067, pmid:18311134.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Ciccocioppo R,
    2. Sanna PP,
    3. Weiss F
    (2001) Cocaine-predictive stimulus induces drug-seeking behavior and neural activation in limbic brain regions after multiple months of abstinence: reversal by D(1) antagonists. Proc Natl Acad Sci U S A 98:1976–1981, doi:10.1073/pnas.98.4.1976, pmid:11172061.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Cohen JY,
    2. Haesler S,
    3. Vong L,
    4. Lowell BB,
    5. Uchida N
    (2012) Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482:85–88, doi:10.1038/nature10754, pmid:22258508.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Cools R,
    2. Robinson OJ,
    3. Sahakian B
    (2008) Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33:2291–2299, doi:10.1038/sj.npp.1301598, pmid:17940553.
    OpenUrlCrossRefPubMed
  8. ↵
    1. Daw ND,
    2. Kakade S,
    3. Dayan P
    (2002) Opponent interactions between serotonin and dopamine. Neural Netw 15:603–616, doi:10.1016/S0893-6080(02)00052-7, pmid:12371515.
    OpenUrlCrossRefPubMed
  9. ↵
    1. Di Chiara G
    (1998) A motivational learning hypothesis of the role of mesolimbic dopamine in compulsive drug use. J Psychopharmacol 12:54–67, doi:10.1177/026988119801200108, pmid:9584969.
    OpenUrlAbstract/FREE Full Text
  10. ↵
    1. Dunning JP,
    2. Parvaz MA,
    3. Hajcak G,
    4. Maloney T,
    5. Alia-Klein N,
    6. Woicik PA,
    7. Telang F,
    8. Wang GJ,
    9. Volkow ND,
    10. Goldstein RZ
    (2011) Motivated attention to cocaine and emotional cues in abstinent and current cocaine users—an ERP study. Eur J Neurosci 33:1716–1723, doi:10.1111/j.1460-9568.2011.07663.x, pmid:21450043.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Ersche KD,
    2. Roiser JP,
    3. Robbins TW,
    4. Sahakian BJ
    (2008) Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl) 197:421–431, doi:10.1007/s00213-007-1051-1, pmid:18214445.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Euser AS,
    2. van Meel CS,
    3. Snelleman M,
    4. Franken IH
    (2011) Acute effects of alcohol on feedback processing and outcome evaluation during risky decision-making: an ERP study. Psychopharmacology (Berl) 217:111–125, doi:10.1007/s00213-011-2264-x, pmid:21475971.
    OpenUrlCrossRefPubMed
  13. ↵
    1. Euser AS,
    2. Greaves-Lord K,
    3. Crowley MJ,
    4. Evans BE,
    5. Huizink AC,
    6. Franken IH
    (2013) Blunted feedback processing during risky decision making in adolescents with a parental history of substance use disorders. Dev Psychopathol 25:1119–1136, doi:10.1017/S0954579413000412, pmid:24229553.
    OpenUrlCrossRefPubMed
  14. ↵
    1. Everitt BJ,
    2. Robbins TW
    (2005) Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci 8:1481–1489, doi:10.1038/nn1579, pmid:16251991.
    OpenUrlCrossRefPubMed
  15. ↵
    1. Fein G,
    2. Chang M
    (2008) Smaller feedback ERN amplitudes during the BART are associated with a greater family history density of alcohol problems in treatment-naive alcoholics. Drug Alcohol Depend 92:141–148, doi:10.1016/j.drugalcdep.2007.07.017, pmid:17869027.
    OpenUrlCrossRefPubMed
  16. ↵
    1. First MB,
    2. Gibbon M,
    3. Spitzer RL
    (1996) User's guide for the structured clinical interview for Axis I DSM-IV Disorders—Research Version (Biometrics Research, New York).
  17. ↵
    1. Frank MJ,
    2. Claus ED
    (2006) Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113:300–326, doi:10.1037/0033-295X.113.2.300, pmid:16637763.
    OpenUrlCrossRefPubMed
  18. ↵
    1. Franken IH,
    2. Van den Berg I,
    3. Van Strien JW
    (2010) Individual differences in alcohol drinking frequency are associated with electrophysiological responses to unexpected nonrewards. Alcohol Clin Exp Res 34:702–707, doi:10.1111/j.1530-0277.2009.01139.x, pmid:20121719.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Garavan H,
    2. Kaufman JN,
    3. Hester R
    (2008) Acute effects of cocaine on the neurobiology of cognitive control. Philos Trans R Soc Lond B Biol Sci 363:3267–3276, doi:10.1098/rstb.2008.0106, pmid:18640911.
    OpenUrlAbstract/FREE Full Text
  20. ↵
    1. George O,
    2. Mandyam CD,
    3. Wee S,
    4. Koob GF
    (2008) Extended access to cocaine self-administration produces long-lasting prefrontal cortex-dependent working memory impairments. Neuropsychopharmacology 33:2474–2482, doi:10.1038/sj.npp.1301626, pmid:18033234.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Glimcher PW
    (2011) Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A 108(Suppl 3):15647–15654, doi:10.1073/pnas.1014269108, pmid:21389268.
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Goldstein RZ,
    2. Woicik PA,
    3. Maloney T,
    4. Tomasi D,
    5. Alia-Klein N,
    6. Shan J,
    7. Honorio J,
    8. Samaras D,
    9. Wang R,
    10. Telang F,
    11. Wang GJ,
    12. Volkow ND
    (2010) Oral methylphenidate normalizes cingulate activity in cocaine addiction during a salient cognitive task. Proc Natl Acad Sci U S A 107:16667–16672, doi:10.1073/pnas.1011455107, pmid:20823246.
    OpenUrlAbstract/FREE Full Text
  23. ↵
    1. Gossop M,
    2. Griffiths P,
    3. Powis B,
    4. Strang J
    (1992) Severity of dependence and route of administration of heroin, cocaine and amphetamines. Br J Addict 87:1527–1536, doi:10.1111/j.1360-0443.1992.tb02660.x, pmid:1458032.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Gradin VB,
    2. Baldacchino A,
    3. Balfour D,
    4. Matthews K,
    5. Steele JD
    (2014) Abnormal brain activity during a reward and loss task in opiate-dependent patients receiving methadone maintenance therapy. Neuropsychopharmacology 39:885–894, doi:10.1038/npp.2013.289, pmid:24132052.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Hajcak G,
    2. Moser JS,
    3. Holroyd CB,
    4. Simons RF
    (2007) It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology 44:905–912, doi:10.1111/j.1469-8986.2007.00567.x, pmid:17666029.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Hart AS,
    2. Rutledge RB,
    3. Glimcher PW,
    4. Phillips PE
    (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34:698–704, doi:10.1523/JNEUROSCI.2489-13.2014, pmid:24431428.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Hauser TU,
    2. Iannaccone R,
    3. Stämpfli P,
    4. Drechsler R,
    5. Brandeis D,
    6. Walitza S,
    7. Brem S
    (2014) The feedback-related negativity (FRN) revisited: new insights into the localization, meaning and network organization. Neuroimage 84:159–168, doi:10.1016/j.neuroimage.2013.08.028, pmid:23973408.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Hollerman JR,
    2. Schultz W
    (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304–309, doi:10.1038/1124, pmid:10195164.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Holroyd CB,
    2. Nieuwenhuis S,
    3. Yeung N,
    4. Cohen JD
    (2003) Errors in reward prediction are reflected in the event-related brain potential. Neuroreport 14:2481–2484, doi:10.1097/00001756-200312190-00037, pmid:14663214.
    OpenUrlCrossRefPubMed
  30. ↵
    1. Holroyd CB,
    2. Pakzad-Vaezi KL,
    3. Krigolson OE
    (2008) The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology 45:688–697, doi:10.1111/j.1469-8986.2008.00668.x, pmid:18513364.
    OpenUrlCrossRefPubMed
  31. ↵
    1. Hyman SE,
    2. Malenka RC,
    3. Nestler EJ
    (2006) Neural mechanisms of addiction: the role of reward-related learning and memory. Annu Rev Neurosci 29:565–598, doi:10.1146/annurev.neuro.29.051605.113009, pmid:16776597.
    OpenUrlCrossRefPubMed
  32. ↵
    1. Jones SR,
    2. Garris PA,
    3. Wightman RM
    (1995) Different effects of cocaine and nomifensine on dopamine uptake in the caudate-putamen and nucleus accumbens. J Pharmacol Exp Ther 274:396–403, pmid:7616424.
    OpenUrlAbstract/FREE Full Text
  33. ↵
    1. Kampman KM,
    2. Volpicelli JR,
    3. McGinnis DE,
    4. Alterman AI,
    5. Weinrieb RM,
    6. D'Angelo L,
    7. Epperson LE
    (1998) Reliability and validity of the Cocaine Selective Severity Assessment. Addict Behav 23:449–461, doi:10.1016/S0306-4603(98)00011-2, pmid:9698974.
    OpenUrlCrossRefPubMed
  34. ↵
    1. Khantzian EJ
    (1997) The self-medication hypothesis of substance use disorders: a reconsideration and recent applications. Harv Rev Psychiatry 4:231–244, doi:10.3109/10673229709030550, pmid:9385000.
    OpenUrlCrossRefPubMed
  35. ↵
    1. Koob GF,
    2. Le Moal M
    (2001) Drug addiction, dysregulation of reward, and allostasis. Neuropsychopharmacology 24:97–129, doi:10.1016/S0893-133X(00)00195-0, pmid:11120394.
    OpenUrlCrossRefPubMed
  36. ↵
    1. Koob GF,
    2. Sanna PP,
    3. Bloom FE
    (1998) Neuroscience of addiction. Neuron 21:467–476, doi:10.1016/S0896-6273(00)80557-7, pmid:9768834.
    OpenUrlCrossRefPubMed
  37. ↵
    1. Lawson RP,
    2. Seymour B,
    3. Loh E,
    4. Lutti A,
    5. Dolan RJ,
    6. Dayan P,
    7. Weiskopf N,
    8. Roiser JP
    (2014) The habenula encodes negative motivational value associated with primary punishment in humans. Proc Natl Acad Sci U S A 111:11858–11863, doi:10.1073/pnas.1323586111, pmid:25071182.
    OpenUrlAbstract/FREE Full Text
  38. ↵
    1. Lesieur HR,
    2. Blume SB
    (1987) The South Oaks Gambling Screen (SOGS): a new instrument for the identification of pathological gamblers. Am J Psychiatry 144:1184–1188, pmid:3631315.
    OpenUrlCrossRefPubMed
  39. ↵
    1. Liu S,
    2. Heitz RP,
    3. Sampson AR,
    4. Zhang W,
    5. Bradberry CW
    (2008) Evidence of temporal cortical dysfunction in rhesus monkeys following chronic cocaine self-administration. Cereb Cortex 18:2109–2116, doi:10.1093/cercor/bhm236, pmid:18096561.
    OpenUrlAbstract/FREE Full Text
  40. ↵
    1. Liu X,
    2. Powell DK,
    3. Wang H,
    4. Gold BT,
    5. Corbly CR,
    6. Joseph JE
    (2007) Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J Neurosci 27:4587–4597, doi:10.1523/JNEUROSCI.5227-06.2007, pmid:17460071.
    OpenUrlAbstract/FREE Full Text
  41. ↵
    1. Maia TV,
    2. Frank MJ
    (2011) From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci 14:154–162, doi:10.1038/nn.2723, pmid:21270784.
    OpenUrlCrossRefPubMed
  42. ↵
    1. Martinez D,
    2. Greene K,
    3. Broft A,
    4. Kumar D,
    5. Liu F,
    6. Narendran R,
    7. Slifstein M,
    8. Van Heertum R,
    9. Kleber HD
    (2009) Lower level of endogenous dopamine in patients with cocaine dependence: findings from PET imaging of D(2)/D(3) receptors following acute dopamine depletion. Am J Psychiatry 166:1170–1177, doi:10.1176/appi.ajp.2009.08121801, pmid:19723785.
    OpenUrlCrossRefPubMed
  43. ↵
    1. Matsumoto M,
    2. Hikosaka O
    (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447:1111–1115, doi:10.1038/nature05860, pmid:17522629.
    OpenUrlCrossRefPubMed
  44. ↵
    1. Matuskey D,
    2. Bhagwagar Z,
    3. Planeta B,
    4. Pittman B,
    5. Gallezot JD,
    6. Chen J,
    7. Wanyiri J,
    8. Najafzadeh S,
    9. Ropchan J,
    10. Geha P,
    11. Huang Y,
    12. Potenza MN,
    13. Neumeister A,
    14. Carson RE,
    15. Malison RT
    (2014) Reductions in brain 5-HT receptor availability in primarily cocaine-dependent humans. Biol Psychiatry 76:816–822, doi:10.1016/j.biopsych.2013.11.022, pmid:24433854.
    OpenUrlCrossRefPubMed
  45. ↵
    1. McClure SM,
    2. Berns GS,
    3. Montague PR
    (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339–346, doi:10.1016/S0896-6273(03)00154-5, pmid:12718866.
    OpenUrlCrossRefPubMed
  46. ↵
    1. McLellan AT,
    2. Kushner H,
    3. Metzger D,
    4. Peters R,
    5. Smith I,
    6. Grissom G,
    7. Pettinati H,
    8. Argeriou M
    (1992) The Fifth Edition of the Addiction Severity Index. J Subst Abuse Treat 9:199–213, doi:10.1016/0740-5472(92)90062-S, pmid:1334156.
    OpenUrlCrossRefPubMed
  47. ↵
    1. Melis M,
    2. Spiga S,
    3. Diana M
    (2005) The dopamine hypothesis of drug addiction: hypodopaminergic state. Int Rev Neurobiol 63:101–154, doi:10.1016/S0074-7742(05)63005-X, pmid:15797467.
    OpenUrlCrossRefPubMed
  48. ↵
    1. Mirenowicz J,
    2. Schultz W
    (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72:1024–1027, pmid:7983508.
    OpenUrlAbstract/FREE Full Text
  49. ↵
    1. Moeller SJ,
    2. Maloney T,
    3. Parvaz MA,
    4. Alia-Klein N,
    5. Woicik PA,
    6. Telang F,
    7. Wang GJ,
    8. Volkow ND,
    9. Goldstein RZ
    (2010) Impaired insight in cocaine addiction: laboratory evidence and effects on cocaine-seeking behaviour. Brain 133:1484–1493, doi:10.1093/brain/awq066, pmid:20395264.
    OpenUrlAbstract/FREE Full Text
  50. ↵
    1. Moeller SJ,
    2. Parvaz MA,
    3. Shumay E,
    4. Beebe-Wang N,
    5. Konova AB,
    6. Alia-Klein N,
    7. Volkow ND,
    8. Goldstein RZ
    (2013) Gene × abstinence effects on drug cue reactivity in addiction: multimodal evidence. J Neurosci 33:10027–10036, doi:10.1523/JNEUROSCI.0695-13.2013, pmid:23761898.
    OpenUrlAbstract/FREE Full Text
  51. ↵
    1. Montague PR,
    2. Hyman SE,
    3. Cohen JD
    (2004) Computational roles for dopamine in behavioural control. Nature 431:760–767, doi:10.1038/nature03015, pmid:15483596.
    OpenUrlCrossRefPubMed
  52. ↵
    1. Muñoz MÁ,
    2. Anllo-Vento L,
    3. del Carmen Fernández M,
    4. Montoya P,
    5. Vila J
    (2012) Modulation of the outcome-related negativity associated with nicotine abstinence. Exp Clin Psychopharmacol 20:151–160, doi:10.1037/a0025991, pmid:22023669.
    OpenUrlCrossRefPubMed
  53. ↵
    1. Nieuwenhuis S,
    2. Holroyd CB,
    3. Mol N,
    4. Coles MG
    (2004a) Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci Biobehav Rev 28:441–448, doi:10.1016/j.neubiorev.2004.05.003, pmid:15289008.
    OpenUrlCrossRefPubMed
  54. ↵
    1. Nieuwenhuis S,
    2. Yeung N,
    3. Holroyd CB,
    4. Schurger A,
    5. Cohen JD
    (2004b) Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cereb Cortex 14:741–747, doi:10.1093/cercor/bhh034, pmid:15054053.
    OpenUrlAbstract/FREE Full Text
  55. ↵
    1. Nolte G,
    2. Hämäläinen MS
    (2001) Partial signal space projection for artefact removal in MEG measurements: a theoretical analysis. Phys Med Biol 46:2873–2887, doi:10.1088/0031-9155/46/11/308, pmid:11720352.
    OpenUrlCrossRefPubMed
  56. ↵
    1. Oliveira FT,
    2. McDonald JJ,
    3. Goodman D
    (2007) Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action–outcome associations. J Cogn Neurosci 19:1994–2004, doi:10.1162/jocn.2007.19.12.1994, pmid:17892382.
    OpenUrlCrossRefPubMed
  57. ↵
    1. Park SQ,
    2. Kahnt T,
    3. Beck A,
    4. Cohen MX,
    5. Dolan RJ,
    6. Wrase J,
    7. Heinz A
    (2010) Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence. J Neurosci 30:7749–7753, doi:10.1523/JNEUROSCI.5587-09.2010, pmid:20519550.
    OpenUrlAbstract/FREE Full Text
  58. ↵
    1. Parvaz MA,
    2. Maloney T,
    3. Moeller SJ,
    4. Woicik PA,
    5. Alia-Klein N,
    6. Telang F,
    7. Wang GJ,
    8. Squires NK,
    9. Volkow ND,
    10. Goldstein RZ
    (2012) Sensitivity to monetary reward is most severely compromised in recently abstaining cocaine addicted individuals: a cross-sectional ERP study. Psychiatry Res 203:75–82, doi:10.1016/j.pscychresns.2012.01.001, pmid:22841343.
    OpenUrlCrossRefPubMed
  59. ↵
    1. Pfabigan DM,
    2. Alexopoulos J,
    3. Bauer H,
    4. Sailer U
    (2011) Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event-related brain potentials. Psychophysiology 48:656–664, doi:10.1111/j.1469-8986.2010.01136.x, pmid:21039585.
    OpenUrlCrossRefPubMed
  60. ↵
    1. Porter JN,
    2. Olsen AS,
    3. Gurnsey K,
    4. Dugan BP,
    5. Jedema HP,
    6. Bradberry CW
    (2011) Chronic cocaine self-administration in rhesus monkeys: impact on associative learning, cognitive control, and working memory. J Neurosci 31:4926–4934, doi:10.1523/JNEUROSCI.5426-10.2011, pmid:21451031.
    OpenUrlAbstract/FREE Full Text
  61. ↵
    1. Reynolds JN,
    2. Hyland BI,
    3. Wickens JR
    (2001) A cellular mechanism of reward-related learning. Nature 413:67–70, doi:10.1038/35092560, pmid:11544526.
    OpenUrlCrossRefPubMed
  62. ↵
    1. Rice ME,
    2. Cragg SJ
    (2004) Nicotine amplifies reward-related dopamine signals in striatum. Nat Neurosci 7:583–584, doi:10.1038/nn1244, pmid:15146188.
    OpenUrlCrossRefPubMed
  63. ↵
    1. Rose EJ,
    2. Ross TJ,
    3. Salmeron BJ,
    4. Lee M,
    5. Shakleya DM,
    6. Huestis M,
    7. Stein EA
    (2012) Chronic exposure to nicotine is associated with reduced reward-related activity in the striatum but not the midbrain. Biol Psychiatry 71:206–213, doi:10.1016/j.biopsych.2011.09.013, pmid:22032832.
    OpenUrlCrossRefPubMed
  64. ↵
    1. Rose EJ,
    2. Salmeron BJ,
    3. Ross TJ,
    4. Waltz J,
    5. Schweitzer JB,
    6. McClure SM,
    7. Stein EA
    (2014) Temporal difference error prediction signal dysregulation in cocaine dependence. Neuropsychopharmacology 39:1732–1742, doi:10.1038/npp.2014.21, pmid:24569319.
    OpenUrlCrossRefPubMed
  65. ↵
    1. Schoenbaum G,
    2. Saddoris MP,
    3. Ramus SJ,
    4. Shaham Y,
    5. Setlow B
    (2004) Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions. Eur J Neurosci 19:1997–2002, doi:10.1111/j.1460-9568.2004.03274.x, pmid:15078575.
    OpenUrlCrossRefPubMed
  66. ↵
    1. Schultz W
    (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1–27, pmid:9658025.
    OpenUrlAbstract/FREE Full Text
  67. ↵
    1. Schultz W
    (2011) Potential vulnerabilities of neuronal reward, risk, and decision mechanisms to addictive drugs. Neuron 69:603–617, doi:10.1016/j.neuron.2011.02.014, pmid:21338874.
    OpenUrlCrossRefPubMed
  68. ↵
    1. Schultz W,
    2. Romo R
    (1992) Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum. Exp Brain Res 91:363–384, pmid:1483512.
    OpenUrlPubMed
  69. ↵
    1. Stern WC,
    2. Johnson A,
    3. Bronzino JD,
    4. Morgane PJ
    (1981) Neuropharmacology of the afferent projections from the lateral habenula and substantia nigra to the anterior raphe in the rat. Neuropharmacology 20:979–989, doi:10.1016/0028-3908(81)90029-0, pmid:7301056.
    OpenUrlCrossRefPubMed
  70. ↵
    1. Talmi D,
    2. Atkinson R,
    3. El-Deredy W
    (2013) The feedback-related negativity signals salience prediction errors, not reward prediction errors. J Neurosci 33:8264–8269, doi:10.1523/JNEUROSCI.5695-12.2013, pmid:23658166.
    OpenUrlAbstract/FREE Full Text
  71. ↵
    1. Tanabe J,
    2. Reynolds J,
    3. Krmpotich T,
    4. Claus E,
    5. Thompson LL,
    6. Du YP,
    7. Banich MT
    (2013) Reduced neural tracking of prediction error in substance-dependent individuals. Am J Psychiatry 170:1356–1363, doi:10.1176/appi.ajp.2013.12091257, pmid:23897123.
    OpenUrlCrossRefPubMed
  72. ↵
    1. Tiffany ST,
    2. Singleton E,
    3. Haertzen CA,
    4. Henningfield JE
    (1993) The development of a cocaine craving questionnaire. Drug Alcohol Depend 34:19–28, doi:10.1016/0376-8716(93)90042-O, pmid:8174499.
    OpenUrlCrossRefPubMed
  73. ↵
    1. Tomasi D,
    2. Goldstein RZ,
    3. Telang F,
    4. Maloney T,
    5. Alia-Klein N,
    6. Caparelli EC,
    7. Volkow ND
    (2007) Widespread disruption in brain activation patterns to a working memory task during cocaine abstinence. Brain Res 1171:83–92, doi:10.1016/j.brainres.2007.06.102, pmid:17765877.
    OpenUrlCrossRefPubMed
  74. ↵
    1. Tran-Nguyen LT,
    2. Fuchs RA,
    3. Coffey GP,
    4. Baker DA,
    5. O'Dell LE,
    6. Neisewander JL
    (1998) Time-dependent changes in cocaine-seeking behavior and extracellular dopamine levels in the amygdala during cocaine withdrawal. Neuropsychopharmacology 19:48–59, doi:10.1016/S0893-133X(97)00205-4, pmid:9608576.
    OpenUrlCrossRefPubMed
  75. ↵
    1. Velasquez KM,
    2. Molfese DL,
    3. Salas R
    (2014) The role of the habenula in drug addiction. Front Hum Neurosci 8:174, doi:10.3389/fnhum.2014.00174, pmid:24734015.
    OpenUrlCrossRefPubMed
  76. ↵
    1. Volkow ND,
    2. Wang GJ,
    3. Fowler JS,
    4. Logan J,
    5. Gatley SJ,
    6. Hitzemann R,
    7. Chen AD,
    8. Dewey SL,
    9. Pappas N
    (1997) Decreased striatal dopaminergic responsiveness in detoxified cocaine-dependent subjects. Nature 386:830–833, doi:10.1038/386830a0, pmid:9126741.
    OpenUrlCrossRefPubMed
  77. ↵
    1. Wager TD,
    2. Keller MC,
    3. Lacey SC,
    4. Jonides J
    (2005) Increased sensitivity in neuroimaging analyses using robust regression. Neuroimage 26:99–113, doi:10.1016/j.neuroimage.2005.01.011, pmid:15862210.
    OpenUrlCrossRefPubMed
  78. ↵
    1. Watanabe M
    (1996) Reward expectancy in primate prefrontal neurons. Nature 382:629–632, doi:10.1038/382629a0, pmid:8757133.
    OpenUrlCrossRefPubMed
  79. ↵
    1. Woicik PA,
    2. Moeller SJ,
    3. Alia-Klein N,
    4. Maloney T,
    5. Lukasik TM,
    6. Yeliosof O,
    7. Wang GJ,
    8. Volkow ND,
    9. Goldstein RZ
    (2009) The neuropsychology of cocaine addiction: recent cocaine use masks impairment. Neuropsychopharmacology 34:1112–1122, doi:10.1038/npp.2008.60, pmid:18496524.
    OpenUrlCrossRefPubMed
  80. ↵
    1. Wu Y,
    2. Zhou X
    (2009) The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res 1286:114–122, doi:10.1016/j.brainres.2009.06.032, pmid:19539614.
    OpenUrlCrossRefPubMed
Back to top

In this issue

Email
Print
View Full Page PDF
Citation Tools
Respond to this article
Impaired Neural Response to Negative Prediction Errors in Cocaine Addiction
Muhammad A. Parvaz, Anna B. Konova, Greg H. Proudfit, Jonathan P. Dunning, Pias Malaker, Scott J. Moeller, Tom Maloney, Nelly Alia-Klein, Rita Z. Goldstein
Journal of Neuroscience 4 February 2015, 35 (5) 1872-1879; DOI: 10.1523/JNEUROSCI.2777-14.2015
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo

Jump to section

Keywords

Responses to this article

Respond to this article

Jump to comment:

  • Published on: (29 July 2015)
    Re:Impaired RPE signaling in substance dependence: comment on Parvaz et al.
    • Muhammad A. Parvaz, Assistant Professor
    • Other Contributors:
      • Scott J. Moeller, Rita Z. Goldstein

    We thank Drs. Baker and Holroyd for their thoughtful comment on our manuscript, titled "Impaired Neural Response to Negative Prediction Errors in Cocaine Addiction," published in the Journal of Neuroscience. Here, we take the opportunity to respond to their comment with the hope that it contributes to a useful scientific discussion.

    First, the commenters stated that our claim of using the feedback- related negati...

    Show More
    Competing Interests: None declared.
  • Published on: (25 June 2015)
    Impaired RPE signaling in substance dependence: comment on Parvaz et al.
    • Travis Baker, Canadian Institute of Health Research Post-doctoral Fellow
    • Other Contributors:
      • Clay B. Holroyd, PhD. Professor of Psychology and Canada Research Chair Department of Psychology University of Victoria

    The recent article by Parvaz et al. utilized a component of the event -related brain potential (ERP) called the feedback error-related negativity (FN) to investigate the neural mechanisms of substance dependence. As stated therein, their central hypothesis was to "leverage feedback error related negativity (FN) to index reward prediction error signals (RPE) in addiction", which they claimed had yet to be done: "Previous...

    Show More
    Competing Interests: None declared.