Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE
PreviousNext
Brief Communications

The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors

Deborah Talmi, Ryan Atkinson and Wael El-Deredy
Journal of Neuroscience 8 May 2013, 33 (19) 8264-8269; https://doi.org/10.1523/JNEUROSCI.5695-12.2013
Deborah Talmi
School of Psychological Sciences, University of Manchester, Manchester, M13 9PL, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ryan Atkinson
School of Psychological Sciences, University of Manchester, Manchester, M13 9PL, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wael El-Deredy
School of Psychological Sciences, University of Manchester, Manchester, M13 9PL, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

Modulations of the feedback-related negativity (FRN) event-related potential (ERP) have been suggested as a potential biomarker in psychopathology. A dominant theory about this signal contends that it reflects the operation of the neural system underlying reinforcement learning in humans. The theory suggests that this frontocentral negative deflection in the ERP 230–270 ms after the delivery of a probabilistic reward expresses a prediction error signal derived from midbrain dopaminergic projections to the anterior cingulate cortex. We tested this theory by investigating whether FRN will also be observed for an inherently aversive outcome: physical pain. In another session, the outcome was monetary reward instead of pain. As predicted, unexpected reward omissions (a negative reward prediction error) yielded a more negative deflection relative to unexpected reward delivery. Surprisingly, unexpected pain omission (a positive reward prediction error) also yielded a negative deflection relative to unexpected pain delivery. Our data challenge the theory by showing that the FRN expresses aversive prediction errors with the same sign as reward prediction errors. Both FRNs were spatiotemporally and functionally equivalent. We suggest that FRN expresses salience prediction errors rather than reward prediction errors.

Introduction

When a reward deviates from the one that was expected, dopaminergic neurons produce an error signal (prediction error) proportional to the magnitude of the deviation, eventually leading to learning or extinction (Schultz, 2007). Prediction error signals are expressed in the midbrain in which dopaminergic neurons increase their phasic firing rate for unexpected reward (a positive prediction error) and pause when reward is unexpectedly omitted (a negative prediction error). A dominant theory, reinforcement-learning error-related negativity (RL-ERN; Holroyd and Coles, 2002), contends that the event-related potential (ERP) feedback-related negativity (FRN), 230–270 ms after feedback is received (Nieuwenhuis et al., 2004), reflects the operation of the neural system underlying reinforcement learning in humans. RL-ERN claims that the FRN expresses a reward prediction error signal derived from dopaminergic projections to the anterior cingulate cortex (ACC), as confirmed recently by a review of source-localization studies (Walsh and Anderson, 2012). Specifically, decreases in phasic dopamine firing are thought to disinhibit while increases inhibit ACC neurons, resulting in a more negative or positive signal, respectively. FRN, the difference wave computed by subtracting positive from negative outcomes, is thought to guide optimal decision making on a trial-by-trial basis (Cohen and Ranganath, 2005) and changes with personality, age, and psychopathology (Cohen et al., 2011).

RL-ERN has typically been tested in situations in which reward attainment is feasible. An exception is an investigation of loss avoidance (Holroyd et al., 2004) which supported RL-ERN. We tested this theory by investigating whether FRN will be observed for an inherently aversive outcome: physical pain. In our experiment, participants experienced blocks in which an aversive outcome (pain) was delivered or omitted and separate blocks in which a rewarding outcome (money) was delivered or omitted. RL-FRN should predict that the usual FRN will be obtained in our aversion blocks, with unexpected pain omission coded similarly to unexpected reward delivery (positive prediction error) and unexpected pain delivery coded similarly to unexpected reward omission (negative prediction error).

At the time when RL-ERN was developed, neural recording data supported a primary role for phasic dopaminergic firing in coding prediction errors associated with motivational value, consistent with the computational reward prediction error signal (Mirenowicz and Schultz, 1996; Ungless, 2004). It is now recognized that this response of dopamine neurons is more diverse (Bromberg-Martin et al., 2010; Ungless et al., 2010). Phasic increase in firing in different populations of dopamine neurons may code unexpected reward, unexpected aversion (Joshua et al., 2008; Anstrom et al., 2009; Lammel et al., 2011), or both rewarding and aversive events (Matsumoto and Hikosaka, 2009; Lammel et al., 2011). The latter population is thought to code motivational salience (Bromberg-Martin et al., 2010). Given these recent findings, it is possible that FRN codes prediction errors associated with motivational salience rather than motivational value. A prominent hypothesis is that ERPs are typically more negative for losses than rewards because losses are more motivationally salient (Oliveira et al., 2007). In which case, and given our design where rewarding and aversive outcomes were presented separately, FRN should reverse in our aversion block, with unexpected pain delivery coded similarly to unexpected reward delivery, and both more positive than unexpected pain and reward omission. This is exactly the pattern we obtained, presenting an important challenge for RL-ERN.

Materials and Methods

Participants

Twenty undergraduate students aged 18–35 (12 females) received course credits and won £10 in the reward condition of the study. Participants had no history of neurological, neuropsychological, psychiatric, or chronic pain conditions, were not taking centrally acting medications, and had normal or corrected-to-normal vision. The study was approved by the University of Manchester ethics committee.

Procedure

On arrival, a transcutaneous electrical nerve stimulator that delivered electrical pulses (2 ms in duration) was fitted on the participants' left index finger. Participants incrementally increased the pulse current level to establish a subjective “low” (just painful) and “high” (but tolerable) pain intensity levels. It was explained to participants that “low” corresponded to a score of 4 and “high” to 7 on a 1- to 10-point scale, where 1 indicated non-painful and 10 intolerably painful stimulation.

The study used a 2 (type: reward/pain) × 2 (expectancy: unexpected/expected) × 2 (magnitude: high/low) × 2 (outcome: delivered/omitted) within-subjects design. Expectancy was manipulated by varying outcome probability, which was either 0.25 or 0.75, corresponding to unexpected and expected outcomes (Fig. 1). The task comprised four reward blocks and four aversion blocks, each with 120 trials; each cell in the design included 60 trials. Block order was counterbalanced between participants. Trial order was randomized for each participant.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Design and paradigm. The boldface rows in the table indicate which conditions are illustrated in the timeline diagrams.

Each trial began with a fixation cue (625 ± 125 ms) followed by a chance cue (1000 ms) that indicated the type, probability, and magnitude of the outcome that may follow (Fig. 1). The chance cue was a pie chart that signaled outcome magnitude by one of two colors (blue for high and green for low, counterbalanced across participants), outcome probability by the colored portion of the chart, and outcome type by a picture of a coin or a flash. In the reward condition, outcome magnitude was also signaled by the coin, a 1- or 50-pence piece. All chance cues had the same luminance. A truth cue (750 ms) was presented at the offset of the chance cue, indicating with 100% contingency whether the outcome was to be delivered (the entire chart was colored) or omitted (none of the chart colored). All truth cues had the same luminance. Outcomes were presented at the offset of the truth cue. Aversive outcomes were presented as an electric stimulation of the hand. Rewards were presented visually (an image of the relevant coin, 100 ms). Participants were informed that, at the end of each block, they will receive rewards in the form of tokens, which will be traded for money once all data were collected, but were not told what the exchange rate would be. For ethical reasons, all participants received the same amount of money (£10). To maintain concentration, participants were asked at the end of each block if outcome delivery corresponded to the probabilities signaled by the anticipation cue.

EEG recording

Continuous EEG was recorded from 32 Ag/AgCl scalp electrodes placed according to the 10–20 system (Synamps; Neuroscan) fitted on an elasticated cap (EASYCAP) and referenced to the vertex electrode Cz with FPz as the ground. Bandpass filters were set at 0.1–100 Hz, with a sampling rate of 500 Hz and gain of 500. Impedances were kept at 5 KΩ or less. The experiment was conducted in a quiet, dimmed room.

EEG data analyses

Preprocessing.

Data analysis focused on the signal associated with the truth cue. Data were analyzed using SPM8 (Litvak et al., 2011). The electrophysiological signals were re-referenced to the mean of all electrodes, downsampled to 125 Hz, and filtered with a fifth-order Butterworth filter between 0.5 and 20 Hz. ERPs were computed for the epoch 100 ms before truth cue onset until 500 ms later. Artifact rejection proceeded in three steps. First, trials with flat segments were rejected, as were trials in which signal in posterior electrodes exceeded a lenient threshold of 110 μV. Second, eyeblink confounds were corrected by a signal space projection method (Nolte and Hämäläinen, 2001) implemented in MEEGTools toolbox distributed with SPM8. Artifact subspace was defined per session by principal component analysis of session-averaged data epoched around eyeblinks, using one principal component. Third, trials in which signal in any of the electrodes exceeded 80 μV were rejected. On average, 7% of trials were removed across participants and conditions, and electrodes were rejected when the proportion of rejected trials exceeded 15%. Single-trial ERPs were averaged separately for each of the 16 conditions using the “robust averaging” method in SPM8 (Litvak et al., 2010). This method considers the distribution of values over trials for each channel and time point, and the outliers are down-weighted when computing the average. This makes it possible to neutralize artifacts restricted to narrow time ranges without rejecting whole trials. Moreover, a clean average can be computed with no clean trials, given that the artifacts do not consistently overlap and only corrupt different parts of trials. Averages were then filtered between 0.1 and 20 Hz to remove high frequencies introduced by the robust averaging method. For each subject and condition, a three-dimensional channel space by time was created by projecting, for each sample point, the electrode locations onto a plane following a linear interpolation to a 64 × 64 pixel grid (pixel size, 2.13 × 2.69 mm). The resulting images were smoothed using a Gaussian kernel full-width at half-maximum of 8 mm/ms.

Statistical analyses.

These images were masked temporally between 100 and 350 ms after truth cue onset and entered into two three-way ANOVA models with the factors expectancy, magnitude, and outcome. Because our manipulations of reward and aversion were so different from each other (see Discussion), we used separate models for the reward and the aversion conditions and never compared them statistically.

The FRN is defined as the difference between outcome delivery and omissions, here operationalized as the onset of the truth cue. Therefore, we first examined which regions expressed the main effect of outcome. For this purpose, we used a t test, with a statistical threshold of familywise errors (FWE) <0.05 and a cluster size threshold exceeding an extent of 100 mm/ms. The FRN is also known to be sensitive to outcome expectancy, so that in our experiment the difference between the delivered and omitted outcomes should be greater for outcomes that are expected 25% of the time relative to those expected 75% of the time. Thus, the FRN can be further defined as signal that is sensitive not only to the main effect of outcome but also to the interaction between outcome and expectancy. To extract such signal, we used a t test to examine the interaction contrast but searched only within the limited set of spatiotemporal regions that expressed the orthogonal main effect of outcome (FEW <0.05). We did not want to impose the FWE criterion twice, to avoid false negatives. To ensure that the results reported for the interaction contrast were robust, we conducted a Monte Carlo simulation (Song et al., 2011) that showed that a cluster extent of 100 mm/ms, in combination with an uncorrected p < 0.001, corresponds to FWE < 0.001. The Monte Carlo simulation formalizes the theory that 100 contiguous voxels are more likely to reflect true activation than one significant voxel.

Results

The main effect of outcome yielded large frontocentral cluster in both reward (x = −13, y = 10; peak FWE <0.001; extent, 2559 pixels) and pain (x = −9, y = −3; peak FWE <0.001; extent, 10,003 pixels) conditions. The reward cluster extended 205–250 ms after the truth cue, and the pain cluster extended 194–289 ms after the truth cue. The topographies that corresponded to the main effect of outcome (omitted outcomes > delivered outcomes) in the reward and the aversion conditions resembled each other in exhibiting marked central–frontal negativity (Fig. 2A,B). To determine the peaks of the corresponding waveforms, we extracted time courses from cluster maxima and computed the FRN by subtracting all outcomes with positive value (reward delivery, aversion omission) from all outcomes with negative value (reward omission, aversion delivery; Fig. 2C). We observed an FRN in the reward condition, as hypothesized and previously demonstrated, but a positivity in the aversion condition. The morphologies of the FRN were similar in both conditions. The reward FRN peaked 236 ms after the truth cue. The pain “FRN: positivity peaked 246 ms after the truth cue.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

The main effect of outcome showing the reward FRN and its reversal in the aversion condition. The topographies correspond to the main effect of outcome (omitted outcomes > delivered outcomes) 240 ms after the truth cue in the reward (A) and the aversion (B) conditions. Time courses (C) were extracted from the cluster maxima for this contrast in SPM (224 ms in the reward condition, 232 ms in the aversion condition). Difference waves, time locked to the truth cue, were computed following the FRN literature by subtracting outcomes with positive value (reward delivery, aversion omission) from outcomes with negative value (reward omission, aversion delivery). An FRN was obtained in the reward condition (black) and a positivity in the aversion condition (dashed). The morphologies of the difference waves that correspond to the main effect of outcome in the reward (black; same as the FRN computation) and aversion (gray) conditions bear striking resemblance to each other.

The interaction between outcome and expectancy, masked inclusively by the main effect of outcome, yielded a single cluster at frontocentral scalp region in the reward condition that extended 205–225 ms after the truth cue (x = −10, y = 18; peak FWE <0.06; extent, 318 pixels) and a single cluster in a similar location in the aversion condition that extended 260- 290 ms after the truth cue (x = 0, y = 13; peak FWE <0.05; extent, 695 pixels). Parameter estimate plots extracted from the maxima of each cluster show that both clusters expressed the difference between delivered and omitted outcomes and that this difference was greater for unexpected outcomes (Fig. 3). A similar pattern was obtained when data were extracted from electrode Fz (see Notes), which was used to measure the FRN in previous studies (Cohen et al., 2007).

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

The interaction of outcome and expectancy in the reward and aversion conditions. Parameter estimates were extracted from cluster maxima (208 ms in the reward condition, 288 ms in the aversion condition) for all eight conditions in the design: expectancy (unexpected/expected) × magnitude (high/low) × 2 outcome (delivered/omitted), separately for the reward (left) and the aversion (right) conditions. Insets, Statistical parametric maps overlaid over the glass brain showing where the interaction of outcome and expectancy (masked by the main effect of outcome) was maximally significant. Error bars represent SEs.

Figure 3 suggested that the interaction was larger for high-magnitude outcomes regardless of motivational value. For both reward and aversion, we analyzed the outcome × expectancy interaction in two separate models, when the outcome magnitude was high or low. Only the high-magnitude data yielded significant effects: central–frontal clusters with maxima that resembled the clusters reported above (reward, 208 ms; aversion, 288 ms). We compared the interaction regressors by extracting the value of the interaction contrast from the same spatiotemporal locations using a mask from the significant clusters in high-magnitude outcomes. There was no significant difference between high and low magnitude (reward, t(38) = 1.03, p > 0.3; aversion, t(38) = 1.05, p > 0.29).

For completion, Figure 4 shows that the waveforms for delivered and omitted outcomes, as well as for the difference between them, had a similar morphology in the reward and aversion conditions during the FRN time window. A similar pattern was obtained when the reward and aversion analyses were both restricted to data from electrode Fz (see Notes), which was used to measure the FRN in previous studies (Cohen et al., 2007).

Figure 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 4.

Time courses in the reward (top) and aversion (bottom) conditions, time locked to the truth cue, separately for high- and low-magnitude outcomes that were expected (75% likely) or unexpected (25% likely). Left, Delivered outcomes; middle, omitted outcomes; right, the difference wave (omitted − delivered outcomes). The waveform morphologies in the reward and aversion condition bear striking resemblance to each other.

Finally, we analyzed the signal that was time locked to the chance cues using the same methodology. Although it would be somewhat challenging to compute the prediction error at that time point, we argue that the prediction error would be larger when the cue signals high- than low-magnitude outcomes. In line with the hypothesis that the FRN expresses salience, rather than reward, prediction errors, the signal we observed within the time window of the FRN in electrode Fz was more negative for high- than low-magnitude outcomes regardless of their valence (see Notes).

Discussion

Both reward and aversion conditions yielded frontal–central clusters that expressed both the main effect of outcome—the difference between delivered and omitted outcomes—and the interaction of outcome and expectancy. The main effect of outcome yielded clusters with similar location and maxima in the reward and the aversion condition. The interaction also yielded clusters with similar location and parameter estimates in the reward and aversion condition, but it was expressed earlier in the reward than in the aversion condition. In both reward and aversion conditions, the interaction stemmed from a smaller difference between delivered and omitted outcomes when outcomes were expected, relative to when they were unexpected. Parameter estimates were larger for unexpected delivered outcomes relative to unexpected omitted outcomes, whereas expected outcomes—either delivered or omitted—were expressed in middling values.

Contrary to the findings of Holroyd et al. (2004), the time courses show that the ERPs we obtained were more positive for delivered outcomes than omitted outcomes in both reward and aversion conditions. The waveform morphologies were strikingly similar in the reward and aversion conditions. Therefore, our data agree with the prediction of RL-ERN that FRN will be obtained in the reward condition but refute its prediction that FRN will be obtained in the aversion condition. Instead, when we computed the FRN according to the literature—by subtracting outcomes with positive value (reward delivery, aversion omission) from outcomes with negative value (reward omission, aversion delivery)—we obtained a “reverse” FRN (a positivity) in the aversion condition.

A computational model of salience suggests that a signal for certain reward is more salient than a signal for certain nonreward (Esber and Haselgrove, 2011). This implies that the truth cue that signaled outcome delivery was more salient than the one that signaled outcome omission. A parsimonious account of our results is that the ERPs we observed express salience prediction errors as a positivity. This claim can only be validated if it could be demonstrated that the signals share the same generator. This would extend RL-ERN, reflecting an updating of the theory given recent evidence for a diversity in what dopaminergic neurons code for (Bromberg-Martin et al., 2010). Of note, our data suggest that salience prediction errors occur even in the absence of explicit opportunity for action.

The present data extend our previous results (Talmi et al., 2012), in which the separate examination of signal associated with wins and losses challenged the interpretation of the FRN as a neural marker of reward prediction errors. Our data agrees with previous fMRI data (Metereau and Dreher, 2013) that showed that both the ACC and the striatum (both targets of dopaminergic projections, which according to RL-ERN cause the FRN) code salience rather than reward prediction errors and supports the suggestion that the medial prefrontal cortex codes discrepancies between expected and unexpected outcomes regardless of their valence (Alexander and Brown, 2011). However, because we did not analyze the generators, we cannot ascertain that the scalp signals we report originate from the same neural source.

The hypothesis that the FRN codes salience, rather than reward, prediction errors is not new. For example, Oliveira et al. (2007) asked participants to evaluate their own response as either correct or incorrect and then gave them real feedback on their performance. The FRN was obtained whenever the feedback was surprising, regardless of its motivational value, namely for both unexpected “correct” or “incorrect” feedback. Unfortunately, the absence of neutral outcomes makes it difficult to ascertain that participants in that study perceived their errors as more salient than their correct evaluations. Therefore, it was possible that the signal Oliveira et al. (2007) observed merely reflected the deviation of the outcomes from expectation rather than a salience prediction error, defined as a response to unexpected, motivationally salient events. Our results extend those of Oliviera et al. and support their conclusions.

A recent review supported RL-ERN and rejected the hypothesis that the FRN expresses motivational salience (Walsh and Anderson, 2012). In response, we note that they appear to confuse the salience of an outcome with its likelihood. For example, they discuss the observation of Holroyd and Krigolson (2007) that ERPs for errors were more negative than ERPs for correct responses even in “hard” blocks, when errors were more frequent. In our opinion, this does not contradict the salience hypothesis of the FRN if we assume that errors are more salient than correct responses even when the former are more frequent. Future research should seek to corroborate independently which outcomes are more salient.

In our experiment, participants were exposed to blocks in which an aversive outcome was delivered or omitted and to separate blocks in which a rewarding outcome was delivered or omitted. This is different from typical paradigms in studies of RL-ERN, in which positive outcomes are always a possibility. For example, participants may be asked to choose between stimuli that are associated with either rewards or punishments (Cohen et al., 2007), presented with a gamble in which they may win or lose (Talmi et al., 2012), or given positive or negative feedback on task performance (Holroyd and Krigolson, 2007; Oliveira et al., 2007). Separating the reward and aversion blocks in the present study renders the omission of pain in the aversion blocks the best possible outcome, therefore maximizing our chance to observe FRN for purely aversive outcomes. In line with Konorski's opponent model (Konorski, 1987), in the aversion blocks, participants should perceive pain omission as a positive outcome and its delivery as a negative outcome. Had pain omission trials been mixed with reward delivery trials, both pain delivery and omission may have been coded as negative outcomes.

A weakness of our design is that the reward and aversion conditions differed in two important ways in addition to their motivational value: (1) the nature of the outcomes themselves, a primary reinforcer in the aversion condition and a secondary reinforcer in the reward condition; and (2) the timing of their delivery, immediately after the truth cue (aversion) or after a prolonged delay (reward). For this reason, we never compare the reward and aversion condition statistically or make claims related to their differential strengths or latency, although we speculate that these differences account for the more robust signal in the aversion condition. Our main finding, that the FRN “reverses” when the outcome is aversive, stands even without such a comparison.

Modulation of the FRN has been suggested as potential biomarker in psychopathology (Olvet and Hajcak, 2008) and individual differences (Sosic-Vasic et al., 2012). For example, although feedback processing is relatively intact in schizophrenia, the representation of value is impaired (Morris et al., 2011). Further, Mason et al. (2012) have reported reduced FRN in a hypomania-prone group, suggesting positive evaluation bias and impaired reinforcement learning. Reaching a clearer understanding of the functional significance of reinforcement learning error-related signals is crucial if their modulation were to be interpreted as biomarkers or risk indicators. Our results suggest that FRN may serve to optimize not only decisions about reward but also decisions about punishment, which may help explain why it is altered in psychopathology.

Notes

Supplemental material for this article is available at www.psych-sci.manchester.ac.uk/staff/talmi/. This material has not been peer reviewed.

Footnotes

  • The study was partially funded by an Economic and Social Research Council First Grant (D.T.) We thank K. Birchall and H. Balmforth for help with data collection and R. Mars and L. Fuentemilla for their helpful comments.

  • Correspondence should be addressed to Deborah Talmi, School of Psychological Sciences, University of Manchester, Oxford Road, Manchester,M13 9PL, UK. Deborah.Talmi{at}manchester.ac.uk

References

  1. ↵
    1. Alexander WH,
    2. Brown JW
    (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14:1338–1344, doi:10.1038/nn.2921, pmid:21926982.
    OpenUrlCrossRefPubMed
  2. ↵
    1. Anstrom KK,
    2. Miczek KA,
    3. Budygin EA
    (2009) Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 161:3–12, doi:10.1016/j.neuroscience.2009.03.023, pmid:19298844.
    OpenUrlCrossRefPubMed
  3. ↵
    1. Bromberg-Martin ES,
    2. Matsumoto M,
    3. Hikosaka O
    (2010) Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68:815–834, doi:10.1016/j.neuron.2010.11.022, pmid:21144997.
    OpenUrlCrossRefPubMed
  4. ↵
    1. Cohen MX,
    2. Ranganath C
    (2005) Behavioral and neural predictors of upcoming decisions. Cogn Affect Behav Neurosci 5:117–126, doi:10.3758/CABN.5.2.117, pmid:16180619.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Cohen MX,
    2. Elger CE,
    3. Ranganath C
    (2007) Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35:968–978, doi:10.1016/j.neuroimage.2006.11.056, pmid:17257860.
    OpenUrlCrossRefPubMed
  6. ↵
    1. Cohen MX,
    2. Wilmes K,
    3. Vijver IV
    (2011) Cortical electrophysiological network dynamics of feedback learning. Trends Cogn Sci 15:558–566, doi:10.1016/j.tics.2011.10.004, pmid:22078930.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Esber GR,
    2. Haselgrove M
    (2011) Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning. Proc Biol Sci 278:2553–2561, doi:10.1098/rspb.2011.0836, pmid:21653585.
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. Holroyd CB,
    2. Coles MG
    (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109:679–709, doi:10.1037/0033-295X.109.4.679, pmid:12374324.
    OpenUrlCrossRefPubMed
  9. ↵
    1. Holroyd CB,
    2. Krigolson OE
    (2007) Reward prediction error signals associated with a modified time estimation task. Psychophysiology 44:913–917, doi:10.1111/j.1469-8986.2007.00561.x, pmid:17640267.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Holroyd CB,
    2. Larsen JT,
    3. Cohen JD
    (2004) Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology 41:245–253, doi:10.1111/j.1469-8986.2004.00152.x, pmid:15032989.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Joshua M,
    2. Adler A,
    3. Mitelman R,
    4. Vaadia E,
    5. Bergman H
    (2008) Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 28:11673–11684, doi:10.1523/JNEUROSCI.3839-08.2008, pmid:18987203.
    OpenUrlAbstract/FREE Full Text
    1. Knobe J,
    2. Buckwalter W,
    3. Nichols S,
    4. Robbins P,
    5. Sarkissian H,
    6. Sommers T
    (2012) Experimental philosophy. Annu Rev Psychol 63:81–99, doi:10.1146/annurev-psych-120710-100350, pmid:21801019.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Konorski J
    (1987) Integrative activity of the brain: an interdisciplinary approach (University of Chicago, Chicago).
  13. ↵
    1. Lammel S,
    2. Ion DI,
    3. Roeper J,
    4. Malenka RC
    (2011) Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 70:855–862, doi:10.1016/j.neuron.2011.03.025, pmid:21658580.
    OpenUrlCrossRefPubMed
  14. ↵
    1. Litvak V,
    2. Eusebio A,
    3. Jha A,
    4. Oostenveld R,
    5. Barnes GR,
    6. Penny WD,
    7. Zrinzo L,
    8. Hariz MI,
    9. Limousin P,
    10. Friston KJ,
    11. Brown P
    (2010) Optimized beamforming for simultaneous MEG and intracranial local field potential recordings in deep brain stimulation patients. Neuroimage 50:1578–1588, doi:10.1016/j.neuroimage.2009.12.115, pmid:20056156.
    OpenUrlCrossRefPubMed
  15. ↵
    1. Litvak V,
    2. Mattout J,
    3. Kiebel S,
    4. Phillips C,
    5. Henson R,
    6. Kilner J,
    7. Barnes G,
    8. Oostenveld R,
    9. Daunizeau J,
    10. Flandin G,
    11. Penny W,
    12. Friston K
    (2011) EEG and MEG data analysis in SPM8. Comput Intell Neurosci 2011:852961, doi:10.1155/2011/852961, pmid:21437221.
    OpenUrlCrossRefPubMed
  16. ↵
    1. Mason L,
    2. O'Sullivan N,
    3. Bentall RP,
    4. El-Deredy W
    (2012) Better than I thought: positive evaluation bias in hypomania. PLoS One 7:e47754, doi:10.1371/journal.pone.0047754, pmid:23082210.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Matsumoto M,
    2. Hikosaka O
    (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837–841, doi:10.1038/nature08028, pmid:19448610.
    OpenUrlCrossRefPubMed
    1. Metereau E,
    2. Dreher JC
    (2012) Cerebral correlates of salient prediction error for different rewards and punishments. Cereb Cortex 23:477–487, doi:10.1093/cercor/bhs037, pmid:22368086.
    OpenUrlAbstract/FREE Full Text
  18. ↵
    1. Mirenowicz J,
    2. Schultz W
    (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449–451, doi:10.1038/379449a0, pmid:8559249.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Morris SE,
    2. Holroyd CB,
    3. Mann-Wrobel MC,
    4. Gold JM
    (2011) Dissociation of response and feedback negativity in schizophrenia: electrophysiological and computational evidence for a deficit in the representation of value. Front Hum Neurosci 5:123, doi:10.3389/fnhum.2011.00123, pmid:22065618.
    OpenUrlCrossRefPubMed
  20. ↵
    1. Nieuwenhuis S,
    2. Holroyd CB,
    3. Mol N,
    4. Coles MG
    (2004) Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci Biobehav Rev 28:441–448, doi:10.1016/j.neubiorev.2004.05.003, pmid:15289008.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Nolte G,
    2. Hämäläinen MS
    (2001) Partial signal space projection for artefact removal in MEG measurements: a theoretical analysis. Phys Med Biol 46:2873–2887, doi:10.1088/0031-9155/46/11/308, pmid:11720352.
    OpenUrlCrossRefPubMed
  22. ↵
    1. Oliveira FT,
    2. McDonald JJ,
    3. Goodman D
    (2007) Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J Cogn Neurosci 19:1994–2004, doi:10.1162/jocn.2007.19.12.1994, pmid:17892382.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Olvet DM,
    2. Hajcak G
    (2008) The error-related negativity (ERN) and psychopathology: toward an endophenotype. Clin Psychol Rev 28:1343–1354, doi:10.1016/j.cpr.2008.07.003, pmid:18694617.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Schultz W
    (2007) Multiple dopamine functions at different time courses. Annu Rev Neurosci 30:259–288, doi:10.1146/annurev.neuro.28.061604.135722, pmid:17600522.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Song XW,
    2. Dong ZY,
    3. Long XY,
    4. Li SF,
    5. Zuo XN,
    6. Zhu CZ,
    7. He Y,
    8. Yan CG,
    9. Zang YF
    (2011) REST: a toolkit for resting-state functional magnetic resonance imaging data processing. PLoS One 6:e25031, doi:10.1371/journal.pone.0025031, pmid:21949842.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Sosic-Vasic Z,
    2. Ulrich M,
    3. Ruchsow M,
    4. Vasic N,
    5. Grön G
    (2012) The modulating effect of personality traits on neural error monitoring: evidence from event-related FMRI. PLoS One 7:e42930, doi:10.1371/journal.pone.0042930, pmid:22937001.
    OpenUrlCrossRefPubMed
  27. ↵
    1. Talmi D,
    2. Fuentemilla L,
    3. Litvak V,
    4. Duzel E,
    5. Dolan RJ
    (2012) An MEG signature corresponding to an axiomatic model of reward prediction error. Neuroimage 59:635–645, doi:10.1016/j.neuroimage.2011.06.051, pmid:21726648.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Ungless MA
    (2004) Dopamine: the salient issue. Trends Neurosci 27:702–706, doi:10.1016/j.tins.2004.10.001, pmid:15541509.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Ungless MA,
    2. Argilli E,
    3. Bonci A
    (2010) Effects of stress and aversion on dopamine neurons: implications for addiction. Neurosci Biobehav Rev 35:151–156, doi:10.1016/j.neubiorev.2010.04.006, pmid:20438754.
    OpenUrlCrossRefPubMed
  30. ↵
    1. Walsh MM,
    2. Anderson JR
    (2012) Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neurosci Biobehav Rev 36:1870–1884, doi:10.1016/j.neubiorev.2012.05.008, pmid:22683741.
    OpenUrlCrossRefPubMed
Back to top

In this issue

The Journal of Neuroscience: 33 (19)
Journal of Neuroscience
Vol. 33, Issue 19
8 May 2013
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors
Deborah Talmi, Ryan Atkinson, Wael El-Deredy
Journal of Neuroscience 8 May 2013, 33 (19) 8264-8269; DOI: 10.1523/JNEUROSCI.5695-12.2013

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors
Deborah Talmi, Ryan Atkinson, Wael El-Deredy
Journal of Neuroscience 8 May 2013, 33 (19) 8264-8269; DOI: 10.1523/JNEUROSCI.5695-12.2013
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Materials and Methods
    • Results
    • Discussion
    • Notes
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

  • Heteromodal Cortical Areas Encode Sensory-Motor Features of Word Meaning
  • Pharmacologically Counteracting a Phenotypic Difference in Cerebellar GABAA Receptor Response to Alcohol Prevents Excessive Alcohol Consumption in a High Alcohol-Consuming Rodent Genotype
  • Neuromuscular NMDA Receptors Modulate Developmental Synapse Elimination
Show more Brief Communications
  • Home
  • Alerts
  • Follow SFN on BlueSky
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Notice
  • Contact
  • Accessibility
(JNeurosci logo)
(SfN logo)

Copyright © 2025 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.