Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE
PreviousNext
Articles, Behavioral/Cognitive

Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults

Rebecca Boehme, Lorenz Deserno, Tobias Gleich, Teresa Katthagen, Anne Pankow, Joachim Behr, Ralph Buchert, Jonathan P. Roiser, Andreas Heinz and Florian Schlagenhauf
Journal of Neuroscience 15 July 2015, 35 (28) 10103-10111; DOI: https://doi.org/10.1523/JNEUROSCI.0805-15.2015
Rebecca Boehme
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lorenz Deserno
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
2Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany,
3Department of Neurology, Otto-von-Guericke University, 39106 Magdeburg, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lorenz Deserno
Tobias Gleich
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tobias Gleich
Teresa Katthagen
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anne Pankow
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joachim Behr
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
4Institute of Neurophysiology, Charité Universitätsmedizin, 10117 Berlin, Germany,
5Department of Psychiatry, Psychotherapy, and Psychosomatics, Medical School Brandenburg, 16816 Neuruppin, Germany, and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ralph Buchert
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan P. Roiser
6Institute of Cognitive Neuroscience, University College London, WC1N 3AR London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jonathan P. Roiser
Andreas Heinz
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Florian Schlagenhauf
1Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin, 10117 Berlin, Germany,
2Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

The striatum is known to play a key role in reinforcement learning, specifically in the encoding of teaching signals such as reward prediction errors (RPEs). It has been proposed that aberrant salience attribution is associated with impaired coding of RPE and heightened dopamine turnover in the striatum, and might be linked to the development of psychotic symptoms. However, the relationship of aberrant salience attribution, RPE coding, and dopamine synthesis capacity has not been directly investigated. Here we assessed the association between a behavioral measure of aberrant salience attribution, the salience attribution test, to neural correlates of RPEs measured via functional magnetic resonance imaging while healthy participants (n = 58) performed an instrumental learning task. A subset of participants (n = 27) also underwent positron emission tomography with the radiotracer [18F]fluoro-l-DOPA to quantify striatal presynaptic dopamine synthesis capacity. Individual variability in aberrant salience measures related negatively to ventral striatal and prefrontal RPE signals and in an exploratory analysis was found to be positively associated with ventral striatal presynaptic dopamine levels. These data provide the first evidence for a specific link between the constructs of aberrant salience attribution, reduced RPE processing, and potentially increased presynaptic dopamine function.

  • aberrant salience
  • dopamine
  • orbitofrontal cortex
  • prediction error
  • reinforcement learning
  • ventral striatum

Introduction

Aberrant attribution of salience, i.e., to irrelevant or otherwise neutral stimuli, has been proposed as the central mechanism in the development of psychotic experiences (Heinz, 2002; Kapur, 2003). It has been suggested that aberrant salience attribution may arise from elevated dopaminergic neurotransmission (Heinz and Schlagenhauf, 2010; Winton-Brown et al., 2014), consistent with the replicated finding of heightened presynaptic dopamine levels in schizophrenia and individuals at risk of psychosis (Howes and Kapur, 2009; Howes et al., 2012) and with data from animal research connecting dopamine levels and models of salience attribution (Bay-Richter et al., 2009; Weiner and Arad, 2009; O'Callaghan et al., 2014).

In healthy individuals, dopamine plays a key role in signaling incentive salience (Robinson and Berridge, 1993) and correlates with a teaching signal central in theories of reinforcement learning (Sutton and Barto, 1998). Teaching signals help adapt to an ever-changing environment. Phasic firing of midbrain dopamine neurons was demonstrated to encode the difference between received outcome and expected value (Montague et al., 1996; Schultz, 1997), termed the reward prediction error (RPE). These findings were mirrored in humans using fMRI: coding of RPEs in areas innervated by dopaminergic neurons was repeatedly shown, particularly in the striatum (O'Doherty et al., 2003; D'Ardenne et al., 2008). In schizophrenia, attenuated striatal RPE signals were observed (Murray et al., 2008; Gradin et al., 2011; Deserno et al., 2013; Schlagenhauf et al., 2014). An association of such signals with delusion severity was reported (Corlett et al., 2007; Schlagenhauf et al., 2009; Romaniuk et al., 2010) and attenuated striatal RPE signals were associated with self-reported delusion-like beliefs in healthy participants (Corlett and Fletcher, 2012). In a similar population, high levels of aberrant salience have been reported (Roiser et al., 2013) suggesting that there might be an association of the constructs of RPE and aberrant salience.

Recently, a paradigm was designed to measure the degree of aberrant salience—the salience attribution test (SAT; Roiser et al., 2009). Participants had to respond to different stimuli, some of which predicted reward while others were uninformative. Aberrant salience was operationalized as implicit (the speeding of responses to irrelevant stimulus features) and explicit measures (subjective probability ratings about reward contingencies). The implicit measure had the highest construct validity in healthy volunteers (Schmidt and Roiser, 2009). So far, it has been demonstrated that schizophrenia patients with delusions exhibited higher explicit aberrant salience than patients without (Roiser et al., 2009) as did individuals in an at-risk state for psychosis compared with healthy volunteers (Roiser et al., 2013). We found significantly higher implicit aberrant salience in a large sample of schizophrenia patients (A. Pankow, T. Katthagen, S. Diner, L. Deserno, R. Boehme, T. Gleich, M. Gaebler, H., A. Heinz, F., unpublished observations). fMRI results showed that the ventral striatum (VS) was activated by task-adaptive reward prediction during the SAT, while aberrant reward prediction responses have been observed inconsistently in the VS (Roiser et al., 2010, 2013).

Although there is an influential theoretical background motivating the idea that aberrant salience attribution may relate to weakened learning signals in the VS elicited by task-relevant cues (Heinz, 2002; Kapur, 2003; Corlett et al., 2007; Schlagenhauf et al., 2009; Heinz and Schlagenhauf, 2010; Winton-Brown et al., 2014), the association between these processes has yet to be investigated directly. Here, we related a behavioral measure of aberrant salience attribution derived from the SAT to RPEs assessed by fMRI during operant learning in a large sample of healthy participants. We hypothesized that high levels of aberrant salience attribution are associated with decreased VS RPE signals; we also investigated whether aberrant salience levels are associated with prefrontal RPE encoding. A subgroup underwent [18F]fluoro-l-DOPA (FDOPA) PET to measure presynaptic striatal dopamine levels. Based on the proposal that aberrant salience attribution is accompanied by elevated presynaptic dopamine levels (Howes et al., 2012), we predicted a positive association with aberrant salience scores.

Materials and Methods

Participants.

Fifty-eight healthy volunteers (23 female; mean age: 25.8 ± 5.9 years, range 18–43) were included; participants were recruited through university mailing lists and from the institute subject database. They were free of Axis I psychiatric disorders, with no history of psychiatric disorders in first-degree relatives, and no current or past alcohol or substance abuse (other than nicotine; First et al., 2001). There were three separate appointments for the SAT, fMRI, and PET measurements. Peter's Delusion Inventory (PDI; Peters et al., 1999) and Schizotypy Personality Questionnaire (SPQ; Raine, 1991) were used to approximate psychosis-like experiences. The local ethics committee approved the study and written informed consent was obtained after complete study description. A subgroup of this sample also performed a different behavioral task during fMRI, published separately (Deserno et al., 2015).

Aberrant salience task.

The SAT was used to measure aberrant salience behaviorally. A more detailed description is provided in the original publication (Roiser et al., 2009). In short, a stimulus appeared on the screen as a cue, which could vary across two dimensions: color (red or blue) and form (animal or household object; Fig. 1). While the stimulus features on one dimension predicted reward availability (e.g., red vs blue: 87.5 vs 12.5%), the other dimension carried no predictive information about the occurrence of reward and was therefore irrelevant (e.g., 50% reward for both animal and household features). Right after the cue, participants had to respond to the presentation of a square (the probe) to win money. They were instructed that faster responses yielded higher rewards, but reward was not always available. If the trial was not reinforced, the message “Sorry—no money available” was displayed after the probe disappeared. If reinforced, “hit” responses (made before the probe disappeared) that were slower than the participant's own mean reaction time (RT) (measured during an earlier practice session) resulted in the message “Hit—good: 10 cents.” For hit responses faster than the participant's mean practice RT the following messages appeared: “Quick—very good: X cents” (for responses up to 1.5 SDs above their mean RT) and “Very quick—excellent: X cents” (for responses faster than 1.5 SD). The scaling of reward in each trial was calculated using the equation: X = 10 + 45 × (mean RT − trial RT)/(3 × SD), up to a maximum of 40 cents per trial. Implicit aberrant salience attribution was measured through RTs and calculated as follows: subtraction of the RTs to subjective low reward stimuli from the RTs to subjective high reward stimuli followed by square root transformation to reduce skew. Participants performed the task in two separate blocks of equal length, over which values were averaged. We used this implicit measure of aberrant salience, which has been shown to have a high construct validity (Schmidt and Roiser, 2009), to create two groups of 29 subjects each (“high” and “low”) via a median split. Additionally, we explored the robustness of the results using an extreme group approach with two groups of 20 people each including the highest and lowest values of implicit aberrant salience attribution. In addition to the implicit measure, we also obtained the explicit measure, based on an individual rating after each of the two blocks. Participants rated the individual stimuli on a visual analog scale by estimating how often each of the four stimulus types had been reinforced (0–100). To analyze the development of salience attribution over the first block of the experiment, RTs were centered using the mean RT from the practice session. RTs were separated into high and low predictive probability trials and irrelevant trials. The latter were categorized as subjective good or bad (based on mean RT/based on individual ratings). RTs were averaged over time bins of five trials, resulting in six data points.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

One trial of the SAT. Participants had to respond to a probe preceded by stimuli that varied in two dimensions (color, shape), only one of which was relevant for predicting reward (80 vs 20%). The other dimension carried no predictive information (50% win probability). Probe duration was calculated from individual reaction times in the second practice session [mean ± 2 SDs from the fastest half of trials (SDF)]. Faster responses yielded higher rewards, about which feedback was given following each trial.

Operant learning task.

For operant learning, a probabilistic reinforcement learning paradigm was used. Participants were instructed to choose one of two different stimuli appearing simultaneously on the screen during a decision window of 1.5 s. Stimuli were randomly assigned to the left or right side (Fig. 2A). If no response occurred within the decision window, the message “too slow!” was displayed and the next trial began. One hundred and sixty trials were administered. Each trial consisted of stimulus presentation (1.5 s); feedback (0.5 s); and a jittered, exponentially distributed intertrial interval (min 1 s, max 12.5 s). On each trial, participants could win or lose money. They were instructed to try to win as much money as possible. One symbol was associated with a high reward probability (80%) and a low loss probability (20%), and the inversed probabilities were assigned to the other symbol. This probability distribution switched at various points in the experiment: at the beginning and end were stable periods without switching (first block: 55 trials; last block: 35 trials); in the middle, shorter blocks alternated between 15 and 20 trials (Fig. 2B). Feedback for win trials consisted of the message “Win! +10 Cent” and for lose trials of the message “Loss! −10 Cent.” Each participant practiced the task during a training session without reversals of reward contingencies, but was notified that there might be switches during the main experiment. A minimum of 3€ and a maximum of 10€ could be won on the task. Behavioral performance was quantified as the percentage of “correct” responses, i.e., choosing the currently better symbol. Groups were compared using two sample t tests. Behavioral data were analyzed using SPSS 19.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Operant learning task. A, Participants had to choose the symbol with the higher reward probability to win money. B, Reward probability associated with one of the symbols changed over the course of the whole experiment (the other symbol's reward probability was the inverse).

Reinforcement learning model.

A reinforcement learning model was applied to the operant learning task to quantify learning dynamically and to generate trial-by-trial RPEs for each individual to serve as regressors in the fMRI analysis. We used a Q-learning algorithm, which estimates five free parameters for every participant to model their choices during the reinforcement learning paradigm. The algorithm tracks the expected outcome value (the “Q-value”) of the chosen stimulus a (Sutton and Barto, 1998) on each trial t. This expected value was adjusted according to the RPE δQa,t, which is defined as the difference between the received outcome Rt and the expected outcome Qa,t for the chosen stimulus: Embedded Image Rt denotes two separate free parameters: for rewarded and punished trials. Instead of setting Rt for reward and punishment to fixed values (1 and −1), we allowed them to vary individually as free parameters to capture variation in reward and punishment sensitivity (Schlagenhauf et al., 2014). The RPE is used as a teaching signal to update expected values iteratively trial by trial: Embedded Image Here, α determines the learning rate, which also was estimated separately for reward and punishment outcomes. The learning rate describes how quickly expectations change with respect to the current RPE. There was another free parameter Qi that specified the initial Q-values for one option (a bias to choose one or the other stimulus initially; Schlagenhauf et al., 2014). A softmax rule was used to estimate the probability of choices (pa(t)) based on expected values: Embedded Image Here, the used softmax equation does not contain a free temperature parameter, because reward and punishment sensitivities cover the same behavioral variation and render the temperature redundant. Parameters of the model were estimated by applying expectation maximization with empirical priors and the model evidence was approximated by integrating out the free parameters over the likelihood via sampling from the prior distribution (Huys et al., 2011, 2012). For between-group comparison, all five parameters, i.e., reward and punishment learning rates, reward and punishment sensitivities, and initial Q-value, were entered into a multivariate ANOVA (MANOVA).

Only subjects whose choice behavior was explained better than chance (based on the likelihood that the observed behavioral data are given by the parameters) were included in further modeling-based analysis (52 of 58 subjects: four from the low and two from the high aberrant salience group were excluded). Thus, time series derived from these parameters reflect important aspects of the behavioral data and can be regressed against imaging data in a meaningful way.

fMRI.

A 3.0 tesla Siemens trio scanner with a 12-channel head coil was used to acquire 423 T2-weighted EPIs containing 40 slices (TR = 2090 ms, TE = 22 ms, slice thickness 2.5 mm, matrix size 64 * 64, field of view 488 * 488 mm2, in-plane voxel resolution 3 mm2, flip angle = 90°). Field distortion maps and T1-weighted anatomical images were also acquired. fMRI data were analyzed using statistical parametric mapping (SPM8; Wellcome Department of Imaging Neuroscience, London, UK; http://www.fil.ion.ucl.ac.uk/spm) in MATLAB R2010b (The MathWorks). The following steps were performed: slice-time and motion correction including unwarping, coregistration of the mean EPI and the anatomical image, spatial normalization to the MNI T1 template, and segmentation of the T1 image using the unified segmentation approach (Ashburner and Friston, 2005). Normalization parameters were applied to all EPIs. Finally, all images were spatially smoothed with an isotropic Gaussian kernel of 6 mm full-width at half-maximum.

For statistical analysis of the BOLD response, the general linear model approach was used as implemented in SPM8. In an event-related design, feedback onsets were convolved with the hemodynamic response function and trial-by-trial RPEs derived from the learning model were added as a parametric modulator. One additional regressor marked trials where no answer occurred. To account for movement-associated variance, realignment parameters and their first temporal derivative of translational movement plus an additional regressor marking scans with >1 mm scan-to-scan movement were included as regressors of no interest. Individual contrast images were taken to a random effects group-level analysis (one-sample t tests for within-group and two-sample t tests for between-group comparisons). To correct for multiple comparisons, statistics are reported using FWE correction at the voxel level across the whole brain. Based on our a priori hypothesis about the negative association between ventral striatal RPE signal and measures of aberrant salience, parameter estimates from the fMRI activations were extracted from a 2 mm sphere around within-group (over all subjects) peak voxels and subjected to a correlation analysis with aberrant salience measures derived from the SAT (one-tailed, based on our a priori hypothesis) using SPSS19. For group comparisons, the search volume was restricted to those voxels showing a significant main RPE effect at p < 0.05 (whole-brain corrected) across the entire sample (Table 1).

View this table:
  • View inline
  • View popup
Table 1.

Prediction error-related activation

PET.

A subgroup of 27 subjects (mean age 28.2 ± 6, 12 female) also underwent FDOPA PET. Data were acquired using a Philips Gemini TF16 time-of-flight PET/CT scanner in 3D mode. After a low-dose transmission CT scan, a 60 min dynamic 3D “list-mode” emission recording started after intravenous bolus administration of 200 MBq FDOPA. The following steps were performed: CT-based tissue attenuation and scatter correction, reconstruction (OSEM, 16 iterations, six subsets) and framing (30 frames: 3 × 20 s, 3 × 1 min, 3 × 2 min, 3 × 3 min, 7 × 5 min, 1 × 6 min) of list-mode data, coregistration of a mean emission image and the individual T1 image, and spatial normalization of the T1 image using the unified segmentation approach (Ashburner and Friston, 2005). Normalization parameters were applied to all frames. Presynaptic dopamine synthesis capacity was quantified as FDOPA Ki (min×1) voxel by voxel. Ki was estimated using the frames from 20 to 60 min of the recording by applying Gjedde–Patlak linear graphical analysis (Patlak and Blasberg, 1985). Values from a standard cerebellum mask (excluding Vermis, WFU PickAtlas) were used as input function. Ki values were extracted after normalization to MNI space from four bilateral ROIs: from limbic (ventral), sensorimotor, and associative striatum (Martinez et al., 2003; Howes et al., 2012) and additionally from 2 mm spheres around the peak voxel of ventral striatal RPE-associated activation obtained in the fMRI analysis over all participants. Ki values were compared between high and low aberrant salience groups using a MANOVA and correlated with aberrant salience scores using Pearson correlations within SPSS19. Correlations were corrected for multiple comparisons via Bonferroni corrections.

Results

Behavior during the SAT

The implicit measure of aberrant salience (AbSal) had a mean of 3.1 ± 1.1 (range 0.7–6.55). Compared with previously published data, this sample displays a rather small overall range (values before transformation for comparability: 11.6 ± 7.8 ms; see Roiser et al., 2009, where the healthy sample was found around 16.5 ± 10.3 and 14.5 ± 14.9, Roiser et al., 2013: 24.6 ± 21.9 ms, and Roiser et al., 2010: 15.7 ± 8.5 ms). During the first block of the experiment, RTs for the subjective “good” cue decreased relative to the subjective “bad” cue (Table 2), indicating that AbSal attribution was acquired during the experiment and not based on a pre-existing bias.

View this table:
  • View inline
  • View popup
Table 2.

Development of RTs over the course of the first block

On the basis of the AbSal measure, two groups of 29 participants each were formed via a median split. The low AbSal group had a mean score of 2.27 ± 0.56 (range 0.7–3.06), and the high AbSal group had a mean score of 3.9 ± 0.77 (range 3.09–6.55; for more details see Table 3). These two groups did not differ in age (t(55) = 1.03, p = 0.32), gender [χ2(1, N = 58) = 0.29, p = 0.9], or verbal intelligence (t(54) <0.001, p > 0.99). There was no difference in the used measures of delusion-like experiences (PDI: t(56) = 0.86, p = 0.4, mean: low AbSal = 6.7 ± 5.7, high AbSal = 7.5 ± 5.6, overall range 0–17; SPQ: t(45) = 0.7, p = 0.48, mean: low AbSal = 18.35 ± 16, high AbSal = 15.5 ± 11.5, overall range 1–73) or in the measure of adaptive salience, i.e., reaction time differences between the cues, which actually predicted reward probabilities (t = −0.93, p = 0.4).

View this table:
  • View inline
  • View popup
Table 3.

Overview modeling parameters and aberrant salience attribution for low and high aberrant salience groups

Mean AbSal values in the extreme groups were 2 ± 0.5 for the low AbSal group and 4.3 ± 0.7 for the high AbSal group. There was a significant difference on the PDI measure for the two extreme groups: t = 2.5, p = 0.018 (mean: low AbSal groups = 4 ± 5, high AbSal group = 8.9 ± 4.9).

Behavior during the operant task

On the operant learning task, performance of the two groups did not differ significantly: mean percentage correct responses were 74.75 ± 11.5% for the low AbSal and 76.7 ± 7.3% for the high AbSal group (t(56) = 0.77, p = 0.44).

With respect to the modeling analysis, a parameter × group MANOVA revealed a significant group difference only for reward learning rate α (mean α: low AbSal group = 0.68 ± 0.13, high AbSal group = 0.57 ± 0.19, F(1,57) = 7.62, p = 0.0078; an overview over model parameters is given in Table 3). After exclusion of the six participants whose behavior was not explained better than chance by the model, this effect remained significant (F(1,51) = 5.58, p = 0.02). The likelihood of the observed choice data was not related to AbSal scores.

The extreme group approach rendered the effect of the learning rate difference nonsignificant (t(40) = 1.2, p = 0.25).

Neural correlates of RPEs

RPEs covaried with BOLD response in a frontostriatal network including VS, cingulate cortex, parietal and temporal cortex, medial prefrontal cortex, orbitofrontal cortex (OFC), hippocampus, and cerebellum, which survived whole-brain FWE correction (FWE-WB; see Table 1).

The difference between the high compared with the low AbSal group in RPE-related activation extracted at the peak coordinate in the VS (right: [14 10 −10], Z = 5.94, PFWE-WB <0.001; left: [−10 12 −10], Z = 5.09, PFWE-WB = 0.021) was significant on the left [t(50) = 1.8, p = 0.04 (one-tailed)] and showed a trend toward significance on the right [t(50) = 1.54, p = 0.063 (one-tailed)], indicating an association of higher levels of AbSal with reduced RPE signaling in the VS. When correlated over both groups, AbSal and RPE activation showed a negative association in the right VS [r = −0.23, p = 0.045 (one-tailed), R2 = 0.05; Fig. 3] and also approached significance in the left VS [r = −0.2, p = 0.08 (one-tailed), R2 = 0.04].

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

Ventral striatal prediction error signals correlate negatively with aberrant salience scores. A, Prediction error-associated activation in the striatum (y = 10). The image is thresholded at p < 0.05 (FWE-WB) and the color bar indicates t values. B, Correlation of parameter estimates from the right ventral striatum [14 10 −10] with aberrant salience scores [r = −0.23, p < 0.05 (one-tailed), R2 = 0.05]. L, left; R, right.

The extreme group approach rendered this finding more significant [right VS: t(40) = 2.044, p = 0.049 (two-tailed), left VS: t(40) = 1.4, p = 0.17 (two-tailed)].

In addition to our a priori hypothesis with respect to the VS, we performed a voxelwise analysis (restricted to regions showing a main effect of RPE, as above), which revealed a significant group difference in the left OFC (Z = 4.52, [−30 46 −14], PSVC main effect = 0.003; Fig. 4A): while participants in the low AbSal group encoded RPEs in this region, this signal was reduced in the high AbSal group (Fig. 4B).

Figure 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 4.

Low and high AbSal groups differ in prediction error-associated activation in the left orbitofrontal cortex. A, Contrast between low and high aberrant salience groups, displayed at p <0.001 (uncorrected). B, Mean parameter estimates for the groups of low and high aberrant salience at [−30 46 −14]. Error bars indicate SEM and the color bar indicates t values. L, left; R, right.

This finding was found to be robust using the two extreme AbSal groups (Z = 3.99, PSVC main effect = 0.023).

Presynaptic dopamine levels and aberrant salience measures

To relate presynaptic dopamine levels (Ki) to aberrant salience attribution, a subsample of 27 subjects also underwent FDOPA PET (low AbSal: n = 14, mean AbSal score = 2.2 ± 0.38, high AbSal n = 13, mean AbSal score = 3.9 ± 1.05). These AbSal subgroups did not differ in any of the demographic parameters (t values <1.1, p values >0.26). There was no significant difference in Ki levels between the AbSal groups in the limbic, associated, or sensorimotor striatum (t values <1.5, p values >0.16). There was no correlation between Ki values in ROIs of striatal subregions (limbic, associative, and sensorimotor) and the implicit aberrant salience score (r values <0.25, p values >0.2). In an exploratory analysis, Ki values were extracted from a sphere around the peak voxels of RPE signals in the VS. These were positively correlated with aberrant salience measures in the right VS (r = 0.54, p = 0.004, R2 = 0.29; Fig. 5), while no association was found in the left VS (r = 0.19, p = 0.35, R2 = 0.036). No significant correlation was observed of RPE BOLD signal with Ki in this ROI (p = 0.89).

Figure 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 5.

PET Ki values (indicated by the color bar) quantifying presynaptic dopamine levels correlate positively with aberrant salience scores. A, PET Ki at y = 10, mean over all participants. B, Correlation of aberrant salience scores with Ki values extracted from peak coordinate of the prediction error-related activation in the right ventral striatum ([14 10 −10], indicated in blue in A; r = 0.54, p < 0.01, R2 = 0.29). L, left; R, right.

Explicit aberrant salience

Following the suggestion of one of our reviewers we also explored associations with the explicit measure of aberrant salience (mean = 2.2 ± 1.4, range = 0–5.5). This measure was not correlated with the implicit aberrant salience measure (r = −0.18, p = 0.18) and there were no relationships of this measure with fMRI (r values <0.09, p values >0.5) or PET-derived values (r values <0.15, p values >0.43).

Discussion

Here we present first evidence for an association of aberrant salience attribution derived from the SAT (Roiser et al., 2009) with reinforcement learning signals and neurochemical measures of presynaptic dopamine in a sample of healthy controls: (1) participants with higher levels of aberrant salience attribution displayed reduced coding of RPEs in VS and OFC during instrumental learning and (2) aberrant salience attribution correlated positively with ventral striatal presynaptic dopamine levels measured in the area activated by RPEs. These results provide first proof that interindividual differences in a measure of aberrant salience attribution relate to behavioral and neural correlates of reinforcement learning and measures of dopaminergic neurotransmission.

Activation of the VS in response to RPEs has been repeatedly demonstrated (O'Doherty et al., 2003; D'Ardenne et al., 2008); these learning signals are important for trial-by-trial updating of reward expectations and underlie behavioral adaptation (Kehagia et al., 2010; Boureau and Dayan, 2011; Deserno et al., 2013; Ullsperger et al., 2014). Here we show that coding of such adaptive learning signals is relatively lower in subjects displaying higher aberrant salience attribution.

The finding of a negative correlation between implicit aberrant salience attribution and VS RPEs, here in healthy controls, is in line with studies showing that people with psychotic experiences show reduced RPE signals (Corlett et al., 2007; Schlagenhauf et al., 2009; Romaniuk et al., 2010; Corlett and Fletcher, 2012). Note, though, that we only obtained an association with one self-report scale of delusion-like experiences in the extreme group approach. This does not necessarily contradict the continuum model of psychosis, because aberrant salience measures of our healthy sample covered the lower range of possible aberrant salience values, which might have been insufficient to detect an association with psychopathology (Roiser et al., 2009, 2010, 2013). The RT measure might be too fine-grained to correlate with the coarser self-assessment scales. It is also conceivable that a number of factors have to interact to lead to psychosis-like experiences; aberrant salience attribution might be only one of them.

Alternatively, high aberrant salience participants might engage in a different strategy to solve the task, which might lead to reduced fMRI signals (Schönberg et al., 2007). We cannot make any claims about possible group differences here, because we did not compare behavioral strategies. Instead we used one computational model for all participants to estimate meaningful regressors. Both subgroups were well explained by the learning model and did not differ regarding their reward or punishment sensitivity. However, the finding of a lower learning rate in the group with higher aberrant salience measures indicates slower updating after a reward. Decreased reward learning rates might lead to slower updating of the conditioned response after an aberrant relationship between expectations and irrelevant cues was established initially. To some extent our presented findings challenge the notion that aberrant salience and flexible reward-based learning represent independent constructs. If the aberrant salience measure constitutes a different conceptualization of the same mechanism evaluated by RPEs, aberrant salience would simply reflect altered RPE-based learning. In this case, correlating these measures would be redundant, but the use of reinforcement learning paradigms for investigations of the aberrant salience hypothesis in psychotic patients would be further supported. On a biological level, there is also evidence for independent dopaminergic processing pathways of RPEs and salience: from studies in monkeys the proposition arises that different subpopulations of dopaminergic neurons encode RPEs and salience (Matsumoto and Hikosaka, 2009; Matsumoto and Takada, 2013). For future studies, pharmacological challenges of the dopamine system represent a powerful tool to proof conceptual overlap as well as independence of both constructs on a psychological and biological level. One first study approached this question recently in Parkinson's disease (Nagy et al., 2012).

Furthermore, we found first evidence that aberrant salience attribution was positively related to presynaptic dopamine levels in the same region of the VS that was activated by RPEs. Increased striatal dopamine levels were proposed to be involved in stochastic assignment of salience to irrelevant stimuli (Heinz, 2002; Kapur, 2003; Poletti et al., 2014). Elevated levels of striatal presynaptic dopamine synthesis capacity are a well established finding in schizophrenia patients (Howes et al., 2012), and have been observed in individuals in an at-risk mental state for psychosis (Egerton et al., 2013). Animal models and human PET imaging suggest an overactivation of the dopaminergic system as possible mechanism: because of altered regulatory processes the spontaneous activity of dopaminergic neurons might be increased (Abi-Dargham et al., 2000; Lodge and Grace, 2007; Goto and Grace, 2008; Mizrahi et al., 2012). A general upregulation of tonic activity, leading to heightened phasic responses, could in turn render all stimulus-driven inputs important contributing to aberrant salience attribution to irrelevant stimuli (Grace, 2012). In a similar vein, heightened aberrant salience attribution might be associated with decreased VS RPE BOLD signals because of stochastic VS activity leading to deflated covariation between RPE size and BOLD signal. Our data complement these lines of research and suggest that aberrant salience attribution is directly correlated with elevated dopamine synthesis capacity and reduced encoding of RPEs.

In the whole-brain analysis, we found decreased OFC activation in subjects with higher values of aberrant salience attribution. The OFC is associated with reward processing in animals (Roesch and Olson, 2004; Padoa-Schioppa and Assad, 2006) and was repeatedly implicated in the reward circuit in humans (Kringelbach and Rolls, 2004). Functional and anatomical abnormalities of this region are found in major psychiatric disorders (Jackowski et al., 2012), especially in obsessive compulsive disorder (Greenberg et al., 2000; Menzies et al., 2008), but also in schizophrenia (Meador-Woodruff et al., 1997; Malchow et al., 2015). Accumulating evidence indicates that the OFC contributes to updating stimulus-outcome associations by providing information about expectations to downstream areas (Stalnaker et al., 2007; Schoenbaum et al., 2009; Takahashi et al., 2009), including the VS (Haber et al., 1995). Interestingly, animal studies found that intact OFC function is needed to learn from unexpected outcomes, i.e., from RPEs (Takahashi et al., 2009), and lesions in the OFC led to alterations of activity in dopaminergic neurons (Takahashi et al., 2011) and changes in striatal dopamine levels (Clarke et al., 2014), while stimulation of the VS influenced OFC activity and possibly connectivity (Ewing and Grace, 2013). Furthermore, it has been hypothesized that the OFC contributes information about current external states and is therefore crucially involved in the model-based aspect of learning (Takahashi et al., 2011). These findings suggest that the reduced OFC activation in participants with a high level of aberrant salience attribution might be related to the reduced RPE coding in the VS.

Limitations include that, because of our correlational approach, we cannot make any claims about causality. We focused here on the relationship between task-relevant, adaptive RPE signals during reinforcement learning and aberrant salience attribution measures. We did not measure brain activation related to aberrant salience attribution during the SAT. Roiser et al. (2010) found VS activation in response to adaptive salience during the SAT, i.e., the contrast of high-probability versus low-probability cues, in healthy participants, but no VS activation elicited by aberrant salience attribution to neutral cues. In another study, explicit aberrant salience ratings correlated positively with VS activation to irrelevant cue features across individuals (Roiser et al., 2013). Thus, the relation between task-relevant neural learning signals such as VS RPE (Roiser et al., 2013) and neural correlates of task-irrelevant, aberrant signals remains to be established. Studies in prodromal subjects found increased dopamine levels in the associative, dorsal striatum (Howes et al., 2009; Fusar-Poli et al., 2010). We did not obtain any differences in this striatal subdivision in this sample of healthy participants in relation to aberrant salience. However, an exploratory analysis revealed an association between aberrant salience attribution and presynaptic dopamine levels using values derived from the peak of RPE signal, which was located in the VS. This finding suggests an interdependence of dopamine levels and salience attribution given the assumption that RPEs and salience are associated concepts, but has to be replicated in an independent sample. Whether this result is related to the finding of increased dopamine levels in prodromal and schizophrenic subjects remains to be elucidated.

In conclusion, our findings are in line with predictions of the aberrant salience account of psychosis (Heinz, 2002; Kapur, 2003; Heinz and Schlagenhauf, 2010; Winton-Brown et al., 2014): we provide evidence that the attribution of salience to irrelevant cues is associated with reduced encoding of RPEs in the VS and OFC during reinforcement learning and with increased presynaptic dopamine levels in the VS region associated with RPE encoding. Here, obtained in healthy subjects, the same relationship may contribute to the development of positive symptoms in the psychotic disease spectrum.

Footnotes

  • This work was supported by grants from Deutsche Forschungsgemeinschaft (SCHL1969/1-1, GRK-1123). We thank Yu Fukuda, Saineb Alaa-Eddine, Sarah Diner, and Jakob Kaminski for assistance during data acquisition.

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Rebecca Boehme, Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin Berlin, Campus Mitte, Charitéplatz 1, 10117 Berlin, Germany. rebecca.boehme{at}charite.de

References

  1. ↵
    1. Abi-Dargham A,
    2. Rodenhiser J,
    3. Printz D,
    4. Zea-Ponce Y,
    5. Gil R,
    6. Kegeles LS,
    7. Weiss R,
    8. Cooper TB,
    9. Mann JJ,
    10. Van Heertum RL,
    11. Gorman JM,
    12. Laruelle M
    (2000) Increased baseline occupancy of D2 receptors by dopamine in schizophrenia. Proc Natl Acad Sci U S A 97:8104–8109, doi:10.1073/pnas.97.14.8104, pmid:10884434.
    OpenUrlAbstract/FREE Full Text
  2. ↵
    1. Ashburner J,
    2. Friston KJ
    (2005) Unified segmentation. Neuroimage 26:839–851, doi:10.1016/j.neuroimage.2005.02.018, pmid:15955494.
    OpenUrlCrossRefPubMed
  3. ↵
    1. Bay-Richter C,
    2. O'Tuathaigh CM,
    3. O'Sullivan G,
    4. Heery DM,
    5. Waddington JL,
    6. Moran PM
    (2009) Enhanced latent inhibition in dopamine receptor-deficient mice is sex-specific for the D1 but not D2 receptor subtype: implications for antipsychotic drug action. Int J Neuropsychopharmacol 12:403–414, pmid:19012810.
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. Boureau YL,
    2. Dayan P
    (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 36:74–97, doi:10.1038/npp.2010.151, pmid:20881948.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Clarke HF,
    2. Cardinal RN,
    3. Rygula R,
    4. Hong YT,
    5. Fryer TD,
    6. Sawiak SJ,
    7. Ferrari V,
    8. Cockcroft G,
    9. Aigbirhio FI,
    10. Robbins TW,
    11. Roberts AC
    (2014) Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity. J Neurosci 34:7663–7676, doi:10.1523/JNEUROSCI.0718–14.2014, pmid:24872570.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Corlett PR,
    2. Fletcher PC
    (2012) The neurobiology of schizotypy: fronto-striatal prediction error signal correlates with delusion-like beliefs in healthy people. Neuropsychologia 50:3612–3620, doi:10.1016/j.neuropsychologia.2012.09.045, pmid:23079501.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Corlett PR,
    2. Murray GK,
    3. Honey GD,
    4. Aitken MR,
    5. Shanks DR,
    6. Robbins TW,
    7. Bullmore ET,
    8. Dickinson A,
    9. Fletcher PC
    (2007) Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain 130:2387–2400, doi:10.1093/brain/awm173, pmid:17690132.
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. D'Ardenne K,
    2. McClure SM,
    3. Nystrom LE,
    4. Cohen JD
    (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319:1264–1267, doi:10.1126/science.1150605, pmid:18309087.
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Deserno L,
    2. Boehme R,
    3. Heinz A,
    4. Schlagenhauf F
    (2013) Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group? Front Psychiatry 4:172, doi:10.3389/fpsyt.2013.00172, pmid:24391603.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Deserno L,
    2. Huys QJ,
    3. Boehme R,
    4. Buchert R,
    5. Heinze HJ,
    6. Grace AA,
    7. Dolan RJ,
    8. Heinz A,
    9. Schlagenhauf F
    (2015) Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proc Natl Acad Sci U S A 112:1595–1600, doi:10.1073/pnas.1417219112, pmid:25605941.
    OpenUrlAbstract/FREE Full Text
  11. ↵
    1. Egerton A,
    2. Chaddock CA,
    3. Winton-Brown TT,
    4. Bloomfield MA,
    5. Bhattacharyya S,
    6. Allen P,
    7. McGuire PK,
    8. Howes OD
    (2013) Presynaptic striatal dopamine dysfunction in people at ultra-high risk for psychosis: findings in a second cohort. Biol Psychiatry 74:106–112, doi:10.1016/j.biopsych.2012.11.017, pmid:23312565.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Ewing SG,
    2. Grace AA
    (2013) Long-term high frequency deep brain stimulation of the nucleus accumbens drives time-dependent changes in functional connectivity in the rodent limbic system. Brain Stimul 6:274–285, doi:10.1016/j.brs.2012.07.007, pmid:22981894.
    OpenUrlCrossRefPubMed
  13. ↵
    1. First MB,
    2. Spitzer RL,
    3. Gibbon M,
    4. Williams J
    (2001) Structured clinical interview for DSM-IV-TR Axis I disorders, research version, patient edition with psychotic screen (SCID-I/P W/PSY SCREEN) (New York State Psychiatric Institute, New York).
  14. ↵
    1. Fusar-Poli P,
    2. Howes OD,
    3. Allen P,
    4. Broome M,
    5. Valli I,
    6. Asselin MC,
    7. Grasby PM,
    8. McGuire PK
    (2010) Abnormal frontostriatal interactions in people with prodromal signs of psychosis: a multimodal imaging study. Arch Gen Psychiatry 67:683–691, doi:10.1001/archgenpsychiatry.2010.77, pmid:20603449.
    OpenUrlCrossRefPubMed
  15. ↵
    1. Goto Y,
    2. Grace AA
    (2008) Limbic and cortical information processing in the nucleus accumbens. Trends Neurosci 31:552–558, doi:10.1016/j.tins.2008.08.002, pmid:18786735.
    OpenUrlCrossRefPubMed
  16. ↵
    1. Grace AA
    (2012) Dopamine system dysregulation by the hippocampus: implications for the pathophysiology and treatment of schizophrenia. Neuropharmacology 62:1342–1348, doi:10.1016/j.neuropharm.2011.05.011, pmid:21621548.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Gradin VB,
    2. Kumar P,
    3. Waiter G,
    4. Ahearn T,
    5. Stickle C,
    6. Milders M,
    7. Reid I,
    8. Hall J,
    9. Steele JD
    (2011) Expected value and prediction error abnormalities in depression and schizophrenia. Brain 134:1751–1764, doi:10.1093/brain/awr059, pmid:21482548.
    OpenUrlAbstract/FREE Full Text
  18. ↵
    1. Greenberg BD,
    2. Murphy DL,
    3. Rasmussen SA
    (2000) Neuroanatomically based approaches to obsessive-compulsive disorder. Neurosurgery and transcranial magnetic stimulation. Psychiatr Clin North Am 23:671–686, xii, doi:10.1016/S0193–953X(05)70188-X, pmid:10986735.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Haber SN,
    2. Kunishio K,
    3. Mizobuchi M,
    4. Lynd-Balta E
    (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851–4867, pmid:7623116.
    OpenUrlAbstract
  20. ↵
    1. Heinz A
    (2002) Dopaminergic dysfunction in alcoholism and schizophrenia–psychopathological and behavioral correlates. Eur Psychiatry 17:9–16, doi:10.1016/S0924–9338(02)00628–4, pmid:11918987.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Heinz A,
    2. Schlagenhauf F
    (2010) Dopaminergic dysfunction in schizophrenia: salience attribution revisited. Schizophr Bull 36:472–485, doi:10.1093/schbul/sbq031, pmid:20453041.
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Howes OD,
    2. Kapur S
    (2009) The dopamine hypothesis of schizophrenia: version III–the final common pathway. Schizophr Bull 35:549–562, doi:10.1093/schbul/sbp006, pmid:19325164.
    OpenUrlAbstract/FREE Full Text
  23. ↵
    1. Howes OD,
    2. Montgomery AJ,
    3. Asselin MC,
    4. Murray RM,
    5. Valli I,
    6. Tabraham P,
    7. Bramon-Bosch E,
    8. Valmaggia L,
    9. Johns L,
    10. Broome M,
    11. McGuire PK,
    12. Grasby PM
    (2009) Elevated striatal dopamine function linked to prodromal signs of schizophrenia. Arch Gen Psychiatry 66:13–20, doi:10.1001/archgenpsychiatry.2008.514, pmid:19124684.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Howes OD,
    2. Kambeitz J,
    3. Kim E,
    4. Stahl D,
    5. Slifstein M,
    6. Abi-Dargham A,
    7. Kapur S
    (2012) The nature of dopamine dysfunction in schizophrenia and what this means for treatment. Arch Gen Psychiatry 69:776–786, doi:10.1001/archgenpsychiatry.2012.169, pmid:22474070.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Huys QJ,
    2. Cools R,
    3. Gölzer M,
    4. Friedel E,
    5. Heinz A,
    6. Dolan RJ,
    7. Dayan P
    (2011) Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput Biol 7:e1002028, doi:10.1371/journal.pcbi.1002028, pmid:21556131.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Huys QJ,
    2. Eshel N,
    3. O'Nions E,
    4. Sheridan L,
    5. Dayan P,
    6. Roiser JP
    (2012) Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comput Biol 8:e1002410, doi:10.1371/journal.pcbi.1002410, pmid:22412360.
    OpenUrlCrossRefPubMed
  27. ↵
    1. Jackowski AP,
    2. Araújo Filho GM,
    3. Almeida AG,
    4. Araújo CM,
    5. Reis M,
    6. Nery F,
    7. Batista IR,
    8. Silva I,
    9. Lacerda AL
    (2012) The involvement of the orbitofrontal cortex in psychiatric disorders: an update of neuroimaging findings. Rev Bras Psiquiatr 34:207–212, doi:10.1016/S1516–4446(12)70040–5, pmid:22729418.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Kapur S
    (2003) Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry 160:13–23, doi:10.1176/appi.ajp.160.1.13, pmid:12505794.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Kehagia AA,
    2. Murray GK,
    3. Robbins TW
    (2010) Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr Opin Neurobiol 20:199–204, doi:10.1016/j.conb.2010.01.007, pmid:20167474.
    OpenUrlCrossRefPubMed
  30. ↵
    1. Kringelbach ML,
    2. Rolls ET
    (2004) The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog Neurobiol 72:341–372, doi:10.1016/j.pneurobio.2004.03.006, pmid:15157726.
    OpenUrlCrossRefPubMed
  31. ↵
    1. Lodge DJ,
    2. Grace AA
    (2007) Aberrant hippocampal activity underlies the dopamine dysregulation in an animal model of schizophrenia. J Neurosci 27:11424–11430, doi:10.1523/JNEUROSCI.2847–07.2007, pmid:17942737.
    OpenUrlAbstract/FREE Full Text
  32. ↵
    1. Malchow B,
    2. Hasan A,
    3. Meyer K,
    4. Schneider-Axmann T,
    5. Radenbach KE,
    6. Gruber O,
    7. Reith W,
    8. McIntosh AM,
    9. Schmitt A,
    10. Falkai P,
    11. Wobrock T
    (2015) Family load impacts orbitofrontal volume in first-episode schizophrenia. Psychiatry Res 232:130–133, doi:10.1016/j.pscychresns.2015.02.006, pmid:25800218.
    OpenUrlCrossRefPubMed
  33. ↵
    1. Martinez D,
    2. Slifstein M,
    3. Broft A,
    4. Mawlawi O,
    5. Hwang DR,
    6. Huang Y,
    7. Cooper T,
    8. Kegeles L,
    9. Zarahn E,
    10. Abi-Dargham A,
    11. Haber SN,
    12. Laruelle M
    (2003) Imaging human mesolimbic dopamine transmission with positron emission tomography. Part II: amphetamine-induced dopamine release in the functional subdivisions of the striatum. J Cereb Blood Flow Metab 23:285–300, doi:10.1097/00004647–200303000–00004, pmid:12621304.
    OpenUrlCrossRefPubMed
  34. ↵
    1. Matsumoto M,
    2. Hikosaka O
    (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837–841, doi:10.1038/nature08028, pmid:19448610.
    OpenUrlCrossRefPubMed
  35. ↵
    1. Matsumoto M,
    2. Takada M
    (2013) Distinct representations of cognitive and motivational signals in midbrain dopamine neurons. Neuron 79:1011–1024, doi:10.1016/j.neuron.2013.07.002, pmid:23932490.
    OpenUrlCrossRefPubMed
  36. ↵
    1. Meador-Woodruff JH,
    2. Haroutunian V,
    3. Powchik P,
    4. Davidson M,
    5. Davis KL,
    6. Watson SJ
    (1997) Dopamine receptor transcript expression in striatum and prefrontal and occipital cortex. Focal abnormalities in orbitofrontal cortex in schizophrenia. Arch Gen Psychiatry 54:1089–1095, doi:10.1001/archpsyc.1997.01830240045007, pmid:9400344.
    OpenUrlCrossRefPubMed
  37. ↵
    1. Menzies L,
    2. Chamberlain SR,
    3. Laird AR,
    4. Thelen SM,
    5. Sahakian BJ,
    6. Bullmore ET
    (2008) Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci Biobehav Rev 32:525–549, doi:10.1016/j.neubiorev.2007.09.005, pmid:18061263.
    OpenUrlCrossRefPubMed
  38. ↵
    1. Mizrahi R,
    2. Addington J,
    3. Rusjan PM,
    4. Suridjan I,
    5. Ng A,
    6. Boileau I,
    7. Pruessner JC,
    8. Remington G,
    9. Houle S,
    10. Wilson AA
    (2012) Increased stress-induced dopamine release in psychosis. Biol Psychiatry 71:561–567, doi:10.1016/j.biopsych.2011.10.009, pmid:22133268.
    OpenUrlCrossRefPubMed
  39. ↵
    1. Montague PR,
    2. Dayan P,
    3. Sejnowski TJ
    (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936–1947, pmid:8774460.
    OpenUrlAbstract/FREE Full Text
  40. ↵
    1. Murray GK,
    2. Corlett PR,
    3. Clark L,
    4. Pessiglione M,
    5. Blackwell AD,
    6. Honey G,
    7. Jones PB,
    8. Bullmore ET,
    9. Robbins TW,
    10. Fletcher PC
    (2008) Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol Psychiatry 13:239, 267–276, doi:10.1038/sj.mp.4002058, pmid:17684497.
    OpenUrlCrossRefPubMed
  41. ↵
    1. Nagy H,
    2. Levy-Gigi E,
    3. Somlai Z,
    4. Takáts A,
    5. Bereczki D,
    6. Kéri S
    (2012) The effect of dopamine agonists on adaptive and aberrant salience in Parkinson's disease. Neuropsychopharmacology 37:950–958, doi:10.1038/npp.2011.278, pmid:22089321.
    OpenUrlCrossRefPubMed
  42. ↵
    1. O'Callaghan MJ,
    2. Bay-Richter C,
    3. O'Tuathaigh CM,
    4. Heery DM,
    5. Waddington JL,
    6. Moran PM
    (2014) Potentiation of latent inhibition by haloperidol and clozapine is attenuated in Dopamine D2 receptor (Drd-2)-deficient mice: do antipsychotics influence learning to ignore irrelevant stimuli via both Drd-2 and non-Drd-2 mechanisms? J Psychopharmacol 28:973–977, doi:10.1177/0269881114544774, pmid:25122042.
    OpenUrlAbstract/FREE Full Text
  43. ↵
    1. O'Doherty JP,
    2. Dayan P,
    3. Friston K,
    4. Critchley H,
    5. Dolan RJ
    (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329–337, doi:10.1016/S0896–6273(03)00169–7, pmid:12718865.
    OpenUrlCrossRefPubMed
  44. ↵
    1. Padoa-Schioppa C,
    2. Assad JA
    (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223–226, doi:10.1038/nature04676, pmid:16633341.
    OpenUrlCrossRefPubMed
  45. ↵
    1. Patlak CS,
    2. Blasberg RG
    (1985) Graphical evaluation of blood-to-brain transfer constants from multiple-time uptake data. Generalizations. J Cereb Blood Flow Metab 5:584–590, doi:10.1038/jcbfm.1985.87, pmid:4055928.
    OpenUrlCrossRefPubMed
  46. ↵
    1. Peters ER,
    2. Joseph SA,
    3. Garety PA
    (1999) Measurement of delusional ideation in the normal population: introducing the PDI (Peters et al. Delusions Inventory). Schizophr Bull 25:553–576, doi:10.1093/oxfordjournals.schbul.a033401, pmid:10478789.
    OpenUrlAbstract/FREE Full Text
  47. ↵
    1. Poletti M,
    2. Frosini D,
    3. Pagni C,
    4. Baldacci F,
    5. Lucetti C,
    6. Del Dotto P,
    7. Ceravolo R,
    8. Bonuccelli U
    (2014) A pilot psychometric study of aberrant salience state in patients with Parkinson's disease and its association with dopamine replacement therapy. Neurol Sci 35:1603–1605, doi:10.1007/s10072–014-1874–6, pmid:25012755.
    OpenUrlCrossRefPubMed
  48. ↵
    1. Raine A
    (1991) The SPQ: a scale for the assessment of schizotypal personality based on DSM-III-R criteria. Schizophr Bull 17:555–564, doi:10.1093/schbul/17.4.555, pmid:1805349.
    OpenUrlAbstract/FREE Full Text
  49. ↵
    1. Robinson TE,
    2. Berridge KC
    (1993) The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res Brain Res Rev 18:247–291, doi:10.1016/0165–0173(93)90013-P, pmid:8401595.
    OpenUrlCrossRefPubMed
  50. ↵
    1. Roesch MR,
    2. Olson CR
    (2004) Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304:307–310, doi:10.1126/science.1093223, pmid:15073380.
    OpenUrlAbstract/FREE Full Text
  51. ↵
    1. Roiser JP,
    2. Stephan KE,
    3. den Ouden HE,
    4. Barnes TR,
    5. Friston KJ,
    6. Joyce EM
    (2009) Do patients with schizophrenia exhibit aberrant salience? Psychol Med 39:199–209, doi:10.1017/S0033291708003863, pmid:18588739.
    OpenUrlCrossRefPubMed
  52. ↵
    1. Roiser JP,
    2. Stephan KE,
    3. den Ouden HE,
    4. Friston KJ,
    5. Joyce EM
    (2010) Adaptive and aberrant reward prediction signals in the human brain. Neuroimage 50:657–664, doi:10.1016/j.neuroimage.2009.11.075, pmid:19969090.
    OpenUrlCrossRefPubMed
  53. ↵
    1. Roiser JP,
    2. Howes OD,
    3. Chaddock CA,
    4. Joyce EM,
    5. McGuire P
    (2013) Neural and behavioral correlates of aberrant salience in individuals at risk for psychosis. Schizophr Bull 39:1328–1336, doi:10.1093/schbul/sbs147, pmid:23236077.
    OpenUrlAbstract/FREE Full Text
  54. ↵
    1. Romaniuk L,
    2. Honey GD,
    3. King JR,
    4. Whalley HC,
    5. McIntosh AM,
    6. Levita L,
    7. Hughes M,
    8. Johnstone EC,
    9. Day M,
    10. Lawrie SM,
    11. Hall J
    (2010) Midbrain activation during Pavlovian conditioning and delusional symptoms in schizophrenia. Arch Gen Psychiatry 67:1246–1254, doi:10.1001/archgenpsychiatry.2010.169, pmid:21135324.
    OpenUrlCrossRefPubMed
  55. ↵
    1. Schlagenhauf F,
    2. Sterzer P,
    3. Schmack K,
    4. Ballmaier M,
    5. Rapp M,
    6. Wrase J,
    7. Juckel G,
    8. Gallinat J,
    9. Heinz A
    (2009) Reward feedback alterations in unmedicated schizophrenia patients: relevance for delusions. Biol Psychiatry 65:1032–1039, doi:10.1016/j.biopsych.2008.12.016, pmid:19195646.
    OpenUrlCrossRefPubMed
  56. ↵
    1. Schlagenhauf F,
    2. Huys QJ,
    3. Deserno L,
    4. Rapp MA,
    5. Beck A,
    6. Heinze HJ,
    7. Dolan R,
    8. Heinz A
    (2014) Striatal dysfunction during reversal learning in unmedicated schizophrenia patients. Neuroimage 89:171–180, doi:10.1016/j.neuroimage.2013.11.034, pmid:24291614.
    OpenUrlCrossRefPubMed
  57. ↵
    1. Schmidt K,
    2. Roiser JP
    (2009) Assessing the construct validity of aberrant salience. Front Behav Neurosci 3:58, doi:10.3389/neuro.08.058.2009, pmid:20057930.
    OpenUrlCrossRefPubMed
  58. ↵
    1. Schoenbaum G,
    2. Roesch MR,
    3. Stalnaker TA,
    4. Takahashi YK
    (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885–892, doi:10.1038/nrn2753, pmid:19904278.
    OpenUrlCrossRefPubMed
  59. ↵
    1. Schönberg T,
    2. Daw ND,
    3. Joel D,
    4. O'Doherty JP
    (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860–12867, doi:10.1523/JNEUROSCI.2496–07.2007, pmid:18032658.
    OpenUrlAbstract/FREE Full Text
  60. ↵
    1. Schultz W,
    2. Dayan P,
    3. Montague PR
    (1997) A neural substrate of prediction and reward. Science 275:1593–1599, doi:10.1126/science.275.5306.1593, pmid:9054347.
    OpenUrlAbstract/FREE Full Text
  61. ↵
    1. Stalnaker TA,
    2. Franz TM,
    3. Singh T,
    4. Schoenbaum G
    (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54:51–58, doi:10.1016/j.neuron.2007.02.014, pmid:17408577.
    OpenUrlCrossRefPubMed
  62. ↵
    1. Sutton R,
    2. Barto AG
    (1998) Reinforcement learning: an introduction (MIT, Cambridge, MA).
  63. ↵
    1. Takahashi YK,
    2. Roesch MR,
    3. Stalnaker TA,
    4. Haney RZ,
    5. Calu DJ,
    6. Taylor AR,
    7. Burke KA,
    8. Schoenbaum G
    (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62:269–280, doi:10.1016/j.neuron.2009.03.005, pmid:19409271.
    OpenUrlCrossRefPubMed
  64. ↵
    1. Takahashi YK,
    2. Roesch MR,
    3. Wilson RC,
    4. Toreson K,
    5. O'Donnell P,
    6. Niv Y,
    7. Schoenbaum G
    (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590–1597, doi:10.1038/nn.2957, pmid:22037501.
    OpenUrlCrossRefPubMed
  65. ↵
    1. Ullsperger M,
    2. Danielmeier C,
    3. Jocham G
    (2014) Neurophysiology of performance monitoring and adaptive behavior. Physiol Rev 94:35–79, doi:10.1152/physrev.00041.2012, pmid:24382883.
    OpenUrlAbstract/FREE Full Text
  66. ↵
    1. Weiner I,
    2. Arad M
    (2009) Using the pharmacology of latent inhibition to model domains of pathology in schizophrenia and their treatment. Behav Brain Res 204:369–386, doi:10.1016/j.bbr.2009.05.004, pmid:19433114.
    OpenUrlCrossRefPubMed
  67. ↵
    1. Winton-Brown TT,
    2. Fusar-Poli P,
    3. Ungless MA,
    4. Howes OD
    (2014) Dopaminergic basis of salience dysregulation in psychosis. Trends Neurosci 37:85–94, doi:10.1016/j.tins.2013.11.003, pmid:24388426.
    OpenUrlCrossRefPubMed
Back to top

In this issue

The Journal of Neuroscience: 35 (28)
Journal of Neuroscience
Vol. 35, Issue 28
15 Jul 2015
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults
Rebecca Boehme, Lorenz Deserno, Tobias Gleich, Teresa Katthagen, Anne Pankow, Joachim Behr, Ralph Buchert, Jonathan P. Roiser, Andreas Heinz, Florian Schlagenhauf
Journal of Neuroscience 15 July 2015, 35 (28) 10103-10111; DOI: 10.1523/JNEUROSCI.0805-15.2015

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults
Rebecca Boehme, Lorenz Deserno, Tobias Gleich, Teresa Katthagen, Anne Pankow, Joachim Behr, Ralph Buchert, Jonathan P. Roiser, Andreas Heinz, Florian Schlagenhauf
Journal of Neuroscience 15 July 2015, 35 (28) 10103-10111; DOI: 10.1523/JNEUROSCI.0805-15.2015
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Materials and Methods
    • Results
    • Discussion
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Keywords

  • aberrant salience
  • dopamine
  • orbitofrontal cortex
  • prediction error
  • reinforcement learning
  • ventral striatum

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

Articles

  • Choice Behavior Guided by Learned, But Not Innate, Taste Aversion Recruits the Orbitofrontal Cortex
  • Maturation of Spontaneous Firing Properties after Hearing Onset in Rat Auditory Nerve Fibers: Spontaneous Rates, Refractoriness, and Interfiber Correlations
  • Insulin Treatment Prevents Neuroinflammation and Neuronal Injury with Restored Neurobehavioral Function in Models of HIV/AIDS Neurodegeneration
Show more Articles

Behavioral/Cognitive

  • Signatures of Electrical Stimulation Driven Network Interactions in the Human Limbic System
  • Dissociable Neural Mechanisms Underlie the Effects of Attention on Visual Appearance and Response Bias
  • Rhythmic Entrainment Echoes in Auditory Perception
Show more Behavioral/Cognitive
  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
(JNeurosci logo)
(SfN logo)

Copyright © 2023 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.