Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE
PreviousNext
Articles, Behavioral/Systems/Cognitive

Anterior Prefrontal Cortex Contributes to Action Selection through Tracking of Recent Reward Trends

Christopher K. Kovach, Nathaniel D. Daw, David Rudrauf, Daniel Tranel, John P. O'Doherty and Ralph Adolphs
Journal of Neuroscience 20 June 2012, 32 (25) 8434-8442; https://doi.org/10.1523/JNEUROSCI.5468-11.2012
Christopher K. Kovach
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nathaniel D. Daw
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Rudrauf
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel Tranel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John P. O'Doherty
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ralph Adolphs
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Figure 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1.

    Experimental task. Participants chose from among four differently colored bandits, which yielded a positive reward between 0 and 100. Payoff varied according to a slowly drifting pseudorandom walk, fixed across subjects (inset, solid line), with added Gaussian noise, different across subjects, of constant SD (inset, shaded region).

  • Figure 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2.

    Lesion overlap in the FP group. Lesions were predominantly right sided and included cortex and white matter outside the FPC; all but one patient had bilateral involvement.

  • Figure 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 3.

    Conditional logit (CL) model. Weights in the CL model show the influence of past reward on selection probability, where the choice value of each bandit is given by a weighted sum over recent payoffs from the bandit. Significance levels under the Wilcoxon rank-sum test (H0, zero median) or Kruskal–Wallis tests (H0, equal medians) are indicated (*p < 0.01, otherwise as shown for p < 0.05). Significant group effects are shown (horizontal bar).

  • Figure 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 4.

    Separate additive contributions of RL and LD terms to weighing of payoffs as a function of selection lag for each group. Points represent individual fits, and lines indicate median weighting across individuals. Top, RL weighting. Middle, LD weighting. Bottom, Sum RL+LD weighting. Note the absence of a contribution of the LD term in group FP. Results do not change with the exclusion of the outlier in group FP.

  • Figure 5.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 5.

    Mean change in reward (difference between the lag-1 and lag-2 payoffs, Δreward) for stay and switch trials. Mean change is shown for trials in which the same choice was repeated (stay trials) and in which a new bandit was chosen (switch trials). For switch trials, Δreward is shown both for the selected bandit (switch, lag-0 choice) and for the previously selected bandit (switch, lag-1 choice). Significance of group effects in each category is indicated with uncorrected p values. Overall significance for the group effect was p = 0.046 (repeated-measures ANOVA).

Tables

  • Figures
    • View popup
    Table 1.

    Participant data

    GroupGenderAge (years)EdVIQPIQFS-IQ
    FPC6 M/2 F52 (15)14 (3.4)114 (20)105 (19)111 (19)
    BDC3 M/5 F45 (18)14 (2)100 (8)106 (8)103 (7)
    NC4 M/10 F53 (10)16 (1.8)110 (10)108 (8)110 (8)
    • Values age given as mean (SD). All participants were fully right handed. M, Male; F, female; VIQ, verbal IQ; PIQ, performance IQ. IQ data were obtained from the WAIS-III (FP, BDC) or estimated from the NART, WRAT-R or abbreviated WAIS-III (NC). Ed, Years of education.

    • View popup
    Table 2.

    Parameters for the RL+LD model

    ParameterDescriptionFPCBDCNC
    βVRL inverse temperature0.33 (0.36)0.53 (0.38)0.45 (0.39)
    αRL learning rate0.52 (0.46)0.35 (0.48)0.43 (0.45)
    βCRecency inverse temperature0.75 (1.1)0.66 (0.89)0.63 (1.31)
    κRecency decay0.40 (0.34)0.14 (0.55)0.42 (0.39)
    βDLag difference−0.008 (0.015)0.034 (0.026)0.026 (0.023)
    • Mean (SD) is shown for parameter values within each participant group.

Back to top

In this issue

The Journal of Neuroscience: 32 (25)
Journal of Neuroscience
Vol. 32, Issue 25
20 Jun 2012
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Anterior Prefrontal Cortex Contributes to Action Selection through Tracking of Recent Reward Trends
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Anterior Prefrontal Cortex Contributes to Action Selection through Tracking of Recent Reward Trends
Christopher K. Kovach, Nathaniel D. Daw, David Rudrauf, Daniel Tranel, John P. O'Doherty, Ralph Adolphs
Journal of Neuroscience 20 June 2012, 32 (25) 8434-8442; DOI: 10.1523/JNEUROSCI.5468-11.2012

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
Anterior Prefrontal Cortex Contributes to Action Selection through Tracking of Recent Reward Trends
Christopher K. Kovach, Nathaniel D. Daw, David Rudrauf, Daniel Tranel, John P. O'Doherty, Ralph Adolphs
Journal of Neuroscience 20 June 2012, 32 (25) 8434-8442; DOI: 10.1523/JNEUROSCI.5468-11.2012
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Materials and Methods
    • Results
    • Discussion
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

Articles

  • Memory Retrieval Has a Dynamic Influence on the Maintenance Mechanisms That Are Sensitive to ζ-Inhibitory Peptide (ZIP)
  • Neurophysiological Evidence for a Cortical Contribution to the Wakefulness-Related Drive to Breathe Explaining Hypocapnia-Resistant Ventilation in Humans
  • Monomeric Alpha-Synuclein Exerts a Physiological Role on Brain ATP Synthase
Show more Articles

Behavioral/Systems/Cognitive

  • The Laminar Development of Direction Selectivity in Ferret Visual Cortex
  • Individual Differences in Amygdala-Medial Prefrontal Anatomy Link Negative Affect, Impaired Social Functioning, and Polygenic Depression Risk
  • Influence of Reward on Corticospinal Excitability during Movement Preparation
Show more Behavioral/Systems/Cognitive
  • Home
  • Alerts
  • Follow SFN on BlueSky
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Notice
  • Contact
  • Accessibility
(JNeurosci logo)
(SfN logo)

Copyright © 2025 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.