Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE
PreviousNext
Journal Club

A Role For Orbitofrontal Neurons in Risky Decisions

Armin Lak and William R. Stauffer
Journal of Neuroscience 28 January 2015, 35 (4) 1340-1342; DOI: https://doi.org/10.1523/JNEUROSCI.4325-14.2015
Armin Lak
Department of Physiology, Development, and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Armin Lak
William R. Stauffer
Department of Physiology, Development, and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for William R. Stauffer
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Making choices between goods appears intuitive but difficulties arise from a computational perspective. In particular, what metric can be used to compare goods that vary along dimensions lacking common units, such as time and amount? A predominant idea is that we integrate value across those dimensions and choose the option with the highest value on the integrated common currency scale. Indeed, when individuals make economically consistent choices, they behave as though they choose the good with the highest integrated value. A fundamental challenge for neuroscience is mapping neuronal activity onto different aspects of this choice process, thereby illuminating underlying biological mechanisms. A plausible neuronal model for the choice process has neurons at the input stage that encode integrated subjective value signals, and downstream neurons that facilitate decisions by comparing those subjective value input signals (Padoa-Schioppa, 2011). It is therefore of great interest to understand neuronal activity that could provide the integrated subjective value input signals to a comparison process.

A previous study provided evidence that economic value is encoded in the orbitofrontal cortex (OFC) (Padoa-Schioppa and Assad, 2006). By offering monkeys two different juices in variable quantities, the study found that most sampled neurons in the OFC represented one of three important economic variables: (1) the values of individual choice options (offer-value cells), (2) the value of the chosen option (chosen-value cells), and (3) the identity of the chosen reward (chosen-juice cells). The data indicated that chosen-value cells integrated juice taste and quantity into a subjective value signal. However, the activity of offer-value cells strongly correlated with juice quantity, making it difficult to determine whether these neurons encoded subjective value or objective properties. Importantly, whereas chosen-value neurons appear to represent a post-decision variable, offer-value cells can, in principle, act as input to a decision. Thus, offer-value cells might represent the subjective value input signals necessary for a neuronal choice computation. A recent study by Raghuraman and Padoa-Schioppa (2014) sought to investigate this by examining whether these neurons encode objective or subjective values.

Raghuraman and Padoa-Schioppa (2014) recorded single-neuron activity in the OFC while monkeys performed saccade-guided binary choices. The choice options were indicated by visual cues that predicted different juice tastes that varied in size as well as the risk associated with probabilistic delivery. The principal advance in this study was achieved through the latter manipulation: reward risk. In decision theory, risk is defined as known uncertainty in the outcome distribution (Knight, 1921), and it has a central role in influential economic theories such as expected utility theory (von Neumann and Morgenstern, 1944). Importantly for neuroscientists attempting to isolate subjective value signals in the brain, the value of a risky option is purely subjective: risk enhances subjective value in risk seekers and reduces subjective value in risk avoiders. In contrast, other reward attributes (such as taste) differ objectively as well as subjectively: differential neuronal responses to different tastes might represent different chemical properties of the tastes rather than different subjective values. Manipulating reward risk allows researchers to present choices that have different subjective values but identical expected values, thus isolating subjective from objective value.

Raghuraman and Padoa-Schioppa (2014) found that monkeys were risk-seeking the majority of the time. That is, when faced with a choice between a gamble and a safe option with identical expected values, the animals tended to choose the gamble (αbehavioral <1, as quantified in the paper). Although risk aversion is normal among human decision makers, most studies on monkeys have uncovered risk-seeking behavior, at least for small rewards (McCoy and Platt, 2005; O'Neill and Schultz, 2010; Lak et al., 2014). Therefore, from a behavioral perspective the current study is consistent with the risk preferences previously reported.

To determine whether OFC neurons incorporated risk into value signals in a manner consistent with the behavioral choices, Raghuraman and Padoa-Schioppa (2014) constructed a neuronal index for risk attitude, αneuronal. The logic behind this measurement is straightforward. Neurons that encode objective value alone (i.e., a gamble's expected value) would respond identically to a 25% chance of winning eight drops of juice, a 50% chance of four drops of juice, and a certain offer of two drops of juice. Such a neuron will display αneuronal = 1. Greater modulation of neuronal activity in response to the risky options compared with certain rewards corresponds to αneuronal <1, indicating neuronal value responses compatible with risk seeking. Likewise, smaller changes in the neuronal response to the risky options compared with the safe options would translate to αneuronal >1 and reflect risk aversion. Using this framework, the authors showed that the majority of offer- and chosen-value neurons incorporated risk into value in a manner consistent with risk seeking (αneuronal <1). Because this result mirrored the monkeys' overall risk seeking behavior, the OFC neurons appeared to integrate reward attributes and reflect risk attitude.

Risk attitude is not a stable phenomenon. For instance, current wealth state is well known to influence risk attitude (Bernoulli, 1954). The poorer a person is, the more risk averse his choices will be. It was recently discovered that this phenomenon generalizes to thirst: thirsty monkeys were more risk averse for juice rewards than sated monkeys (Yamada et al., 2013). Therefore, if a neuron is involved in trial-by-trial choice behavior, its activity should reflect animals' moment-by-moment risk attitude, rather than a global metric of risk seeking or avoiding. To address this issue, the authors compared the session-by-session measures of behavioral and neuronal risk modulation (αbehavioral and αneuronal). This subtle yet important analysis revealed a positive relationship between daily risk attitude and the activity of offer- and chosen-value neurons. Despite the small correlation coefficient, the result was significant and provided evidence that OFC neurons are dynamically engaged in the economic valuation. It is possible that taking the reward magnitude more directly into account might substantially increase the measured correlation. Human risk attitudes are highly dependent on the magnitude of the rewards at stake (Markowitz, 1952). People are more likely to gamble when they are “playing for peanuts” (Prelec and Loewenstein, 1991) and become more risk averse as real stakes increase (Holt and Laury, 2002). The monkeys in this task gambled for differently sized rewards. Therefore, taking the outcome magnitudes into consideration might reveal a nonlinear relationship between reward size and risk attitude, and increase the correlation between subjective value and OFC neuronal responses.

In addition to encoding variables relevant immediately before and after a decision, Raghuraman and Padoa-Schioppa (2014) demonstrated that OFC neurons encoded events that occurred after the decision, such as the delivery or omission of juice or the value of the received juice. These post-decision signals could be useful during reward learning, and may be related to other reward learning signals, including dopamine prediction error responses (Schultz et al., 1997). Indeed, similar to OFC value-coding neurons, dopamine prediction error responses encode integrated subjective value (Lak et al., 2014). These prediction error signals encode reward properties only when they are valuable to individual decision makers. For instance, risk enhances dopamine responses during risk seeking but fails to modulate dopamine responses during risk-neutral behavior. Therefore, together with the current findings and studies in other brain regions (Matsumoto et al., 2007; So and Stuphorn, 2012), it is apparent that learning-related subjective value signals are found in the activity of single neurons in several brain structures. Quantification of neuronal reinforcement-learning signals using behavioral economic theories would thus provide a coherent framework for studying neuronal correlates of reward learning during economic decision-making.

Raghuraman and Padoa-Schioppa (2014) concluded that OFC neurons integrated reward attributes and encoded the subjective value of choice alternatives and the chosen option. This finding reinforces the idea that the OFC has the capacity to perform a major part of the computations necessary for economic choice. This conclusion does not preclude the possibility that some OFC neurons retain the capacity to reflect valueless variables. Indeed, Raghuraman and Padoa-Schioppa (2014) reported neurons that encode the riskiness of the option. Such OFC neurons were found previously and their activity was shown to be distinct from reward value (O'Neill and Schultz, 2010). This risk signal could be a precursor used in the computation of subjective value signals. Thus, the OFC encodes subjective value and precursors of subjective value.

Despite this clear evidence that OFC neurons encode subjective value of goods, the nature or source of the subjective value signal remains a mystery. Nearly every influential theory of decision-making involves a combination of reward value and the probability of getting that reward. It has long been hypothesized that subjective value can arise from the nonlinear relationship between reward utility and physical reward value (Bernoulli, 1954). More recently, it has been recognized that a second source of nonlinearity can be found in reward probability processing. Decision makers often overweight low-probability rewards and underweight high-probability rewards, leading to an inverted S-shaped probability distortion function (Fig. 1A). Modern decision theories posit that decision makers combine distorted probabilities with a nonlinear utility function (Fig. 1B) to calculate the ultimate decision variable (Kahneman and Tversky, 1979). In this scheme, risk attitudes can be modified in different ways. For instance, apparent risk seeking would increase as the elevation of the probability weight functions increases (gambles become more attractive, especially with the low probabilities used here), or utility functions become more convex (increasing marginal utility for rewards) (Fig. 1, blue arrows). Conversely, apparent risk avoidance would increase when the elevation of the probability weight function decreases (gambles are less attractive) or when utility functions become more concave (decreasing marginal utility for rewards) (Fig. 1, red arrows) (Gonzalez and Wu, 1999). Accordingly, Raghuraman and Padoa-Schioppa (2014) attempted to distinguish different forms of nonlinear subjective value in the OFC signals (dP and dU, as they were named in their paper). Although the current data could not distinguish between the two sources of subjective value, disambiguating these concepts in the future studies could provide mechanistic insights into the neurobiological computation of values and choices.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

A, Classical probability weighting function indicates distorted probabilities that individuals assign to nominal reward probabilities. B, Utility functions represent the relationship between reward magnitude and utility and can account for risk seeking (convex), risk avoiding (concave), or risk neutral (identity line) behavior.

By introducing economic risk into their experiment, Raghuraman and Padoa-Schioppa (2014) demonstrated that neurons in the OFC could provide the necessary integrated subjective value input to the choice computation. Additionally, they identified neuronal correlates for several other variables that might have direct roles in a variety of behavioral contexts, including reward learning. Future studies can build on these insights in multiple ways, including identifying the neuronal building blocks of economic values (namely neurons encoding utility functions and distorted probability), as well as investigating single neuron correlates of reward learning during economic choice.

Footnotes

  • Editor's Note: These short, critical reviews of recent papers in the Journal, written exclusively by graduate students or postdoctoral fellows, are intended to summarize the important findings of the paper and provide additional insight and commentary. For more information on the format and purpose of the Journal Club, please see http://www.jneurosci.org/misc/ifa_features.shtml.

  • We thank Fabian Grabenhorst for helpful comments, and Wellcome Trust and European Research Council for financial support.

  • Correspondence should be addressed to either Armin Lak or William R. Stauffer, Department of Physiology, Development, and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK. arminlak{at}gmail.com or william.stauffer{at}gmail.com

References

  1. ↵
    1. Bernoulli D
    (1954) Exposition of a new theory on the measurement of risk. Econometrica 22:23–36, doi:10.2307/1909829.
    OpenUrlCrossRef
  2. ↵
    1. Gonzalez R,
    2. Wu G
    (1999) On the shape of the probability weighting function. Cogn Psychol 38:129–166, doi:10.1006/cogp.1998.0710, pmid:10090801.
    OpenUrlCrossRefPubMed
  3. ↵
    1. Holt CA,
    2. Laury SK
    (2002) Risk aversion and incentive effects. Am Econ Rev 92:1644–1655, doi:10.1257/000282802762024700.
    OpenUrlCrossRef
  4. ↵
    1. Kahneman D,
    2. Tversky A
    (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263–292, doi:10.2307/1914185.
    OpenUrlCrossRef
  5. ↵
    1. Knight FH
    (1921) Risk, uncertainty and profit (Hart, Boston).
  6. ↵
    1. Lak A,
    2. Stauffer WR,
    3. Schultz W
    (2014) Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc Natl Acad Sci U S A 111:2343–2348, doi:10.1073/pnas.1321596111, pmid:24453218.
    OpenUrlAbstract/FREE Full Text
  7. ↵
    1. Markowitz HM
    (1952) The utility of wealth. J Pol Econ 60:151–158, doi:10.1086/257177.
    OpenUrlCrossRef
  8. ↵
    1. Matsumoto M,
    2. Matsumoto K,
    3. Abe H,
    4. Tanaka K
    (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10:647–656, doi:10.1038/nn1890, pmid:17450137.
    OpenUrlCrossRefPubMed
  9. ↵
    1. McCoy AN,
    2. Platt ML
    (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 8:1220–1227, doi:10.1038/nn1523, pmid:16116449.
    OpenUrlCrossRefPubMed
  10. ↵
    1. O'Neill M,
    2. Schultz W
    (2010) Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68:789–800, doi:10.1016/j.neuron.2010.09.031, pmid:21092866.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Padoa-Schioppa C
    (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333–359, doi:10.1146/annurev-neuro-061010-113648, pmid:21456961.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Padoa-Schioppa C,
    2. Assad JA
    (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223–226, doi:10.1038/nature04676, pmid:16633341.
    OpenUrlCrossRefPubMed
  13. ↵
    1. Prelec D,
    2. Loewenstein G
    (1991) Decision making over time and under uncertainty: a common approach. Manage Sci 37:770–786, doi:10.1287/mnsc.37.7.770.
    OpenUrlCrossRef
  14. ↵
    1. Raghuraman AP,
    2. Padoa-Schioppa C
    (2014) Integration of multiple determinants in the neuronal computation of economic values. J Neurosci 34:11583–11603, doi:10.1523/JNEUROSCI.1235-14.2014, pmid:25164656.
    OpenUrlAbstract/FREE Full Text
  15. ↵
    1. Schultz W,
    2. Dayan P,
    3. Montague PR
    (1997) A neural substrate of prediction and reward. Science 275:1593–1599, doi:10.1126/science.275.5306.1593, pmid:9054347.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. So N,
    2. Stuphorn V
    (2012) Supplementary eye field encodes reward prediction error. J Neurosci 32:2950–2963, doi:10.1523/JNEUROSCI.4419-11.2012, pmid:22378869.
    OpenUrlAbstract/FREE Full Text
  17. ↵
    1. von Neumann J,
    2. Morgenstern O
    (1944) Theory of games and economic behavior (Princeton UP, Princeton, NJ).
  18. ↵
    1. Yamada H,
    2. Tymula A,
    3. Louie K,
    4. Glimcher PW
    (2013) Thirst-dependent risk preferences in monkeys identify a primitive form of wealth. Proc Natl Acad Sci U S A 110:15788–15793, doi:10.1073/pnas.1308718110, pmid:24019461.
    OpenUrlAbstract/FREE Full Text
Back to top

In this issue

The Journal of Neuroscience: 35 (4)
Journal of Neuroscience
Vol. 35, Issue 4
28 Jan 2015
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
A Role For Orbitofrontal Neurons in Risky Decisions
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
A Role For Orbitofrontal Neurons in Risky Decisions
Armin Lak, William R. Stauffer
Journal of Neuroscience 28 January 2015, 35 (4) 1340-1342; DOI: 10.1523/JNEUROSCI.4325-14.2015

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
A Role For Orbitofrontal Neurons in Risky Decisions
Armin Lak, William R. Stauffer
Journal of Neuroscience 28 January 2015, 35 (4) 1340-1342; DOI: 10.1523/JNEUROSCI.4325-14.2015
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

  • Parabrachial Projections to PAG-RVM Axis May Promote Placebo Hypoalgesia and Nocebo Hyperalgesia
  • Differential Dopamine Dynamics in Adolescents and Adults
  • Complementing Neuroregeneration: Deciphering the Role of Neuro-Immune Interactions in CNS Repair
Show more Journal Club
  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
(JNeurosci logo)
(SfN logo)

Copyright © 2022 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.