QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

HOME  |   SEARCH  |   ARCHIVE  |   SUBSCRIBE  |   CONTACT  |   HELP

The Journal of Neuroscience, November 19, 2008, 28(47):12294-12304; doi:10.1523/JNEUROSCI.3116-08.2008

This Article Full Text Full Text (PDF) Submit an eLetter Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Moustafa, A. A. Articles by Frank, M. J. Search for Related Content PubMed PubMed Citation Articles by Moustafa, A. A. Articles by Frank, M. J.

 Previous Article  |  Next Article 

Behavioral/Systems/Cognitive
A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism

Ahmed A. Moustafa,^1 * Michael X. Cohen,¹ Scott J. Sherman,² and Michael J. Frank^1 *

¹Department of Psychology and Program in Neuroscience, and ²Department of Neurology, University of Arizona, Tucson, Arizona 85721

Correspondence should be addressed to Michael J. Frank at the above address. Email: mfrank{at}u.arizona.edu

Converging evidence implicates striatal dopamine (DA) in reinforcement learning, such that DA increases enhance "Go learning" to pursue actions with rewarding outcomes, whereas DA decreases enhance "NoGo learning" to avoid non-rewarding actions. Here we test whether these effects apply to the response time domain. We employ a novel paradigm which requires the adjustment of response times to a single response. Reward probability varies as a function of response time, whereas reward magnitude changes in the opposite direction. In the control condition, these factors exactly cancel, such that the expected value across time is constant (CEV). In two other conditions, expected value increases (IEV) or decreases (DEV), such that reward maximization requires either speeding up (Go learning) or slowing down (NoGo learning) relative to the CEV condition. We tested patients with Parkinson's disease (depleted striatal DA levels) on and off dopaminergic medication, compared with age-matched controls. While medicated, patients were better at speeding up in the DEV relative to CEV conditions. Conversely, nonmedicated patients were better at slowing down to maximize reward in the IEV condition. These effects of DA manipulation on cumulative Go/NoGo response time adaptation were captured with our a priori computational model of the basal ganglia, previously applied only to forced-choice tasks. There were also robust trial-to-trial changes in response time, but these single trial adaptations were not affected by disease or medication and are posited to rely on extrastriatal, possibly prefrontal, structures.

Key words: Parkinson's disease; basal ganglia; dopamine; reinforcement learning; computational model; reward

---

Received July 4, 2008; revised Sept. 24, 2008; accepted Oct. 7, 2008.

Correspondence should be addressed to Michael J. Frank at the above address. Email: mfrank{at}u.arizona.edu

This article has been cited by other articles:

				N. Bodi, S. Keri, H. Nagy, A. Moustafa, C. E. Myers, N. Daw, G. Dibo, A. Takats, D. Bereczki, and M. A. Gluck Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients Brain, September 1, 2009; 132(9): 2385 - 2395. [Abstract] [Full Text] [PDF]

Home  |   Search  |   Archive  |   Subscribe  |   Contact  |   Help