Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD
Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD
Attention Deficit/Hyperactivity Disorder (ADHD) is a pathophysiologically complex and heterogeneous condition with both cognitive and motivational components. We propose a novel computational hypothesis of motivational deficits in ADHD, drawing together recent evidence on the role of anterior cingulate cortex (ACC) and associated mesolimbic dopamine circuits in both reinforcement learning and ADHD. Based on findings of dopamine dysregulation and ACC involvement in ADHD we simulated a lesion in a previously validated computational model of ACC (Reward Value and Prediction Model, RVPM). We explored the effects of the lesion on the processing of reinforcement signals. We tested specific behavioral predictions about the profile of reinforcement-related deficits in ADHD in three experimental contexts; probability tracking task, partial and continuous reward schedules, and immediate versus delayed rewards. In addition, predictions were made at the neurophysiological level. Behavioral and neurophysiological predictions from the RVPM-based lesion-model of motivational dysfunction in ADHD were confirmed by data from previously published studies. RVPM represents a promising model of ADHD reinforcement learning suggesting that ACC dysregulation might play a role in the pathogenesis of motivational deficits in ADHD. However, more behavioral and neurophysiological studies are required to test core predictions of the model. In addition, the interaction with different brain networks underpinning other aspects of ADHD neuropathology (i.e., executive function) needs to be better understood.
adhd, acc, reinforcement learning, dopamine, prediction error, reward expectation
199-209
Silvetti, Massimo
380dd068-96ec-4734-aef8-1e84e1800ad1
Wiersema, Jan R.
cc91556a-6a9f-4079-b0b8-502bd729b936
Sonuga-Barke, Edmund
bc80bf95-6cf9-4c76-a09d-eaaf0b717635
Verguts, Tom
6e5335fd-b742-4c58-8dd4-31a37e6c5d46
2013
Silvetti, Massimo
380dd068-96ec-4734-aef8-1e84e1800ad1
Wiersema, Jan R.
cc91556a-6a9f-4079-b0b8-502bd729b936
Sonuga-Barke, Edmund
bc80bf95-6cf9-4c76-a09d-eaaf0b717635
Verguts, Tom
6e5335fd-b742-4c58-8dd4-31a37e6c5d46
Silvetti, Massimo, Wiersema, Jan R., Sonuga-Barke, Edmund and Verguts, Tom
(2013)
Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD.
Neural Networks, 46, .
(doi:10.1016/j.neunet.2013.05.008).
Abstract
Attention Deficit/Hyperactivity Disorder (ADHD) is a pathophysiologically complex and heterogeneous condition with both cognitive and motivational components. We propose a novel computational hypothesis of motivational deficits in ADHD, drawing together recent evidence on the role of anterior cingulate cortex (ACC) and associated mesolimbic dopamine circuits in both reinforcement learning and ADHD. Based on findings of dopamine dysregulation and ACC involvement in ADHD we simulated a lesion in a previously validated computational model of ACC (Reward Value and Prediction Model, RVPM). We explored the effects of the lesion on the processing of reinforcement signals. We tested specific behavioral predictions about the profile of reinforcement-related deficits in ADHD in three experimental contexts; probability tracking task, partial and continuous reward schedules, and immediate versus delayed rewards. In addition, predictions were made at the neurophysiological level. Behavioral and neurophysiological predictions from the RVPM-based lesion-model of motivational dysfunction in ADHD were confirmed by data from previously published studies. RVPM represents a promising model of ADHD reinforcement learning suggesting that ACC dysregulation might play a role in the pathogenesis of motivational deficits in ADHD. However, more behavioral and neurophysiological studies are required to test core predictions of the model. In addition, the interaction with different brain networks underpinning other aspects of ADHD neuropathology (i.e., executive function) needs to be better understood.
This record has no associated files available for download.
More information
Published date: 2013
Keywords:
adhd, acc, reinforcement learning, dopamine, prediction error, reward expectation
Organisations:
Clinical Neuroscience
Identifiers
Local EPrints ID: 354553
URI: http://eprints.soton.ac.uk/id/eprint/354553
PURE UUID: ca3a1136-8bec-4588-8788-d47daabc1322
Catalogue record
Date deposited: 15 Jul 2013 14:33
Last modified: 14 Mar 2024 14:20
Export record
Altmetrics
Contributors
Author:
Massimo Silvetti
Author:
Jan R. Wiersema
Author:
Edmund Sonuga-Barke
Author:
Tom Verguts
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics