The University of Southampton
University of Southampton Institutional Repository

Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD

Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD
Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD
Attention Deficit/Hyperactivity Disorder (ADHD) is a pathophysiologically complex and heterogeneous condition with both cognitive and motivational components. We propose a novel computational hypothesis of motivational deficits in ADHD, drawing together recent evidence on the role of anterior cingulate cortex (ACC) and associated mesolimbic dopamine circuits in both reinforcement learning and ADHD. Based on findings of dopamine dysregulation and ACC involvement in ADHD we simulated a lesion in a previously validated computational model of ACC (Reward Value and Prediction Model, RVPM). We explored the effects of the lesion on the processing of reinforcement signals. We tested specific behavioral predictions about the profile of reinforcement-related deficits in ADHD in three experimental contexts; probability tracking task, partial and continuous reward schedules, and immediate versus delayed rewards. In addition, predictions were made at the neurophysiological level. Behavioral and neurophysiological predictions from the RVPM-based lesion-model of motivational dysfunction in ADHD were confirmed by data from previously published studies. RVPM represents a promising model of ADHD reinforcement learning suggesting that ACC dysregulation might play a role in the pathogenesis of motivational deficits in ADHD. However, more behavioral and neurophysiological studies are required to test core predictions of the model. In addition, the interaction with different brain networks underpinning other aspects of ADHD neuropathology (i.e., executive function) needs to be better understood.

adhd, acc, reinforcement learning, dopamine, prediction error, reward expectation
199-209
Silvetti, Massimo
380dd068-96ec-4734-aef8-1e84e1800ad1
Wiersema, Jan R.
cc91556a-6a9f-4079-b0b8-502bd729b936
Sonuga-Barke, Edmund
bc80bf95-6cf9-4c76-a09d-eaaf0b717635
Verguts, Tom
6e5335fd-b742-4c58-8dd4-31a37e6c5d46
Silvetti, Massimo
380dd068-96ec-4734-aef8-1e84e1800ad1
Wiersema, Jan R.
cc91556a-6a9f-4079-b0b8-502bd729b936
Sonuga-Barke, Edmund
bc80bf95-6cf9-4c76-a09d-eaaf0b717635
Verguts, Tom
6e5335fd-b742-4c58-8dd4-31a37e6c5d46

Silvetti, Massimo, Wiersema, Jan R., Sonuga-Barke, Edmund and Verguts, Tom (2013) Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD. Neural Networks, 46, 199-209. (doi:10.1016/j.neunet.2013.05.008).

Record type: Article

Abstract

Attention Deficit/Hyperactivity Disorder (ADHD) is a pathophysiologically complex and heterogeneous condition with both cognitive and motivational components. We propose a novel computational hypothesis of motivational deficits in ADHD, drawing together recent evidence on the role of anterior cingulate cortex (ACC) and associated mesolimbic dopamine circuits in both reinforcement learning and ADHD. Based on findings of dopamine dysregulation and ACC involvement in ADHD we simulated a lesion in a previously validated computational model of ACC (Reward Value and Prediction Model, RVPM). We explored the effects of the lesion on the processing of reinforcement signals. We tested specific behavioral predictions about the profile of reinforcement-related deficits in ADHD in three experimental contexts; probability tracking task, partial and continuous reward schedules, and immediate versus delayed rewards. In addition, predictions were made at the neurophysiological level. Behavioral and neurophysiological predictions from the RVPM-based lesion-model of motivational dysfunction in ADHD were confirmed by data from previously published studies. RVPM represents a promising model of ADHD reinforcement learning suggesting that ACC dysregulation might play a role in the pathogenesis of motivational deficits in ADHD. However, more behavioral and neurophysiological studies are required to test core predictions of the model. In addition, the interaction with different brain networks underpinning other aspects of ADHD neuropathology (i.e., executive function) needs to be better understood.

This record has no associated files available for download.

More information

Published date: 2013
Keywords: adhd, acc, reinforcement learning, dopamine, prediction error, reward expectation
Organisations: Clinical Neuroscience

Identifiers

Local EPrints ID: 354553
URI: http://eprints.soton.ac.uk/id/eprint/354553
PURE UUID: ca3a1136-8bec-4588-8788-d47daabc1322

Catalogue record

Date deposited: 15 Jul 2013 14:33
Last modified: 14 Mar 2024 14:20

Export record

Altmetrics

Contributors

Author: Massimo Silvetti
Author: Jan R. Wiersema
Author: Edmund Sonuga-Barke
Author: Tom Verguts

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×