Individual differences in reinforcement learning: behavioral, electrophysiological, and neuroimaging correlates.

Abstract:

:During reinforcement learning, phasic modulations of activity in midbrain dopamine neurons are conveyed to the dorsal anterior cingulate cortex (dACC) and basal ganglia (BG) and serve to guide adaptive responding. While the animal literature supports a role for the dACC in integrating reward history over time, most human electrophysiological studies of dACC function have focused on responses to single positive and negative outcomes. The present electrophysiological study investigated the role of the dACC in probabilistic reward learning in healthy subjects using a task that required integration of reinforcement history over time. We recorded the feedback-related negativity (FRN) to reward feedback in subjects who developed a response bias toward a more frequently rewarded ("rich") stimulus ("learners") versus subjects who did not ("non-learners"). Compared to non-learners, learners showed more positive (i.e., smaller) FRNs and greater dACC activation upon receiving reward for correct identification of the rich stimulus. In addition, dACC activation and a bias to select the rich stimulus were positively correlated. The same participants also completed a monetary incentive delay (MID) task administered during functional magnetic resonance imaging. Compared to non-learners, learners displayed stronger BG responses to reward in the MID task. These findings raise the possibility that learners in the probabilistic reinforcement task were characterized by stronger dACC and BG responses to rewarding outcomes. Furthermore, these results highlight the importance of the dACC to probabilistic reward learning in humans.

journal_name

Neuroimage

journal_title

NeuroImage

authors

Santesso DL,Dillon DG,Birk JL,Holmes AJ,Goetz E,Bogdan R,Pizzagalli DA

doi

10.1016/j.neuroimage.2008.05.032

subject

Has Abstract

pub_date

2008-08-15 00:00:00

pages

807-16

issue

2

eissn

1053-8119

issn

1095-9572

pii

S1053-8119(08)00668-X

journal_volume

42

pub_type

杂志文章
  • Reliable individual differences in fine-grained cortical functional architecture.

    abstract::Fine-grained functional organization of cortex is not well-conserved across individuals. As a result, individual differences in cortical functional architecture are confounded by topographic idiosyncrasies-i.e., differences in functional-anatomical correspondence. In this study, we used hyperalignment to align informa...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.08.029

    authors: Feilong M,Nastase SA,Guntupalli JS,Haxby JV

    更新日期:2018-12-01 00:00:00

  • Variational Bayesian mixed-effects inference for classification studies.

    abstract::Multivariate classification algorithms are powerful tools for predicting cognitive or pathophysiological states from neuroimaging data. Assessing the utility of a classifier in application domains such as cognitive neuroscience, brain-computer interfaces, or clinical diagnostics necessitates inference on classificatio...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2013.03.008

    authors: Brodersen KH,Daunizeau J,Mathys C,Chumbley JR,Buhmann JM,Stephan KE

    更新日期:2013-08-01 00:00:00

  • Physical and physiological consequences of passive intra-oral shimming.

    abstract::Imaging the human orbitofrontal cortex (OFC) with fMRI is problematic due to the proximity of this region to the air-filled sinuses, which causes susceptibility artifacts. Placing a strongly diamagnetic material into the mouth ('mouthshim') of a human volunteer can significantly reduce the artifacts in this region. Us...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.neuroimage.2005.07.006

    authors: Osterbauer RA,Wilson JL,Calvert GA,Jezzard P

    更新日期:2006-01-01 00:00:00

  • Progressive grey matter atrophy over the first 2-3 years of illness in first-episode schizophrenia: a tensor-based morphometry study.

    abstract::Little is known about the structural brain changes that occur over the first few years of schizophrenia, or how these changes differ from those associated with healthy brain development in adolescence and early adulthood. In this study, we aimed to identify regional differences in grey matter (GM) volume between patie...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2006.03.041

    authors: Whitford TJ,Grieve SM,Farrow TF,Gomes L,Brennan J,Harris AW,Gordon E,Williams LM

    更新日期:2006-08-15 00:00:00

  • Verbal episodic memory impairment in Alzheimer's disease: a combined structural and functional MRI study.

    abstract::Anatomical and functional MRI images were acquired in a group of healthy elderly subjects (n = 11) and a group of patients diagnosed with probable Alzheimer's disease, from mild to moderate severity (n = 8). During functional sessions, verbal episodic Encoding and Recognition tasks were presented to subjects. Both gro...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2004.10.045

    authors: Rémy F,Mirrashed F,Campbell B,Richter W

    更新日期:2005-03-01 00:00:00

  • Identifying functional subdivisions in the human brain using meta-analytic activation modeling-based parcellation.

    abstract::Parcellation of the human brain into fine-grained units by grouping voxels into distinct clusters has been an effective approach for delineating specific brain regions and their subregions. Published neuroimaging studies employing coordinate-based meta-analyses have shown that the activation foci and their correspondi...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2015.08.027

    authors: Yang Y,Fan L,Chu C,Zhuo J,Wang J,Fox PT,Eickhoff SB,Jiang T

    更新日期:2016-01-01 00:00:00

  • A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes.

    abstract::Recent multi-voxel pattern classification (MVPC) studies have shown that in early visual cortex patterns of brain activity generated during mental imagery are similar to patterns of activity generated during perception. This finding implies that low-level visual features (e.g., space, spatial frequency, and orientatio...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.10.018

    authors: Naselaris T,Olman CA,Stansbury DE,Ugurbil K,Gallant JL

    更新日期:2015-01-15 00:00:00

  • Multi-atlas segmentation of the whole hippocampus and subfields using multiple automatically generated templates.

    abstract:INTRODUCTION:Advances in image segmentation of magnetic resonance images (MRI) have demonstrated that multi-atlas approaches improve segmentation over regular atlas-based approaches. These approaches often rely on a large number of manually segmented atlases (e.g. 30-80) that take significant time and expertise to prod...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.04.054

    authors: Pipitone J,Park MT,Winterburn J,Lett TA,Lerch JP,Pruessner JC,Lepage M,Voineskos AN,Chakravarty MM,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2014-11-01 00:00:00

  • Ultra-high field MRI: Advancing systems neuroscience towards mesoscopic human brain function.

    abstract::Human MRI scanners at ultra-high magnetic field strengths of 7 T and higher are increasingly available to the neuroscience community. A key advantage brought by ultra-high field MRI is the possibility to increase the spatial resolution at which data is acquired, with little reduction in image quality. This opens a new...

    journal_title:NeuroImage

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuroimage.2017.01.028

    authors: Dumoulin SO,Fracasso A,van der Zwaag W,Siero JCW,Petridou N

    更新日期:2018-03-01 00:00:00

  • A special role for numbers in working memory? An fMRI study.

    abstract::Although numbers carry averbal semantics (i.e., magnitude), they are often utilized in verbal Working Memory (vWM) tasks. However, vWM is thought to rely on a purely phonological code. Here, we tested the influence of (a) averbal semantics and (b) different tasks on performance in a vWM context by examining stimulus a...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.neuroimage.2005.07.009

    authors: Knops A,Nuerk HC,Fimm B,Vohn R,Willmes K

    更新日期:2006-01-01 00:00:00

  • Thinking about intentions.

    abstract::In this fMRI study, we investigated the convergence of underlying neural networks in thinking about a scenario involving one's own intentional action and its consequences and setting up and holding in mind an intention to act. A factorial design was employed comprising two factors: i. Causality (intentional or physica...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2005.05.001

    authors: den Ouden HE,Frith U,Frith C,Blakemore SJ

    更新日期:2005-12-01 00:00:00

  • The fine line between 'brave' and 'reckless': amygdala reactivity and regulation predict recognition of risk.

    abstract:BACKGROUND:High sensation-seekers (HSS) pursue novelty even at the cost of self-harm. When challenged, HSS are less anxious, show blunted physiological (cortisol, startle) and neurobiological (prefrontal-limbic) responses, and devalue aversive outcomes. Here, we investigate how these features interact under conditions ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.08.038

    authors: Mujica-Parodi LR,Carlson JM,Cha 차지욱 J,Rubin D

    更新日期:2014-12-01 00:00:00

  • Graded recall success: an event-related fMRI comparison of tip of the tongue and feeling of knowing.

    abstract::Insights into memory retrieval processes can be obtained by examining graded recall success, specifically, tip-of-the-tongue (TOT) and feeling-of-knowing (FOK) states. TOT is defined as a recall failure accompanied by a strong feeling of imminent retrieval, and FOK as a recall failure accompanied by a feeling of futur...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2004.10.024

    authors: Maril A,Simons JS,Weaver JJ,Schacter DL

    更新日期:2005-02-15 00:00:00

  • Deficits in ascending and descending pain modulation pathways in patients with postherpetic neuralgia.

    abstract::Postherpetic Neuralgia (PHN), develops after the resolution of the herpes zoster mucocutaneous eruption, is a debilitating chronic pain. However, there is a lack of knowledge regarding the underlying mechanisms associated with ascending and descending pain modulations in PHN patients. Here, we combined psychophysics w...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.117186

    authors: Li H,Li X,Feng Y,Gao F,Kong Y,Hu L

    更新日期:2020-11-01 00:00:00

  • Resting state network estimation in individual subjects.

    abstract::Resting state functional magnetic resonance imaging (fMRI) has been used to study brain networks associated with both normal and pathological cognitive functions. The objective of this work is to reliably compute resting state network (RSN) topography in single participants. We trained a supervised classifier (multi-l...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2013.05.108

    authors: Hacker CD,Laumann TO,Szrama NP,Baldassarre A,Snyder AZ,Leuthardt EC,Corbetta M

    更新日期:2013-11-15 00:00:00

  • Dynamic functional connectivity impairments in early schizophrenia and clinical high-risk for psychosis.

    abstract::Individuals at clinical high-risk (CHR) for psychosis are characterized by attenuated psychotic symptoms. Only a minority of CHR individuals convert to full-blown psychosis. Therefore, there is a strong interest in identifying neurobiological abnormalities underlying the psychosis risk syndrome. Dynamic functional con...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.10.022

    authors: Du Y,Fryer SL,Fu Z,Lin D,Sui J,Chen J,Damaraju E,Mennigen E,Stuart B,Loewy RL,Mathalon DH,Calhoun VD

    更新日期:2018-10-15 00:00:00

  • Affective decision making under uncertainty during a plausible aviation task: an fMRI study.

    abstract::In aeronautics, plan continuation error (PCE) represents failure to revise a flight plan despite emerging evidence suggesting that it is no longer safe. Assuming that PCE may be associated with a shift from cold to hot reasoning, we hypothesized that this transition may result from a large range of strong negative emo...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.12.060

    authors: Causse M,Péran P,Dehais F,Caravasso CF,Zeffiro T,Sabatini U,Pastor J

    更新日期:2013-05-01 00:00:00

  • Microstructure of frontoparietal connections predicts individual resistance to sleep deprivation.

    abstract::Sleep deprivation (SD) can degrade cognitive functioning, but growing evidence suggests that there are large individual differences in the vulnerability to this effect. Some evidence suggests that baseline differences in the responsiveness of a fronto-parietal attention system that is activated during working memory (...

    journal_title:NeuroImage

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.neuroimage.2014.11.035

    authors: Cui J,Tkachenko O,Gogel H,Kipman M,Preer LA,Weber M,Divatia SC,Demers LA,Olson EA,Buchholz JL,Bark JS,Rosso IM,Rauch SL,Killgore WD

    更新日期:2015-02-01 00:00:00

  • Implementation of visuospatial cues in response selection.

    abstract::We used functional magnetic resonance imaging to examine neuronal activity reflecting the dynamic interplay of external and internal guidance of action. Participants performed a choice reaction time task based on spatial visual cues with their right and left middle and index finger. In a given trial, the cue either fu...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2005.07.014

    authors: van Eimeren T,Wolbers T,Münchau A,Büchel C,Weiller C,Siebner HR

    更新日期:2006-01-01 00:00:00

  • Real-time fMRI and its application to neurofeedback.

    abstract::Real-time fMRI (rtfMRI) allows immediate access to experimental results by analyzing data as fast as they are acquired. It was devised soon after the inception of fMRI and has undergone a rapid development since then. The availability of results during the ongoing experiment facilitates a variety of applications such ...

    journal_title:NeuroImage

    pub_type: 历史文章,杂志文章,评审

    doi:10.1016/j.neuroimage.2011.10.009

    authors: Weiskopf N

    更新日期:2012-08-15 00:00:00

  • CLADA: cortical longitudinal atrophy detection algorithm.

    abstract::Measurement of changes in brain cortical thickness is useful for the assessment of regional gray matter atrophy in neurodegenerative conditions. A new longitudinal method, called CLADA (cortical longitudinal atrophy detection algorithm), has been developed for the measurement of changes in cortical thickness in magnet...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2010.07.052

    authors: Nakamura K,Fox R,Fisher E

    更新日期:2011-01-01 00:00:00

  • Paired pulse depression in the somatosensory cortex: associations between MEG and BOLD fMRI.

    abstract::Interpretation of the blood oxygen level dependent (BOLD) response measured using functional magnetic resonance imaging (fMRI) requires an understanding of the underlying neuronal activity. Here we report on a study using both magnetoencephalography (MEG) and BOLD fMRI, to measure the brain's functional response to el...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.10.037

    authors: Stevenson CM,Wang F,Brookes MJ,Zumer JM,Francis ST,Morris PG

    更新日期:2012-02-01 00:00:00

  • The tendency to trust is reflected in human brain structure.

    abstract::Trust is an important component of human social life. Within the brain, the function within a neural network implicated in interpersonal and social-cognitive processing is associated with the way trust-based decisions are made. However, it is currently unknown how localized structure within the healthy human brain is ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.11.060

    authors: Haas BW,Ishak A,Anderson IW,Filkowski MM

    更新日期:2015-02-15 00:00:00

  • Stimulation of subgenual cingulate area decreases limbic top-down effect on ventral visual stream: A DBS-EEG pilot study.

    abstract::Deep brain stimulation (DBS) of the subgenual cingulate gyrus (area CG25) is beneficial in treatment resistant depression. Though the mechanisms of action of Cg25 DBS remain largely unknown, it is commonly believed that Cg25 DBS modulates limbic activity of large networks to achieve thymic regulation of patients. To i...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2016.10.018

    authors: Kibleur A,Polosan M,Favre P,Rudrauf D,Bougerol T,Chabardès S,David O

    更新日期:2017-02-01 00:00:00

  • A protocol for use of medetomidine anesthesia in rats for extended studies using task-induced BOLD contrast and resting-state functional connectivity.

    abstract::The alpha-2-adrenoreceptor agonist, medetomidine, which exhibits dose-dependent sedative effects and is gaining acceptance in small-animal functional magnetic resonance imaging (fMRI), has been studied. Rats were examined on the bench using the classic tail-pinch method with three infusion sequences: 100 microg/kg/h, ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2009.03.004

    authors: Pawela CP,Biswal BB,Hudetz AG,Schulte ML,Li R,Jones SR,Cho YR,Matloub HS,Hyde JS

    更新日期:2009-07-15 00:00:00

  • Detecting white matter activity using conventional 3 Tesla fMRI: An evaluation of standard field strength and hemodynamic response function.

    abstract::Detection of functional magnetic resonance imaging (fMRI) activation in white matter has been increasingly reported despite historically being controversial. Much of the development work to-date has used high-field 4 T MRI and specialized pulse sequences. In the current study, we utilized conventional 3 T MRI and a co...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.12.008

    authors: Courtemanche MJ,Sparrey CJ,Song X,MacKay A,D'Arcy RCN

    更新日期:2018-04-01 00:00:00

  • Changes in structural and functional connectivity among resting-state networks across the human lifespan.

    abstract::At rest, the brain's sensorimotor and higher cognitive systems engage in organized patterns of correlated activity forming resting-state networks. An important empirical question is how functional connectivity and structural connectivity within and between resting-state networks change with age. In this study we use n...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.07.067

    authors: Betzel RF,Byrge L,He Y,Goñi J,Zuo XN,Sporns O

    更新日期:2014-11-15 00:00:00

  • Classic identity negative priming involves accessing semantic representations in the left anterior temporal cortex.

    abstract::Classic identity negative priming (NP) refers to the finding that when an object is ignored, subsequent naming responses to it are slower than when it has not been previously ignored (Tipper, S.P., 1985. The negative priming effect: inhibitory priming by ignored objects. Q. J. Exp. Psychol. 37A, 571-590). It is unclea...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.neuroimage.2006.06.024

    authors: de Zubicaray G,McMahon K,Eastburn M,Pringle A,Lorenz L

    更新日期:2006-10-15 00:00:00

  • In vivo multi-slice mapping of myelin water content using T2* decay.

    abstract::Quantitative assessment of the myelin water content in the brain can substantially improve our understanding of white matter diseases such as multiple sclerosis. In this study, in vivo myelin water content was estimated using T(2)* relaxation with multi-slice acquisitions in magnetic resonance imaging (MRI). The main ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2010.04.023

    authors: Hwang D,Kim DH,Du YP

    更新日期:2010-08-01 00:00:00

  • Left hemisphere lateralization for lexical and acoustic pitch processing in Cantonese speakers as revealed by mismatch negativity.

    abstract::For nontonal language speakers, speech processing is lateralized to the left hemisphere and musical processing is lateralized to the right hemisphere (i.e., function-dependent brain asymmetry). On the other hand, acoustic temporal processing is lateralized to the left hemisphere and spectral/pitch processing is latera...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2013.02.080

    authors: Gu F,Zhang C,Hu A,Zhao G

    更新日期:2013-12-01 00:00:00