Human reversal learning under conditions of certain versus uncertain outcomes.

Abstract:

:Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to non-reinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain.

journal_name

Neuroimage

journal_title

NeuroImage

authors

D'Cruz AM,Ragozzino ME,Mosconi MW,Pavuluri MN,Sweeney JA

doi

10.1016/j.neuroimage.2011.01.068

subject

Has Abstract

pub_date

2011-05-01 00:00:00

pages

315-22

issue

1

eissn

1053-8119

issn

1095-9572

pii

S1053-8119(11)00104-2

journal_volume

56

pub_type

杂志文章
  • Task demands modulate sustained and transient neural activity during visual-matching tasks.

    abstract::The extent to which a task demands verbal or non-verbal processing may influence which neural regions underlie performance. In the present study, sustained and transient responses were examined using functional magnetic resonance imaging (fMRI) in conjunction with a mixed blocked/event-related design during three visu...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2004.12.039

    authors: Darcy Burgund E,Lugar HM,Schlaggar BL,Petersen SE

    更新日期:2005-04-01 00:00:00

  • Diffusion kurtosis as an in vivo imaging marker for reactive astrogliosis in traumatic brain injury.

    abstract::Diffusion Kurtosis Imaging (DKI) provides quantifiable information on the non-Gaussian behavior of water diffusion in biological tissue. Changes in water diffusion tensor imaging (DTI) parameters and DKI parameters in several white and gray matter regions were investigated in a mild controlled cortical impact (CCI) in...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.07.050

    authors: Zhuo J,Xu S,Proctor JL,Mullins RJ,Simon JZ,Fiskum G,Gullapalli RP

    更新日期:2012-01-02 00:00:00

  • Cardiac and respiration-induced brain deformations in humans quantified with high-field MRI.

    abstract::Microvascular blood volume pulsations due to the cardiac and respiratory cycles induce brain tissue deformation and, as such, are considered to drive the brain's waste clearance system. We have developed a high-field magnetic resonance imaging (MRI) technique to quantify both cardiac and respiration-induced tissue def...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.116581

    authors: Sloots JJ,Biessels GJ,Zwanenburg JJM

    更新日期:2020-04-15 00:00:00

  • Elevated Neuroinflammation Contributes to the Deleterious Impact of Iron Overload on Brain Function in Aging.

    abstract::Intracellular iron is essential for many neurobiological mechanisms. However, at high concentrations, iron may induce oxidative stress and inflammation. Brain iron overload has been shown in various neurodegenerative disorders and in normal aging. Elevated brain iron in old age may trigger brain dysfunction and concom...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2021.117792

    authors: Salami A,Papenberg G,Sitnikov R,Laukka EJ,Persson J,Kalpouzos G

    更新日期:2021-01-23 00:00:00

  • Measuring relative timings of brain activities using fMRI.

    abstract::Functional MRI (fMRI) has previously been shown to be able to measure hundreds of milliseconds differences in timings of activities in different brain regions, even though the underlying blood oxygenation level-dependent (BOLD) response is delayed and dispersed on the order of seconds. This capability may contribute t...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.10.052

    authors: Katwal SB,Gore JC,Gatenby JC,Rogers BP

    更新日期:2013-02-01 00:00:00

  • Abnormal association between reduced magnetic mismatch field to speech sounds and smaller left planum temporale volume in schizophrenia.

    abstract::Schizophrenia is associated with language-related dysfunction. A previous study [Schizophr. Res. 59 (2003c) 159] has shown that this abnormality is present at the level of automatic discrimination of change in speech sounds, as revealed by magnetoencephalographic recording of auditory mismatch field in response to acr...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2004.01.042

    authors: Yamasue H,Yamada H,Yumoto M,Kamio S,Kudo N,Uetsuki M,Abe O,Fukuda R,Aoki S,Ohtomo K,Iwanami A,Kato N,Kasai K

    更新日期:2004-06-01 00:00:00

  • Echo-time dependence of the BOLD response transients - A window into brain functional physiology.

    abstract::The blood oxygenation level-dependent (BOLD) fMRI response to neuronal activation results from a complex interplay of induced metabolic and vascular changes. Thus, its transients, such as initial overshoot and post-stimulus undershoot, provide a window into the dynamic relationships of the underlying physiological var...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.07.034

    authors: Havlicek M,Ivanov D,Poser BA,Uludag K

    更新日期:2017-10-01 00:00:00

  • Focus of attention modulates the heartbeat evoked potential.

    abstract::Theoretical frameworks such as predictive coding suggest that the perception of the body and world - interoception and exteroception - involve intertwined processes of inference, learning, and prediction. In this framework, attention is thought to gate the influence of sensory information on perception. In contrast to...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.11.037

    authors: Petzschner FH,Weber LA,Wellstein KV,Paolini G,Do CT,Stephan KE

    更新日期:2019-02-01 00:00:00

  • Evidence for a spinal involvement in temporal pain contrast enhancement.

    abstract::Spatiotemporal filtering and amplification of sensory information at multiple levels during the generation of perceptual representations is a fundamental processing principle of the nervous system. While for the visual and auditory system temporal filtering of sensory signals has been noticed for a long time, respecti...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.09.003

    authors: Sprenger C,Stenmans P,Tinnermann A,Büchel C

    更新日期:2018-12-01 00:00:00

  • The influence of contextual reward statistics on risk preference.

    abstract::Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2015.12.016

    authors: Rigoli F,Rutledge RB,Dayan P,Dolan RJ

    更新日期:2016-03-01 00:00:00

  • Overlapping activity in anterior insula during interoception and emotional experience.

    abstract::Classic theories of emotion posit that awareness of one's internal bodily states (interoception) is a key component of emotional experience. This view has been indirectly supported by data demonstrating similar patterns of brain activity - most importantly, in the anterior insula - during both interoception and emotio...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.05.012

    authors: Zaki J,Davis JI,Ochsner KN

    更新日期:2012-08-01 00:00:00

  • Integrating VBM into the General Linear Model with voxelwise anatomical covariates.

    abstract::A current limitation for imaging of brain function is the potential confound of anatomical differences or registration error, which may manifest via apparent functional "activation" for between-subject analyses. With respect to functional activations, underlying tissue mismatches can be regarded as a nuisance variable...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2006.10.007

    authors: Oakes TR,Fox AS,Johnstone T,Chung MK,Kalin N,Davidson RJ

    更新日期:2007-01-15 00:00:00

  • Combining fMRI during resting state and an attention bias task in children.

    abstract::Neuroimaging studies typically focus on either resting state or task-based fMRI data. Prior research has shown that similarity in functional connectivity between rest and cognitive tasks, interpreted as reconfiguration efficiency, is related to task performance and IQ. Here, we extend this approach from adults to chil...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.116301

    authors: Harrewijn A,Abend R,Linke J,Brotman MA,Fox NA,Leibenluft E,Winkler AM,Pine DS

    更新日期:2020-01-15 00:00:00

  • Phonological manipulation between speech perception and production activates a parieto-frontal circuit.

    abstract::Repetition has been shown to activate the so-called 'dorsal stream', a network of temporo-parieto-frontal areas subserving the mapping of acoustic speech input onto articulatory-motor representations. Among these areas, a region in the posterior Sylvian fissure at the temporo-parietal boundary (also called 'area Spt')...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.07.025

    authors: Peschke C,Ziegler W,Eisenberger J,Baumgaertner A

    更新日期:2012-01-02 00:00:00

  • Towards a fronto-temporal neural network for the decoding of angry vocal expressions.

    abstract::Vocal expressions commonly elicit activity in superior temporal and inferior frontal cortices, indicating a distributed network to decode vocally expressed emotions. We examined the involvement of this fronto-temporal network for the decoding of angry voices during attention towards (explicit attention) or away from e...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.06.015

    authors: Frühholz S,Grandjean D

    更新日期:2012-09-01 00:00:00

  • A tensor based morphometry study of longitudinal gray matter contraction in FTD.

    abstract::Frontotemporal dementia (FTD) is a neurodegenerative disease characterized by progressive behavioural abnormalities and frontotemporal atrophy. Here we used tensor based morphometry (TBM) to identify regions of longitudinal progression of gray matter atrophy in FTD compared to controls. T1-weighted MRI images were acq...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.01.028

    authors: Brambati SM,Renda NC,Rankin KP,Rosen HJ,Seeley WW,Ashburner J,Weiner MW,Miller BL,Gorno-Tempini ML

    更新日期:2007-04-15 00:00:00

  • Sustained magnetic fields reveal separate sites for sound level and temporal regularity in human auditory cortex.

    abstract::Magnetoencephalography was used to investigate the relationship between the sustained magnetic field in auditory cortex and the perception of periodic sounds. The response to regular and irregular click trains was measured at three sound intensities. Two separate sources were isolated adjacent to primary auditory cort...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2001.0949

    authors: Gutschalk A,Patterson RD,Rupp A,Uppenkamp S,Scherg M

    更新日期:2002-01-01 00:00:00

  • Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text.

    abstract::Embodiment theory predicts that mental imagery of object words recruits neural circuits involved in object perception. The degree of visual imagery present in routine thought and how it is encoded in the brain is largely unknown. We test whether fMRI activity patterns elicited by participants reading objects' names in...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2015.06.093

    authors: Anderson AJ,Bruni E,Lopopolo A,Poesio M,Baroni M

    更新日期:2015-10-15 00:00:00

  • Measurement of GABAA receptor binding in vivo with [11C]flumazenil: a test-retest study in healthy subjects.

    abstract::[(11)C]Flumazenil is widely used in positron emission tomography (PET) studies to measure GABA(A) receptors in vivo in humans. Although several different methods have been applied for the quantification of [(11)C]flumazenil binding, the reproducibility of these methods has not been previously examined. The reproducibi...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2008.02.035

    authors: Salmi E,Aalto S,Hirvonen J,Långsjö JW,Maksimow AT,Oikonen V,Metsähonkala L,Virkkala J,Någren K,Scheinin H

    更新日期:2008-06-01 00:00:00

  • Spatiotemporal trajectories of reactivation of somatosensory cortex by direct and secondary pathways after dorsal column lesions in squirrel monkeys.

    abstract::After lesions of the somatosensory dorsal column (DC) pathway, the cortical hand representation can become unresponsive to tactile stimuli, but considerable responsiveness returns over weeks of post-lesion recovery. The reactivation suggests that preserved subthreshold sensory inputs become potentiated and axon sprout...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2016.08.015

    authors: Qi HX,Wang F,Liao CC,Friedman RM,Tang C,Kaas JH,Avison MJ

    更新日期:2016-11-15 00:00:00

  • Neuroimaging reveals automatic speech coding during perception of written word meaning.

    abstract::The extent to which visual word perception engages speech codes (i.e., phonological recoding) remains a crucial question in understanding mechanisms of reading. In this study, we used functional magnetic resonance imaging techniques combined with behavioral response measures to examine neural responses to focused vers...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:

    authors: Xu B,Grafman J,Gaillard WD,Spanaki M,Ishii K,Balsamo L,Makale M,Theodore WH

    更新日期:2002-10-01 00:00:00

  • Coupling of gamma band activity to sleep spindle oscillations - a combined EEG/MEG study.

    abstract::Sleep spindles are crucial to memory consolidation. Cortical gamma oscillations (30-100 Hz) are considered to reflect processing of memory in local cortical networks. The temporal and regulatory relationship between spindles and gamma activity might therefore provide clues into how sleep strengthens cortical memory re...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.117452

    authors: Weber FD,Supp GG,Klinzing JG,Mölle M,Engel AK,Born J

    更新日期:2021-01-01 00:00:00

  • Nonlinear coupling between occipital and motor cortex during motor imagery: a dynamic causal modeling study.

    abstract::We demonstrate the capacity of dynamic causal modeling to characterize the nonlinear coupling among cortical sources that underlie time-frequency modulations in MEG data. Our experimental task involved the mental rotation of hand drawings that ten subjects used to decide if it was a right or left hand. Reaction times ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.12.076

    authors: van Wijk BC,Litvak V,Friston KJ,Daffertshofer A

    更新日期:2013-05-01 00:00:00

  • Trajectories of brain aging in middle-aged and older adults: regional and individual differences.

    abstract::The human brain changes with age. However, the rate and the trajectories of change vary among the brain regions and among individuals, and the reasons for these differences are unclear. In a sample of healthy middle-aged and older adults, we examined mean volume change and individual differences in the rate of change ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2010.03.020

    authors: Raz N,Ghisletta P,Rodrigue KM,Kennedy KM,Lindenberger U

    更新日期:2010-06-01 00:00:00

  • Hyperbaric oxygen treatment in acute experimental allergic encephalomyelitis. Contribution of magnetic resonance imaging study.

    abstract::Magnetic resonance imaging (MRI) has been performed to determine the efficacy of hyperbaric oxygen treatment (HBO) on experimental allergic encephalomyelitis (EAE) in Lewis rats. The animals were exposed for 2 x 3 h in a 24-h period at 2 ATA pure O2. Three HBO treatment protocols were used: a 10-day preventive treatme...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.1994.1015

    authors: Namer IJ,Steibel J,Poulet P,Mauss Y,Armspach JP,Eclancher B,Chambron J

    更新日期:1994-11-01 00:00:00

  • Wallerian degeneration after spinal cord lesions in cats detected with diffusion tensor imaging.

    abstract::One goal of in vivo neuroimaging is the detection of neurodegenerative processes and anatomical reorganizations after spinal cord (SC) injury. Non-invasive examination of white matter fibers in the living SC can be conducted using magnetic resonance diffusion-weighted imaging. However, this technique is challenging at...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.04.068

    authors: Cohen-Adad J,Leblond H,Delivet-Mongrain H,Martinez M,Benali H,Rossignol S

    更新日期:2011-08-01 00:00:00

  • The neural system underlying Chinese logograph reading.

    abstract::Written Chinese as logographic script differs notably from alphabets such as English in visual form, orthography, phonology, and semantics. Thus, research on the Chinese language is important to advance our understanding of the universality and particularity of the organization of language systems in the brain. In thi...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2001.0749

    authors: Tan LH,Liu HL,Perfetti CA,Spinks JA,Fox PT,Gao JH

    更新日期:2001-05-01 00:00:00

  • Dynamic causal modeling for calcium imaging: Exploration of differential effective connectivity for sensory processing in a barrel cortical column.

    abstract::Multi-photon calcium imaging (CaI) is an important tool to assess activities of neural populations within a column in the sensory cortex. However, the complex asymmetrical interactions among neural populations, termed effective connectivity, cannot be directly assessed by measuring the activity of each neuron or neura...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.116008

    authors: Jung K,Kang J,Chung S,Park HJ

    更新日期:2019-11-01 00:00:00

  • Individual differences in aesthetic engagement are reflected in resting-state fMRI connectivity: Implications for stress resilience.

    abstract:OBJECTIVE:Individual differences in aesthetic engagement-the propensity to be moved by art, nature, and beauty-are associated with positive health outcomes, as well as stress resilience. The purpose of the current study was to identify potential neural substrate mechanisms underlying individual differences in aesthetic...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.06.042

    authors: Williams PG,Johnson KT,Curtis BJ,King JB,Anderson JS

    更新日期:2018-10-01 00:00:00

  • Stimulus-driven modulation of motor-evoked potentials during observation of others' pain.

    abstract::Empathy may allow interindividual sharing not only of emotions (e.g., joy, sadness, disgust) but also of sensations (e.g., touch, itching, pain). Although empathy for pain may rely upon both sensory and affective components of the pain experience, neuroimaging studies indicate that only the affective component of the ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2006.03.010

    authors: Avenanti A,Minio-Paluello I,Bufalari I,Aglioti SM

    更新日期:2006-08-01 00:00:00