Surprise beyond prediction error.

Abstract:

:Surprise drives learning. Various neural "prediction error" signals are believed to underpin surprise-based reinforcement learning. Here, we report a surprise signal that reflects reinforcement learning but is neither un/signed reward prediction error (RPE) nor un/signed state prediction error (SPE). To exclude these alternatives, we measured surprise responses in the absence of RPE and accounted for a host of potential SPE confounds. This new surprise signal was evident in ventral striatum, primary sensory cortex, frontal poles, and amygdala. We interpret these findings via a normative model of surprise.

journal_name

Hum Brain Mapp

journal_title

Human brain mapping

authors

Chumbley JR,Burke CJ,Stephan KE,Friston KJ,Tobler PN,Fehr E

doi

10.1002/hbm.22513

subject

Has Abstract

pub_date

2014-09-01 00:00:00

pages

4805-14

issue

9

eissn

1065-9471

issn

1097-0193

journal_volume

35

pub_type

杂志文章
  • Somatosensory cortex: a comparison of the response to noxious thermal, mechanical, and electrical stimuli using functional magnetic resonance imaging.

    abstract::In the present study, functional magnetic resonance imaging (fMRI) was used to examine pain perception in humans. Three types of noxious stimuli were presented: electric shock (20.8 mA, 2 Hz), heat (48 degrees C), and mechanical, as well as a control tactile stimulus. The significance of activation at the level of the...

    journal_title:Human brain mapping

    pub_type: 临床试验,杂志文章

    doi:

    authors: Disbrow E,Buonocore M,Antognini J,Carstens E,Rowley HA

    更新日期:1998-01-01 00:00:00

  • The influence of positive and negative emotional associations on semantic processing in depression: an fMRI study.

    abstract::In depression, patients suffer from emotional and cognitive deficits, among others in semantic processing. If these semantic deficits are cognitive or interact with emotional dysfunctions, is still an open question. The aim of the current study was to investigate the influence of emotional valence on the neural correl...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22186

    authors: Sass K,Habel U,Kellermann T,Mathiak K,Gauggel S,Kircher T

    更新日期:2014-02-01 00:00:00

  • Accessing newly learned names and meanings in the native language.

    abstract::Ten healthy adults encountered pictures of unfamiliar archaic tools and successfully learned either their name, verbal definition of their usage, or both. Neural representation of the newly acquired information was probed with magnetoencephalography in an overt picture-naming task before and after learning, and in two...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20561

    authors: Hultén A,Vihla M,Laine M,Salmelin R

    更新日期:2009-03-01 00:00:00

  • Network abnormalities among non-manifesting Parkinson disease related LRRK2 mutation carriers.

    abstract::Non-manifesting carriers (NMC) of the G2019S mutation in the LRRK2 gene represent an "at risk" group for future development of Parkinson's disease (PD) and have demonstrated task related fMRI changes. However, resting-state networks have received less research focus, thus this study aimed to assess the integrity of th...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24543

    authors: Jacob Y,Rosenberg-Katz K,Gurevich T,Helmich RC,Bloem BR,Orr-Urtreger A,Giladi N,Mirelman A,Hendler T,Thaler A

    更新日期:2019-06-01 00:00:00

  • Consortium neuroscience of attention deficit/hyperactivity disorder and autism spectrum disorder: The ENIGMA adventure.

    abstract::Neuroimaging has been extensively used to study brain structure and function in individuals with attention deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) over the past decades. Two of the main shortcomings of the neuroimaging literature of these disorders are the small sample sizes employed a...

    journal_title:Human brain mapping

    pub_type: 杂志文章,评审

    doi:10.1002/hbm.25029

    authors: Hoogman M,van Rooij D,Klein M,Boedhoe P,Ilioska I,Li T,Patel Y,Postema MC,Zhang-James Y,Anagnostou E,Arango C,Auzias G,Banaschewski T,Bau CHD,Behrmann M,Bellgrove MA,Brandeis D,Brem S,Busatto GF,Calderoni S,Calvo

    更新日期:2020-05-18 00:00:00

  • Losing the struggle to stay awake: divergent thalamic and cortical activity during microsleeps.

    abstract::Maintaining alertness is critical for safe and successful performance of most human activities. Consequently, microsleeps during continuous visuomotor tasks, such as driving, can be very serious, not only disrupting performance but sometimes leading to injury or death due to accidents. We have investigated the neural ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22178

    authors: Poudel GR,Innes CR,Bones PJ,Watts R,Jones RD

    更新日期:2014-01-01 00:00:00

  • Individual variability in the shape and amplitude of the BOLD-HRF correlates with endogenous GABAergic inhibition.

    abstract::It has previously been demonstrated that there is a negative correlation between the amplitude of the BOLD response and resting γ amino-butyric acid (GABA) concentration in visual cortex. The work here is the first to empirically characterize individual variability in the haemodynamic response functions (HRFs) in resp...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21223

    authors: Muthukumaraswamy SD,Evans CJ,Edden RA,Wise RG,Singh KD

    更新日期:2012-02-01 00:00:00

  • Key functional circuitry altered in schizophrenia involves parietal regions associated with sense of self.

    abstract::There is still no clear consensus as to which of the many functional and structural changes in the brain in schizophrenia are of most importance, although the main focus to date has been on those in the frontal and cingulate cortices. In the present study, we have used a novel holistic approach to identify brain-wide ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22162

    authors: Guo S,Kendrick KM,Yu R,Wang HL,Feng J

    更新日期:2014-01-01 00:00:00

  • Gray matter correlates of dopaminergic degeneration in Parkinson's disease: A hybrid PET/MR study using (18) F-FP-CIT.

    abstract::Dopaminergic degeneration is a hallmark of Parkinson's disease (PD), which causes various symptoms affected by corticostriatal circuits. So far, the relationship between cortical changes and dopamine loss in the striatum is unclear. Here, we evaluate the gray matter (GM) changes in accordance with striatal dopaminergi...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23130

    authors: Choi H,Cheon GJ,Kim HJ,Choi SH,Kim YI,Kang KW,Chung JK,Kim EE,Lee DS

    更新日期:2016-05-01 00:00:00

  • Statistical inference in brain graphs using threshold-free network-based statistics.

    abstract::The description of brain networks as graphs where nodes represent different brain regions and edges represent a measure of connectivity between a pair of nodes is an increasingly used approach in neuroimaging research. The development of powerful methods for edge-wise group-level statistical inference in brain graphs ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24007

    authors: Baggio HC,Abos A,Segura B,Campabadal A,Garcia-Diaz A,Uribe C,Compta Y,Marti MJ,Valldeoriola F,Junque C

    更新日期:2018-06-01 00:00:00

  • Effects of individual alpha rTMS applied to the auditory cortex and its implications for the treatment of chronic tinnitus.

    abstract::An increasing amount of studies apply repetetive transcranial magnetic stimulation (rTMS) to treat chronic tinnitus, yet the neurophysiological impacts have remained largely obscure. Several studies show that endogenous brain rhythms may be enhanced via diverse brain stimulation techniques applying rhythmic stimulatio...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22152

    authors: Weisz N,Lüchinger C,Thut G,Müller N

    更新日期:2014-01-01 00:00:00

  • fMRI study comparing names versus pictures of objects.

    abstract::We performed an fMRI one-back recognition study aimed at distinguishing the semantic versus perceptual aspects of how objects and their written forms are processed. There were three types of visually presented items: pictures (schematic drawings of objects); words identifying these objects; and a mixed condition in wh...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.10037

    authors: Sevostianov A,Horwitz B,Nechaev V,Williams R,Fromm S,Braun AR

    更新日期:2002-07-01 00:00:00

  • Dorsolateral prefrontal circuit effective connectivity mediates the relationship between white matter structure and PASAT-3 performance in multiple sclerosis.

    abstract::Three decades ago a series of parallel circuits were described involving the frontal cortex and deep grey matter structures, with putative roles in control of motor and oculomotor function, cognition, behaviour and emotion. The circuit comprising the dorsolateral prefrontal cortex, caudate, globus pallidus and thalamu...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25239

    authors: Meng D,Welton T,Elsarraj A,Morgan PS,das Nair R,Constantinescu CS,Evangelou N,Auer DP,Dineen RA

    更新日期:2020-10-19 00:00:00

  • Prediction of human actions: expertise and task-related effects on neural activation of the action observation network.

    abstract::The action observation network (AON) is supposed to play a crucial role when athletes anticipate the effect of others' actions in sports such as tennis. We used functional magnetic resonance imaging to explore whether motor expertise leads to a differential activation pattern within the AON during effect anticipation ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22455

    authors: Balser N,Lorey B,Pilgramm S,Stark R,Bischoff M,Zentgraf K,Williams AM,Munzert J

    更新日期:2014-08-01 00:00:00

  • White matter deficits mediate effects of prenatal alcohol exposure on cognitive development in childhood.

    abstract::Fetal alcohol spectrum disorders comprise the spectrum of cognitive, behavioral, and neurological impairments caused by prenatal alcohol exposure (PAE). Diffusion tensor imaging (DTI) was performed on 54 children (age 10.1 ± 1.0 years) from the Cape Town Longitudinal Cohort, for whom detailed drinking histories obtain...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23218

    authors: Fan J,Jacobson SW,Taylor PA,Molteno CD,Dodge NC,Stanton ME,Jacobson JL,Meintjes EM

    更新日期:2016-08-01 00:00:00

  • Generalizing age effects on brain structure and cognition: A two-study comparison approach.

    abstract::Normal aging is accompanied by an interindividually variable decline in cognitive abilities and brain structure. This variability, in combination with methodical differences and differences in sample characteristics across studies, pose a major challenge for generalizability of results from different studies. Therefor...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24524

    authors: Jockwitz C,Mérillat S,Liem F,Oschwald J,Amunts K,Caspers S,Jäncke L

    更新日期:2019-06-01 00:00:00

  • Common and unique connectivity at the interface of motor, neuropsychiatric, and cognitive symptoms in Parkinson's disease: A commonality analysis.

    abstract::Parkinson's disease (PD) is characterized by overlapping motor, neuropsychiatric, and cognitive symptoms. Worse performance in one domain is associated with worse performance in the other domains. Commonality analysis (CA) is a method of variance partitioning in multiple regression, used to separate the specific and c...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25084

    authors: Lang S,Ismail Z,Kibreab M,Kathol I,Sarna J,Monchi O

    更新日期:2020-09-01 00:00:00

  • Practice-related changes in neural activation patterns investigated via wavelet-based clustering analysis.

    abstract:OBJECTIVES:To evaluate brain activation using functional magnetic resonance imaging (fMRI) and specifically, activation changes across time associated with practice-related cognitive control during eye movement tasks. EXPERIMENTAL DESIGN:Participants were engaged in antisaccade performance (generating a glance away fr...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22066

    authors: Lee J,Park C,Dyckman KA,Lazar NA,Austin BP,Li Q,McDowell JE

    更新日期:2013-09-01 00:00:00

  • Effects of aripiprazole and haloperidol on neural activation during a simple motor task in healthy individuals: A functional MRI study.

    abstract::The dopaminergic system plays a key role in motor function and motor abnormalities have been shown to be a specific feature of psychosis. Due to their dopaminergic action, antipsychotic drugs may be expected to modulate motor function, but the precise effects of these drugs on motor function remain unclear. We carried...

    journal_title:Human brain mapping

    pub_type: 杂志文章,随机对照试验

    doi:10.1002/hbm.23485

    authors: Goozee R,O'Daly O,Handley R,Reis Marques T,Taylor H,McQueen G,Hubbard K,Pariante C,Mondelli V,Reinders AA,Dazzan P

    更新日期:2017-04-01 00:00:00

  • Consciousness and cerebral baseline activity fluctuations.

    abstract::The origin of within-subject variability in perceptual experiments is poorly understood. We here review evidence that baseline brain activity in the areas involved in sensory perception predict subsequent variations in sensory awareness. We place these findings in light of recent findings on the architecture of sponta...

    journal_title:Human brain mapping

    pub_type: 杂志文章,评审

    doi:10.1002/hbm.20602

    authors: Boly M,Phillips C,Balteau E,Schnakers C,Degueldre C,Moonen G,Luxen A,Peigneux P,Faymonville ME,Maquet P,Laureys S

    更新日期:2008-07-01 00:00:00

  • Neural basis for sentence comprehension: grammatical and short-term memory components.

    abstract::We monitored regional cerebral activity with BOLD fMRI while subjects were presented written sentences differing in their grammatical structure (subject-relative or object-relative center-embedded clauses) and their short-term memory demands (short or long antecedent-gap linkages). A core region of left posterior supe...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.10006

    authors: Cooke A,Zurif EB,DeVita C,Alsop D,Koenig P,Detre J,Gee J,Pinãngo M,Balogh J,Grossman M

    更新日期:2002-02-01 00:00:00

  • Real-time strategy video game experience and structural connectivity - A diffusion tensor imaging study.

    abstract::Experienced video game players exhibit superior performance in visuospatial cognition when compared to non-players. However, very little is known about the relation between video game experience and structural brain plasticity. To address this issue, a direct comparison of the white matter brain structure in RTS (real...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24208

    authors: Kowalczyk N,Shi F,Magnuski M,Skorko M,Dobrowolski P,Kossowski B,Marchewka A,Bielecki M,Kossut M,Brzezicka A

    更新日期:2018-09-01 00:00:00

  • Gyrification brain abnormalities as predictors of outcome in anorexia nervosa.

    abstract::Gyrification brain abnormalities are considered a marker of early deviations from normal developmental trajectories and a putative predictor of poor outcome in psychiatric disorders. The aim of this study was to explore cortical folding morphology in patients with anorexia nervosa (AN). A MRI brain study was conducted...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22998

    authors: Favaro A,Tenconi E,Degortes D,Manara R,Santonastaso P

    更新日期:2015-12-01 00:00:00

  • White matter alterations over the course of two consecutive high-school football seasons and the effect of a jugular compression collar: A preliminary longitudinal diffusion tensor imaging study.

    abstract::The cumulative effects of repetitive subclinical head impacts during sports may result in chronic white matter (WM) changes and possibly, neurodegenerative sequelae. In this pilot study, we investigated the longitudinal WM changes over the course of two consecutive high-school football seasons and explored the long-te...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23859

    authors: Yuan W,Barber Foss KD,Thomas S,DiCesare CA,Dudley JA,Kitchen K,Gadd B,Leach JL,Smith D,Altaye M,Gubanich P,Galloway RT,McCrory P,Bailes JE,Mannix R,Meehan WP 3rd,Myer GD

    更新日期:2018-01-01 00:00:00

  • Longitudinal development in the preterm thalamus and posterior white matter: MRI correlations between diffusion weighted imaging and T2 relaxometry.

    abstract::Infants born prematurely are at increased risk of adverse neurodevelopmental outcome. The measurement of white matter tissue composition and structure can help predict functional performance. Specifically, measurements of myelination and indicators of myelination status in the preterm brain could be predictive of late...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23188

    authors: Melbourne A,Eaton-Rosen Z,Orasanu E,Price D,Bainbridge A,Cardoso MJ,Kendall GS,Robertson NJ,Marlow N,Ourselin S

    更新日期:2016-07-01 00:00:00

  • Nonlinear analysis of EEG during NREM sleep reveals changes in functional connectivity due to natural aging.

    abstract::The spatial organization of nonlinear interactions between different brain regions during the first NREM sleep stage is investigated. This is achieved via consideration of four bipolar electrode derivations, Fp1F3, Fp2F4, O1P3, O2P4, which are used to compare anterior and posterior interhemispheric interactions and le...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20052

    authors: Terry JR,Anderson C,Horne JA

    更新日期:2004-10-01 00:00:00

  • Neural substrates differentiating global/local processing of bilateral visual inputs.

    abstract::We investigated neural substrates of global/local processing of bilateral hierarchical stimuli using functional magnetic resonance imaging (fMRI). Subjects were presented with two compound letters that were displayed simultaneously in the left and right visual fields, respectively. In a steady-state, block-design para...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20044

    authors: Han S,Jiang Y,Gu H

    更新日期:2004-08-01 00:00:00

  • Cerebellar-hippocampal processing in passive perception of visuospatial change: An ego- and allocentric axis?

    abstract::In addition to its role in visuospatial navigation and the generation of spatial representations, in recent years, the hippocampus has been proposed to support perceptual processes. This is especially the case where high-resolution details, in the form of fine-grained relationships between features such as angles betw...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24865

    authors: Hauser MFA,Heba S,Schmidt-Wilcke T,Tegenthoff M,Manahan-Vaughan D

    更新日期:2020-04-01 00:00:00

  • Material specific lateralization of medial temporal lobe function: An fMRI investigation.

    abstract::The theory of material specific lateralization of memory function posits that left and right MTL regions are asymmetrically involved in mnemonic processing of verbal and nonverbal material respectively. Lesion and functional imaging (fMRI) studies provide robust evidence for a left MTL asymmetry in the verbal memory d...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23077

    authors: Dalton MA,Hornberger M,Piguet O

    更新日期:2016-03-01 00:00:00

  • Early red nucleus atrophy in relapse-onset multiple sclerosis.

    abstract::No study has investigated red nucleus (RN) atrophy in multiple sclerosis (MS) despite cerebellum and its connections are elective sites of MS-related pathology. In this study, we explore RN atrophy in early MS phases and its association with cerebellar damage (focal lesions and atrophy) and physical disability. Thirty...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25213

    authors: Margoni M,Poggiali D,Zywicki S,Rubin M,Lazzarotto A,Franciotta S,Anglani MG,Causin F,Rinaldi F,Perini P,Filippi M,Gallo P

    更新日期:2021-01-01 00:00:00