Making predictions in a changing world-inference, uncertainty, and learning.

Abstract:

:To function effectively, brains need to make predictions about their environment based on past experience, i.e., they need to learn about their environment. The algorithms by which learning occurs are of interest to neuroscientists, both in their own right (because they exist in the brain) and as a tool to model participants' incomplete knowledge of task parameters and hence, to better understand their behavior. This review focusses on a particular challenge for learning algorithms-how to match the rate at which they learn to the rate of change in the environment, so that they use as much observed data as possible whilst disregarding irrelevant, old observations. To do this algorithms must evaluate whether the environment is changing. We discuss the concepts of likelihood, priors and transition functions, and how these relate to change detection. We review expected and estimation uncertainty, and how these relate to change detection and learning rate. Finally, we consider the neural correlates of uncertainty and learning. We argue that the neural correlates of uncertainty bear a resemblance to neural systems that are active when agents actively explore their environments, suggesting that the mechanisms by which the rate of learning is set may be subject to top down control (in circumstances when agents actively seek new information) as well as bottom up control (by observations that imply change in the environment).

journal_name

Front Neurosci

authors

O'Reilly JX

doi

10.3389/fnins.2013.00105

subject

Has Abstract

pub_date

2013-06-14 00:00:00

pages

105

eissn

1662-4548

issn

1662-453X

journal_volume

7

pub_type

杂志文章
  • A Comparison of Regularization Methods in Forward and Backward Models for Auditory Attention Decoding.

    abstract::The decoding of selective auditory attention from noninvasive electroencephalogram (EEG) data is of interest in brain computer interface and auditory perception research. The current state-of-the-art approaches for decoding the attentional selection of listeners are based on linear mappings between features of sound s...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00531

    authors: Wong DDE,Fuglsang SA,Hjortkjær J,Ceolini E,Slaney M,de Cheveigné A

    更新日期:2018-08-07 00:00:00

  • No Differential Effects of Two Different Alpha-Band Electrical Stimulation Protocols Over Fronto-Parietal Regions on Spatial Attention.

    abstract::In a previous study using transcranial alternating current stimulation (tACS), we found preliminary evidence that phase coherence in the alpha band (8-12 Hz) within the fronto-parietal network may critically support top-down control of spatial attention (van Schouwenburg et al., 2017). Specifically, synchronous alpha-...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00433

    authors: van Schouwenburg MR,Sörensen LKA,de Klerk R,Reteig LC,Slagter HA

    更新日期:2018-07-03 00:00:00

  • A P300 Brain-Computer Interface With a Reduced Visual Field.

    abstract::A P300 brain-computer interface (BCI) is a paradigm, where text characters are decoded from event-related potentials (ERPs). In a popular implementation, called P300 speller, a subject looks at a display where characters are flashing and selects one character by attending to it. The selection is recognized as the item...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.604629

    authors: Kirasirova L,Bulanov V,Ossadtchi A,Kolsanov A,Pyatin V,Lebedev M

    更新日期:2020-12-03 00:00:00

  • Effects of Second Language Learning on the Plastic Aging Brain: Functional Connectivity, Cognitive Decline, and Reorganization.

    abstract::Learning a new language requires the use of extensive neural networks and can represent a powerful tool to reorganize brain neuroplasticity. In this study, we analyze how a 4 months long second language learning program (16, 2 h sessions) can lead to functional changes in the brain of healthy elderly individuals. A la...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00423

    authors: Bubbico G,Chiacchiaretta P,Parenti M,di Marco M,Panara V,Sepede G,Ferretti A,Perrucci MG

    更新日期:2019-05-15 00:00:00

  • sEMG-Based Trunk Compensation Detection in Rehabilitation Training.

    abstract::Stroke patients often use trunk to compensate for impaired upper limb motor function during upper limb rehabilitation training, which results in a reduced rehabilitation training effect. Detecting trunk compensations can improve the effect of rehabilitation training. This study investigates the feasibility of a surfac...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01250

    authors: Ma K,Chen Y,Zhang X,Zheng H,Yu S,Cai S,Xie L

    更新日期:2019-11-21 00:00:00

  • The Current State-of-the Art of LRRK2-Based Biomarker Assay Development in Parkinson's Disease.

    abstract::Evidence is mounting that LRRK2 function, particularly its kinase activity, is elevated in multiple forms of Parkinson's disease, both idiopathic as well as familial forms linked to mutations in the LRRK2 gene. However, sensitive quantitative markers of LRRK2 activation in clinical samples remain at the early stages o...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00865

    authors: Rideout HJ,Chartier-Harlin MC,Fell MJ,Hirst WD,Huntwork-Rodriguez S,Leyns CEG,Mabrouk OS,Taymans JM

    更新日期:2020-08-18 00:00:00

  • Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making.

    abstract::Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00050

    authors: Alabi OO,Fortunato MP,Fuccillo MV

    更新日期:2019-02-07 00:00:00

  • Valproic Acid Enhances Reprogramming Efficiency and Neuronal Differentiation on Small Molecules Staged-Induction Neural Stem Cells: Suggested Role of mTOR Signaling.

    abstract::Inducing somatic cells into neural stem cells (iNSCs) in specific ways provides a new cell therapy in a variety of neurological diseases. In the past, iNSCs were generated by transcription factors which increased the risk of mutagenesis, tumor formations, and immune reactions by viral transduction vectors. Therefore, ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00867

    authors: Duan Q,Li S,Wen X,Sunnassee G,Chen J,Tan S,Guo Y

    更新日期:2019-09-04 00:00:00

  • Alpha-Synuclein Continues to Enhance SNARE-Dependent Vesicle Docking at Exorbitant Concentrations.

    abstract::Recently, Parkinson's disease-associated α-synuclein (αS) has emerged as an important regulator for SNARE-dependent vesicle fusion. However, it is controversial if excessive accumulation of αS, even in the absence of aggregation, impairs neurotransmission. Here we use a single vesicle fusion assay with ms time resolut...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00216

    authors: Hawk BJD,Khounlo R,Shin YK

    更新日期:2019-03-21 00:00:00

  • Regulation of Chromatin Structure During Neural Development.

    abstract::The regulation of genome architecture is a key determinant of gene transcription patterns and neural development. Advances in methodologies based on chromatin conformation capture (3C) have shed light on the genome-wide organization of chromatin in developmental processes. Here, we review recent discoveries regarding ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2018.00874

    authors: Kishi Y,Gotoh Y

    更新日期:2018-12-11 00:00:00

  • A New Approach of Modified Submerged Patch Clamp Recording Reveals Interneuronal Dynamics during Epileptiform Oscillations.

    abstract::Highlights Simultaneous epileptiform LFPs and single-cell activity can be recorded in the membrane chamber.Interneuron firing can be linked to epileptiform high frequency activity.Fast ripples, unique to chronic epilepsy, can be modeled in ex vivo tissue from TeNT-treated rats. Traditionally, visually-guided patch cla...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00519

    authors: Morris G,Jiruska P,Jefferys JG,Powell AD

    更新日期:2016-11-09 00:00:00

  • Statistical learning analysis in neuroscience: aiming for transparency.

    abstract::Encouraged by a rise of reciprocal interest between the machine learning and neuroscience communities, several recent studies have demonstrated the explanatory power of statistical learning techniques for the analysis of neural data. In order to facilitate a wider adoption of these methods, neuroscientific research ne...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.01.007.2010

    authors: Hanke M,Halchenko YO,Haxby JV,Pollmann S

    更新日期:2010-05-15 00:00:00

  • Safety and Efficacy of Magnetic Resonance-Guided Focused Ultrasound Surgery With Autofocusing Echo Imaging.

    abstract:Objective:Magnetic resonance-guided focused ultrasound surgery (MRgFUS) lesioning is a new treatment for brain disorders. However, the skull is a major barrier of ultrasound sonication in MRgFUS because it has an irregular surface and varies its size and shape among individuals. We recently developed the concept of sku...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.592763

    authors: Chang KW,Rachmilevitch I,Chang WS,Jung HH,Zadicario E,Prus O,Chang JW

    更新日期:2021-01-12 00:00:00

  • Preliminary Neurophysiological Evidence of Altered Cortical Activity and Connectivity With Neurologic Music Therapy in Parkinson's Disease.

    abstract::Neurologic Music Therapy (NMT) is a novel impairment-focused behavioral intervention system whose techniques are based on the clinical neuroscience of music perception, cognition, and production. Auditory Stimulation (RAS) is one of the NMT techniques, which aims to develop and maintain a physiological rhythmic motor ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00105

    authors: Buard I,Dewispelaere WB,Thaut M,Kluger BM

    更新日期:2019-02-19 00:00:00

  • A Comparative Study of Different EEG Reference Choices for Event-Related Potentials Extracted by Independent Component Analysis.

    abstract::In the event-related potential (ERP) of scalp electroencephalography (EEG) studies, the vertex reference (Cz), linked mastoids or ears (LM), and average reference (AVG) are popular reference methods, and the reference electrode standardization technique (REST) is increasingly applied. Because scalp EEG recordings are ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01068

    authors: Dong L,Liu X,Zhao L,Lai Y,Gong D,Liu T,Yao D

    更新日期:2019-10-11 00:00:00

  • Acute Social Defeat Stress Increases Sleep in Mice.

    abstract::Social conflict is a major source of stress in humans. Animals also experience social conflicts and cope with them by stress responses that facilitate arousal and activate sympathetic and neuroendocrine systems. The effect of acute social defeat (SoD) stress on the sleep/wake behavior of mice has been reported in seve...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00322

    authors: Fujii S,Kaushik MK,Zhou X,Korkutata M,Lazarus M

    更新日期:2019-04-03 00:00:00

  • Effects of Field-Map Distortion Correction on Resting State Functional Connectivity MRI.

    abstract::Magnetic field inhomogeneities cause geometric distortions of echo planar images used for functional magnetic resonance imaging (fMRI). To reduce this problem, distortion correction (DC) with field map is widely used for both task and resting-state fMRI (rs-fMRI). Although DC with field map has been reported to improv...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00656

    authors: Togo H,Rokicki J,Yoshinaga K,Hisatsune T,Matsuda H,Haga N,Hanakawa T

    更新日期:2017-12-01 00:00:00

  • Metallothionein, Copper and Alpha-Synuclein in Alpha-Synucleinopathies.

    abstract::Metallothioneins (MTs) are proteins that function by metal exchange to regulate the bioavailability of metals, such as zinc and copper. Copper functions in the brain to regulate mitochondria, neurotransmitter production, and cell signaling. Inappropriate copper binding can result in loss of protein function and Cu(I)/...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00114

    authors: Okita Y,Rcom-H'cheo-Gauthier AN,Goulding M,Chung RS,Faller P,Pountney DL

    更新日期:2017-04-04 00:00:00

  • Effects of Noise on the Behavioral and Neural Categorization of Speech.

    abstract::We investigated whether the categorical perception (CP) of speech might also provide a mechanism that aids its perception in noise. We varied signal-to-noise ratio (SNR) [clear, 0 dB, -5 dB] while listeners classified an acoustic-phonetic continuum (/u/ to /a/). Noise-related changes in behavioral categorization were ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00153

    authors: Bidelman GM,Bush LC,Boudreaux AM

    更新日期:2020-02-27 00:00:00

  • Arousal Contributions to Resting-State fMRI Connectivity and Dynamics.

    abstract::Resting-state functional magnetic resonance imaging (rsfMRI) is being widely used for charting brain connectivity and dynamics in healthy and diseased brains. However, the resting state paradigm allows an unconstrained fluctuation of brain arousal, which may have profound effects on resting-state fMRI signals and asso...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01190

    authors: Gu Y,Han F,Liu X

    更新日期:2019-11-05 00:00:00

  • Antibiotic Driven Changes in Gut Motility Suggest Direct Modulation of Enteric Nervous System.

    abstract::Antibiotic-mediated changes to the intestinal microbiome have largely been assumed to be the basis of antibiotic-induced neurophysiological and behavioral changes. However, relatively little research has addressed whether antibiotics act directly on the host nervous system to produce these changes. We aimed to identif...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00588

    authors: Delungahawatta T,Amin JY,Stanisz AM,Bienenstock J,Forsythe P,Kunze WA

    更新日期:2017-10-20 00:00:00

  • Virtual Balancing for Studying and Training Postural Control.

    abstract::Postural control during free stance has been frequently interpreted in terms of balancing an inverted pendulum. This even holds, if subjects do not balance their own, but an external body weight. We introduce here a virtual balancing apparatus, which produces torque in the ankle joint as a function of ankle angle rese...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00531

    authors: Buettner D,Dalin D,Wiesmeier IK,Maurer C

    更新日期:2017-09-26 00:00:00

  • Design of an Adaptive Human-Machine System Based on Dynamical Pattern Recognition of Cognitive Task-Load.

    abstract::This paper developed a cognitive task-load (CTL) classification algorithm and allocation strategy to sustain the optimal operator CTL levels over time in safety-critical human-machine integrated systems. An adaptive human-machine system is designed based on a non-linear dynamic CTL classifier, which maps a set of elec...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00129

    authors: Zhang J,Yin Z,Wang R

    更新日期:2017-03-17 00:00:00

  • ATP as a multi-target danger signal in the brain.

    abstract::ATP is released in an activity-dependent manner from different cell types in the brain, fulfilling different roles as a neurotransmitter, neuromodulator, in astrocyte-to-neuron communication, propagating astrocytic responses and formatting microglia responses. This involves the activation of different ATP P2 receptors...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00148

    authors: Rodrigues RJ,Tomé AR,Cunha RA

    更新日期:2015-04-28 00:00:00

  • Reduced Oblique Effect in Children with Autism Spectrum Disorders (ASD).

    abstract::People are very precise in the discrimination of a line orientation relative to the cardinal (vertical and horizontal) axes, while their orientation discrimination sensitivity along the oblique axes is less refined. This difference in discrimination sensitivity along cardinal and oblique axes is called the "oblique ef...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00512

    authors: Sysoeva OV,Davletshina MA,Orekhova EV,Galuta IA,Stroganova TA

    更新日期:2016-01-21 00:00:00

  • No Evidence That Frontal Eye Field tDCS Affects Latency or Accuracy of Prosaccades.

    abstract::Transcranial direct current stimulation (tDCS) may be used to directly affect neural activity from outside of the skull. However, its exact physiological mechanisms remain elusive, particularly when applied to new brain areas. The frontal eye field (FEF) has rarely been targeted with tDCS, even though it plays a cruci...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00617

    authors: Reteig LC,Knapen T,Roelofs FJFW,Ridderinkhof KR,Slagter HA

    更新日期:2018-09-04 00:00:00

  • Neurodegenerative Susceptibility During Maternal Nutritional Programing: Are Central and Peripheral Innate Immune Training Relevant?

    abstract::Maternal overnutrition modulates body weight, development of metabolic failure and, potentially, neurodegenerative susceptibility in the offspring. Overnutrition sets a chronic pro-inflammatory profile that integrates peripheral and central immune activation nodes, damaging neuronal physiology and survival. Innate imm...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00013

    authors: Cárdenas-Tueme M,Montalvo-Martínez L,Maldonado-Ruiz R,Camacho-Morales A,Reséndez-Pérez D

    更新日期:2020-02-04 00:00:00

  • Chatting with the neighbors: crosstalk between Rho-kinase (ROCK) and other signaling pathways for treatment of neurological disorders.

    abstract::ROCK inhibition has been largely applied as a strategy to treat neurodegenerative diseases (NDDs) and promising results have been obtained in the recent years. However, the underlying molecular and cellular mechanisms are not fully understood and different models have been proposed for neurodegenerative disorders. Her...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00198

    authors: Hensel N,Rademacher S,Claus P

    更新日期:2015-06-02 00:00:00

  • Contribution of Tau Pathology to Mitochondrial Impairment in Neurodegeneration.

    abstract::Tau is an essential protein that physiologically promotes the assembly and stabilization of microtubules, and participates in neuronal development, axonal transport, and neuronal polarity. However, in a number of neurodegenerative diseases, including Alzheimer's disease (AD), tau undergoes pathological modifications i...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2018.00441

    authors: Pérez MJ,Jara C,Quintanilla RA

    更新日期:2018-07-05 00:00:00

  • MMP13 Expression Is Increased Following Mutant α-Synuclein Exposure and Promotes Inflammatory Responses in Microglia.

    abstract::α-Synuclein is a 140-amino acid protein that readily misfolds and is associated with the Lewy body pathology found in sporadic and genetic forms of Parkinson's disease. We and others have shown that wild-type α-synuclein is a damage-associated molecular pattern that directly elicits a proinflammatory response in micro...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.585544

    authors: Sánchez K,Maguire-Zeiss K

    更新日期:2020-12-02 00:00:00