Comparative Analysis of Behavioral Models for Adaptive Learning in Changing Environments.

Abstract:

:Probabilistic models of decision making under various forms of uncertainty have been applied in recent years to numerous behavioral and model-based fMRI studies. These studies were highly successful in enabling a better understanding of behavior and delineating the functional properties of brain areas involved in decision making under uncertainty. However, as different studies considered different models of decision making under uncertainty, it is unclear which of these computational models provides the best account of the observed behavioral and neuroimaging data. This is an important issue, as not performing model comparison may tempt researchers to over-interpret results based on a single model. Here we describe how in practice one can compare different behavioral models and test the accuracy of model comparison and parameter estimation of Bayesian and maximum-likelihood based methods. We focus our analysis on two well-established hierarchical probabilistic models that aim at capturing the evolution of beliefs in changing environments: Hierarchical Gaussian Filters and Change Point Models. To our knowledge, these two, well-established models have never been compared on the same data. We demonstrate, using simulated behavioral experiments, that one can accurately disambiguate between these two models, and accurately infer free model parameters and hidden belief trajectories (e.g., posterior expectations, posterior uncertainties, and prediction errors) even when using noisy and highly correlated behavioral measurements. Importantly, we found several advantages of Bayesian inference and Bayesian model comparison compared to often-used Maximum-Likelihood schemes combined with the Bayesian Information Criterion. These results stress the relevance of Bayesian data analysis for model-based neuroimaging studies that investigate human decision making under uncertainty.

journal_name

Front Comput Neurosci

authors

Marković D,Kiebel SJ

doi

10.3389/fncom.2016.00033

subject

Has Abstract

pub_date

2016-04-20 00:00:00

pages

33

issn

1662-5188

journal_volume

10

pub_type

杂志文章
  • Anisotropic connectivity implements motion-based prediction in a spiking neural network.

    abstract::Predictive coding hypothesizes that the brain explicitly infers upcoming sensory input to establish a coherent representation of the world. Although it is becoming generally accepted, it is not clear on which level spiking neural networks may implement predictive coding and what function their connectivity may have. W...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00112

    authors: Kaplan BA,Lansner A,Masson GS,Perrinet LU

    更新日期:2013-09-17 00:00:00

  • Unsupervised Few-Shot Feature Learning via Self-Supervised Training.

    abstract::Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a large amount of labeled examples. Unsupervised learning is a more natural procedure...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00083

    authors: Ji Z,Zou X,Huang T,Wu S

    更新日期:2020-10-14 00:00:00

  • Multiple Frequency Bands Analysis of Large Scale Intrinsic Brain Networks and Its Application in Schizotypal Personality Disorder.

    abstract::The human brain is a complex system composed by several large scale intrinsic networks with distinct functions. The low frequency oscillation (LFO) signal of blood oxygen level dependent (BOLD), measured through resting-state fMRI, reflects the spontaneous neural activity of these networks. We propose to characterize ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00064

    authors: Qi S,Gao Q,Shen J,Teng Y,Xie X,Sun Y,Wu J

    更新日期:2018-08-03 00:00:00

  • Demystifying Brain Tumor Segmentation Networks: Interpretability and Uncertainty Analysis.

    abstract::The accurate automatic segmentation of gliomas and its intra-tumoral structures is important not only for treatment planning but also for follow-up evaluations. Several methods based on 2D and 3D Deep Neural Networks (DNN) have been developed to segment brain tumors and to classify different categories of tumors from ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00006

    authors: Natekar P,Kori A,Krishnamurthi G

    更新日期:2020-02-07 00:00:00

  • Differing effects of attention in single-units and populations are well predicted by heterogeneous tuning and the normalization model of attention.

    abstract::Single-unit measurements have reported many different effects of attention on contrast-response (e.g., contrast-gain, response-gain, additive-offset dependent on visibility), while functional imaging measurements have more uniformly reported increases in response across all contrasts (additive-offset). The normalizati...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00012

    authors: Hara Y,Pestilli F,Gardner JL

    更新日期:2014-02-19 00:00:00

  • Striatal Network Models of Huntington's Disease Dysfunction Phenotypes.

    abstract::We present a network model of striatum, which generates "winnerless" dynamics typical for a network of sparse, unidirectionally connected inhibitory units. We observe that these dynamics, while interesting and a good match to normal striatal electrophysiological recordings, are fragile. Specifically, we find that rand...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00070

    authors: Zheng P,Kozloski J

    更新日期:2017-07-27 00:00:00

  • A circular model for song motor control in Serinus canaria.

    abstract::Song production in songbirds is controlled by a network of nuclei distributed across several brain regions, which drives respiratory and vocal motor systems to generate sound. We built a model for birdsong production, whose variables are the average activities of different neural populations within these nuclei of the...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00041

    authors: Alonso RG,Trevisan MA,Amador A,Goller F,Mindlin GB

    更新日期:2015-04-07 00:00:00

  • Inferring single neuron properties in conductance based balanced networks.

    abstract::Balanced states in large networks are a usual hypothesis for explaining the variability of neural activity in cortical systems. In this regime the statistics of the inputs is characterized by static and dynamic fluctuations. The dynamic fluctuations have a Gaussian distribution. Such statistics allows to use reverse c...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00041

    authors: Pool RR,Mato G

    更新日期:2011-10-12 00:00:00

  • Investigating irregularly patterned deep brain stimulation signal design using biophysical models.

    abstract::Parkinson's disease (PD) is a neurodegenerative disorder which follows from cell loss of dopaminergic neurons in the substantia nigra pars compacta (SNc), a nucleus in the basal ganglia (BG). Deep brain stimulation (DBS) is an electrical therapy that modulates the pathological activity to treat the motor symptoms of P...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00078

    authors: Summerson SR,Aazhang B,Kemere C

    更新日期:2015-06-26 00:00:00

  • Non-invasive Decoding of the Motoneurons: A Guided Source Separation Method Based on Convolution Kernel Compensation With Clustered Initial Points.

    abstract::Despite the progress in understanding of neural codes, the studies of the cortico-muscular coupling still largely rely on interferential electromyographic (EMG) signal or its rectification for the assessment of motor neuron pool behavior. This assessment is non-trivial and should be used with precaution. Direct analys...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00014

    authors: Mohebian MR,Marateb HR,Karimimehr S,Mañanas MA,Kranjec J,Holobar A

    更新日期:2019-04-02 00:00:00

  • Synaptic encoding of temporal contiguity.

    abstract::Often we need to perform tasks in an environment that changes stochastically. In these situations it is important to learn the statistics of sequences of events in order to predict the future and the outcome of our actions. The statistical description of many of these sequences can be reduced to the set of probabiliti...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00032

    authors: Ostojic S,Fusi S

    更新日期:2013-04-12 00:00:00

  • Statistical physics of pairwise probability models.

    abstract::Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using a reasonable amount of data: knowledge of the mean values and correlations betw...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.10.022.2009

    authors: Roudi Y,Aurell E,Hertz JA

    更新日期:2009-11-17 00:00:00

  • Neuronal Degeneration Impairs Rhythms Between Connected Microcircuits.

    abstract::Synchronization of neural activity across brain regions is critical to processes that include perception, learning, and memory. After traumatic brain injury (TBI), neuronal degeneration is one possible effect and can alter communication between neural circuits. Consequently, synchronization between neurons may change ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00018

    authors: Schumm SN,Gabrieli D,Meaney DF

    更新日期:2020-03-03 00:00:00

  • Learning modular policies for robotics.

    abstract::A promising idea for scaling robot learning to more complex tasks is to use elemental behaviors as building blocks to compose more complex behavior. Ideally, such building blocks are used in combination with a learning algorithm that is able to learn to select, adapt, sequence and co-activate the building blocks. Whil...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2014.00062

    authors: Neumann G,Daniel C,Paraschos A,Kupcsik A,Peters J

    更新日期:2014-06-11 00:00:00

  • Fusimotor control of spindle sensitivity regulates central and peripheral coding of joint angles.

    abstract::Proprioceptive afferents from muscle spindles encode information about peripheral joint movements for the central nervous system (CNS). The sensitivity of muscle spindle is nonlinearly dependent on the activation of gamma (γ) motoneurons in the spinal cord that receives inputs from the motor cortex. How fusimotor cont...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00066

    authors: Lan N,He X

    更新日期:2012-08-30 00:00:00

  • Neural Coding With Bursts-Current State and Future Perspectives.

    abstract::Neuronal action potentials or spikes provide a long-range, noise-resistant means of communication between neurons. As point processes single spikes contain little information in themselves, i.e., outside the context of spikes from other neurons. Moreover, they may fail to cross a synapse. A burst, which consists of a ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2018.00048

    authors: Zeldenrust F,Wadman WJ,Englitz B

    更新日期:2018-07-06 00:00:00

  • Information diversity in structure and dynamics of simulated neuronal networks.

    abstract::Neuronal networks exhibit a wide diversity of structures, which contributes to the diversity of the dynamics therein. The presented work applies an information theoretic framework to simultaneously analyze structure and dynamics in neuronal networks. Information diversity within the structure and dynamics of a neurona...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00026

    authors: Mäki-Marttunen T,Aćimović J,Nykter M,Kesseli J,Ruohonen K,Yli-Harja O,Linne ML

    更新日期:2011-06-01 00:00:00

  • Topological View of Flows Inside the BOLD Spontaneous Activity of the Human Brain.

    abstract::Spatio-temporal brain activities with variable delay detectable in resting-state functional magnetic resonance imaging (rs-fMRI) give rise to highly reproducible structures, termed cortical lag threads, that propagate from one brain region to another. Using a computational topology of data approach, we found that pers...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00034

    authors: Don APH,Peters JF,Ramanna S,Tozzi A

    更新日期:2020-04-22 00:00:00

  • Generation of Granule Cell Dendritic Morphologies by Estimating the Spatial Heterogeneity of Dendritic Branching.

    abstract::Biological realism of dendritic morphologies is important for simulating electrical stimulation of brain tissue. By adding point process modeling and conditional sampling to existing generation strategies, we provide a novel means of reproducing the nuanced branching behavior that occurs in different layers of granule...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00023

    authors: Chou ZZ,Yu GJ,Berger TW

    更新日期:2020-04-09 00:00:00

  • Computational Neural Modeling of Auditory Cortical Receptive Fields.

    abstract::Previous studies have shown that the auditory cortex can enhance the perception of behaviorally important sounds in the presence of background noise, but the mechanisms by which it does this are not yet elucidated. Rapid plasticity of spectrotemporal receptive fields (STRFs) in the primary (A1) cortical neurons is obs...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00028

    authors: Chambers JD,Elgueda D,Fritz JB,Shamma SA,Burkitt AN,Grayden DB

    更新日期:2019-05-24 00:00:00

  • Higher-order correlations in non-stationary parallel spike trains: statistical modeling and inference.

    abstract::The extent to which groups of neurons exhibit higher-order correlations in their spiking activity is a controversial issue in current brain research. A major difficulty is that currently available tools for the analysis of massively parallel spike trains (N >10) for higher-order correlations typically require vast sam...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00016

    authors: Staude B,Grün S,Rotter S

    更新日期:2010-07-02 00:00:00

  • Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data.

    abstract::Automatic segmentation of Multiple Sclerosis (MS) lesions from Magnetic Resonance Imaging (MRI) images is essential for clinical assessment and treatment planning of MS. Recent years have seen an increasing use of Convolutional Neural Networks (CNNs) for this task. Although these methods provide accurate segmentation,...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00019

    authors: Ackaouy A,Courty N,Vallée E,Commowick O,Barillot C,Galassi F

    更新日期:2020-03-09 00:00:00

  • A model-based approach to predict muscle synergies using optimization: application to feedback control.

    abstract::This paper presents a new model-based method to define muscle synergies. Unlike the conventional factorization approach, which extracts synergies from electromyographic data, the proposed method employs a biomechanical model and formally defines the synergies as the solution of an optimal control problem. As a result,...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00121

    authors: Sharif Razavian R,Mehrabi N,McPhee J

    更新日期:2015-10-06 00:00:00

  • Input-output relation and energy efficiency in the neuron with different spike threshold dynamics.

    abstract::Neuron encodes and transmits information through generating sequences of output spikes, which is a high energy-consuming process. The spike is initiated when membrane depolarization reaches a threshold voltage. In many neurons, threshold is dynamic and depends on the rate of membrane depolarization (dV/dt) preceding a...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00062

    authors: Yi GS,Wang J,Tsang KM,Wei XL,Deng B

    更新日期:2015-05-27 00:00:00

  • ARTIE: An Integrated Environment for the Development of Affective Robot Tutors.

    abstract::Over the last decade robotics has attracted a great deal of interest from teachers and researchers as a valuable educational tool from preschool to highschool levels. The implementation of social-support behaviors in robot tutors, in particular in the emotional dimension, can make a significant contribution to learnin...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00077

    authors: Imbernón Cuadrado LE,Manjarrés Riesco Á,De La Paz López F

    更新日期:2016-08-03 00:00:00

  • Predicting Antidepressant Citalopram Treatment Response via Changes in Brain Functional Connectivity After Acute Intravenous Challenge.

    abstract::Introduction: The early and therapy-specific prediction of treatment success in major depressive disorder is of paramount importance due to high lifetime prevalence, and heterogeneity of response to standard medication and symptom expression. Hence, this study assessed the predictability of long-term antidepressant ef...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.554186

    authors: Klöbl M,Gryglewski G,Rischka L,Godbersen GM,Unterholzner J,Reed MB,Michenthaler P,Vanicek T,Winkler-Pjrek E,Hahn A,Kasper S,Lanzenberger R

    更新日期:2020-10-06 00:00:00

  • Model-Based Comparison of Deep Brain Stimulation Array Functionality with Varying Number of Radial Electrodes and Machine Learning Feature Sets.

    abstract::Deep brain stimulation (DBS) leads with radially distributed electrodes have potential to improve clinical outcomes through more selective targeting of pathways and networks within the brain. However, increasing the number of electrodes on clinical DBS leads by replacing conventional cylindrical shell electrodes with ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00058

    authors: Teplitzky BA,Zitella LM,Xiao Y,Johnson MD

    更新日期:2016-06-10 00:00:00

  • A single theoretical framework for circular features processing in humans: orientation and direction of motion compared.

    abstract::Common computational principles underlie processing of various visual features in the cortex. They are considered to create similar patterns of contextual modulations in behavioral studies for different features as orientation and direction of motion. Here, I studied the possibility that a single theoretical framework...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00028

    authors: Tzvetanov T

    更新日期:2012-05-22 00:00:00

  • Stochastic Resonance Based Visual Perception Using Spiking Neural Networks.

    abstract::Our aim is to propose an efficient algorithm for enhancing the contrast of dark images based on the principle of stochastic resonance in a global feedback spiking network of integrate-and-fire neurons. By linear approximation and direct simulation, we disclose the dependence of the peak signal-to-noise ratio on the sp...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00024

    authors: Fu Y,Kang Y,Chen G

    更新日期:2020-05-15 00:00:00

  • Revealing the Computational Meaning of Neocortical Interarea Signals.

    abstract::To understand the function of the neocortex, which is a hierarchical distributed network, it is useful giving meaning to the signals transmitted between these areas from the computational viewpoint. The overall anatomical structure or organs related to this network, including the neocortex, thalamus, and basal ganglia...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00074

    authors: Yamakawa H

    更新日期:2020-08-18 00:00:00