A model of food reward learning with dynamic reward exposure.

Abstract:

:The process of conditioning via reward learning is highly relevant to the study of food choice and obesity. Learning is itself shaped by environmental exposure, with the potential for such exposures to vary substantially across individuals and across place and time. In this paper, we use computational techniques to extend a well-validated standard model of reward learning, introducing both substantial heterogeneity and dynamic reward exposures. We then apply the extended model to a food choice context. The model produces a variety of individual behaviors and population-level patterns which are not evident from the traditional formulation, but which offer potential insights for understanding food reward learning and obesity. These include a "lock-in" effect, through which early exposure can strongly shape later reward valuation. We discuss potential implications of our results for the study and prevention of obesity, for the reward learning field, and for future experimental and computational work.

journal_name

Front Comput Neurosci

authors

Hammond RA,Ornstein JT,Fellows LK,Dubé L,Levitan R,Dagher A

doi

10.3389/fncom.2012.00082

subject

Has Abstract

pub_date

2012-10-11 00:00:00

pages

82

issn

1662-5188

journal_volume

6

pub_type

杂志文章
  • Classification of EEG Signals Based on Pattern Recognition Approach.

    abstract::Feature extraction is an important step in the process of electroencephalogram (EEG) signal classification. The authors propose a "pattern recognition" approach that discriminates EEG signals recorded during different cognitive conditions. Wavelet based feature extraction such as, multi-resolution decompositions into ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00103

    authors: Amin HU,Mumtaz W,Subhani AR,Saad MNM,Malik AS

    更新日期:2017-11-21 00:00:00

  • Is attentional blink a byproduct of neocortical attractors?

    abstract::This study proposes a computational model for attentional blink or "blink of the mind," a phenomenon where a human subject misses perception of a later expected visual pattern as two expected visual patterns are presented less than 500 ms apart. A neocortical patch modeled as an attractor network is stimulated with a ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00013

    authors: Silverstein DN,Lansner A

    更新日期:2011-05-03 00:00:00

  • Anti-kindling Induced by Two-Stage Coordinated Reset Stimulation with Weak Onset Intensity.

    abstract::Abnormal neuronal synchrony plays an important role in a number of brain diseases. To specifically counteract abnormal neuronal synchrony by desynchronization, Coordinated Reset (CR) stimulation, a spatiotemporally patterned stimulation technique, was designed with computational means. In neuronal networks with spike ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00044

    authors: Zeitler M,Tass PA

    更新日期:2016-05-17 00:00:00

  • Correlation-based analysis and generation of multiple spike trains using hawkes models with an exogenous input.

    abstract::The correlation structure of neural activity is believed to play a major role in the encoding and possibly the decoding of information in neural populations. Recently, several methods were developed for exactly controlling the correlation structure of multi-channel synthetic spike trains (Brette, 2009; Krumin and Shoh...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00147

    authors: Krumin M,Reutsky I,Shoham S

    更新日期:2010-11-19 00:00:00

  • Causal Role of Thalamic Interneurons in Brain State Transitions: A Study Using a Neural Mass Model Implementing Synaptic Kinetics.

    abstract::Experimental studies on the Lateral Geniculate Nucleus (LGN) of mammals and rodents show that the inhibitory interneurons (IN) receive around 47.1% of their afferents from the retinal spiking neurons, and constitute around 20-25% of the LGN cell population. However, there is a definite gap in knowledge about the role ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00115

    authors: Bhattacharya BS,Bond TP,O'Hare L,Turner D,Durrant SJ

    更新日期:2016-11-16 00:00:00

  • Sex Differences in Fiber Connection between the Striatum and Subcortical and Cortical Regions.

    abstract::The striatum is an important subcortical structure with extensive connections to other regions of the brain. These connections are believed to play important roles in behaviors such as reward-related processes and impulse control, which show significant sex differences. However, little is known about sex differences i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00100

    authors: Lei X,Han Z,Chen C,Bai L,Xue G,Dong Q

    更新日期:2016-09-23 00:00:00

  • Learning Generative State Space Models for Active Inference.

    abstract::In this paper we investigate the active inference framework as a means to enable autonomous behavior in artificial agents. Active inference is a theoretical framework underpinning the way organisms act and observe in the real world. In active inference, agents act in order to minimize their so called free energy, or p...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.574372

    authors: Çatal O,Wauthier S,De Boom C,Verbelen T,Dhoedt B

    更新日期:2020-11-16 00:00:00

  • Model-Based Comparison of Deep Brain Stimulation Array Functionality with Varying Number of Radial Electrodes and Machine Learning Feature Sets.

    abstract::Deep brain stimulation (DBS) leads with radially distributed electrodes have potential to improve clinical outcomes through more selective targeting of pathways and networks within the brain. However, increasing the number of electrodes on clinical DBS leads by replacing conventional cylindrical shell electrodes with ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00058

    authors: Teplitzky BA,Zitella LM,Xiao Y,Johnson MD

    更新日期:2016-06-10 00:00:00

  • A circular model for song motor control in Serinus canaria.

    abstract::Song production in songbirds is controlled by a network of nuclei distributed across several brain regions, which drives respiratory and vocal motor systems to generate sound. We built a model for birdsong production, whose variables are the average activities of different neural populations within these nuclei of the...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00041

    authors: Alonso RG,Trevisan MA,Amador A,Goller F,Mindlin GB

    更新日期:2015-04-07 00:00:00

  • Analog Signaling With the "Digital" Molecular Switch CaMKII.

    abstract::Molecular switches, such as the protein kinase CaMKII, play a fundamental role in cell signaling by decoding inputs into either high or low states of activity; because the high activation state can be turned on and persist after the input ceases, these switches have earned a reputation as "digital." Although this on/o...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00092

    authors: Clarke SE

    更新日期:2018-11-22 00:00:00

  • Impact of Physical Obstacles on the Structural and Effective Connectivity of in silico Neuronal Circuits.

    abstract::Scaffolds and patterned substrates are among the most successful strategies to dictate the connectivity between neurons in culture. Here, we used numerical simulations to investigate the capacity of physical obstacles placed on a flat substrate to shape structural connectivity, and in turn collective dynamics and effe...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00077

    authors: Ludl AA,Soriano J

    更新日期:2020-08-31 00:00:00

  • Hyperpolarization-Activated Current Induces Period-Doubling Cascades and Chaos in a Cold Thermoreceptor Model.

    abstract::In this article, we describe and analyze the chaotic behavior of a conductance-based neuronal bursting model. This is a model with a reduced number of variables, yet it retains biophysical plausibility. Inspired by the activity of cold thermoreceptors, the model contains a persistent Sodium current, a Calcium-activate...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00012

    authors: Xu K,Maidana JP,Caviedes M,Quero D,Aguirre P,Orio P

    更新日期:2017-03-10 00:00:00

  • Estimating neuronal connectivity from axonal and dendritic density fields.

    abstract::Neurons innervate space by extending axonal and dendritic arborizations. When axons and dendrites come in close proximity of each other, synapses between neurons can be formed. Neurons vary greatly in their morphologies and synaptic connections with other neurons. The size and shape of the arborizations determine the ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00160

    authors: van Pelt J,van Ooyen A

    更新日期:2013-11-25 00:00:00

  • Dopamine-signaled reward predictions generated by competitive excitation and inhibition in a spiking neural network model.

    abstract::Dopaminergic neurons in the mammalian substantia nigra display characteristic phasic responses to stimuli which reliably predict the receipt of primary rewards. These responses have been suggested to encode reward prediction-errors similar to those used in reinforcement learning. Here, we propose a model of dopaminerg...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00021

    authors: Chorley P,Seth AK

    更新日期:2011-05-18 00:00:00

  • Stochastic Resonance Based Visual Perception Using Spiking Neural Networks.

    abstract::Our aim is to propose an efficient algorithm for enhancing the contrast of dark images based on the principle of stochastic resonance in a global feedback spiking network of integrate-and-fire neurons. By linear approximation and direct simulation, we disclose the dependence of the peak signal-to-noise ratio on the sp...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00024

    authors: Fu Y,Kang Y,Chen G

    更新日期:2020-05-15 00:00:00

  • Steering the Volume of Tissue Activated With a Directional Deep Brain Stimulation Lead in the Globus Pallidus Pars Interna: A Modeling Study With Heterogeneous Tissue Properties.

    abstract::Objective: To study the effect of directional deep brain stimulation (DBS) electrode configuration and vertical electrode spacing on the volume of tissue activated (VTA) in the globus pallidus, pars interna (GPi). Background: Directional DBS leads may allow clinicians to precisely direct current fields to different fu...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.561180

    authors: Zhang S,Tagliati M,Pouratian N,Cheeran B,Ross E,Pereira E

    更新日期:2020-09-25 00:00:00

  • Unsupervised Few-Shot Feature Learning via Self-Supervised Training.

    abstract::Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a large amount of labeled examples. Unsupervised learning is a more natural procedure...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00083

    authors: Ji Z,Zou X,Huang T,Wu S

    更新日期:2020-10-14 00:00:00

  • Neural circuits for peristaltic wave propagation in crawling Drosophila larvae: analysis and modeling.

    abstract::Drosophila larvae crawl by peristaltic waves of muscle contractions, which propagate along the animal body and involve the simultaneous contraction of the left and right side of each segment. Coordinated propagation of contraction does not require sensory input, suggesting that movement is generated by a central patte...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00024

    authors: Gjorgjieva J,Berni J,Evers JF,Eglen SJ

    更新日期:2013-04-04 00:00:00

  • Calcium messenger heterogeneity: a possible signal for spike timing-dependent plasticity.

    abstract::Calcium concentrations as well as time courses have been used to model the signaling cascades leading to changes in the strength of synaptic connections. Previous models consider the dendritic spines as uniform compartments regarding calcium signaling. However, calcium concentrations can vary drastically on distances ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00158

    authors: Mihalas S

    更新日期:2011-01-13 00:00:00

  • A Glutamatergic Spine Model to Enable Multi-Scale Modeling of Nonlinear Calcium Dynamics.

    abstract::In synapses, calcium is required for modulating synaptic transmission, plasticity, synaptogenesis, and synaptic pruning. The regulation of calcium dynamics within neurons involves cellular mechanisms such as synaptically activated channels and pumps, calcium buffers, and calcium sequestrating organelles. Many experime...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00058

    authors: Hu E,Mergenthal A,Bingham CS,Song D,Bouteiller JM,Berger TW

    更新日期:2018-07-27 00:00:00

  • Statistical physics of pairwise probability models.

    abstract::Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using a reasonable amount of data: knowledge of the mean values and correlations betw...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.10.022.2009

    authors: Roudi Y,Aurell E,Hertz JA

    更新日期:2009-11-17 00:00:00

  • Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data.

    abstract::Automatic segmentation of Multiple Sclerosis (MS) lesions from Magnetic Resonance Imaging (MRI) images is essential for clinical assessment and treatment planning of MS. Recent years have seen an increasing use of Convolutional Neural Networks (CNNs) for this task. Although these methods provide accurate segmentation,...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00019

    authors: Ackaouy A,Courty N,Vallée E,Commowick O,Barillot C,Galassi F

    更新日期:2020-03-09 00:00:00

  • Signal enhancement in the output stage of the basal ganglia by synaptic short-term plasticity in the direct, indirect, and hyperdirect pathways.

    abstract::Many of the synapses in the basal ganglia display short-term plasticity. Still, computational models have not yet been used to investigate how this affects signaling. Here we use a model of the basal ganglia network, constrained by available data, to quantitatively investigate how synaptic short-term plasticity affect...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00076

    authors: Lindahl M,Kamali Sarvestani I,Ekeberg O,Kotaleski JH

    更新日期:2013-06-19 00:00:00

  • Interareal coupling reduces encoding variability in multi-area models of spatial working memory.

    abstract::Persistent activity observed during delayed-response tasks for spatial working memory (Funahashi et al., 1989) has commonly been modeled by recurrent networks whose dynamics is described as a bump attractor (Compte et al., 2000). We examine the effects of interareal architecture on the dynamics of bump attractors in s...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00082

    authors: Kilpatrick ZP

    更新日期:2013-07-01 00:00:00

  • Sensitivity analysis for the EEG forward problem.

    abstract::Sensitivity analysis can provide useful information when one is interested in identifying the parameter θ of a system since it measures the variations of the output u when θ changes. In the literature two different sensitivity functions are frequently used: the traditional sensitivity functions (TSF) and the generaliz...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00138

    authors: Troparevsky MI,Rubio D,Saintier N

    更新日期:2010-09-30 00:00:00

  • Deep networks for motor control functions.

    abstract::The motor system generates time-varying commands to move our limbs and body. Conventional descriptions of motor control and learning rely on dynamical representations of our body's state (forward and inverse models), and control policies that must be integrated forward to generate feedforward time-varying commands; th...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00032

    authors: Berniker M,Kording KP

    更新日期:2015-03-19 00:00:00

  • On the dynamics of cortical development: synchrony and synaptic self-organization.

    abstract::We describe a model for cortical development that resolves long-standing difficulties of earlier models. It is proposed that, during embryonic development, synchronous firing of neurons and their competition for limited metabolic resources leads to selection of an array of neurons with ultra-small-world characteristic...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00004

    authors: Wright JJ,Bourke PD

    更新日期:2013-02-15 00:00:00

  • Dynamical Graph Theory Networks Methods for the Analysis of Sparse Functional Connectivity Networks and for Determining Pinning Observability in Brain Networks.

    abstract::Neuroimaging in combination with graph theory has been successful in analyzing the functional connectome. However almost all analysis are performed based on static graph theory. The derived quantitative graph measures can only describe a snap shot of the disease over time. Neurodegenerative disease evolution is poorly...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00087

    authors: Meyer-Bäse A,Roberts RG,Illan IA,Meyer-Bäse U,Lobbes M,Stadlbauer A,Pinker-Domenig K

    更新日期:2017-10-05 00:00:00

  • A Neuronal Network Model for Pitch Selectivity and Representation.

    abstract::Pitch is a perceptual correlate of periodicity. Sounds with distinct spectra can elicit the same pitch. Despite the importance of pitch perception, understanding the cellular mechanism of pitch perception is still a major challenge and a mechanistic model of pitch is lacking. A multi-stage neuronal network model is de...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00057

    authors: Huang C,Rinzel J

    更新日期:2016-06-16 00:00:00

  • Reducing the Effect of Spurious Phase Variations in Neural Oscillatory Signals.

    abstract::The phase-reset model of oscillatory EEG activity has received a lot of attention in the last decades for decoding different cognitive processes. Based on this model, the ERPs are assumed to be generated as a result of phase reorganization in ongoing EEG. Alignment of the phase of neuronal activities can be observed w...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00082

    authors: Mortezapouraghdam Z,Corona-Strauss FI,Takahashi K,Strauss DJ

    更新日期:2018-10-08 00:00:00