Dopamine-signaled reward predictions generated by competitive excitation and inhibition in a spiking neural network model.

Abstract:

:Dopaminergic neurons in the mammalian substantia nigra display characteristic phasic responses to stimuli which reliably predict the receipt of primary rewards. These responses have been suggested to encode reward prediction-errors similar to those used in reinforcement learning. Here, we propose a model of dopaminergic activity in which prediction-error signals are generated by the joint action of short-latency excitation and long-latency inhibition, in a network undergoing dopaminergic neuromodulation of both spike-timing dependent synaptic plasticity and neuronal excitability. In contrast to previous models, sensitivity to recent events is maintained by the selective modification of specific striatal synapses, efferent to cortical neurons exhibiting stimulus-specific, temporally extended activity patterns. Our model shows, in the presence of significant background activity, (i) a shift in dopaminergic response from reward to reward-predicting stimuli, (ii) preservation of a response to unexpected rewards, and (iii) a precisely timed below-baseline dip in activity observed when expected rewards are omitted.

journal_name

Front Comput Neurosci

authors

Chorley P,Seth AK

doi

10.3389/fncom.2011.00021

subject

Has Abstract

pub_date

2011-05-18 00:00:00

pages

21

issn

1662-5188

journal_volume

5

pub_type

杂志文章
  • Visual Cortex Inspired CNN Model for Feature Construction in Text Analysis.

    abstract::Recently, biologically inspired models are gradually proposed to solve the problem in text analysis. Convolutional neural networks (CNN) are hierarchical artificial neural networks, which include a various of multilayer perceptrons. According to biological research, CNN can be improved by bringing in the attention mod...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00064

    authors: Fu H,Niu Z,Zhang C,Ma J,Chen J

    更新日期:2016-07-14 00:00:00

  • Determine Neuronal Tuning Curves by Exploring Optimum Firing Rate Distribution for Information Efficiency.

    abstract::This paper proposed a new method to determine the neuronal tuning curves for maximum information efficiency by computing the optimum firing rate distribution. Firstly, we proposed a general definition for the information efficiency, which is relevant to mutual information and neuronal energy consumption. The energy co...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00010

    authors: Han F,Wang Z,Fan H

    更新日期:2017-02-21 00:00:00

  • Is attentional blink a byproduct of neocortical attractors?

    abstract::This study proposes a computational model for attentional blink or "blink of the mind," a phenomenon where a human subject misses perception of a later expected visual pattern as two expected visual patterns are presented less than 500 ms apart. A neocortical patch modeled as an attractor network is stimulated with a ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00013

    authors: Silverstein DN,Lansner A

    更新日期:2011-05-03 00:00:00

  • Investigating irregularly patterned deep brain stimulation signal design using biophysical models.

    abstract::Parkinson's disease (PD) is a neurodegenerative disorder which follows from cell loss of dopaminergic neurons in the substantia nigra pars compacta (SNc), a nucleus in the basal ganglia (BG). Deep brain stimulation (DBS) is an electrical therapy that modulates the pathological activity to treat the motor symptoms of P...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00078

    authors: Summerson SR,Aazhang B,Kemere C

    更新日期:2015-06-26 00:00:00

  • Striatal Network Models of Huntington's Disease Dysfunction Phenotypes.

    abstract::We present a network model of striatum, which generates "winnerless" dynamics typical for a network of sparse, unidirectionally connected inhibitory units. We observe that these dynamics, while interesting and a good match to normal striatal electrophysiological recordings, are fragile. Specifically, we find that rand...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00070

    authors: Zheng P,Kozloski J

    更新日期:2017-07-27 00:00:00

  • Dynamical Graph Theory Networks Methods for the Analysis of Sparse Functional Connectivity Networks and for Determining Pinning Observability in Brain Networks.

    abstract::Neuroimaging in combination with graph theory has been successful in analyzing the functional connectome. However almost all analysis are performed based on static graph theory. The derived quantitative graph measures can only describe a snap shot of the disease over time. Neurodegenerative disease evolution is poorly...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00087

    authors: Meyer-Bäse A,Roberts RG,Illan IA,Meyer-Bäse U,Lobbes M,Stadlbauer A,Pinker-Domenig K

    更新日期:2017-10-05 00:00:00

  • Hyperpolarization-Activated Current Induces Period-Doubling Cascades and Chaos in a Cold Thermoreceptor Model.

    abstract::In this article, we describe and analyze the chaotic behavior of a conductance-based neuronal bursting model. This is a model with a reduced number of variables, yet it retains biophysical plausibility. Inspired by the activity of cold thermoreceptors, the model contains a persistent Sodium current, a Calcium-activate...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00012

    authors: Xu K,Maidana JP,Caviedes M,Quero D,Aguirre P,Orio P

    更新日期:2017-03-10 00:00:00

  • Enabling functional neural circuit simulations with distributed computing of neuromodulated plasticity.

    abstract::A major puzzle in the field of computational neuroscience is how to relate system-level learning in higher organisms to synaptic plasticity. Recently, plasticity rules depending not only on pre- and post-synaptic activity but also on a third, non-local neuromodulatory signal have emerged as key candidates to bridge th...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00141

    authors: Potjans W,Morrison A,Diesmann M

    更新日期:2010-11-23 00:00:00

  • Synaptic bouton properties are tuned to best fit the prevailing firing pattern.

    abstract::The morphology of presynaptic specializations can vary greatly ranging from classical single-release-site boutons in the central nervous system to boutons of various sizes harboring multiple vesicle release sites. Multi-release-site boutons can be found in several neural contexts, for example at the neuromuscular junc...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00101

    authors: Knodel MM,Geiger R,Ge L,Bucher D,Grillo A,Wittum G,Schuster CM,Queisser G

    更新日期:2014-09-09 00:00:00

  • Cooperation and Competition with Hyperscanning Methods: Review and Future Application to Emotion Domain.

    abstract::Cooperation and competition, as two common and opposite examples of interpersonal dynamics, are thought to be reflected by different cognitive, neural, and behavioral patterns. According to the conventional approach, they have been explored by measuring subjects' reactions during individual performance or turn-based i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2017.00086

    authors: Balconi M,Vanutelli ME

    更新日期:2017-09-29 00:00:00

  • Learning Generative State Space Models for Active Inference.

    abstract::In this paper we investigate the active inference framework as a means to enable autonomous behavior in artificial agents. Active inference is a theoretical framework underpinning the way organisms act and observe in the real world. In active inference, agents act in order to minimize their so called free energy, or p...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.574372

    authors: Çatal O,Wauthier S,De Boom C,Verbelen T,Dhoedt B

    更新日期:2020-11-16 00:00:00

  • Tonality Tunes the Statistical Characteristics in Music: Computational Approaches on Statistical Learning.

    abstract::Statistical learning is a learning mechanism based on transition probability in sequences such as music and language. Recent computational and neurophysiological studies suggest that the statistical learning contributes to production, action, and musical creativity as well as prediction and perception. The present stu...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00070

    authors: Daikoku T

    更新日期:2019-10-02 00:00:00

  • Quantized response times are a signature of a neuronal bottleneck in decision.

    abstract::The histograms of response times of optimal YES/NO decisions that are computed from a single sensory Poisson neuron are highly structured. In particular, response times in NO decisions are quantized to a small set of times, while response times in YES decisions have a multimodal structure. Both the times of NO decisio...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00042

    authors: Perona P

    更新日期:2014-04-11 00:00:00

  • Nine criteria for a measure of scientific output.

    abstract::Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evalua...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00048

    authors: Kreiman G,Maunsell JH

    更新日期:2011-11-10 00:00:00

  • Information diversity in structure and dynamics of simulated neuronal networks.

    abstract::Neuronal networks exhibit a wide diversity of structures, which contributes to the diversity of the dynamics therein. The presented work applies an information theoretic framework to simultaneously analyze structure and dynamics in neuronal networks. Information diversity within the structure and dynamics of a neurona...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00026

    authors: Mäki-Marttunen T,Aćimović J,Nykter M,Kesseli J,Ruohonen K,Yli-Harja O,Linne ML

    更新日期:2011-06-01 00:00:00

  • Estimating neuronal connectivity from axonal and dendritic density fields.

    abstract::Neurons innervate space by extending axonal and dendritic arborizations. When axons and dendrites come in close proximity of each other, synapses between neurons can be formed. Neurons vary greatly in their morphologies and synaptic connections with other neurons. The size and shape of the arborizations determine the ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00160

    authors: van Pelt J,van Ooyen A

    更新日期:2013-11-25 00:00:00

  • Causal Role of Thalamic Interneurons in Brain State Transitions: A Study Using a Neural Mass Model Implementing Synaptic Kinetics.

    abstract::Experimental studies on the Lateral Geniculate Nucleus (LGN) of mammals and rodents show that the inhibitory interneurons (IN) receive around 47.1% of their afferents from the retinal spiking neurons, and constitute around 20-25% of the LGN cell population. However, there is a definite gap in knowledge about the role ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00115

    authors: Bhattacharya BS,Bond TP,O'Hare L,Turner D,Durrant SJ

    更新日期:2016-11-16 00:00:00

  • Segmental Bayesian estimation of gap-junctional and inhibitory conductance of inferior olive neurons from spike trains with complicated dynamics.

    abstract::The inverse problem for estimating model parameters from brain spike data is an ill-posed problem because of a huge mismatch in the system complexity between the model and the brain as well as its non-stationary dynamics, and needs a stochastic approach that finds the most likely solution among many possible solutions...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00056

    authors: Hoang H,Yamashita O,Tokuda IT,Sato MA,Kawato M,Toyama K

    更新日期:2015-05-21 00:00:00

  • Examining Brain Morphometry Associated with Self-Esteem in Young Adults Using Multilevel-ROI-Features-Based Classification Method.

    abstract::Purpose: This study is to exam self-esteem related brain morphometry on brain magnetic resonance (MR) images using multilevel-features-based classification method. Method: The multilevel region of interest (ROI) features consist of two types of features: (i) ROI features, which include gray matter volume, white matter...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00037

    authors: Peng B,Lu J,Saxena A,Zhou Z,Zhang T,Wang S,Dai Y

    更新日期:2017-05-22 00:00:00

  • Stability constraints on large-scale structural brain networks.

    abstract::Stability is an important dynamical property of complex systems and underpins a broad range of coherent self-organized behavior. Based on evidence that some neurological disorders correspond to linear instabilities, we hypothesize that stability constrains the brain's electrical activity and influences its structure a...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00031

    authors: Gray RT,Robinson PA

    更新日期:2013-04-12 00:00:00

  • Conscious Multisensory Integration: Introducing a Universal Contextual Field in Biological and Deep Artificial Neural Networks.

    abstract::Conscious awareness plays a major role in human cognition and adaptive behavior, though its function in multisensory integration is not yet fully understood, hence, questions remain: How does the brain integrate the incoming multisensory signals with respect to different external environments? How are the roles of the...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00015

    authors: Adeel A

    更新日期:2020-05-19 00:00:00

  • Unsupervised Few-Shot Feature Learning via Self-Supervised Training.

    abstract::Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a large amount of labeled examples. Unsupervised learning is a more natural procedure...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00083

    authors: Ji Z,Zou X,Huang T,Wu S

    更新日期:2020-10-14 00:00:00

  • A single theoretical framework for circular features processing in humans: orientation and direction of motion compared.

    abstract::Common computational principles underlie processing of various visual features in the cortex. They are considered to create similar patterns of contextual modulations in behavioral studies for different features as orientation and direction of motion. Here, I studied the possibility that a single theoretical framework...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00028

    authors: Tzvetanov T

    更新日期:2012-05-22 00:00:00

  • Population coding of visual space: comparison of spatial representations in dorsal and ventral pathways.

    abstract::Although the representation of space is as fundamental to visual processing as the representation of shape, it has received relatively little attention from neurophysiological investigations. In this study we characterize representations of space within visual cortex, and examine how they differ in a first direct comp...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00159

    authors: Sereno AB,Lehky SR

    更新日期:2011-02-01 00:00:00

  • A micro-pool model for decision-related signals in visual cortical areas.

    abstract::The study of sensory signaling in the visual cortex has been greatly advanced by the recording of neural activity simultaneously with the performance of a specific psychophysical task. Individual nerve cells may also increase their firing leading up to the particular choice or decision made on a single psychophysical ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00115

    authors: Parker AJ

    更新日期:2013-08-13 00:00:00

  • Analog Signaling With the "Digital" Molecular Switch CaMKII.

    abstract::Molecular switches, such as the protein kinase CaMKII, play a fundamental role in cell signaling by decoding inputs into either high or low states of activity; because the high activation state can be turned on and persist after the input ceases, these switches have earned a reputation as "digital." Although this on/o...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00092

    authors: Clarke SE

    更新日期:2018-11-22 00:00:00

  • Input-output relation and energy efficiency in the neuron with different spike threshold dynamics.

    abstract::Neuron encodes and transmits information through generating sequences of output spikes, which is a high energy-consuming process. The spike is initiated when membrane depolarization reaches a threshold voltage. In many neurons, threshold is dynamic and depends on the rate of membrane depolarization (dV/dt) preceding a...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00062

    authors: Yi GS,Wang J,Tsang KM,Wei XL,Deng B

    更新日期:2015-05-27 00:00:00

  • Probabilistic Circuits for Autonomous Learning: A Simulation Study.

    abstract::Modern machine learning is based on powerful algorithms running on digital computing platforms and there is great interest in accelerating the learning process and making it more energy efficient. In this paper we present a fully autonomous probabilistic circuit for fast and efficient learning that makes no use of dig...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00014

    authors: Kaiser J,Faria R,Camsari KY,Datta S

    更新日期:2020-02-25 00:00:00

  • ARTIE: An Integrated Environment for the Development of Affective Robot Tutors.

    abstract::Over the last decade robotics has attracted a great deal of interest from teachers and researchers as a valuable educational tool from preschool to highschool levels. The implementation of social-support behaviors in robot tutors, in particular in the emotional dimension, can make a significant contribution to learnin...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00077

    authors: Imbernón Cuadrado LE,Manjarrés Riesco Á,De La Paz López F

    更新日期:2016-08-03 00:00:00

  • Structure learning and the Occam's razor principle: a new view of human function acquisition.

    abstract::We often encounter pairs of variables in the world whose mutual relationship can be described by a function. After training, human responses closely correspond to these functional relationships. Here we study how humans predict unobserved segments of a function that they have been trained on and we compare how human p...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00121

    authors: Narain D,Smeets JB,Mamassian P,Brenner E,van Beers RJ

    更新日期:2014-09-30 00:00:00