A reinforcement learning framework for spiking networks with dynamic synapses.

Abstract:

:An integration of both the Hebbian-based and reinforcement learning (RL) rules is presented for dynamic synapses. The proposed framework permits the Hebbian rule to update the hidden synaptic model parameters regulating the synaptic response rather than the synaptic weights. This is performed using both the value and the sign of the temporal difference in the reward signal after each trial. Applying this framework, a spiking network with spike-timing-dependent synapses is tested to learn the exclusive-OR computation on a temporally coded basis. Reward values are calculated with the distance between the output spike train of the network and a reference target one. Results show that the network is able to capture the required dynamics and that the proposed framework can reveal indeed an integrated version of Hebbian and RL. The proposed framework is tractable and less computationally expensive. The framework is applicable to a wide class of synaptic models and is not restricted to the used neural representation. This generality, along with the reported results, supports adopting the introduced approach to benefit from the biologically plausible synaptic models in a wide range of intuitive signal processing.

journal_name

Comput Intell Neurosci

authors

El-Laithy K,Bogdan M

doi

10.1155/2011/869348

subject

Has Abstract

pub_date

2011-01-01 00:00:00

pages

869348

eissn

1687-5265

issn

1687-5273

journal_volume

2011

pub_type

杂志文章
  • SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine.

    abstract::A novel ensemble scheme for extreme learning machine (ELM), named Stochastic Gradient Boosting-based Extreme Learning Machine (SGB-ELM), is proposed in this paper. Instead of incorporating the stochastic gradient boosting method into ELM ensemble procedure primitively, SGB-ELM constructs a sequence of weak ELMs where ...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2018/4058403

    authors: Guo H,Wang J,Ao W,He Y

    更新日期:2018-06-26 00:00:00

  • A red-light running prevention system based on artificial neural network and vehicle trajectory data.

    abstract::The high frequency of red-light running and complex driving behaviors at the yellow onset at intersections cannot be explained solely by the dilemma zone and vehicle kinematics. In this paper, the author presented a red-light running prevention system which was based on artificial neural networks (ANNs) to approximate...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2014/892132

    authors: Li P,Li Y,Guo X

    更新日期:2014-01-01 00:00:00

  • Study of the bus dynamic coscheduling optimization method under urban rail transit line emergency.

    abstract::As one of the most important urban commuter transportation modes, urban rail transit (URT) has been acting as a key solution for supporting mobility needs in high-density urban areas. However, in recent years, high frequency of unexpected events has caused serious service disruptions in URT system, greatly harming pas...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2014/174369

    authors: Wang Y,Yan X,Zhou Y,Wang J,Chen S

    更新日期:2014-01-01 00:00:00

  • On the relation between bursts and dynamic synapse properties: a modulation-based ansatz.

    abstract::When entering a synapse, presynaptic pulse trains are filtered according to the recent pulse history at the synapse and also with respect to their own pulse time course. Various behavioral models have tried to reproduce these complex filtering properties. In particular, the quantal model of neurotransmitter release ha...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2009/658474

    authors: Mayr C,Partzsch J,Schüffny R

    更新日期:2009-01-01 00:00:00

  • Cloud Model-Based Artificial Immune Network for Complex Optimization Problem.

    abstract::This paper proposes an artificial immune network based on cloud model (AINet-CM) for complex function optimization problems. Three key immune operators-cloning, mutation, and suppression-are redesigned with the help of the cloud model. To be specific, an increasing half cloud-based cloning operator is used to adjust t...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2017/5901258

    authors: Wang M,Feng S,Li J,Li Z,Xue Y,Guo D

    更新日期:2017-01-01 00:00:00

  • Estimation of critical gap based on Raff's definition.

    abstract::Critical gap is an important parameter used to calculate the capacity and delay of minor road in gap acceptance theory of unsignalized intersections. At an unsignalized intersection with two one-way traffic flows, it is assumed that two events are independent between vehicles' arrival of major stream and vehicles' arr...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2014/236072

    authors: Guo RJ,Wang XJ,Wang WX

    更新日期:2014-01-01 00:00:00

  • An Energy Storage Performance Improvement Model for Grid-Connected Wind-Solar Hybrid Energy Storage System.

    abstract::This study introduces a supercapacitor hybrid energy storage system in a wind-solar hybrid power generation system, which can remarkably increase the energy storage capacity and output power of the system. In the specific solution, this study combines the distributed power generation system and the hybrid energy stora...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2020/8887227

    authors: Zhu R,Zhao AL,Wang GC,Xia X,Yang Y

    更新日期:2020-08-28 00:00:00

  • Online Hierarchical Sparse Representation of Multifeature for Robust Object Tracking.

    abstract::Object tracking based on sparse representation has given promising tracking results in recent years. However, the trackers under the framework of sparse representation always overemphasize the sparse representation and ignore the correlation of visual information. In addition, the sparse coding methods only encode the...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2016/5894639

    authors: Yang H,Qu S

    更新日期:2016-01-01 00:00:00

  • Study on optimized Elman neural network classification algorithm based on PLS and CA.

    abstract::High-dimensional large sample data sets, between feature variables and between samples, may cause some correlative or repetitive factors, occupy lots of storage space, and consume much computing time. Using the Elman neural network to deal with them, too many inputs will influence the operating efficiency and recognit...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2014/724317

    authors: Jia W,Zhao D,Shen T,Tang Y,Zhao Y

    更新日期:2014-01-01 00:00:00

  • New algorithms for computing the time-to-collision in freeway traffic simulation models.

    abstract::Ways to estimate the time-to-collision are explored. In the context of traffic simulation models, classical lane-based notions of vehicle location are relaxed and new, fast, and efficient algorithms are examined. With trajectory conflicts being the main focus, computational procedures are explored which use a two-dime...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2014/761047

    authors: Hou J,List GF,Guo X

    更新日期:2014-01-01 00:00:00

  • Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors.

    abstract::EEG-controlled gaming applications range widely from strictly medical to completely nonmedical applications. Games can provide not only entertainment but also strong motivation for practicing, thereby achieving better control with rehabilitation system. In this paper we present real-time control of video game with eye...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/653639

    authors: Belkacem AN,Saetia S,Zintus-art K,Shin D,Kambara H,Yoshimura N,Berrached N,Koike Y

    更新日期:2015-01-01 00:00:00

  • Inclusion of Neuropsychological Scores in Atrophy Models Improves Diagnostic Classification of Alzheimer's Disease and Mild Cognitive Impairment.

    abstract::Brain atrophy in mild cognitive impairment (MCI) and Alzheimer's disease (AD) are difficult to demarcate to assess the progression of AD. This study presents a statistical framework on the basis of MRI volumes and neuropsychological scores. A feature selection technique using backward stepwise linear regression togeth...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/865265

    authors: Goryawala M,Zhou Q,Barker W,Loewenstein DA,Duara R,Adjouadi M

    更新日期:2015-01-01 00:00:00

  • Adaptive State Observer Design for Dynamic Links in Complex Dynamical Networks.

    abstract::The state observer for dynamic links in complex dynamical networks (CDNs) is investigated by using the adaptive method whether the networks are undirected or directed. In this paper, a complete network model is proposed, which is composed of two coupled subsystems called nodes subsystem and links subsystem, respective...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2020/8846438

    authors: Gao Z,Xiong J,Zhong J,Liu F,Liu Q

    更新日期:2020-10-21 00:00:00

  • An Improved DSA-Based Approach for Multi-AUV Cooperative Search.

    abstract::Multi-AUV cooperative target search problem in unknown 3D underwater environment is not only a research hot spot but also a challenging task. To complete this task, each autonomous underwater vehicle (AUV) needs to move quickly without collision and cooperate with other AUVs to find the target. In this paper, an impro...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2018/2186574

    authors: Ni J,Yang L,Shi P,Luo C

    更新日期:2018-12-02 00:00:00

  • A novel multiple instance learning method based on extreme learning machine.

    abstract::Since real-world data sets usually contain large instances, it is meaningful to develop efficient and effective multiple instance learning (MIL) algorithm. As a learning paradigm, MIL is different from traditional supervised learning that handles the classification of bags comprising unlabeled instances. In this paper...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/405890

    authors: Wang J,Cai L,Peng J,Jia Y

    更新日期:2015-01-01 00:00:00

  • Modified Mahalanobis Taguchi System for Imbalance Data Classification.

    abstract::The Mahalanobis Taguchi System (MTS) is considered one of the most promising binary classification algorithms to handle imbalance data. Unfortunately, MTS lacks a method for determining an efficient threshold for the binary classification. In this paper, a nonlinear optimization model is formulated based on minimizing...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2017/5874896

    authors: El-Banna M

    更新日期:2017-01-01 00:00:00

  • Neural Basis of Intrinsic Motivation: Evidence from Event-Related Potentials.

    abstract::Human intrinsic motivation is of great importance in human behavior. However, although researchers have focused on this topic for decades, its neural basis was still unclear. The current study employed event-related potentials to investigate the neural disparity between an interesting stop-watch (SW) task and a boring...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/698725

    authors: Jin J,Yu L,Ma Q

    更新日期:2015-01-01 00:00:00

  • Study on the calculation models of bus delay at bays using queueing theory and Markov chain.

    abstract::Traffic congestion at bus bays has decreased the service efficiency of public transit seriously in China, so it is crucial to systematically study its theory and methods. However, the existing studies lack theoretical model on computing efficiency. Therefore, the calculation models of bus delay at bays are studied. Fi...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/750304

    authors: Sun F,Sun L,Sun SW,Wang DH

    更新日期:2015-01-01 00:00:00

  • Single-Trial Evoked Potential Estimating Based on Sparse Coding under Impulsive Noise Environment.

    abstract::Estimating single-trial evoked potentials (EPs) corrupted by the spontaneous electroencephalogram (EEG) can be regarded as signal denoising problem. Sparse coding has significant success in signal denoising and EPs have been proven to have strong sparsity over an appropriate dictionary. In sparse coding, the noise gen...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2018/9672871

    authors: Yu N,Chen Y,Wu L,Lu H

    更新日期:2018-03-22 00:00:00

  • Construction Project Safety Performance Management Using Analytic Network Process (ANP) as a Multicriteria Decision-Making (MCDM) Tool.

    abstract::The paper addresses the context in which the construction industry is considered risky, as the intense labor and machine environment interacts with acceleration and overlapping activities. This situation results in accidents and fatalities. A high number of accidents and fatalities leads to additional costs and delays...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2020/2610306

    authors: Gunduz M,Khader BK

    更新日期:2020-02-25 00:00:00

  • The track of brain activity during the observation of TV commercials with the high-resolution EEG technology.

    abstract::We estimate cortical activity in normal subjects during the observation of TV commercials inserted within a movie by using high-resolution EEG techniques. The brain activity was evaluated in both time and frequency domains by solving the associate inverse problem of EEG with the use of realistic head models. In partic...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2009/652078

    authors: Astolfi L,Vecchiato G,De Vico Fallani F,Salinari S,Cincotti F,Aloise F,Mattia D,Marciani MG,Bianchi L,Soranzo R,Babiloni F

    更新日期:2009-01-01 00:00:00

  • RnRTD: Intelligent Approach Based on the Relationship-Driven Neural Network and Restricted Tensor Decomposition for Multiple Accusation Judgment in Legal Cases.

    abstract::The use of intelligent judgment technology to assist in judgment is an inevitable trend in the development of judgment in contemporary social legal cases. Using big data and artificial intelligence technology to accurately determine multiple accusations involved in legal cases is an urgent problem to be solved in lega...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2019/6705405

    authors: Guo X,Zhang H,Ye L,Li S

    更新日期:2019-07-07 00:00:00

  • Automated Text Analysis Based on Skip-Gram Model for Food Evaluation in Predicting Consumer Acceptance.

    abstract::The purpose of this paper is to evaluate food taste, smell, and characteristics from consumers' online reviews. Several studies in food sensory evaluation have been presented for consumer acceptance. However, these studies need taste descriptive word lexicon, and they are not suitable for analyzing large number of eva...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2018/9293437

    authors: Kim AY,Ha JG,Choi H,Moon H

    更新日期:2018-01-22 00:00:00

  • Reducing the Schizophrenia Stigma: A New Approach Based on Augmented Reality.

    abstract::Schizophrenia is a chronic mental disease that usually manifests psychotic symptoms and affects an individual's functionality. The stigma related to this disease is a serious obstacle for an adequate approach to its treatment. Stigma can, for example, delay the start of treatment, and it creates difficulties in interp...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2017/2721846

    authors: Silva RDC,Albuquerque SGC,Muniz AV,Filho PPR,Ribeiro S,Pinheiro PR,Albuquerque VHC

    更新日期:2017-01-01 00:00:00

  • Immune centroids oversampling method for binary classification.

    abstract::To improve the classification performance of imbalanced learning, a novel oversampling method, immune centroids oversampling technique (ICOTE) based on an immune network, is proposed. ICOTE generates a set of immune centroids to broaden the decision regions of the minority class space. The representative immune centro...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2015/109806

    authors: Ai X,Wu J,Sheng VS,Zhao P,Cui Z

    更新日期:2015-01-01 00:00:00

  • Analyzing the effects of gap junction blockade on neural synchrony via a motoneuron network computational model.

    abstract::In specific regions of the central nervous system (CNS), gap junctions have been shown to participate in neuronal synchrony. Amongst the CNS regions identified, some populations of brainstem motoneurons are known to be coupled by gap junctions. The application of various gap junction blockers to these motoneuron popul...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2012/575129

    authors: Memelli H,Horn KG,Wittie LD,Solomon IC

    更新日期:2012-01-01 00:00:00

  • A Genetic Algorithm and Fuzzy Logic Approach for Video Shot Boundary Detection.

    abstract::This paper proposed a shot boundary detection approach using Genetic Algorithm and Fuzzy Logic. In this, the membership functions of the fuzzy system are calculated using Genetic Algorithm by taking preobserved actual values for shot boundaries. The classification of the types of shot transitions is done by the fuzzy ...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2016/8469428

    authors: Thounaojam DM,Khelchandra T,Manglem Singh Kh,Roy S

    更新日期:2016-01-01 00:00:00

  • Inferring functional brain states using temporal evolution of regularized classifiers.

    abstract::We present a framework for inferring functional brain state from electrophysiological (MEG or EEG) brain signals. Our approach is adapted to the needs of functional brain imaging rather than EEG-based brain-computer interface (BCI). This choice leads to a different set of requirements, in particular to the demand for ...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2007/52609

    authors: Zhdanov A,Hendler T,Ungerleider L,Intrator N

    更新日期:2007-01-01 00:00:00

  • A Reweighted Scheme to Improve the Representation of the Neural Autoregressive Distribution Estimator.

    abstract::The neural autoregressive distribution estimator(NADE) is a competitive model for the task of density estimation in the field of machine learning. While NADE mainly focuses on the problem of estimating density, the ability for dealing with other tasks remains to be improved. In this paper, we introduce a simple and ef...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2018/6401645

    authors: Wang Z,Wu Q

    更新日期:2018-12-23 00:00:00

  • Why people play: artificial lives acquiring play instinct to stabilize productivity.

    abstract::We propose a model to generate a group of artificial lives capable of coping with various environments which is equivalent to a set of requested task, and likely to show that the plays or hobbies are necessary for the group of individuals to maintain the coping capability with various changes of the environment as a w...

    journal_title:Computational intelligence and neuroscience

    pub_type: 杂志文章

    doi:10.1155/2012/197262

    authors: Tamura S,Inabayashi S,Hayakawa W,Yokouchi T,Mitsumoto H,Taketani H

    更新日期:2012-01-01 00:00:00