Probabilistic Circuits for Autonomous Learning: A Simulation Study.

Abstract:

:Modern machine learning is based on powerful algorithms running on digital computing platforms and there is great interest in accelerating the learning process and making it more energy efficient. In this paper we present a fully autonomous probabilistic circuit for fast and efficient learning that makes no use of digital computing. Specifically we use SPICE simulations to demonstrate a clockless autonomous circuit where the required synaptic weights are read out in the form of analog voltages. This allows us to demonstrate a circuit that can be built with existing technology to emulate the Boltzmann machine learning algorithm based on gradient optimization of the maximum likelihood function. Such autonomous circuits could be particularly of interest as standalone learning devices in the context of mobile and edge computing.

journal_name

Front Comput Neurosci

authors

Kaiser J,Faria R,Camsari KY,Datta S

doi

10.3389/fncom.2020.00014

subject

Has Abstract

pub_date

2020-02-25 00:00:00

pages

14

issn

1662-5188

journal_volume

14

pub_type

杂志文章
  • Model-Based Comparison of Deep Brain Stimulation Array Functionality with Varying Number of Radial Electrodes and Machine Learning Feature Sets.

    abstract::Deep brain stimulation (DBS) leads with radially distributed electrodes have potential to improve clinical outcomes through more selective targeting of pathways and networks within the brain. However, increasing the number of electrodes on clinical DBS leads by replacing conventional cylindrical shell electrodes with ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00058

    authors: Teplitzky BA,Zitella LM,Xiao Y,Johnson MD

    更新日期:2016-06-10 00:00:00

  • A circular model for song motor control in Serinus canaria.

    abstract::Song production in songbirds is controlled by a network of nuclei distributed across several brain regions, which drives respiratory and vocal motor systems to generate sound. We built a model for birdsong production, whose variables are the average activities of different neural populations within these nuclei of the...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00041

    authors: Alonso RG,Trevisan MA,Amador A,Goller F,Mindlin GB

    更新日期:2015-04-07 00:00:00

  • A simple transfer function for nonlinear dendritic integration.

    abstract::Relatively recent advances in patch clamp recordings and iontophoresis have enabled unprecedented study of neuronal post-synaptic integration ("dendritic integration"). Findings support a separate layer of integration in the dendritic branches before potentials reach the cell's soma. While integration between branches...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00098

    authors: Singh MF,Zald DH

    更新日期:2015-08-10 00:00:00

  • Optimizing Clinical Assessments in Parkinson's Disease Through the Use of Wearable Sensors and Data Driven Modeling.

    abstract::The emergence of motion sensors as a tool that provides objective motor performance data on individuals afflicted with Parkinson's disease offers an opportunity to expand the horizon of clinical care for this neurodegenerative condition. Subjective clinical scales and patient based motor diaries have limited clinometr...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2018.00072

    authors: Ramdhani RA,Khojandi A,Shylo O,Kopell BH

    更新日期:2018-09-11 00:00:00

  • MACOP modular architecture with control primitives.

    abstract::Walking, catching a ball and reaching are all tasks in which humans and animals exhibit advanced motor skills. Findings in biological research concerning motor control suggest a modular control hierarchy which combines movement/motor primitives into complex and natural movements. Engineers inspire their research on th...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00099

    authors: Waegeman T,Hermans M,Schrauwen B

    更新日期:2013-07-23 00:00:00

  • Structural Plasticity Denoises Responses and Improves Learning Speed.

    abstract::Despite an abundance of computational models for learning of synaptic weights, there has been relatively little research on structural plasticity, i.e., the creation and elimination of synapses. Especially, it is not clear how structural plasticity works in concert with spike-timing-dependent plasticity (STDP) and wha...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00093

    authors: Spiess R,George R,Cook M,Diehl PU

    更新日期:2016-09-08 00:00:00

  • Learning Generative State Space Models for Active Inference.

    abstract::In this paper we investigate the active inference framework as a means to enable autonomous behavior in artificial agents. Active inference is a theoretical framework underpinning the way organisms act and observe in the real world. In active inference, agents act in order to minimize their so called free energy, or p...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.574372

    authors: Çatal O,Wauthier S,De Boom C,Verbelen T,Dhoedt B

    更新日期:2020-11-16 00:00:00

  • Invariant object recognition based on extended fragments.

    abstract::Visual appearance of natural objects is profoundly affected by viewing conditions such as viewpoint and illumination. Human subjects can nevertheless compensate well for variations in these viewing conditions. The strategies that the visual system uses to accomplish this are largely unclear. Previous computational stu...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00056

    authors: Bart E,Hegdé J

    更新日期:2012-08-24 00:00:00

  • Direct connections assist neurons to detect correlation in small amplitude noises.

    abstract::We address a question on the effect of common stochastic inputs on the correlation of the spike trains of two neurons when they are coupled through direct connections. We show that the change in the correlation of small amplitude stochastic inputs can be better detected when the neurons are connected by direct excitat...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00108

    authors: Bolhasani E,Azizi Y,Valizadeh A

    更新日期:2013-08-14 00:00:00

  • Brain Network Analysis and Classification Based on Convolutional Neural Network.

    abstract::Background: Convolution neural networks (CNN) is increasingly used in computer science and finds more and more applications in different fields. However, analyzing brain network with CNN is not trivial, due to the non-Euclidean characteristics of brain network built by graph theory. Method: To address this problem, we...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00095

    authors: Meng L,Xiang J

    更新日期:2018-12-10 00:00:00

  • Nine criteria for a measure of scientific output.

    abstract::Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evalua...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00048

    authors: Kreiman G,Maunsell JH

    更新日期:2011-11-10 00:00:00

  • Reducing the Effect of Spurious Phase Variations in Neural Oscillatory Signals.

    abstract::The phase-reset model of oscillatory EEG activity has received a lot of attention in the last decades for decoding different cognitive processes. Based on this model, the ERPs are assumed to be generated as a result of phase reorganization in ongoing EEG. Alignment of the phase of neuronal activities can be observed w...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00082

    authors: Mortezapouraghdam Z,Corona-Strauss FI,Takahashi K,Strauss DJ

    更新日期:2018-10-08 00:00:00

  • Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data.

    abstract::Automatic segmentation of Multiple Sclerosis (MS) lesions from Magnetic Resonance Imaging (MRI) images is essential for clinical assessment and treatment planning of MS. Recent years have seen an increasing use of Convolutional Neural Networks (CNNs) for this task. Although these methods provide accurate segmentation,...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00019

    authors: Ackaouy A,Courty N,Vallée E,Commowick O,Barillot C,Galassi F

    更新日期:2020-03-09 00:00:00

  • Visual Cortex Inspired CNN Model for Feature Construction in Text Analysis.

    abstract::Recently, biologically inspired models are gradually proposed to solve the problem in text analysis. Convolutional neural networks (CNN) are hierarchical artificial neural networks, which include a various of multilayer perceptrons. According to biological research, CNN can be improved by bringing in the attention mod...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00064

    authors: Fu H,Niu Z,Zhang C,Ma J,Chen J

    更新日期:2016-07-14 00:00:00

  • Impact of Physical Obstacles on the Structural and Effective Connectivity of in silico Neuronal Circuits.

    abstract::Scaffolds and patterned substrates are among the most successful strategies to dictate the connectivity between neurons in culture. Here, we used numerical simulations to investigate the capacity of physical obstacles placed on a flat substrate to shape structural connectivity, and in turn collective dynamics and effe...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00077

    authors: Ludl AA,Soriano J

    更新日期:2020-08-31 00:00:00

  • Short-Term Facilitation may Stabilize Parametric Working Memory Trace.

    abstract::Networks with continuous set of attractors are considered to be a paradigmatic model for parametric working memory (WM), but require fine tuning of connections and are thus structurally unstable. Here we analyzed the network with ring attractor, where connections are not perfectly tuned and the activity state therefor...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00040

    authors: Itskov V,Hansel D,Tsodyks M

    更新日期:2011-10-24 00:00:00

  • Simultaneous stability and sensitivity in model cortical networks is achieved through anti-correlations between the in- and out-degree of connectivity.

    abstract::Neuronal networks in rodent barrel cortex are characterized by stable low baseline firing rates. However, they are sensitive to the action potentials of single neurons as suggested by recent single-cell stimulation experiments that reported quantifiable behavioral responses in response to short spike trains elicited i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00156

    authors: Vasquez JC,Houweling AR,Tiesinga P

    更新日期:2013-11-07 00:00:00

  • Emergence of Relaxation Oscillations in Neurons Interacting With Non-stationary Ambient GABA.

    abstract::Dynamics of a homogeneous neural population interacting with active extracellular medium were considered. The corresponding mathematical model was tuned specifically to describe the behavior of interneurons with tonic GABA conductance under the action of non-stationary ambient GABA. The feedback provided by the GABA m...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00019

    authors: Adamchik DA,Matrosov VV,Kazantsev VB

    更新日期:2018-04-05 00:00:00

  • A Role for Electrotonic Coupling Between Cortical Pyramidal Cells.

    abstract::Many brain regions communicate information through synchronized network activity. Electrical coupling among the dendrites of interneurons in the cortex has been implicated in forming and sustaining such activity in the cortex. Evidence for the existence of electrical coupling among cortical pyramidal cells, however, h...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00033

    authors: Crodelle J,Zhou D,Kovačič G,Cai D

    更新日期:2019-05-28 00:00:00

  • Inferring single neuron properties in conductance based balanced networks.

    abstract::Balanced states in large networks are a usual hypothesis for explaining the variability of neural activity in cortical systems. In this regime the statistics of the inputs is characterized by static and dynamic fluctuations. The dynamic fluctuations have a Gaussian distribution. Such statistics allows to use reverse c...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00041

    authors: Pool RR,Mato G

    更新日期:2011-10-12 00:00:00

  • Inhibition potentiates the synchronizing action of electrical synapses.

    abstract::In vivo and in vitro experimental studies have found that blocking electrical interactions connecting GABAergic interneurons reduces oscillatory activity in the gamma range in cortex. However, recent theoretical works have shown that the ability of electrical synapses to promote or impede synchrony, when alone, depend...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.10.008.2007

    authors: Pfeuty B,Golomb D,Mato G,Hansel D

    更新日期:2007-11-02 00:00:00

  • Model selection for the extraction of movement primitives.

    abstract::A wide range of blind source separation methods have been used in motor control research for the extraction of movement primitives from EMG and kinematic data. Popular examples are principal component analysis (PCA), independent component analysis (ICA), anechoic demixing, and the time-varying synergy model (d'Avella ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00185

    authors: Endres DM,Chiovetto E,Giese MA

    更新日期:2013-12-20 00:00:00

  • Is attentional blink a byproduct of neocortical attractors?

    abstract::This study proposes a computational model for attentional blink or "blink of the mind," a phenomenon where a human subject misses perception of a later expected visual pattern as two expected visual patterns are presented less than 500 ms apart. A neocortical patch modeled as an attractor network is stimulated with a ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00013

    authors: Silverstein DN,Lansner A

    更新日期:2011-05-03 00:00:00

  • A Computational Model of Interactions Between Neuronal and Astrocytic Networks: The Role of Astrocytes in the Stability of the Neuronal Firing Rate.

    abstract::Recent research in neuroscience indicates the importance of tripartite synapses and gliotransmission mediated by astrocytes in neuronal system modulation. Although the astrocyte and neuronal network functions are interrelated, they are fundamentally different in their signaling patterns and, possibly, the time scales ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00092

    authors: Lenk K,Satuvuori E,Lallouette J,Ladrón-de-Guevara A,Berry H,Hyttinen JAK

    更新日期:2020-01-22 00:00:00

  • Predicting Antidepressant Citalopram Treatment Response via Changes in Brain Functional Connectivity After Acute Intravenous Challenge.

    abstract::Introduction: The early and therapy-specific prediction of treatment success in major depressive disorder is of paramount importance due to high lifetime prevalence, and heterogeneity of response to standard medication and symptom expression. Hence, this study assessed the predictability of long-term antidepressant ef...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.554186

    authors: Klöbl M,Gryglewski G,Rischka L,Godbersen GM,Unterholzner J,Reed MB,Michenthaler P,Vanicek T,Winkler-Pjrek E,Hahn A,Kasper S,Lanzenberger R

    更新日期:2020-10-06 00:00:00

  • Spatiotemporal imaging of complexity.

    abstract::What are the functional neuroimaging measurements required for more fully characterizing the events and locations of neocortical activity? A prime assumption has been that modulation of cortical activity will inevitably be reflected in changes in energy utilization (for the most part) changes of glucose and oxygen con...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00101

    authors: Robinson SE,Mandell AJ,Coppola R

    更新日期:2013-01-24 00:00:00

  • Interareal coupling reduces encoding variability in multi-area models of spatial working memory.

    abstract::Persistent activity observed during delayed-response tasks for spatial working memory (Funahashi et al., 1989) has commonly been modeled by recurrent networks whose dynamics is described as a bump attractor (Compte et al., 2000). We examine the effects of interareal architecture on the dynamics of bump attractors in s...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00082

    authors: Kilpatrick ZP

    更新日期:2013-07-01 00:00:00

  • Conscious Multisensory Integration: Introducing a Universal Contextual Field in Biological and Deep Artificial Neural Networks.

    abstract::Conscious awareness plays a major role in human cognition and adaptive behavior, though its function in multisensory integration is not yet fully understood, hence, questions remain: How does the brain integrate the incoming multisensory signals with respect to different external environments? How are the roles of the...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00015

    authors: Adeel A

    更新日期:2020-05-19 00:00:00

  • Segmental Bayesian estimation of gap-junctional and inhibitory conductance of inferior olive neurons from spike trains with complicated dynamics.

    abstract::The inverse problem for estimating model parameters from brain spike data is an ill-posed problem because of a huge mismatch in the system complexity between the model and the brain as well as its non-stationary dynamics, and needs a stochastic approach that finds the most likely solution among many possible solutions...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00056

    authors: Hoang H,Yamashita O,Tokuda IT,Sato MA,Kawato M,Toyama K

    更新日期:2015-05-21 00:00:00

  • A model-based approach to predict muscle synergies using optimization: application to feedback control.

    abstract::This paper presents a new model-based method to define muscle synergies. Unlike the conventional factorization approach, which extracts synergies from electromyographic data, the proposed method employs a biomechanical model and formally defines the synergies as the solution of an optimal control problem. As a result,...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00121

    authors: Sharif Razavian R,Mehrabi N,McPhee J

    更新日期:2015-10-06 00:00:00