Deep networks for motor control functions.

Abstract:

:The motor system generates time-varying commands to move our limbs and body. Conventional descriptions of motor control and learning rely on dynamical representations of our body's state (forward and inverse models), and control policies that must be integrated forward to generate feedforward time-varying commands; thus these are representations across space, but not time. Here we examine a new approach that directly represents both time-varying commands and the resulting state trajectories with a function; a representation across space and time. Since the output of this function includes time, it necessarily requires more parameters than a typical dynamical model. To avoid the problems of local minima these extra parameters introduce, we exploit recent advances in machine learning to build our function using a stacked autoencoder, or deep network. With initial and target states as inputs, this deep network can be trained to output an accurate temporal profile of the optimal command and state trajectory for a point-to-point reach of a non-linear limb model, even when influenced by varying force fields. In a manner that mirrors motor babble, the network can also teach itself to learn through trial and error. Lastly, we demonstrate how this network can learn to optimize a cost objective. This functional approach to motor control is a sharp departure from the standard dynamical approach, and may offer new insights into the neural implementation of motor control.

journal_name

Front Comput Neurosci

authors

Berniker M,Kording KP

doi

10.3389/fncom.2015.00032

subject

Has Abstract

pub_date

2015-03-19 00:00:00

pages

32

issn

1662-5188

journal_volume

9

pub_type

杂志文章
  • Synaptic bouton properties are tuned to best fit the prevailing firing pattern.

    abstract::The morphology of presynaptic specializations can vary greatly ranging from classical single-release-site boutons in the central nervous system to boutons of various sizes harboring multiple vesicle release sites. Multi-release-site boutons can be found in several neural contexts, for example at the neuromuscular junc...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00101

    authors: Knodel MM,Geiger R,Ge L,Bucher D,Grillo A,Wittum G,Schuster CM,Queisser G

    更新日期:2014-09-09 00:00:00

  • Revealing the Computational Meaning of Neocortical Interarea Signals.

    abstract::To understand the function of the neocortex, which is a hierarchical distributed network, it is useful giving meaning to the signals transmitted between these areas from the computational viewpoint. The overall anatomical structure or organs related to this network, including the neocortex, thalamus, and basal ganglia...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00074

    authors: Yamakawa H

    更新日期:2020-08-18 00:00:00

  • A Computational Model of Interactions Between Neuronal and Astrocytic Networks: The Role of Astrocytes in the Stability of the Neuronal Firing Rate.

    abstract::Recent research in neuroscience indicates the importance of tripartite synapses and gliotransmission mediated by astrocytes in neuronal system modulation. Although the astrocyte and neuronal network functions are interrelated, they are fundamentally different in their signaling patterns and, possibly, the time scales ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00092

    authors: Lenk K,Satuvuori E,Lallouette J,Ladrón-de-Guevara A,Berry H,Hyttinen JAK

    更新日期:2020-01-22 00:00:00

  • Structure learning and the Occam's razor principle: a new view of human function acquisition.

    abstract::We often encounter pairs of variables in the world whose mutual relationship can be described by a function. After training, human responses closely correspond to these functional relationships. Here we study how humans predict unobserved segments of a function that they have been trained on and we compare how human p...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00121

    authors: Narain D,Smeets JB,Mamassian P,Brenner E,van Beers RJ

    更新日期:2014-09-30 00:00:00

  • Topological View of Flows Inside the BOLD Spontaneous Activity of the Human Brain.

    abstract::Spatio-temporal brain activities with variable delay detectable in resting-state functional magnetic resonance imaging (rs-fMRI) give rise to highly reproducible structures, termed cortical lag threads, that propagate from one brain region to another. Using a computational topology of data approach, we found that pers...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00034

    authors: Don APH,Peters JF,Ramanna S,Tozzi A

    更新日期:2020-04-22 00:00:00

  • Generation of Granule Cell Dendritic Morphologies by Estimating the Spatial Heterogeneity of Dendritic Branching.

    abstract::Biological realism of dendritic morphologies is important for simulating electrical stimulation of brain tissue. By adding point process modeling and conditional sampling to existing generation strategies, we provide a novel means of reproducing the nuanced branching behavior that occurs in different layers of granule...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00023

    authors: Chou ZZ,Yu GJ,Berger TW

    更新日期:2020-04-09 00:00:00

  • Optimization of Real-Time EEG Artifact Removal and Emotion Estimation for Human-Robot Interaction Applications.

    abstract::Affective human-robot interaction requires lightweight software and cheap wearable devices that could further this field. However, the estimation of emotions in real-time poses a problem that has not yet been optimized. An optimization is proposed for the emotion estimation methodology including artifact removal, feat...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00080

    authors: Val-Calvo M,Álvarez-Sánchez JR,Ferrández-Vicente JM,Fernández E

    更新日期:2019-11-26 00:00:00

  • The role of pulvinar in the transmission of information in the visual hierarchy.

    abstract::VISUAL RECEPTIVE FIELD (RF) ATTRIBUTES IN VISUAL CORTEX OF PRIMATES HAVE BEEN EXPLAINED MAINLY FROM CORTICAL CONNECTIONS: visual RFs progress from simple to complex through cortico-cortical pathways from lower to higher levels in the visual hierarchy. This feedforward flow of information is paired with top-down proces...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00029

    authors: Cortes N,van Vreeswijk C

    更新日期:2012-05-28 00:00:00

  • Sex Differences in Fiber Connection between the Striatum and Subcortical and Cortical Regions.

    abstract::The striatum is an important subcortical structure with extensive connections to other regions of the brain. These connections are believed to play important roles in behaviors such as reward-related processes and impulse control, which show significant sex differences. However, little is known about sex differences i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00100

    authors: Lei X,Han Z,Chen C,Bai L,Xue G,Dong Q

    更新日期:2016-09-23 00:00:00

  • Striatal Network Models of Huntington's Disease Dysfunction Phenotypes.

    abstract::We present a network model of striatum, which generates "winnerless" dynamics typical for a network of sparse, unidirectionally connected inhibitory units. We observe that these dynamics, while interesting and a good match to normal striatal electrophysiological recordings, are fragile. Specifically, we find that rand...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00070

    authors: Zheng P,Kozloski J

    更新日期:2017-07-27 00:00:00

  • Analysis of Nociceptive Information Encoded in the Temporal Discharge Patterns of Cutaneous C-Fibers.

    abstract::The generation of pain signals from primary afferent neurons is explained by a labeled-line code. However, this notion cannot apply in a simple way to cutaneous C-fibers, which carry signals from a variety of receptors that respond to various stimuli including agonist chemicals. To represent the discharge patterns of ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00118

    authors: Cho K,Jang JH,Kim SP,Lee SH,Chung SC,Kim IY,Jang DP,Jung SJ

    更新日期:2016-11-18 00:00:00

  • Bursting Neurons in the Hippocampal Formation Encode Features of LFP Rhythms.

    abstract::Burst spike patterns are common in regions of the hippocampal formation such as the subiculum and medial entorhinal cortex (MEC). Neurons in these areas are immersed in extracellular electrical potential fluctuations often recorded as the local field potential (LFP). LFP rhythms within different frequency bands are li...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00133

    authors: Constantinou M,Gonzalo Cogno S,Elijah DH,Kropff E,Gigg J,Samengo I,Montemurro MA

    更新日期:2016-12-26 00:00:00

  • Enabling functional neural circuit simulations with distributed computing of neuromodulated plasticity.

    abstract::A major puzzle in the field of computational neuroscience is how to relate system-level learning in higher organisms to synaptic plasticity. Recently, plasticity rules depending not only on pre- and post-synaptic activity but also on a third, non-local neuromodulatory signal have emerged as key candidates to bridge th...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00141

    authors: Potjans W,Morrison A,Diesmann M

    更新日期:2010-11-23 00:00:00

  • Multimodal Neural Network for Rapid Serial Visual Presentation Brain Computer Interface.

    abstract::Brain computer interfaces allow users to preform various tasks using only the electrical activity of the brain. BCI applications often present the user a set of stimuli and record the corresponding electrical response. The BCI algorithm will then have to decode the acquired brain response and perform the desired task....

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00130

    authors: Manor R,Mishali L,Geva AB

    更新日期:2016-12-20 00:00:00

  • Causal Inference for Cross-Modal Action Selection: A Computational Study in a Decision Making Framework.

    abstract::Animals try to make sense of sensory information from multiple modalities by categorizing them into perceptions of individual or multiple external objects or internal concepts. For example, the brain constructs sensory, spatial representations of the locations of visual and auditory stimuli in the visual and auditory ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00062

    authors: Daemi M,Harris LR,Crawford JD

    更新日期:2016-06-23 00:00:00

  • Stochastic Resonance Based Visual Perception Using Spiking Neural Networks.

    abstract::Our aim is to propose an efficient algorithm for enhancing the contrast of dark images based on the principle of stochastic resonance in a global feedback spiking network of integrate-and-fire neurons. By linear approximation and direct simulation, we disclose the dependence of the peak signal-to-noise ratio on the sp...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00024

    authors: Fu Y,Kang Y,Chen G

    更新日期:2020-05-15 00:00:00

  • Inhibition potentiates the synchronizing action of electrical synapses.

    abstract::In vivo and in vitro experimental studies have found that blocking electrical interactions connecting GABAergic interneurons reduces oscillatory activity in the gamma range in cortex. However, recent theoretical works have shown that the ability of electrical synapses to promote or impede synchrony, when alone, depend...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.10.008.2007

    authors: Pfeuty B,Golomb D,Mato G,Hansel D

    更新日期:2007-11-02 00:00:00

  • A model of food reward learning with dynamic reward exposure.

    abstract::The process of conditioning via reward learning is highly relevant to the study of food choice and obesity. Learning is itself shaped by environmental exposure, with the potential for such exposures to vary substantially across individuals and across place and time. In this paper, we use computational techniques to ex...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00082

    authors: Hammond RA,Ornstein JT,Fellows LK,Dubé L,Levitan R,Dagher A

    更新日期:2012-10-11 00:00:00

  • Impact of Physical Obstacles on the Structural and Effective Connectivity of in silico Neuronal Circuits.

    abstract::Scaffolds and patterned substrates are among the most successful strategies to dictate the connectivity between neurons in culture. Here, we used numerical simulations to investigate the capacity of physical obstacles placed on a flat substrate to shape structural connectivity, and in turn collective dynamics and effe...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00077

    authors: Ludl AA,Soriano J

    更新日期:2020-08-31 00:00:00

  • Structural Plasticity Denoises Responses and Improves Learning Speed.

    abstract::Despite an abundance of computational models for learning of synaptic weights, there has been relatively little research on structural plasticity, i.e., the creation and elimination of synapses. Especially, it is not clear how structural plasticity works in concert with spike-timing-dependent plasticity (STDP) and wha...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00093

    authors: Spiess R,George R,Cook M,Diehl PU

    更新日期:2016-09-08 00:00:00

  • Statistical physics of pairwise probability models.

    abstract::Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using a reasonable amount of data: knowledge of the mean values and correlations betw...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.10.022.2009

    authors: Roudi Y,Aurell E,Hertz JA

    更新日期:2009-11-17 00:00:00

  • Fusimotor control of spindle sensitivity regulates central and peripheral coding of joint angles.

    abstract::Proprioceptive afferents from muscle spindles encode information about peripheral joint movements for the central nervous system (CNS). The sensitivity of muscle spindle is nonlinearly dependent on the activation of gamma (γ) motoneurons in the spinal cord that receives inputs from the motor cortex. How fusimotor cont...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00066

    authors: Lan N,He X

    更新日期:2012-08-30 00:00:00

  • Determine Neuronal Tuning Curves by Exploring Optimum Firing Rate Distribution for Information Efficiency.

    abstract::This paper proposed a new method to determine the neuronal tuning curves for maximum information efficiency by computing the optimum firing rate distribution. Firstly, we proposed a general definition for the information efficiency, which is relevant to mutual information and neuronal energy consumption. The energy co...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00010

    authors: Han F,Wang Z,Fan H

    更新日期:2017-02-21 00:00:00

  • Computational Neural Modeling of Auditory Cortical Receptive Fields.

    abstract::Previous studies have shown that the auditory cortex can enhance the perception of behaviorally important sounds in the presence of background noise, but the mechanisms by which it does this are not yet elucidated. Rapid plasticity of spectrotemporal receptive fields (STRFs) in the primary (A1) cortical neurons is obs...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00028

    authors: Chambers JD,Elgueda D,Fritz JB,Shamma SA,Burkitt AN,Grayden DB

    更新日期:2019-05-24 00:00:00

  • A stimulus-dependent spike threshold is an optimal neural coder.

    abstract::A neural code based on sequences of spikes can consume a significant portion of the brain's energy budget. Thus, energy considerations would dictate that spiking activity be kept as low as possible. However, a high spike-rate improves the coding and representation of signals in spike trains, particularly in sensory sy...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00061

    authors: Jones DL,Johnson EC,Ratnam R

    更新日期:2015-06-02 00:00:00

  • Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation.

    abstract::The cerebellum is known to play a critical role in learning relevant patterns of activity for adaptive motor control, but the underlying network mechanisms are only partly understood. The classical long-term synaptic plasticity between parallel fibers (PFs) and Purkinje cells (PCs), which is driven by the inferior oli...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2014.00097

    authors: Luque NR,Garrido JA,Carrillo RR,D'Angelo E,Ros E

    更新日期:2014-08-15 00:00:00

  • A three-dimensional mathematical model for the signal propagation on a neuron's membrane.

    abstract::In order to be able to examine the extracellular potential's influence on network activity and to better understand dipole properties of the extracellular potential, we present and analyze a three-dimensional formulation of the cable equation which facilitates numeric simulations. When the neuron's intra- and extracel...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00094

    authors: Xylouris K,Wittum G

    更新日期:2015-07-17 00:00:00

  • Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science.

    abstract::With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publi...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2012.00020

    authors: Wicherts JM,Kievit RA,Bakker M,Borsboom D

    更新日期:2012-04-03 00:00:00

  • Interareal coupling reduces encoding variability in multi-area models of spatial working memory.

    abstract::Persistent activity observed during delayed-response tasks for spatial working memory (Funahashi et al., 1989) has commonly been modeled by recurrent networks whose dynamics is described as a bump attractor (Compte et al., 2000). We examine the effects of interareal architecture on the dynamics of bump attractors in s...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00082

    authors: Kilpatrick ZP

    更新日期:2013-07-01 00:00:00

  • Dynamical Graph Theory Networks Methods for the Analysis of Sparse Functional Connectivity Networks and for Determining Pinning Observability in Brain Networks.

    abstract::Neuroimaging in combination with graph theory has been successful in analyzing the functional connectome. However almost all analysis are performed based on static graph theory. The derived quantitative graph measures can only describe a snap shot of the disease over time. Neurodegenerative disease evolution is poorly...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00087

    authors: Meyer-Bäse A,Roberts RG,Illan IA,Meyer-Bäse U,Lobbes M,Stadlbauer A,Pinker-Domenig K

    更新日期:2017-10-05 00:00:00