Unsupervised Few-Shot Feature Learning via Self-Supervised Training.

Abstract:

:Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a large amount of labeled examples. Unsupervised learning is a more natural procedure for cognitive mammals and has produced promising results in many machine learning tasks. In this paper, we propose an unsupervised feature learning method for few-shot learning. The proposed model consists of two alternate processes, progressive clustering and episodic training. The former generates pseudo-labeled training examples for constructing episodic tasks; and the later trains the few-shot learner using the generated episodic tasks which further optimizes the feature representations of data. The two processes facilitate each other, and eventually produce a high quality few-shot learner. In our experiments, our model achieves good generalization performance in a variety of downstream few-shot learning tasks on Omniglot and MiniImageNet. We also construct a new few-shot person re-identification dataset FS-Market1501 to demonstrate the feasibility of our model to a real-world application.

journal_name

Front Comput Neurosci

authors

Ji Z,Zou X,Huang T,Wu S

doi

10.3389/fncom.2020.00083

subject

Has Abstract

pub_date

2020-10-14 00:00:00

pages

83

issn

1662-5188

journal_volume

14

pub_type

杂志文章
  • Interareal coupling reduces encoding variability in multi-area models of spatial working memory.

    abstract::Persistent activity observed during delayed-response tasks for spatial working memory (Funahashi et al., 1989) has commonly been modeled by recurrent networks whose dynamics is described as a bump attractor (Compte et al., 2000). We examine the effects of interareal architecture on the dynamics of bump attractors in s...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00082

    authors: Kilpatrick ZP

    更新日期:2013-07-01 00:00:00

  • Hyperpolarization-Activated Current Induces Period-Doubling Cascades and Chaos in a Cold Thermoreceptor Model.

    abstract::In this article, we describe and analyze the chaotic behavior of a conductance-based neuronal bursting model. This is a model with a reduced number of variables, yet it retains biophysical plausibility. Inspired by the activity of cold thermoreceptors, the model contains a persistent Sodium current, a Calcium-activate...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00012

    authors: Xu K,Maidana JP,Caviedes M,Quero D,Aguirre P,Orio P

    更新日期:2017-03-10 00:00:00

  • Probabilistic Circuits for Autonomous Learning: A Simulation Study.

    abstract::Modern machine learning is based on powerful algorithms running on digital computing platforms and there is great interest in accelerating the learning process and making it more energy efficient. In this paper we present a fully autonomous probabilistic circuit for fast and efficient learning that makes no use of dig...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00014

    authors: Kaiser J,Faria R,Camsari KY,Datta S

    更新日期:2020-02-25 00:00:00

  • Information diversity in structure and dynamics of simulated neuronal networks.

    abstract::Neuronal networks exhibit a wide diversity of structures, which contributes to the diversity of the dynamics therein. The presented work applies an information theoretic framework to simultaneously analyze structure and dynamics in neuronal networks. Information diversity within the structure and dynamics of a neurona...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00026

    authors: Mäki-Marttunen T,Aćimović J,Nykter M,Kesseli J,Ruohonen K,Yli-Harja O,Linne ML

    更新日期:2011-06-01 00:00:00

  • Comparative Analysis of Behavioral Models for Adaptive Learning in Changing Environments.

    abstract::Probabilistic models of decision making under various forms of uncertainty have been applied in recent years to numerous behavioral and model-based fMRI studies. These studies were highly successful in enabling a better understanding of behavior and delineating the functional properties of brain areas involved in deci...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00033

    authors: Marković D,Kiebel SJ

    更新日期:2016-04-20 00:00:00

  • Analysis of Nociceptive Information Encoded in the Temporal Discharge Patterns of Cutaneous C-Fibers.

    abstract::The generation of pain signals from primary afferent neurons is explained by a labeled-line code. However, this notion cannot apply in a simple way to cutaneous C-fibers, which carry signals from a variety of receptors that respond to various stimuli including agonist chemicals. To represent the discharge patterns of ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00118

    authors: Cho K,Jang JH,Kim SP,Lee SH,Chung SC,Kim IY,Jang DP,Jung SJ

    更新日期:2016-11-18 00:00:00

  • Bayesian Inference of Synaptic Quantal Parameters from Correlated Vesicle Release.

    abstract::Synaptic transmission is both history-dependent and stochastic, resulting in varying responses to presentations of the same presynaptic stimulus. This complicates attempts to infer synaptic parameters and has led to the proposal of a number of different strategies for their quantification. Recently Bayesian approaches...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00116

    authors: Bird AD,Wall MJ,Richardson MJ

    更新日期:2016-11-25 00:00:00

  • Synaptic encoding of temporal contiguity.

    abstract::Often we need to perform tasks in an environment that changes stochastically. In these situations it is important to learn the statistics of sequences of events in order to predict the future and the outcome of our actions. The statistical description of many of these sequences can be reduced to the set of probabiliti...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00032

    authors: Ostojic S,Fusi S

    更新日期:2013-04-12 00:00:00

  • Anisotropic connectivity implements motion-based prediction in a spiking neural network.

    abstract::Predictive coding hypothesizes that the brain explicitly infers upcoming sensory input to establish a coherent representation of the world. Although it is becoming generally accepted, it is not clear on which level spiking neural networks may implement predictive coding and what function their connectivity may have. W...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00112

    authors: Kaplan BA,Lansner A,Masson GS,Perrinet LU

    更新日期:2013-09-17 00:00:00

  • Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation.

    abstract::The cerebellum is known to play a critical role in learning relevant patterns of activity for adaptive motor control, but the underlying network mechanisms are only partly understood. The classical long-term synaptic plasticity between parallel fibers (PFs) and Purkinje cells (PCs), which is driven by the inferior oli...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fncom.2014.00097

    authors: Luque NR,Garrido JA,Carrillo RR,D'Angelo E,Ros E

    更新日期:2014-08-15 00:00:00

  • Higher-order correlations in non-stationary parallel spike trains: statistical modeling and inference.

    abstract::The extent to which groups of neurons exhibit higher-order correlations in their spiking activity is a controversial issue in current brain research. A major difficulty is that currently available tools for the analysis of massively parallel spike trains (N >10) for higher-order correlations typically require vast sam...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2010.00016

    authors: Staude B,Grün S,Rotter S

    更新日期:2010-07-02 00:00:00

  • A three-dimensional mathematical model for the signal propagation on a neuron's membrane.

    abstract::In order to be able to examine the extracellular potential's influence on network activity and to better understand dipole properties of the extracellular potential, we present and analyze a three-dimensional formulation of the cable equation which facilitates numeric simulations. When the neuron's intra- and extracel...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00094

    authors: Xylouris K,Wittum G

    更新日期:2015-07-17 00:00:00

  • A micro-pool model for decision-related signals in visual cortical areas.

    abstract::The study of sensory signaling in the visual cortex has been greatly advanced by the recording of neural activity simultaneously with the performance of a specific psychophysical task. Individual nerve cells may also increase their firing leading up to the particular choice or decision made on a single psychophysical ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00115

    authors: Parker AJ

    更新日期:2013-08-13 00:00:00

  • Simultaneous stability and sensitivity in model cortical networks is achieved through anti-correlations between the in- and out-degree of connectivity.

    abstract::Neuronal networks in rodent barrel cortex are characterized by stable low baseline firing rates. However, they are sensitive to the action potentials of single neurons as suggested by recent single-cell stimulation experiments that reported quantifiable behavioral responses in response to short spike trains elicited i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00156

    authors: Vasquez JC,Houweling AR,Tiesinga P

    更新日期:2013-11-07 00:00:00

  • Predicting Antidepressant Citalopram Treatment Response via Changes in Brain Functional Connectivity After Acute Intravenous Challenge.

    abstract::Introduction: The early and therapy-specific prediction of treatment success in major depressive disorder is of paramount importance due to high lifetime prevalence, and heterogeneity of response to standard medication and symptom expression. Hence, this study assessed the predictability of long-term antidepressant ef...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.554186

    authors: Klöbl M,Gryglewski G,Rischka L,Godbersen GM,Unterholzner J,Reed MB,Michenthaler P,Vanicek T,Winkler-Pjrek E,Hahn A,Kasper S,Lanzenberger R

    更新日期:2020-10-06 00:00:00

  • Density Visualization Pipeline: A Tool for Cellular and Network Density Visualization and Analysis.

    abstract::Neuron classification is an important component in analyzing network structure and quantifying the effect of neuron topology on signal processing. Current quantification and classification approaches rely on morphology projection onto lower-dimensional spaces. In this paper a 3D visualization and quantification tool i...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2020.00042

    authors: Grein S,Qi G,Queisser G

    更新日期:2020-06-26 00:00:00

  • Causal Inference for Cross-Modal Action Selection: A Computational Study in a Decision Making Framework.

    abstract::Animals try to make sense of sensory information from multiple modalities by categorizing them into perceptions of individual or multiple external objects or internal concepts. For example, the brain constructs sensory, spatial representations of the locations of visual and auditory stimuli in the visual and auditory ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00062

    authors: Daemi M,Harris LR,Crawford JD

    更新日期:2016-06-23 00:00:00

  • Multimodal Neural Network for Rapid Serial Visual Presentation Brain Computer Interface.

    abstract::Brain computer interfaces allow users to preform various tasks using only the electrical activity of the brain. BCI applications often present the user a set of stimuli and record the corresponding electrical response. The BCI algorithm will then have to decode the acquired brain response and perform the desired task....

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00130

    authors: Manor R,Mishali L,Geva AB

    更新日期:2016-12-20 00:00:00

  • Brain Network Analysis and Classification Based on Convolutional Neural Network.

    abstract::Background: Convolution neural networks (CNN) is increasingly used in computer science and finds more and more applications in different fields. However, analyzing brain network with CNN is not trivial, due to the non-Euclidean characteristics of brain network built by graph theory. Method: To address this problem, we...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00095

    authors: Meng L,Xiang J

    更新日期:2018-12-10 00:00:00

  • Neural variability, or lack thereof.

    abstract::We do not claim that the brain is completely deterministic, and we agree that noise may be beneficial in some cases. But we suggest that neuronal variability may be often overestimated, due to uncontrolled internal variables, and/or the use of inappropriate reference times. These ideas are not new, but should be re-ex...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00007

    authors: Masquelier T

    更新日期:2013-02-25 00:00:00

  • Layer-Dependent Attentional Processing by Top-down Signals in a Visual Cortical Microcircuit Model.

    abstract::A vast amount of information about the external world continuously flows into the brain, whereas its capacity to process such information is limited. Attention enables the brain to allocate its resources of information processing to selected sensory inputs for reducing its computational load, and effects of attention ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2011.00031

    authors: Wagatsuma N,Potjans TC,Diesmann M,Fukai T

    更新日期:2011-07-08 00:00:00

  • Examining Brain Morphometry Associated with Self-Esteem in Young Adults Using Multilevel-ROI-Features-Based Classification Method.

    abstract::Purpose: This study is to exam self-esteem related brain morphometry on brain magnetic resonance (MR) images using multilevel-features-based classification method. Method: The multilevel region of interest (ROI) features consist of two types of features: (i) ROI features, which include gray matter volume, white matter...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00037

    authors: Peng B,Lu J,Saxena A,Zhou Z,Zhang T,Wang S,Dai Y

    更新日期:2017-05-22 00:00:00

  • Neuromodulation impact on nonlinear firing behavior of a reduced model motoneuron with the active dendrite.

    abstract::Neuromodulatory inputs from brainstem systems modulate the normal function of spinal motoneurons by altering the activation properties of persistent inward currents (PICs) in their dendrites. However, the effect of the PIC on firing outputs also depends on its location in the dendritic tree. To investigate the interac...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2014.00110

    authors: Kim H,Heckman CJ

    更新日期:2014-09-09 00:00:00

  • ARTIE: An Integrated Environment for the Development of Affective Robot Tutors.

    abstract::Over the last decade robotics has attracted a great deal of interest from teachers and researchers as a valuable educational tool from preschool to highschool levels. The implementation of social-support behaviors in robot tutors, in particular in the emotional dimension, can make a significant contribution to learnin...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00077

    authors: Imbernón Cuadrado LE,Manjarrés Riesco Á,De La Paz López F

    更新日期:2016-08-03 00:00:00

  • A Glutamatergic Spine Model to Enable Multi-Scale Modeling of Nonlinear Calcium Dynamics.

    abstract::In synapses, calcium is required for modulating synaptic transmission, plasticity, synaptogenesis, and synaptic pruning. The regulation of calcium dynamics within neurons involves cellular mechanisms such as synaptically activated channels and pumps, calcium buffers, and calcium sequestrating organelles. Many experime...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2018.00058

    authors: Hu E,Mergenthal A,Bingham CS,Song D,Bouteiller JM,Berger TW

    更新日期:2018-07-27 00:00:00

  • Model selection for the extraction of movement primitives.

    abstract::A wide range of blind source separation methods have been used in motor control research for the extraction of movement primitives from EMG and kinematic data. Popular examples are principal component analysis (PCA), independent component analysis (ICA), anechoic demixing, and the time-varying synergy model (d'Avella ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2013.00185

    authors: Endres DM,Chiovetto E,Giese MA

    更新日期:2013-12-20 00:00:00

  • Transition Dynamics of a Dentate Gyrus-CA3 Neuronal Network during Temporal Lobe Epilepsy.

    abstract::In temporal lobe epilepsy (TLE), the variation of chemical receptor expression underlies the basis of neural network activity shifts, resulting in neuronal hyperexcitability and epileptiform discharges. However, dynamical mechanisms involved in the transitions of TLE are not fully understood, because of the neuronal d...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2017.00061

    authors: Zhang L,Fan D,Wang Q

    更新日期:2017-07-11 00:00:00

  • Architectural constraints are a major factor reducing path integration accuracy in the rat head direction cell system.

    abstract::Head direction cells fire to signal the direction in which an animal's head is pointing. They are able to track head direction using only internally-derived information (path integration)In this simulation study we investigate the factors that affect path integration accuracy. Specifically, two major limiting factors ...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2015.00010

    authors: Page HJ,Walters D,Stringer SM

    更新日期:2015-02-06 00:00:00

  • Network Models Predict That Pyramidal Neuron Hyperexcitability and Synapse Loss in the dlPFC Lead to Age-Related Spatial Working Memory Impairment in Rhesus Monkeys.

    abstract::Behavioral studies have shown spatial working memory impairment with aging in several animal species, including humans. Persistent activity of layer 3 pyramidal dorsolateral prefrontal cortex (dlPFC) neurons during delay periods of working memory tasks is important for encoding memory of the stimulus. In vitro studies...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2019.00089

    authors: Ibañez S,Luebke JI,Chang W,Draguljić D,Weaver CM

    更新日期:2020-01-17 00:00:00

  • A Phenomenological Model of the Electrically Stimulated Auditory Nerve Fiber: Temporal and Biphasic Response Properties.

    abstract::We present a phenomenological model of electrically stimulated auditory nerve fibers (ANFs). The model reproduces the probabilistic and temporal properties of the ANF response to both monophasic and biphasic stimuli, in isolation. The main contribution of the model lies in its ability to reproduce statistics of the AN...

    journal_title:Frontiers in computational neuroscience

    pub_type: 杂志文章

    doi:10.3389/fncom.2016.00008

    authors: Horne CD,Sumner CJ,Seeber BU

    更新日期:2016-02-08 00:00:00