An introductory review of information theory in the context of computational neuroscience.

Abstract:

:This article introduces several fundamental concepts in information theory from the perspective of their origins in engineering. Understanding such concepts is important in neuroscience for two reasons. Simply applying formulae from information theory without understanding the assumptions behind their definitions can lead to erroneous results and conclusions. Furthermore, this century will see a convergence of information theory and neuroscience; information theory will expand its foundations to incorporate more comprehensively biological processes thereby helping reveal how neuronal networks achieve their remarkable information processing abilities.

journal_name

Biol Cybern

journal_title

Biological cybernetics

authors

McDonnell MD,Ikeda S,Manton JH

doi

10.1007/s00422-011-0451-9

subject

Has Abstract

pub_date

2011-07-01 00:00:00

pages

55-70

issue

1

eissn

0340-1200

issn

1432-0770

journal_volume

105

pub_type

杂志文章,评审
  • Langevin machine: a neural network based on stochastically justifiable sigmoidal function.

    abstract::In neural networks the activation process controls the output as a nonlinear function of the input; and, this output remains bounded between limits as decided by a logistic function known as the sigmoid (S-shaped). Presently, by applying the considerations of Maxwell-Boltzmann statistics, the Langevin function is show...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00216966

    authors: Neelakanta PS,Sudhakar R,DeGroff D

    更新日期:1991-01-01 00:00:00

  • Understanding finger coordination through analysis of the structure of force variability.

    abstract::Most common motor acts involve highly redundant effector systems. Understanding how such systems are controlled by the nervous system is a long-standing scientific challenge. Most proposals for solving this problem are based on the assumption that a particular solution, which optimizes additional constraints, is selec...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220100279

    authors: Scholz JP,Danion F,Latash ML,Schöner G

    更新日期:2002-01-01 00:00:00

  • Internal models and intermittency: a theoretical account of human tracking behavior.

    abstract::This paper concerns the use of tracking studies to test a theoretical account of the information processing performed by the human CNS during control of movement. The theory provides a bridge between studies of reaction time and continuous tracking. It is proposed that the human CNS includes neuronal circuitry to comp...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00364156

    authors: Neilson PD,Neilson MD,O'Dwyer NJ

    更新日期:1988-01-01 00:00:00

  • Synaptic organizations and dynamical properties of weakly connected neural oscillators. I. Analysis of a canonical model.

    abstract::We study weakly connected networks of neural oscillators near multiple Andronov-Hopf bifurcation points. We analyze relationships between synaptic organizations (anatomy) of the networks and their dynamical properties (function). Our principal assumptions are: (1) Each neural oscillator comprises two populations of ne...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050279

    authors: Hoppensteadt FC,Izhikevich EM

    更新日期:1996-08-01 00:00:00

  • Neural coding and contextual influences in the whisker system.

    abstract::A fundamental problem in neuroscience, to which Prof. Segundo has made seminal contributions, is to understand how action potentials represent events in the external world. The aim of this paper is to review the issue of neural coding in the context of the rodent whiskers, an increasingly popular model system. Key iss...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-008-0290-5

    authors: Petersen RS,Panzeri S,Maravall M

    更新日期:2009-06-01 00:00:00

  • A stochastic model of retinotopy: a self organizing process.

    abstract::Following Kohonen and using the Hebb principle, we define a self organizing stochastic process, which is a simple modelization of the retinotopy, i.e. the establishment of well-ordered connexions between the retina and the cortex. We give some mathematical results about convergence of this process. These results are i...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00318206

    authors: Cottrell M,Fort JC

    更新日期:1986-01-01 00:00:00

  • Computational modeling of synchronization process of the circadian timing system of mammals.

    abstract::This paper presents a model for the circadian temporization system of mammals which associates the synchronization dynamics of coupling oscillators to a set of equations able to reproduce the synaptic characteristics of somatodendritic membrane of neurons. The circadian timing system is organized in a way to receive i...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-009-0309-6

    authors: Cardoso FR,de Oliveira Cruz FA,Silva D,Cortez CM

    更新日期:2009-05-01 00:00:00

  • Comparison of congruence judgment and auditory localization tasks for assessing the spatial limits of visual capture.

    abstract::Vision typically has better spatial accuracy and precision than audition and as a result often captures auditory spatial perception when visual and auditory cues are presented together. One determinant of visual capture is the amount of spatial disparity between auditory and visual cues: when disparity is small, visua...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-016-0706-6

    authors: Bosen AK,Fleming JT,Brown SE,Allen PD,O'Neill WE,Paige GD

    更新日期:2016-12-01 00:00:00

  • A new algorithm for voltage clamp by iteration: a learning control of a nonlinear neuronal system.

    abstract::Voltage-clamp of excitable membrane allows the measurement of membrane currents associated with electrical potential changes across the membrane. However, it has been impossible in practice to apply the conventional analog feedback voltage-clamp circuits to single electrode voltage clamping in central neurons. The rea...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00355690

    authors: Kawato M,Etoh M,Oda Y,Tsukahara N

    更新日期:1985-01-01 00:00:00

  • Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity--strengthening correlated input pathways.

    abstract::Spike-timing-dependent plasticity (STDP) determines the evolution of the synaptic weights according to their pre- and post-synaptic activity, which in turn changes the neuronal activity. In this paper, we extend previous studies of input selectivity induced by (STDP) for single neurons to the biologically interesting ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-009-0319-4

    authors: Gilson M,Burkitt AN,Grayden DB,Thomas DA,van Hemmen JL

    更新日期:2009-08-01 00:00:00

  • A model of anuran retina relating interneurons to ganglion cell responses.

    abstract::A model is presented which accounts for many characteristic response properties used to classify anuran ganglion cell types while being consistent with data concerning interneurons. In the model color is ignored and input stimuli are assumed to be only black and white at high contrast. We show that accurate ganglion c...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00201980

    authors: Teeters JL,Arbib MA

    更新日期:1991-01-01 00:00:00

  • Neural modeling of intrinsic and spike-discharge properties of cochlear nucleus neurons.

    abstract::The purpose of this study was to develop neurobiologically plausible models to account for the response properties of several types of cochlear nucleus neurons. Three cell types--the bushy cells, stellate cells, and fusiform cells--were selected because useful data from intracellular recordings were available for thes...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00199590

    authors: Arle JE,Kim DO

    更新日期:1991-01-01 00:00:00

  • Face-infringement space: the frame of reference of the ventral intraparietal area.

    abstract::Experimental studies have shown that responses of ventral intraparietal area (VIP) neurons specialize in head movements and the environment near the head. VIP neurons respond to visual, auditory, and tactile stimuli, smooth pursuit eye movements, and passive and active movements of the head. This study demonstrates ma...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-012-0491-9

    authors: McCollum G,Klam F,Graf W

    更新日期:2012-07-01 00:00:00

  • Mathematical formulations of Hebbian learning.

    abstract::Several formulations of correlation-based Hebbian learning are reviewed. On the presynaptic side, activity is described either by a firing rate or by presynaptic spike arrival. The state of the postsynaptic neuron can be described by its membrane potential, its firing rate, or the timing of backpropagating action pote...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-002-0353-y

    authors: Gerstner W,Kistler WM

    更新日期:2002-12-01 00:00:00

  • The distributed representation of vestibulo-oculomotor signals by brain-stem neurons.

    abstract::The vestibuloocular reflex and other oculomotor functions are subserved by populations of neurons operating in parallel. This distributed aspect of the system's organization has been largely ignored in previous block diagram models. Neurons that transmit oculomotor signals, such as those in the vestibular nucleus (VN)...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00204592

    authors: Anastasio TJ,Robinson DA

    更新日期:1989-01-01 00:00:00

  • Behavioral analysis of differential Hebbian learning in closed-loop systems.

    abstract::Understanding closed loop behavioral systems is a non-trivial problem, especially when they change during learning. Descriptions of closed loop systems in terms of information theory date back to the 1950s, however, there have been only a few attempts which take into account learning, mostly measuring information of i...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-010-0396-4

    authors: Kulvicius T,Kolodziejski C,Tamosiunaite M,Porr B,Wörgötter F

    更新日期:2010-10-01 00:00:00

  • Contrast Discrimination by the human visual system.

    abstract::In vision of everyday scenes, features requiring detection are frequently observed in the presence of suprathreshold background structures. Detection of such features is a contrast discrimination task and is often necessary for the subsequent process of recognition. In order to provide a description of this task, cont...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00326678

    authors: Burton GJ

    更新日期:1981-01-01 00:00:00

  • Conditions for noise reduction and stable encoding of spatial structure by cortical neural networks.

    abstract::Cortical circuits have been proposed to encode information by forming stable spatially structured attractors. Experimentally in the primary somatosensory cortex of the monkey, temporally invariant stimuli lead to spatially structured activity patterns. The purpose of this work is to study a recurrent cortical neural n...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050599

    authors: Gutkin BS,Smith CE

    更新日期:2000-06-01 00:00:00

  • Properties of 3D rotations and their relation to eye movement control.

    abstract::Rotations of the eye are generated by the torques that the eye muscles apply to the eye. The relationship between eye orientation and the direction of the torques generated by the extraocular muscles is therefore central to any understanding of the control of three-dimensional eye movements of any type. We review the ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-004-0477-3

    authors: Koene AR,Erkelens CJ

    更新日期:2004-06-01 00:00:00

  • Rate coherence and event coherence in the visual cortex: a neuronal model of object recognition.

    abstract::We propose a function-oriented model of the visual cortex. The model addresses an essential task of the visual system: to detect and represent objects. These are defined as sets, which reappear in the input with invariant inner relations. A network, incorporating an idealized description of anatomical and physiologica...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF02414887

    authors: Neven H,Aertsen A

    更新日期:1992-01-01 00:00:00

  • The frequency of seeing square wave density modulations in random dot patterns.

    abstract::A theoretical and experimental study on the detection of a square wave pattern of random dots is presented. Our theory applies to two-alternative forced choice experiments as well as to "seen"-"not seen" discrimination experiments. In our experiments we used the forced choice method. The theory provides a good descrip...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00318084

    authors: Lelkens AM,Oppeneer PM

    更新日期:1983-01-01 00:00:00

  • A saliency-based bottom-up visual attention model for dynamic scenes analysis.

    abstract::This work proposes a model of visual bottom-up attention for dynamic scene analysis. Our work adds motion saliency calculations to a neural network model with realistic temporal dynamics [(e.g., building motion salience on top of De Brecht and Saiki Neural Networks 19:1467-1474, (2006)]. The resulting network elicits ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-012-0542-2

    authors: Ramirez-Moreno DF,Schwartz O,Ramirez-Villegas JF

    更新日期:2013-04-01 00:00:00

  • Combined dynamics of EEG and evoked potentials. II. Studies of simultaneously recorded EEG-EPograms in the auditory pathway, reticular formation, and hippocampus of the cat brain during sleep.

    abstract::This study is carried out on single (not averaged) recordings combining the spontaneous activity preceding the stimulus onset and the EP recorded upon acoustical stimulation. These recordings, which we call EEG-EPograms, are measured simultaneously from different subdural structures, such as the auditory cortex, media...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336853

    authors: Başar E,Durusan R,Gönder A,Ungan P

    更新日期:1979-09-01 00:00:00

  • A dynamical model for reflex activated head movements in the horizontal plane.

    abstract::We present a controls systems model of horizontal-plane head movements during perturbations of the trunk, which for the first time interfaces a model of the human head with neural feedback controllers representing the vestibulocollic (VCR) and the cervicocollic (CCR) reflexes. This model is homeomorphic such that mode...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050297

    authors: Peng GC,Hain TC,Peterson BW

    更新日期:1996-10-01 00:00:00

  • Valentino Braitenberg: From neuroanatomy to behavior and back.

    abstract::This article compiles an expose of Valentino Braitenberg's singular view on neuroanatomy and neuroscience. The review emphasizes his topologically informed work on neuroanatomy and his dialectics of brain-based explanations of motor behavior. Some of his early ideas on topologically informed neuroanatomy are presented...

    journal_title:Biological cybernetics

    pub_type: 传,历史文章,杂志文章,评审

    doi:10.1007/s00422-012-0533-3

    authors: Negrello M

    更新日期:2014-10-01 00:00:00

  • A computer system for the analysis and synthesis of field potentials.

    abstract::It is shown how field potentials due to neuronal membrane processes can be computed by means of a digital computer system. The essence of the method consists in evaluating a discrete expression for the field potential as a function of membrane potentials. This expression is considered as a three-dimensional convolutio...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00347640

    authors: van Rotterdam A

    更新日期:1980-01-01 00:00:00

  • Physiology based simulation model of triangle shape recognition.

    abstract::The present paper considers the relation between the shape of a triangle and probability of its recognition. An effect of triangle size on perception of its shape is examined in the first experiment. In the second the loci of eye fixations during triangle recognition task are recorded and analysed. A simulation model ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00363955

    authors: Pizlo Z

    更新日期:1988-01-01 00:00:00

  • Numerical fourier transform spectroscopy of EMG half-waves: fragmentary-decomposition-based approach to nonstationary signal analysis.

    abstract::A nonstationary signal analysis technique is introduced, which regards an oscillatory physiological signal as a sum of its fragments, presented in the form of a fragmentary decomposition (FD). The virtue of FD is that it is free of the necessity to choose a priori the basis functions intended for signal analysis or sy...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050575

    authors: Melkonian D,Blumenthal T,Gordon E

    更新日期:1999-11-01 00:00:00

  • A model for the economical encoding of the visual image in cerebral cortex.

    abstract::We propose a model for the first stage of the cortical transformation of the visual image based on the principle that the cortex encodes the information with the minimum number of channels mathematically needed. We restrict our model to be consistent with the data on size adaptations, the known relationships of acuity...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336972

    authors: Sakitt B,Barlow HB

    更新日期:1982-01-01 00:00:00

  • Quantitation of a mass action of dopaminergic neurones regulating temporal damping of linear electrocortical waves.

    abstract::We have previously proposed that electrocortical waves are linear waves, subject to regulation by mesotelencephalic dopaminergic neurones. As a further means to test this theory, selective unilateral lesions of varying extent were made in the nucleii of origin of the dopaminergic mesotelencephalic tract. Changes in th...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00355749

    authors: Wright JJ,Kydd RR,Lees GJ

    更新日期:1985-01-01 00:00:00