Reinforcement learning in populations of spiking neurons.

Abstract:

:Population coding is widely regarded as an important mechanism for achieving reliable behavioral responses despite neuronal variability. However, standard reinforcement learning slows down with increasing population size, as the global reward signal becomes less and less related to the performance of any single neuron. We found that learning speeds up with increasing population size if, in addition to global reward, feedback about the population response modulates synaptic plasticity.

journal_name

Nat Neurosci

journal_title

Nature neuroscience

authors

Urbanczik R,Senn W

doi

10.1038/nn.2264

subject

Has Abstract

pub_date

2009-03-01 00:00:00

pages

250-2

issue

3

eissn

1097-6256

issn

1546-1726

pii

nn.2264

journal_volume

12

pub_type

杂志文章
  • Control of tumor-associated macrophages and T cells in glioblastoma via AHR and CD39.

    abstract::Tumor-associated macrophages (TAMs) play an important role in the immune response to cancer, but the mechanisms by which the tumor microenvironment controls TAMs and T cell immunity are not completely understood. Here we report that kynurenine produced by glioblastoma cells activates aryl hydrocarbon receptor (AHR) in...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/s41593-019-0370-y

    authors: Takenaka MC,Gabriely G,Rothhammer V,Mascanfroni ID,Wheeler MA,Chao CC,Gutiérrez-Vázquez C,Kenison J,Tjon EC,Barroso A,Vandeventer T,de Lima KA,Rothweiler S,Mayo L,Ghannam S,Zandee S,Healy L,Sherr D,Farez MF,Prat A,

    更新日期:2019-05-01 00:00:00

  • Exome sequencing to identify de novo mutations in sporadic ALS trios.

    abstract::Amyotrophic lateral sclerosis (ALS) is a devastating neurodegenerative disease whose causes are still poorly understood. To identify additional genetic risk factors, we assessed the role of de novo mutations in ALS by sequencing the exomes of 47 ALS patients and both of their unaffected parents (n = 141 exomes). We fo...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3412

    authors: Chesi A,Staahl BT,Jovičić A,Couthouis J,Fasolino M,Raphael AR,Yamazaki T,Elias L,Polak M,Kelly C,Williams KL,Fifita JA,Maragakis NJ,Nicholson GA,King OD,Reed R,Crabtree GR,Blair IP,Glass JD,Gitler AD

    更新日期:2013-07-01 00:00:00

  • Tonotopic reorganization of developing auditory brainstem circuits.

    abstract::A fundamental organizing principle of auditory brain circuits is tonotopy, the orderly representation of the sound frequency to which neurons are most sensitive. Tonotopy arises from the coding of frequency along the cochlea and the topographic organization of auditory pathways. The mechanisms that underlie the establ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/nn.2332

    authors: Kandler K,Clause A,Noh J

    更新日期:2009-06-01 00:00:00

  • BMPs inhibit neurogenesis by a mechanism involving degradation of a transcription factor.

    abstract::Bone morphogenetic proteins (BMPs), negative regulators of neural determination in the early embryo, were found to be potent inhibitors of neurogenesis in olfactory epithelium (OE) cultures. BMPs 2, 4 or 7 decreased the number of proliferating progenitor cells and blocked production of olfactory receptor neurons (ORNs...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/7251

    authors: Shou J,Rim PC,Calof AL

    更新日期:1999-04-01 00:00:00

  • Causal role of the prefrontal cortex in top-down modulation of visual processing and working memory.

    abstract::Selective attention filters information to limit what is encoded and maintained in working memory. Although the prefrontal cortex (PFC) is central to both selective attention and working memory, the underlying neural processes that link these cognitive abilities remain elusive. Using functional magnetic resonance imag...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2773

    authors: Zanto TP,Rubens MT,Thangavel A,Gazzaley A

    更新日期:2011-05-01 00:00:00

  • Stress, genotype and norepinephrine in the prediction of mouse behavior using reinforcement learning.

    abstract::Individual behavioral performance during learning is known to be affected by modulatory factors, such as stress and motivation, and by genetic predispositions that influence sensitivity to these factors. Despite numerous studies, no integrative framework is available that could predict how a given animal would perform...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2374

    authors: Luksys G,Gerstner W,Sandi C

    更新日期:2009-09-01 00:00:00

  • Reactivation of experience-dependent cell assembly patterns in the hippocampus.

    abstract::The hippocampus is thought to be involved in episodic memory formation by reactivating traces of waking experience during sleep. Indeed, the joint firing of spatially tuned pyramidal cells encoding nearby places recur during sleep. We found that the sleep cofiring of rat CA1 pyramidal cells encoding similar places inc...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn2037

    authors: O'Neill J,Senior TJ,Allen K,Huxter JR,Csicsvari J

    更新日期:2008-02-01 00:00:00

  • Rho-kinase regulates energy balance by targeting hypothalamic leptin receptor signaling.

    abstract::Leptin regulates energy balance. However, knowledge of the critical intracellular transducers of leptin signaling remains incomplete. We found that Rho-kinase 1 (ROCK1) regulates leptin action on body weight homeostasis by activating JAK2, an initial trigger of leptin receptor signaling. Leptin promoted the physical i...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3207

    authors: Huang H,Kong D,Byun KH,Ye C,Koda S,Lee DH,Oh BC,Lee SW,Lee B,Zabolotny JM,Kim MS,Bjørbæk C,Lowell BB,Kim YB

    更新日期:2012-10-01 00:00:00

  • Running increases cell proliferation and neurogenesis in the adult mouse dentate gyrus.

    abstract::Exposure to an enriched environment increases neurogenesis in the dentate gyrus of adult rodents. Environmental enrichment, however, typically consists of many components, such as expanded learning opportunities, increased social interaction, more physical activity and larger housing. We attempted to separate componen...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/6368

    authors: van Praag H,Kempermann G,Gage FH

    更新日期:1999-03-01 00:00:00

  • A neuroprotective role for polyamines in a Xenopus tadpole model of epilepsy.

    abstract::Polyamines are endogenous molecules involved in cell damage following neurological insults, although it is unclear whether polyamines reduce or exacerbate this damage. We used a developmental seizure model in which we exposed Xenopus laevis tadpoles to pentylenetetrazole (PTZ), a known convulsant. We found that, after...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2777

    authors: Bell MR,Belarde JA,Johnson HF,Aizenman CD

    更新日期:2011-04-01 00:00:00

  • Rhythmic gene expression in pituitary depends on heterologous sensitization by the neurohormone melatonin.

    abstract::In mammals, many daily cycles are driven by a central circadian clock, which is based on the cell-autonomous rhythmic expression of clock genes. It is not clear, however, how peripheral cells are able to interpret the rhythmic signals disseminated from this central oscillator. Here we show that cycling expression of t...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn806

    authors: von Gall C,Garabette ML,Kell CA,Frenzel S,Dehghani F,Schumm-Draeger PM,Weaver DR,Korf HW,Hastings MH,Stehle JH

    更新日期:2002-03-01 00:00:00

  • Histone deacetylase 3 associates with MeCP2 to regulate FOXO and social behavior.

    abstract::Mutations in MECP2 cause the neurodevelopmental disorder Rett syndrome (RTT). The RTT missense MECP2R306C mutation prevents MeCP2 from interacting with the NCoR/histone deacetylase 3 (HDAC3) complex; however, the neuronal function of HDAC3 is incompletely understood. We found that neuronal deletion of Hdac3 in mice el...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4347

    authors: Nott A,Cheng J,Gao F,Lin YT,Gjoneska E,Ko T,Minhas P,Zamudio AV,Meng J,Zhang F,Jin P,Tsai LH

    更新日期:2016-11-01 00:00:00

  • Author Correction: Single-nucleus analysis of accessible chromatin in developing mouse forebrain reveals cell-type-specific transcriptional regulation.

    abstract::In the version of this article initially published online, the accession code was given as GSE1000333. The correct code is GSE100033. The error has been corrected in the print, HTML and PDF versions of the article. ...

    journal_title:Nature neuroscience

    pub_type: 已发布勘误

    doi:10.1038/s41593-018-0114-4

    authors: Preissl S,Fang R,Huang H,Zhao Y,Raviram R,Gorkin DU,Zhang Y,Sos BC,Afzal V,Dickel DE,Kuan S,Visel A,Pennacchio LA,Zhang K,Ren B

    更新日期:2018-07-01 00:00:00

  • Slowly dividing neural progenitors are an embryonic origin of adult neural stem cells.

    abstract::The mechanism by which adult neural stem cells (NSCs) are established during development is unclear. In this study, analysis of cell cycle progression by examining retention of a histone 2B (H2B)-GFP fusion protein revealed that, in a subset of mouse embryonic neural progenitor cells (NPCs), the cell cycle slows betwe...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3989

    authors: Furutachi S,Miya H,Watanabe T,Kawai H,Yamasaki N,Harada Y,Imayoshi I,Nelson M,Nakayama KI,Hirabayashi Y,Gotoh Y

    更新日期:2015-05-01 00:00:00

  • RGS2 modulates coupling between GABAB receptors and GIRK channels in dopamine neurons of the ventral tegmental area.

    abstract::Agonists of GABA(B) receptors exert a bi-directional effect on the activity of dopamine (DA) neurons of the ventral tegmental area, which can be explained by the fact that coupling between GABA(B) receptors and G protein-gated inwardly rectifying potassium (GIRK) channels is significantly weaker in DA neurons than in ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn2006

    authors: Labouèbe G,Lomazzi M,Cruz HG,Creton C,Luján R,Li M,Yanagawa Y,Obata K,Watanabe M,Wickman K,Boyer SB,Slesinger PA,Lüscher C

    更新日期:2007-12-01 00:00:00

  • Modulation of glycine-activated ion channel function by G-protein betagamma subunits.

    abstract::Glycine receptors (GlyRs), together with GABA(A) and nicotinic acetylcholine (ACh) receptors, form part of the ligand-activated ion channel superfamily and regulate the excitability of the mammalian brain stem and spinal cord. Here we report that the ability of the neurotransmitter glycine to gate recombinant and nati...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1095

    authors: Yevenes GE,Peoples RW,Tapia JC,Parodi J,Soto X,Olate J,Aguayo LG

    更新日期:2003-08-01 00:00:00

  • An α2-Na/K ATPase/α-adducin complex in astrocytes triggers non-cell autonomous neurodegeneration.

    abstract::Perturbations of astrocytes trigger neurodegeneration in several diseases, but the glial cell-intrinsic mechanisms that induce neurodegeneration remain poorly understood. We found that a protein complex of α2-Na/K ATPase and α-adducin was enriched in astrocytes expressing mutant superoxide dismutase 1 (SOD1), which ca...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3853

    authors: Gallardo G,Barowski J,Ravits J,Siddique T,Lingrel JB,Robertson J,Steen H,Bonni A

    更新日期:2014-12-01 00:00:00

  • Müller glia are a potential source of neural regeneration in the postnatal chicken retina.

    abstract::The retina of warm-blooded vertebrates is believed to be incapable of neural regeneration. Here we provide evidence that the retina of postnatal chickens has the potential to generate new neurons. In response to acute damage, numerous Müller glia re-entered the cell cycle, and shortly thereafter, expressed CASH-1, Pax...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/85090

    authors: Fischer AJ,Reh TA

    更新日期:2001-03-01 00:00:00

  • Amygdala inputs to prefrontal cortex guide behavior amid conflicting cues of reward and punishment.

    abstract::Orchestrating appropriate behavioral responses in the face of competing signals that predict either rewards or threats in the environment is crucial for survival. The basolateral nucleus of the amygdala (BLA) and prelimbic (PL) medial prefrontal cortex have been implicated in reward-seeking and fear-related responses,...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4553

    authors: Burgos-Robles A,Kimchi EY,Izadmehr EM,Porzenheim MJ,Ramos-Guasp WA,Nieh EH,Felix-Ortiz AC,Namburi P,Leppla CA,Presbrey KN,Anandalingam KK,Pagan-Rivera PA,Anahtar M,Beyeler A,Tye KM

    更新日期:2017-06-01 00:00:00

  • Thalamic functions in distributed cognitive control.

    abstract::Cognition can be conceptualized as a set of algorithmic control functions whose real-time deployment determines how an organism stores and uses information to guide thought and action. A subset of these functions is required for goal-directed selection and amplification of sensory signals-broadly referred to as attent...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/s41593-017-0020-1

    authors: Halassa MM,Kastner S

    更新日期:2017-12-01 00:00:00

  • PI3 kinase enhancer-Homer complex couples mGluRI to PI3 kinase, preventing neuronal apoptosis.

    abstract::Phosphoinositide 3 kinase enhancer (PIKE) is a recently identified nuclear GTPase that activates nuclear phosphoinositide 3-kinase (PI3 kinase). We have identified, cloned and characterized a new form of PIKE, designated PIKE-L, which, unlike the nuclear PIKE-S, localizes to both the cytoplasm and the nucleus. We demo...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1134

    authors: Rong R,Ahn JY,Huang H,Nagata E,Kalman D,Kapp JA,Tu J,Worley PF,Snyder SH,Ye K

    更新日期:2003-11-01 00:00:00

  • p75NTR-dependent, myelin-mediated axonal degeneration regulates neural connectivity in the adult brain.

    abstract::Axonal degeneration is important during development but has not been thought to function in the intact mature nervous system. Here, we provide evidence that degeneration of adult axons occurs in the intact rodent brain through a p75 neurotrophin receptor (p75NTR)- and myelin-dependent mechanism. Specifically, we show ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2513

    authors: Park KJ,Grosso CA,Aubert I,Kaplan DR,Miller FD

    更新日期:2010-05-01 00:00:00

  • Sparse odor representation and olfactory learning.

    abstract::Sensory systems create neural representations of environmental stimuli and these representations can be associated with other stimuli through learning. Are spike patterns the neural representations that get directly associated with reinforcement during conditioning? In the moth Manduca sexta, we found that odor presen...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2192

    authors: Ito I,Ong RC,Raman B,Stopfer M

    更新日期:2008-10-01 00:00:00

  • Regulation of T-type calcium channels by Rho-associated kinase.

    abstract::We investigated the regulation of T-type channels by Rho-associated kinase (ROCK). Activation of ROCK via the endogenous ligand lysophosphatidic acid (LPA) reversibly inhibited the peak current amplitudes of rat Ca(v)3.1 and Ca(v)3.3 channels without affecting the voltage dependence of activation or inactivation, wher...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1921

    authors: Iftinca M,Hamid J,Chen L,Varela D,Tadayonnejad R,Altier C,Turner RW,Zamponi GW

    更新日期:2007-07-01 00:00:00

  • A system in the human brain for predicting the actions of others.

    abstract::The ability to attribute mental states to others, and therefore to predict others' behavior, is particularly advanced in humans. A controversial but untested idea is that this is achieved by simulating the other person's mental processes in one's own mind. If this is the case, then the same neural systems activated by...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1168

    authors: Ramnani N,Miall RC

    更新日期:2004-01-01 00:00:00

  • Distinct spatial frequency sensitivities for processing faces and emotional expressions.

    abstract::High and low spatial frequency information in visual images is processed by distinct neural channels. Using event-related functional magnetic resonance imaging (fMRI) in humans, we show dissociable roles of such visual channels for processing faces and emotional fearful expressions. Neural responses in fusiform cortex...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1057

    authors: Vuilleumier P,Armony JL,Driver J,Dolan RJ

    更新日期:2003-06-01 00:00:00

  • Plasticity of temporal information processing in the primary auditory cortex.

    abstract::Neurons in the rat primary auditory cortex (A1) generally cannot respond to tone sequences faster than 12 pulses per second (pps). To test whether experience can modify this maximum following rate in adult rats, trains of brief tones with random carrier frequency but fixed repetition rate were paired with electrical s...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/3729

    authors: Kilgard MP,Merzenich MM

    更新日期:1998-12-01 00:00:00

  • From neurobiology to treatment: progress against addiction.

    abstract::Most advances in addiction treatment to date have addressed the physical dependence and withdrawal that accompany addiction to some drugs of abuse. In contrast, it has proven more difficult to develop medications that effectively treat drug craving and relapse, the core features of addictive disorders. Current efforts...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/nn945

    authors: Nestler EJ

    更新日期:2002-11-01 00:00:00

  • Self-administration behavior is maintained by the psychoactive ingredient of marijuana in squirrel monkeys.

    abstract::Many attempts to obtain reliable self-administration behavior by laboratory animals with delta-9-tetrahydrocannabinol (THC), the psychoactive ingredient in marijuana, have been unsuccessful. Because self-administration behavior has been demonstrated in laboratory animals for almost all other psychoactive drugs abused ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/80577

    authors: Tanda G,Munzar P,Goldberg SR

    更新日期:2000-11-01 00:00:00

  • High frequency, synchronized bursting drives eye-specific segregation of retinogeniculate projections.

    abstract::Blockade of retinal waves prevents the segregation of retinogeniculate afferents into eye-specific layers in the visual thalamus. However, the key features of retinal waves that drive this refinement are controversial. Some manipulations of retinal waves lead to normal eye-specific segregation but others do not. By co...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1376

    authors: Torborg CL,Hansen KA,Feller MB

    更新日期:2005-01-01 00:00:00