Reinforcement learning: the good, the bad and the ugly.

Abstract:

:Reinforcement learning provides both qualitative and quantitative frameworks for understanding and modeling adaptive decision-making in the face of rewards and punishments. Here we review the latest dispatches from the forefront of this field, and map out some of the territories where lie monsters.

journal_name

Curr Opin Neurobiol

authors

Dayan P,Niv Y

doi

10.1016/j.conb.2008.08.003

subject

Has Abstract

pub_date

2008-04-01 00:00:00

pages

185-96

issue

2

eissn

0959-4388

issn

1873-6882

pii

S0959-4388(08)00076-7

journal_volume

18

pub_type

杂志文章,评审
  • Dysconnectivity, large-scale networks and neuronal dynamics in schizophrenia.

    abstract::Schizophrenia remains a daunting challenge for efforts aimed at identifying fundamental pathophysiological processes and to develop evidence-based effective treatments and interventions. One reason for the lack of progress lies in the fact that the pathophysiology of schizophrenia has been predominantly conceived in t...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2012.11.004

    authors: Uhlhaas PJ

    更新日期:2013-04-01 00:00:00

  • Representations in auditory cortex.

    abstract::How does auditory cortex represent auditory stimuli, and how do these representations contribute to behavior? Recent experimental evidence suggests that activity in auditory cortex consists of sparse and highly synchronized volleys of activity, observed both in anesthetized and awake animals. Many neurons are capable ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2009.07.009

    authors: Hromádka T,Zador AM

    更新日期:2009-08-01 00:00:00

  • Looking for the roots of cortical sensory computation in three-layered cortices.

    abstract::Despite considerable effort over a century and the benefit of remarkable technical advances in the past few decades, we are still far from understanding mammalian cerebral neocortex. With its six layers, modular architecture, canonical circuits, innumerable cell types, and computational complexity, isocortex remains a...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2014.09.006

    authors: Fournier J,Müller CM,Laurent G

    更新日期:2015-04-01 00:00:00

  • Presynaptic origins of distinct modes of neurotransmitter release.

    abstract::Presynaptic nerve terminals release neurotransmitter synchronously, asynchronously or spontaneously. During synchronous neurotransmission release is precisely coupled to action potentials, in contrast, asynchronous release events show only loose temporal coupling to presynaptic activity whereas spontaneous neurotransm...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2018.03.005

    authors: Chanaday NL,Kavalali ET

    更新日期:2018-08-01 00:00:00

  • Zebrafish sleep: from geneZZZ to neuronZZZ.

    abstract::All animals have a fundamental and unavoidable requirement for rest, yet we still do not fully understand the processes that initiate, maintain, and regulate sleep. The larval zebrafish is an optically translucent, genetically tractable model organism that exhibits sleep states regulated by conserved sleep circuits, t...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2017.02.009

    authors: Barlow IL,Rihel J

    更新日期:2017-06-01 00:00:00

  • Signal acquisition and analysis for cortical control of neuroprosthetics.

    abstract::Work in cortically controlled neuroprosthetic systems has concentrated on decoding natural behaviors from neural activity, with the idea that if the behavior could be fully decoded it could be duplicated using an artificial system. Initial estimates from this approach suggested that a high-fidelity signal comprised of...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2004.10.013

    authors: Tillery SI,Taylor DM

    更新日期:2004-12-01 00:00:00

  • Synaptic signaling by nitric oxide.

    abstract::Endogenous nitric oxide (NO) mediates certain aspects of synaptic plasticity and neurotoxicity associated with NMDA-type glutamate receptors. Neuronal NO synthase contains a modular protein-protein interaction motif, termed the PDZ domain, that links the synthase to a synaptic protein complex containing postsynaptic d...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(97)80065-7

    authors: Brenman JE,Bredt DS

    更新日期:1997-06-01 00:00:00

  • Striatal synapses, circuits, and Parkinson's disease.

    abstract::The striatum is a hub in the basal ganglia circuitry controlling goal directed actions and habits. The loss of its dopaminergic (DAergic) innervation in Parkinson's disease (PD) disrupts the ability of the two principal striatal projection systems to respond appropriately to cortical and thalamic signals, resulting in...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2017.08.004

    authors: Zhai S,Tanimura A,Graves SM,Shen W,Surmeier DJ

    更新日期:2018-02-01 00:00:00

  • Signals mediating ion channel clustering at the neuromuscular junction.

    abstract::High densities of acetylcholine receptors and sodium channels in the crests and troughs of the postsynaptic folds, respectively, ensure reliable neuromuscular signalling. Clustering of both ion channels is mediated by agrin. In the case of acetylcholine receptors, agrin activates the tyrosine kinase receptor muscle-sp...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(98)80061-5

    authors: Colledge M,Froehner SC

    更新日期:1998-06-01 00:00:00

  • An argument for hyperbolic geometry in neural circuits.

    abstract::This review connects several lines of research to argue that hyperbolic geometry should be broadly applicable to neural circuits as well as other biological circuits. The reason for this is that networks that conform to hyperbolic geometry are maximally responsive to external and internal perturbations. These networks...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.07.008

    authors: Sharpee TO

    更新日期:2019-10-01 00:00:00

  • Genetic mosaic analysis in the nervous system.

    abstract::Genetic mosaic techniques provide a powerful tool for dissecting gene function in the intricate genetic networks that underlie the formation and function of nervous systems. For instance, it is possible to make individual cells or groups of cells homozygous for mutations of interest at specific points during an organi...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2004.08.005

    authors: Zugates CT,Lee T

    更新日期:2004-10-01 00:00:00

  • Central core modulation of spontaneous oscillations and sensory transmission in thalamocortical systems.

    abstract::Central core (brainstem, diencephalic and basal forebrain) systems influence the functional modes of thalamic and cortical neurons during behavioral states of vigilance. Recent studies in vivo and in vitro have focused on the cellular properties of central core systems and their modulation of slow sleep oscillations, ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(93)90064-6

    authors: Steriade M

    更新日期:1993-08-01 00:00:00

  • How social experiences influence the brain.

    abstract::Social experiences throughout life influence gene expression and behavior, however, early in development these influences have a particularly profound effect. In mammals, mother-infant interactions are the primary source of social stimulation and result in long-term changes in offspring phenotype. This has previously ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2005.10.001

    authors: Champagne FA,Curley JP

    更新日期:2005-12-01 00:00:00

  • A network of networks: cytoskeletal control of compartmentalized function within dendritic spines.

    abstract::Almost 30 years ago, actin was identified as the major cytoskeletal component of dendritic spines. Since then, its role in the remarkable dynamics of spine morphology have been detailed with live-cell views establishing that spine shape dynamics are an important requirement for synaptogenesis and synaptic plasticity. ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2010.06.009

    authors: Frost NA,Kerr JM,Lu HE,Blanpied TA

    更新日期:2010-10-01 00:00:00

  • The distinct methylation landscape of maturing neurons and its role in Rett syndrome pathogenesis.

    abstract::Rett syndrome (RTT) is one of the most common causes of intellectual and developmental disabilities in girls, and is caused by mutations in the gene encoding methyl-CpG binding protein 2 (MECP2). Here we will review our current understanding of RTT, the landscape of pathogenic mutations and function of MeCP2, and culm...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.08.001

    authors: Lavery LA,Zoghbi HY

    更新日期:2019-12-01 00:00:00

  • GABAergic cell type diversity in the basolateral amygdala.

    abstract::Here I review the diversity of GABAergic neurons in the rodent basolateral amygdala (BLA). In spite of the recent identification of the role played by certain neurons of BLA in learning and memory of fear, the diversity of GABAergic neurons has not been fully explored. I describe analogies and differences between GABA...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2014.01.006

    authors: Capogna M

    更新日期:2014-06-01 00:00:00

  • The midbrain--hindbrain boundary organizer.

    abstract::Cell fate in the cephalic neural primordium is controlled by an organizer located at the midbrain-hindbrain boundary. Studies in chick, mouse and zebrafish converge to show that mutually repressive interactions between homeodomain transcription factors of the Otx and Gbx class position this organizer in the neural pri...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(00)00171-9

    authors: Rhinn M,Brand M

    更新日期:2001-02-01 00:00:00

  • Auditory map plasticity: diversity in causes and consequences.

    abstract::Auditory cortical maps have been a long-standing focus of studies that assess the expression, mechanisms, and consequences of sensory plasticity. Here we discuss recent progress in understanding how auditory experience transforms spatially organized sound representations at higher levels of the central auditory pathwa...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2013.11.009

    authors: Schreiner CE,Polley DB

    更新日期:2014-02-01 00:00:00

  • Emerging principles of intrinsic hippocampal organization.

    abstract::The hippocampal formation has a unique and highly distributed network of intrinsic connections. What are the principles of organization that govern information flow through this system? The notion that information processing in the hippocampal formation is segregated in autonomous chips or lamellae appears to be incon...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(93)90214-j

    authors: Amaral DG

    更新日期:1993-04-01 00:00:00

  • Cellular and biochemical mechanisms underlying circadian rhythms in vertebrates.

    abstract::Circadian clocks organize neural processes, such as motor activities, into near 24-hour oscillations and adaptively synchronize these rhythms to the solar cycle. Recently, the first mammalian clock genes have been found. Unpredicted diversity in signaling pathways and clock-controlled gating of signals that modulate t...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(97)80138-9

    authors: Gillette MU

    更新日期:1997-12-01 00:00:00

  • The many facets of facial interactions in mammals.

    abstract::Facial interactions are prominent behaviors in primates. Primate facial signaling, which includes the expression of emotions, mimicking of facial movements, and gaze interactions, is visually dominated. Correspondingly, in primate brains an elaborate network of face processing areas exists within visual cortex. But ot...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2011.12.003

    authors: Brecht M,Freiwald WA

    更新日期:2012-04-01 00:00:00

  • Guidance and induction of branch formation in developing axons by target-derived diffusible factors.

    abstract::Developing axons appear to navigate to their targets partly in response to long-range diffusible chemoattractants secreted by target cells. The past year has seen the identification of the first target-derived attractants for developing axons, the netrins. Target-derived diffusible factors have also been implicated in...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(95)80091-3

    authors: Kennedy TE,Tessier-Lavigne M

    更新日期:1995-02-01 00:00:00

  • Patterning centers, regulatory genes and extrinsic mechanisms controlling arealization of the neocortex.

    abstract::The adult mammalian neocortex, the major region of the cerebral cortex, is divided into functionally specialized areas, defined by distinct architecture and axonal connections. Extrinsic influences, such as thalamocortical input, and genetic regulation, intrinsic to the dorsal telencephalon, control the gradual emerge...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(02)00285-4

    authors: O'Leary DD,Nakagawa Y

    更新日期:2002-02-01 00:00:00

  • Ciliary neurotrophic factor as an injury factor.

    abstract::This article reviews recent evidence suggesting that endogenous ciliary neurotrophic factor may be involved in neural responses to injury, and discusses the possibility that ciliary neurotrophic factor could have therapeutic applications in a clinical setting. The functional relevance of ciliary neurotrophic factor in...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(93)90154-q

    authors: Adler R

    更新日期:1993-10-01 00:00:00

  • Neuronal coding mechanisms mediating fear behavior.

    abstract::The behavioral repertoire of an organism can be highly diverse, spanning from social to defensive. How an animal efficiently switches between distinct behaviors is a fundamental question whose inquiry will provide insights into the mechanisms that are necessary for an organism's survival. Previous work aimed at identi...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2018.04.017

    authors: Rozeske RR,Herry C

    更新日期:2018-10-01 00:00:00

  • Olfactory system oscillations across phyla.

    abstract::Neural oscillations are ubiquitous in olfactory systems of mammals, insects and molluscs. Neurophysiological and computational investigations point to common mechanisms for gamma or odor associated oscillations across phyla (40-100Hz in mammals, 20-30Hz in insects, 0.5-1.5Hz in molluscs), engaging the reciprocal dendr...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2014.10.004

    authors: Kay LM

    更新日期:2015-04-01 00:00:00

  • Specificity and randomness: structure-function relationships in neural circuits.

    abstract::A fundamental but unsolved problem in neuroscience is how connections between neurons might underlie information processing in central circuits. Building wiring diagrams of neural networks may accelerate our understanding of how they compute. But even if we had wiring diagrams, it is critical to know what neurons in a...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2011.07.004

    authors: Lee WC,Reid RC

    更新日期:2011-10-01 00:00:00

  • Information theoretic approaches to understanding circuit function.

    abstract::The analysis of stimulus/response patterns using information theoretic approaches requires the full probability distribution of stimuli and response. Recent progress in using information-based tools to understand circuit function has advanced understanding of neural coding at the single cell and population level. In a...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2012.06.005

    authors: Fairhall A,Shea-Brown E,Barreiro A

    更新日期:2012-08-01 00:00:00

  • Regulation of transmitter release by Unc-13 and its homologues.

    abstract::Neurotransmitters are released by Ca(2+)-triggered exocytotic fusion of synaptic vesicles. Before fusion, vesicles dock at a specialised presynaptic plasma membrane region, the active zone, where they are primed to a fusion competent state. The nature of this priming reaction has long been enigmatic. Recent evidence d...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(00)00105-7

    authors: Brose N,Rosenmund C,Rettig J

    更新日期:2000-06-01 00:00:00

  • Diversity in AMPA receptor complexes in the brain.

    abstract::AMPA receptor (AMPAR) complexes comprise four of the AMPAR subunits GluA1-4 and several additional interacting proteins. Subunit composition determines AMPAR function. However, AMPAR function depends to a large extent also on interacting proteins, which influence trafficking to the cell surface, activity-dependent sub...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2017.03.001

    authors: Jacobi E,von Engelhardt J

    更新日期:2017-08-01 00:00:00