The many worlds hypothesis of dopamine prediction error: implications of a parallel circuit architecture in the basal ganglia.

Abstract:

:Computational models of reinforcement learning (RL) strive to produce behavior that maximises reward, and thus allow software or robots to behave adaptively [1]. At the core of RL models is a learned mapping between 'states'-situations or contexts that an agent might encounter in the world-and actions. A wealth of physiological and anatomical data suggests that the basal ganglia (BG) is important for learning these mappings [2,3]. However, the computations performed by specific circuits are unclear. In this brief review, we highlight recent work concerning the anatomy and physiology of BG circuits that suggest refinements in our understanding of computations performed by the basal ganglia. We focus on one important component of basal ganglia circuitry, midbrain dopamine neurons, drawing attention to data that has been cast as supporting or departing from the RL framework that has inspired experiments in basal ganglia research over the past two decades. We suggest that the parallel circuit architecture of the BG might be expected to produce variability in the response properties of different dopamine neurons, and that variability in response profile may not reflect variable functions, but rather different arguments that serve as inputs to a common function: the computation of prediction error.

journal_name

Curr Opin Neurobiol

authors

Lau B,Monteiro T,Paton JJ

doi

10.1016/j.conb.2017.08.015

subject

Has Abstract

pub_date

2017-10-01 00:00:00

pages

241-247

eissn

0959-4388

issn

1873-6882

pii

S0959-4388(17)30158-7

journal_volume

46

pub_type

杂志文章,评审
  • The evolution of language from social cognition.

    abstract::Despite their differences, human language and the vocal communication of nonhuman primates share many features. Both constitute a form of joint action, rely on similar neural mechanisms, and involve discrete, combinatorial cognition. These shared features suggest that during evolution the ancestors of modern primates ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2014.04.003

    authors: Seyfarth RM,Cheney DL

    更新日期:2014-10-01 00:00:00

  • Advanced optical imaging techniques for neurodevelopment.

    abstract::Over the past decade, developmental neuroscience has been transformed by the widespread application of confocal and two-photon fluorescence microscopy. Even greater progress is imminent, as recent innovations in microscopy now enable imaging with increased depth, speed, and spatial resolution; reduced phototoxicity; a...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2013.06.008

    authors: Wu Y,Christensen R,Colón-Ramos D,Shroff H

    更新日期:2013-12-01 00:00:00

  • Ensemble coding in amygdala circuits for associative learning.

    abstract::Associative fear learning in the basolateral amygdala (BLA) is crucial for an animal's survival upon environmental threats. BLA neurons are defined on the basis of their projection target, genetic markers, and associated function. BLA principal neuron responses to threat signaling stimuli are potentiated upon associat...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2015.10.005

    authors: Gründemann J,Lüthi A

    更新日期:2015-12-01 00:00:00

  • Sodium-dependent neurotransmitter reuptake systems.

    abstract::The recent cloning of the gamma-aminobutyric acid and norepinephrine Na(+)-dependent neurotransmitter transporters has led to new approaches for understanding the structure and function of these important synaptic proteins and provides a conceptual model in which to consider recent advances in the physiology, pharmaco...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(91)90014-x

    authors: Amara SG,Pacholczyk T

    更新日期:1991-06-01 00:00:00

  • Signals mediating ion channel clustering at the neuromuscular junction.

    abstract::High densities of acetylcholine receptors and sodium channels in the crests and troughs of the postsynaptic folds, respectively, ensure reliable neuromuscular signalling. Clustering of both ion channels is mediated by agrin. In the case of acetylcholine receptors, agrin activates the tyrosine kinase receptor muscle-sp...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(98)80061-5

    authors: Colledge M,Froehner SC

    更新日期:1998-06-01 00:00:00

  • Classical fear conditioning in functional neuroimaging.

    abstract::Classical conditioning, the simplest form of associative learning, is one of the most studied paradigms in behavioural psychology. Since the formal description of classical conditioning by Pavlov, lesion studies in animals have identified a number of anatomical structures involved in, and necessary for, classical cond...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(00)00078-7

    authors: Büchel C,Dolan RJ

    更新日期:2000-04-01 00:00:00

  • Modeling human neuronal migration deficits in 3D.

    abstract::During the past few decades, we have witnessed an impressive gain in the knowledge regarding the basic mechanisms underlying human neuronal migration disorders by the usage of mouse models. Nevertheless, despite the remarkable conservation both in the genetic encoded information and the developmental processes, there ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2020.09.005

    authors: Reiner O,Parichha A,Sapir T

    更新日期:2020-10-15 00:00:00

  • Multisensory integration in spatial orientation.

    abstract::Recent psychophysical studies on normal subjects, as well as brain imaging studies, have revised the concepts concerning the mechanisms underlying spatial orientation during navigation tasks. The emphasis has been put on internal models that allow the prediction of a planned trajectory and are essential in the steerin...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(99)00041-0

    authors: Berthoz A,Viaud-Delmon I

    更新日期:1999-12-01 00:00:00

  • Music perception, pitch, and the auditory system.

    abstract::The perception of music depends on many culture-specific factors, but is also constrained by properties of the auditory system. This has been best characterized for those aspects of music that involve pitch. Pitch sequences are heard in terms of relative as well as absolute pitch. Pitch combinations give rise to emerg...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2008.09.005

    authors: McDermott JH,Oxenham AJ

    更新日期:2008-08-01 00:00:00

  • Human disorders of axon guidance.

    abstract::Axon pathfinding is essential for the establishment of proper neuronal connections during development. Advances in neuroimaging and genomic technologies, coupled with animal modeling, are leading to the identification of an increasing number of human disorders that result from aberrant axonal wiring. In this review, w...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2012.02.006

    authors: Nugent AA,Kolpak AL,Engle EC

    更新日期:2012-10-01 00:00:00

  • Reconsolidation: the advantage of being refocused.

    abstract::Ample evidence suggests that upon their retrieval, items in long-term memory enter a transient special state, in which they might become prone to change. The process that generates this state is dubbed 'reconsolidation'. The dominant conceptual framework in this revitalized field of memory research focuses on whether ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2006.03.010

    authors: Dudai Y

    更新日期:2006-04-01 00:00:00

  • Visual perception and cuttlefish camouflage.

    abstract::Visual perception is inherently statistical: brains exploit repeating features of natural scenes to disambiguate images that could, in principle, have many causes. A clear case for the relevance of statistical inference in vision is animal camouflage. Although visual scenes are each composed of unique arrangements of ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.10.010

    authors: Reiter S,Laurent G

    更新日期:2020-02-01 00:00:00

  • Development of the zebrafish lateral line.

    abstract::The lateral line system is simple (comprising six cell types), its sense organs form according to a defined and reproducible pattern, and its neurons are easily visualized. In the zebrafish, these advantages can be combined with a wealth of genetic tools, making this system ideally suited to a combined molecular, cell...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2004.01.012

    authors: Ghysen A,Dambly-Chaudière C

    更新日期:2004-02-01 00:00:00

  • Individual differences in emotion processing.

    abstract::Recent functional brain imaging studies of the neurobiology of emotion have investigated how individual differences among subjects modulate neural responses during emotion processing. Differences in personality, dispositional affect, biological sex, and genotype can all substantially modulate the neural bases of emoti...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2004.03.010

    authors: Hamann S,Canli T

    更新日期:2004-04-01 00:00:00

  • An argument for hyperbolic geometry in neural circuits.

    abstract::This review connects several lines of research to argue that hyperbolic geometry should be broadly applicable to neural circuits as well as other biological circuits. The reason for this is that networks that conform to hyperbolic geometry are maximally responsive to external and internal perturbations. These networks...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.07.008

    authors: Sharpee TO

    更新日期:2019-10-01 00:00:00

  • From chills to chilis: mechanisms for thermosensation and chemesthesis via thermoTRPs.

    abstract::Six highly temperature-sensitive ion channels of the transient receptor potential (TRP) family have been implicated to mediate temperature sensation. These channels, expressed in sensory neurons innervating the skin or the skin itself, are active at specific temperatures ranging from noxious cold to burning heat. In a...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2007.07.014

    authors: Bandell M,Macpherson LJ,Patapoutian A

    更新日期:2007-08-01 00:00:00

  • Posttranslational modifications of neuroligins regulate neuronal and glial signaling.

    abstract::This review covers the dynamic regulation of neuroligin isoforms, focusing on posttranslational events including phosphorylation, glycosylation and activity-dependent cleavage. There is a growing literature on how phosphorylation confers an isoform-specific level of modulation affecting a variety of protein interactio...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2017.05.017

    authors: Jeong J,Paskus JD,Roche KW

    更新日期:2017-08-01 00:00:00

  • TaDa! Analysing cell type-specific chromatin in vivo with Targeted DamID.

    abstract::The emergence of neuronal diversity during development of the nervous system relies on dynamic changes in the epigenetic landscape of neural stem cells and their progeny. Targeted DamID (TaDa) is proving invaluable in identifying the genome-wide binding sites of chromatin-associated proteins in vivo, without fixation,...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.01.021

    authors: van den Ameele J,Krautz R,Brand AH

    更新日期:2019-06-01 00:00:00

  • It takes a seasoned bird to be a good listener: communication between the sexes.

    abstract::Birds commonly use sound for communication between the sexes. In many songbird species, only males sing and there are pronounced sex differences in the neural song control circuits. By contrast, the auditory circuitry is largely similar in males and females. Both sexes learn to recognize vocalizations heard as juvenil...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2016.01.005

    authors: Brenowitz EA,Remage-Healey L

    更新日期:2016-06-01 00:00:00

  • Inhibitory neurons in human cortical circuits: substrate for cognitive dysfunction in schizophrenia.

    abstract::Schizophrenia is a disorder of cognitive neurodevelopment. At least some of the core cognitive deficits of the illness appear to be the product of impaired gamma frequency oscillations which depend, in part, on the inhibitory actions of a subpopulation of cortical GABA neurons that express the calcium binding protein ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2013.11.003

    authors: Lewis DA

    更新日期:2014-06-01 00:00:00

  • Viral vectors for modulating gene expression in neurons.

    abstract::The inability to reliably express foreign proteins in postmitotic neurons has hampered numerous studies in the field of neurobiology. Within the past several years, a number of viral vectors that overcome this problem under controlled conditions in vitro have been developed. In particular, recombinant adenoviruses hav...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(96)80088-2

    authors: Slack RS,Miller FD

    更新日期:1996-10-01 00:00:00

  • Calmodulin regulation of cyclic-nucleotide-gated channels.

    abstract::Cyclic-nucleotide-gated (CNG) channels play key roles in photoreceptor and olfactory signal-transduction pathways. Recent studies have focused on the molecular characterization of CNG channel subunits and on the identification of the structural domains that contribute to ligand selectivity and affinity, ion gating and...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(96)80048-1

    authors: Molday RS

    更新日期:1996-08-01 00:00:00

  • miRNAs in synapse development and synaptic plasticity.

    abstract::Synapses are functional units of the nervous system, through which information is transferred between neurons. The development and activity-dependent modification of synapses require temporally and spatially controlled modulation of gene expression. microRNAs (miRNAs) have emerged as essential regulators of gene expre...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2017.02.014

    authors: Hu Z,Li Z

    更新日期:2017-08-01 00:00:00

  • Neuromodulation of olfactory transformations.

    abstract::The olfactory bulb and piriform cortex are the best studied structures of the mammalian olfactory system and are heavily innervated by extrinsic neuromodulatory inputs. The state-dependent release of acetylcholine, norepinephrine, serotonin, and other neuromodulators into these olfactory structures alters a constellat...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2016.07.006

    authors: Linster C,Cleland TA

    更新日期:2016-10-01 00:00:00

  • Eye evolution: a question of genetic promiscuity.

    abstract::Animal eyes have long served as a classical example of independent origin followed by convergence of structures onto a few different solutions. During the past decade this view has been challenged by the discovery of shared developmental regulatory genes. The Pax6 gene in particular is almost universally employed for ...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2004.07.004

    authors: Nilsson DE

    更新日期:2004-08-01 00:00:00

  • Rhythms of behavior: are the times changin'?

    abstract::Animal life is rhythmic. Here we provide an overview of various rhythmic behaviors, connected environmental factors and endogenous mechanisms. We not only cover terrestrial species, but also highlight aquatic environments with typically complex interconnected rhythms. We further address diel, seasonal and potential lu...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2019.10.005

    authors: Häfker NS,Tessmar-Raible K

    更新日期:2020-02-01 00:00:00

  • Neural population codes.

    abstract::In many regions of the brain, information is represented by patterns of activity occurring over populations of neurons. Understanding the encoding of information in neural population activity is important both for grasping the fundamental computations underlying brain function, and for interpreting signals that may be...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0959-4388(03)00034-5

    authors: Sanger TD

    更新日期:2003-04-01 00:00:00

  • Reception of odors and repellents in mosquitoes.

    abstract::Mosquitoes use their sense of smell to find hosts, nectar, and oviposition sites, and to avoid repellents. A small number of mosquito species are adapted to feed on humans and have a major impact on public health by transmitting diseases such as malaria, dengue and filariasis. The application of odorants for behaviora...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2015.06.014

    authors: Ray A

    更新日期:2015-10-01 00:00:00

  • The perceptual logic of smell.

    abstract::Mammals have ∼1000 different olfactory receptor subtypes, each responding to a number of different odorants, and each odorant activating a number of different receptor subtypes. These molecular and anatomical underpinnings of olfaction imply a perceptual structure of very high dimensionality that relies on combinatori...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.conb.2013.12.010

    authors: Secundo L,Snitz K,Sobel N

    更新日期:2014-04-01 00:00:00

  • The perception of visual motion.

    abstract::Recent developments have led to a greater insight into the complex processes of perception of visual motion. A better understanding of the neuronal circuitry involved and advances in electrophysiological techniques have allowed researchers to alter the perception of an animal with a stimulating electrode. In addition,...

    journal_title:Current opinion in neurobiology

    pub_type: 杂志文章,评审

    doi:10.1016/0959-4388(92)90008-9

    authors: Snowden RJ

    更新日期:1992-04-01 00:00:00