The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective.

Abstract:

:In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this relationship affect reinforcement learning in the striatum. TANs pause their tonic firing activity after excitatory stimuli from thalamic and cortical neurons in response to a sensory event or reward information. During the pause striatal dopamine concentration excursions are observed. However, functional interactions between the TAN pause and striatal dopamine release are poorly understood. Here we propose a TAN activity-dopamine relationship model and demonstrate that the TAN pause is likely a time window to gate phasic dopamine release and dopamine variations reciprocally modulate the TAN pause duration. Furthermore, this model is integrated into our previously published model of reward-based motor adaptation to demonstrate how phasic dopamine release is gated by the TAN pause to deliver reward information for reinforcement learning in a timely manner. We also show how TAN-dopamine interactions are affected by striatal dopamine deficiency to produce poor performance of motor adaptation.

journal_name

Front Neural Circuits

authors

Kim T,Capps RA,Hamade KC,Barnett WH,Todorov DI,Latash EM,Markin SN,Rybak IA,Molkov YI

doi

10.3389/fncir.2019.00010

subject

Has Abstract

pub_date

2019-02-21 00:00:00

pages

10

issn

1662-5110

journal_volume

13

pub_type

杂志文章
  • Cortical modulation of auditory processing in the midbrain.

    abstract::In addition to their ascending pathways that originate at the receptor cells, all sensory systems are characterized by extensive descending projections. Although the size of these connections often outweighs those that carry information in the ascending auditory pathway, we still have a relatively poor understanding o...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00114

    authors: Bajo VM,King AJ

    更新日期:2013-01-03 00:00:00

  • Two-photon scanning microscopy of in vivo sensory responses of cortical neurons genetically encoded with a fluorescent voltage sensor in rat.

    abstract::A fluorescent voltage sensor protein "Flare" was created from a Kv1.4 potassium channel with YFP situated to report voltage-induced conformational changes in vivo. The RNA virus Sindbis introduced Flare into neurons in the binocular region of visual cortex in rat. Injection sites were selected based on intrinsic optic...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00015

    authors: Ahrens KF,Heider B,Lee H,Isacoff EY,Siegel RM

    更新日期:2012-03-22 00:00:00

  • Natural Vocalizations in the Mammalian Inferior Colliculus are Broadly Encoded by a Small Number of Independent Multi-Units.

    abstract::How complex natural sounds are represented by the main converging center of the auditory midbrain, the central inferior colliculus, is an open question. We applied neural discrimination to determine the variation of detailed encoding of individual vocalizations across the best frequency gradient of the central inferio...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2015.00091

    authors: Lyzwa D,Herrmann JM,Wörgötter F

    更新日期:2016-02-01 00:00:00

  • Abundance of gap junctions at glutamatergic mixed synapses in adult Mosquitofish spinal cord neurons.

    abstract::"Dye-coupling", whole-mount immunohistochemistry for gap junction channel protein connexin 35 (Cx35), and freeze-fracture replica immunogold labeling (FRIL) reveal an abundance of electrical synapses/gap junctions at glutamatergic mixed synapses in the 14th spinal segment that innervates the adult male gonopodium of W...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2014.00066

    authors: Serrano-Velez JL,Rodriguez-Alvarado M,Torres-Vazquez II,Fraser SE,Yasumura T,Vanderpool KG,Rash JE,Rosa-Molinar E

    更新日期:2014-06-26 00:00:00

  • Towards a circuit mechanism for movement tuning in motor cortex.

    abstract::The firing rates of neurons in primate motor cortex have been related to multiple parameters of voluntary movement. This finding has been corroborated by stimulation-based studies that have mapped complex movements in rodent and primate motor cortex. However, it has been difficult to link the movement tuning of a neur...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00127

    authors: Harrison TC,Murphy TH

    更新日期:2013-01-18 00:00:00

  • Manganese Enhanced MRI for Use in Studying Neurodegenerative Diseases.

    abstract::MRI has been extensively used in neurodegenerative disorders, such as Alzheimer's disease (AD), frontal-temporal dementia (FTD), mild cognitive impairment (MCI), Parkinson's disease (PD), Huntington's disease (HD) and amyotrophic lateral sclerosis (ALS). MRI is important for monitoring the neurodegenerative components...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2018.00114

    authors: Saar G,Koretsky AP

    更新日期:2019-01-07 00:00:00

  • Functional recovery of odor representations in regenerated sensory inputs to the olfactory bulb.

    abstract::The olfactory system has a unique capacity for recovery from peripheral damage. After injury to the olfactory epithelium (OE), olfactory sensory neurons (OSNs) regenerate and re-converge on target glomeruli of the olfactory bulb (OB). Thus far, this process has been described anatomically for only a few defined popula...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2013.00207

    authors: Cheung MC,Jang W,Schwob JE,Wachowiak M

    更新日期:2014-01-07 00:00:00

  • Shank3 Transgenic and Prenatal Zinc-Deficient Autism Mouse Models Show Convergent and Individual Alterations of Brain Structures in MRI.

    abstract::Research efforts over the past decades have unraveled both genetic and environmental factors, which contribute to the development of autism spectrum disorders (ASD). It is, to date, largely unknown how different underlying causes result in a common phenotype. However, the individual course of development and the diffe...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2019.00006

    authors: Schoen M,Asoglu H,Bauer HF,Müller HP,Abaei A,Sauer AK,Zhang R,Song TJ,Bockmann J,Kassubek J,Rasche V,Grabrucker AM,Boeckers TM

    更新日期:2019-02-22 00:00:00

  • The Thalamus as a Low Pass Filter: Filtering at the Cellular Level does Not Equate with Filtering at the Network Level.

    abstract::In the mammalian central nervous system, most sensory information passes through primary sensory thalamic nuclei, however the consequence of this remains unclear. Various propositions exist, likening the thalamus to a gate, or a high pass filter. Here, using a simple leaky integrate and fire model based on physiologic...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2015.00089

    authors: Connelly WM,Laing M,Errington AC,Crunelli V

    更新日期:2016-01-14 00:00:00

  • Why Isn't the Head Direction System Necessary for Direction? Lessons From the Lateral Mammillary Nuclei.

    abstract::Complex spatial representations in the hippocampal formation and related cortical areas require input from the head direction system. However, a recurrent finding is that behavior apparently supported by these spatial representations does not appear to require input from generative head direction regions, i.e., latera...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2019.00060

    authors: Dillingham CM,Vann SD

    更新日期:2019-09-13 00:00:00

  • Models of grid cell spatial firing published 2005-2011.

    abstract::Since the discovery of grid cells in rat entorhinal cortex, many models of their hexagonally arrayed spatial firing fields have been suggested. We review the models and organize them according to the mechanisms they use to encode position, update the positional code, read it out in the spatial grid pattern, and learn ...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00016

    authors: Zilli EA

    更新日期:2012-04-18 00:00:00

  • Peripheral Sensory Neurons Expressing Melanopsin Respond to Light.

    abstract::The ability of light to cause pain is paradoxical. The retina detects light but is devoid of nociceptors while the trigeminal sensory ganglia (TG) contain nociceptors but not photoreceptors. Melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs) are thought to mediate light-induced pain but...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2016.00060

    authors: Matynia A,Nguyen E,Sun X,Blixt FW,Parikh S,Kessler J,Pérez de Sevilla Müller L,Habib S,Kim P,Wang ZZ,Rodriguez A,Charles A,Nusinowitz S,Edvinsson L,Barnes S,Brecha NC,Gorin MB

    更新日期:2016-08-10 00:00:00

  • Recombinant Adeno-Associated Virus-Mediated microRNA Delivery into the Postnatal Mouse Brain Reveals a Role for miR-134 in Dendritogenesis in Vivo.

    abstract::Recent studies using primary neuronal cultures have revealed important roles of the microRNA pathway in the regulation of neuronal development and morphology. For example, miR-134 is involved in dendritogenesis and spine development in hippocampal neurons by regulating local mRNA translation in dendrites. The in vivo ...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/neuro.04.016.2009

    authors: Christensen M,Larsen LA,Kauppinen S,Schratt G

    更新日期:2010-01-12 00:00:00

  • Stimulation of the Nigrotectal Pathway at the Level of the Superior Colliculus Reduces Threat Recognition and Causes a Shift From Avoidance to Approach Behavior.

    abstract::Defensive behavioral responses are essential for survival in threating situations. The superior colliculus (SC) has been implicated in the generation of defensive behaviors elicited by visual, tactile and auditory stimuli. Furthermore, substantia nigra pars reticulata (SNr) neurons are known to exert a modulatory effe...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2018.00036

    authors: Almada RC,Genewsky AJ,Heinz DE,Kaplick PM,Coimbra NC,Wotjak CT

    更新日期:2018-05-07 00:00:00

  • Improved methods for chronic light-based motor mapping in mice: automated movement tracking with accelerometers, and chronic EEG recording in a bilateral thin-skull preparation.

    abstract::Optogenetic stimulation of the mouse cortex can be used to generate motor maps that are similar to maps derived from electrode-based stimulation. Here we present a refined set of procedures for repeated light-based motor mapping in ChR2-expressing mice implanted with a bilateral thinned-skull chronic window and a chro...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2013.00123

    authors: Silasi G,Boyd JD,Ledue J,Murphy TH

    更新日期:2013-07-25 00:00:00

  • The Diversity of Cortical Inhibitory Synapses.

    abstract::The most typical and well known inhibitory action in the cortical microcircuit is a strong inhibition on the target neuron by axo-somatic synapses. However, it has become clear that synaptic inhibition in the cortex is much more diverse and complicated. Firstly, at least ten or more inhibitory non-pyramidal cell subty...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2016.00027

    authors: Kubota Y,Karube F,Nomura M,Kawaguchi Y

    更新日期:2016-04-25 00:00:00

  • GABA as a rising gliotransmitter.

    abstract::Gamma-amino butyric acid (GABA) is the major inhibitory neurotransmitter that is known to be synthesized and released from GABAergic neurons in the brain. However, recent studies have shown that not only neurons but also astrocytes contain a considerable amount of GABA that can be released and activate GABA receptors ...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2014.00141

    authors: Yoon BE,Lee CJ

    更新日期:2014-12-17 00:00:00

  • Topological dynamics in spike-timing dependent plastic model neural networks.

    abstract::Spike-timing dependent plasticity (STDP) is a biologically constrained unsupervised form of learning that potentiates or depresses synaptic connections based on the precise timing of pre-synaptic and post-synaptic firings. The effects of on-going STDP on the topology of evolving model neural networks were assessed in ...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2013.00070

    authors: Stone DB,Tesche CD

    更新日期:2013-04-18 00:00:00

  • Input-specific excitation of olfactory cortex microcircuits.

    abstract::Every higher-order association cortex receives a variety of synaptic signals from different regions of the brain. How these cortical networks are capable of differentially responding to these various extrinsic synaptic inputs remains unclear. To address this issue, we studied how the basolateral amygdala (BLA) and the...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00069

    authors: Luna VM,Morozov A

    更新日期:2012-09-19 00:00:00

  • Local Field Potentials: Myths and Misunderstandings.

    abstract::The intracerebral local field potential (LFP) is a measure of brain activity that reflects the highly dynamic flow of information across neural networks. This is a composite signal that receives contributions from multiple neural sources, yet interpreting its nature and significance may be hindered by several confound...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2016.00101

    authors: Herreras O

    更新日期:2016-12-15 00:00:00

  • Thirst Is Associated with Suppression of Habenula Output and Active Stress Coping: Is there a Role for a Non-canonical Vasopressin-Glutamate Pathway?

    abstract::Water-homeostasis is a fundamental physiological process for terrestrial life. In vertebrates, thirst drives water intake, but the neuronal circuits that connect the physiology of water regulation with emotional context are poorly understood. Vasopressin (VP) is a prominent messenger in this circuit, as well as L-glut...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2016.00013

    authors: Zhang L,Hernández VS,Vázquez-Juárez E,Chay FK,Barrio RA

    更新日期:2016-03-31 00:00:00

  • Viral vector-mediated selective and reversible blockade of the pathway for visual orienting in mice.

    abstract::Recently, by using a combination of two viral vectors, we developed a technique for pathway-selective and reversible synaptic transmission blockade, and successfully induced a behavioral deficit of dexterous hand movements in macaque monkeys by affecting a population of spinal interneurons. To explore the capacity of ...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2013.00162

    authors: Sooksawate T,Isa K,Matsui R,Kato S,Kinoshita M,Kobayashi K,Watanabe D,Kobayashi K,Isa T

    更新日期:2013-10-11 00:00:00

  • Spectrotemporal sound preferences of neighboring inferior colliculus neurons: implications for local circuitry and processing.

    abstract::How do local circuits in the inferior colliculus (IC) process and transform spectral and temporal sound information? Using a four-tetrode array we examined the functional properties of the IC and metrics of its micro circuitry by recording neural activity from neighboring single neurons in the cat. Spectral and tempor...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00062

    authors: Chen C,Rodriguez FC,Read HL,Escabí MA

    更新日期:2012-09-27 00:00:00

  • Cholinergic partition cells and lamina x neurons induce a muscarinic-dependent short-term potentiation of commissural glutamatergic inputs in lumbar motoneurons.

    abstract::Acetylcholine and the activation of muscarinic receptors influence the activity of neural networks generating locomotor behavior in the mammalian spinal cord. Using electrical stimulations of the ventral commissure, we show that commissural muscarinic (CM) depolarizations could be induced in lumbar motoneurons. We pro...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2011.00015

    authors: Bertrand SS,Cazalets JR

    更新日期:2011-11-04 00:00:00

  • Fish in the matrix: motor learning in a virtual world.

    abstract::One of the large remaining challenges in the field of zebrafish neuroscience is the establishment of techniques and preparations that permit the recording and perturbation of neural activity in animals that can interact meaningfully with the environment. Since it is very difficult to do this in freely behaving zebrafi...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2012.00125

    authors: Engert F

    更新日期:2013-01-25 00:00:00

  • Development of an Acute Method to Deliver Transgenes Into the Brains of Adult Xenopus laevis.

    abstract::The central vocal pathway of the African clawed frog, Xenopus laevis, is a powerful vertebrate model to understand mechanisms underlying central pattern generation. However, fast and efficient methods of introducing exogenous genes into the neurons of adult X. laevis are currently not available. Here, we systematicall...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/fncir.2018.00092

    authors: Yamaguchi A,Woller DJ,Rodrigues P

    更新日期:2018-10-26 00:00:00

  • Shaping Diversity Into the Brain's Form and Function.

    abstract::The brain contains a large diversity of unique cell types that use specific genetic programs to control development and instruct the intricate wiring of sensory, motor, and cognitive brain regions. In addition to their cellular diversity and specialized connectivity maps, each region's dedicated function is also expre...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2018.00083

    authors: Miterko LN,Lackey EP,Heck DH,Sillitoe RV

    更新日期:2018-10-10 00:00:00

  • The cellular architecture of the larval zebrafish tectum, as revealed by gal4 enhancer trap lines.

    abstract::We have carried out a Gal4 enhancer trap screen in zebrafish, and have generated 184 stable transgenic lines with interesting expression patterns throughout the nervous system. Of these, three display clear expression in the tectum, each with a distinguishable and stereotyped distribution of Gal4 expressing cells. Det...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章

    doi:10.3389/neuro.04.013.2009

    authors: Scott EK,Baier H

    更新日期:2009-10-09 00:00:00

  • A new era for functional labeling of neurons: activity-dependent promoters have come of age.

    abstract::Genetic labeling of neurons with a specific response feature is an emerging technology for precise dissection of brain circuits that are functionally heterogeneous at the single-cell level. While immediate early gene mapping has been widely used for decades to identify brain regions which are activated by external sti...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2014.00037

    authors: Kawashima T,Okuno H,Bito H

    更新日期:2014-04-23 00:00:00

  • Mapping arealisation of the visual cortex of non-primate species: lessons for development and evolution.

    abstract::The integration of the visual stimulus takes place at the level of the neocortex, organized in anatomically distinct and functionally unique areas. Primates, including humans, are heavily dependent on vision, with approximately 50% of their neocortical surface dedicated to visual processing and possess many more visua...

    journal_title:Frontiers in neural circuits

    pub_type: 杂志文章,评审

    doi:10.3389/fncir.2014.00079

    authors: Homman-Ludiye J,Bourne JA

    更新日期:2014-07-04 00:00:00