The serial blocking effect: a testbed for the neural mechanisms of temporal-difference learning.

Abstract:

:Temporal-difference (TD) learning models afford the neuroscientist a theory-driven roadmap in the quest for the neural mechanisms of reinforcement learning. The application of these models to understanding the role of phasic midbrain dopaminergic responses in reward prediction learning constitutes one of the greatest success stories in behavioural and cognitive neuroscience. Critically, the classic learning paradigms associated with TD are poorly suited to cast light on its neural implementation, thus hampering progress. Here, we present a serial blocking paradigm in rodents that overcomes these limitations and allows for the simultaneous investigation of two cardinal TD tenets; namely, that learning depends on the computation of a prediction error, and that reinforcing value, whether intrinsic or acquired, propagates back to the onset of the earliest reliable predictor. The implications of this paradigm for the neural exploration of TD mechanisms are highlighted.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Mahmud A,Petrov P,Esber GR,Iordanova MD

doi

10.1038/s41598-019-42244-4

subject

Has Abstract

pub_date

2019-04-12 00:00:00

pages

5962

issue

1

issn

2045-2322

pii

10.1038/s41598-019-42244-4

journal_volume

9

pub_type

杂志文章
  • Effects of polarization mode dispersion on polarization-entangled photons generated via broadband pumped spontaneous parametric down-conversion.

    abstract::An inexpensive and compact frequency multi-mode diode laser enables a compact two-photon polarization entanglement source via the continuous wave broadband pumped spontaneous parametric down-conversion (SPDC) process. Entanglement degradation caused by polarization mode dispersion (PMD) is one of the critical issues i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep25846

    authors: Lim HT,Hong KH,Kim YH

    更新日期:2016-05-13 00:00:00

  • The Reaction of Dimerization by Itself Reduces the Noise Intensity of the Protein Monomer.

    abstract::Because of the small particle number of intracellular species participating in genetic circuits, stochastic fluctuations are inevitable. This intracellular noise is detrimental to precise regulation. To maintain the proper function of a cell, some natural motifs attenuate the noise at the protein level. In many biolog...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-39611-6

    authors: Liu FY,Lo SC,Shu CC

    更新日期:2019-03-04 00:00:00

  • Development of miniaturized walking biological machines.

    abstract::The quest to 'forward-engineer' and fabricate biological machines remains a grand challenge. Towards this end, we have fabricated locomotive "bio-bots" from hydrogels and cardiomyocytes using a 3D printer. The multi-material bio-bot consisted of a 'biological bimorph' cantilever structure as the actuator to power the ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep00857

    authors: Chan V,Park K,Collens MB,Kong H,Saif TA,Bashir R

    更新日期:2012-01-01 00:00:00

  • Bursaphelenchus xylophilus is killed by homologues of 2-(1-undecyloxy)-1-ethanol.

    abstract::2-(1-Undecyloxy)-1-ethanol, monochamol, is a male-produced aggregation pheromone of the Monochamus species, which are efficient vectors of the pine wood nematode (PWN), Bursaphelenchus xylophilus, which cause devastating damage to pines worldwide. The nematicidal activity of synthetic monochamol and its homologues (RO...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep29300

    authors: Kim J,Lee SM,Park CG

    更新日期:2016-07-11 00:00:00

  • A Rapid Method for Label-Free Enrichment of Rare Trophoblast Cells from Cervical Samples.

    abstract::Extravillous trophoblasts (EVTs) have the potential to provide the entire fetal genome for prenatal testing. Previous studies have demonstrated the presence of EVTs in the cervical canal and the ability to retrieve a small quantity of these cells by cervical sampling. However, these small quantities of trophoblasts ar...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-48346-3

    authors: Bailey-Hytholt CM,Sayeed S,Kraus M,Joseph R,Shukla A,Tripathi A

    更新日期:2019-08-20 00:00:00

  • Photoresponsivity of an all-semimetal heterostructure based on graphene and WTe2.

    abstract::Heterostructures based on two-dimensional (2D) materials have sparked wide interests in both fundamental physics and applied devices. Recently, Dirac/Weyl semimetals are emerging as capable functional materials for optoelectronic devices. However, thus far the interfacial coupling of an all-semimetal 2D heterostructur...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-29717-8

    authors: Liu Y,Liu C,Wang X,He L,Wan X,Xu Y,Shi Y,Zhang R,Wang F

    更新日期:2018-08-27 00:00:00

  • Amaryllidaceae alkaloids: identification and partial characterization of montanine production in Rhodophiala bifida plant.

    abstract::Rhodophiala bifida (R. bifida) is a representative of the Amaryllidaceae plant family and is rich in montanine, an alkaloid with high pharmaceutical potential. Despite the interest in these compounds, many steps of the biosynthetic pathway have not been elucidated. In this study, we identified the alkaloids produced i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44746-7

    authors: Reis A,Magne K,Massot S,Tallini LR,Scopel M,Bastida J,Ratet P,Zuanazzi JAS

    更新日期:2019-06-11 00:00:00

  • Declaration of local chemical eradication of the Argentine ant: Bayesian estimation with a multinomial-mixture model.

    abstract::Determining the success of eradication of an invasive species requires a way to decide when its risk of reoccurrence has become acceptably low. In Japan, the area populated by the Argentine ant, Linepithema humile (Mayr), is expanding, and eradication via chemical treatment is ongoing at various locations. One such pr...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-03516-z

    authors: Sakamoto Y,Kumagai NH,Goka K

    更新日期:2017-06-13 00:00:00

  • Antagonistic pleiotropy in mice carrying a CAG repeat expansion in the range causing Huntington's disease.

    abstract::Antagonist pleiotropy, where a gene exerts a beneficial effect at early stages and a deleterious effect later on in an animal's life, may explain the evolutionary persistence of devastating genetic diseases such as Huntington's disease (HD). To date, however, there is little direct experimental evidence to support thi...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-37102-8

    authors: Morton AJ,Skillings EA,Wood NI,Zheng Z

    更新日期:2019-01-10 00:00:00

  • Escaping the Ashby limit for mechanical damping/stiffness trade-off using a constrained high internal friction interfacial layer.

    abstract::The development of new materials with reduced noise and vibration levels is an active area of research due to concerns in various aspects of environmental noise pollution and its effects on health. Excessive vibrations also reduce the service live of the structures and limit the fields of their utilization. In oscilla...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-20670-0

    authors: Unwin AP,Hine PJ,Ward IM,Fujita M,Tanaka E,Gusev AA

    更新日期:2018-02-06 00:00:00

  • Optimal Environmental Conditions and Anomalous Ecosystem Responses: Constraining Bottom-up Controls of Phytoplankton Biomass in the California Current System.

    abstract::In Eastern Boundary Current systems, wind-driven upwelling drives nutrient-rich water to the ocean surface, making these regions among the most productive on Earth. Regulation of productivity by changing wind and/or nutrient conditions can dramatically impact ecosystem functioning, though the mechanisms are not well u...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep27612

    authors: Jacox MG,Hazen EL,Bograd SJ

    更新日期:2016-06-09 00:00:00

  • A computationally efficient hybrid 2D-3D subwoofer model.

    abstract::A subwoofer generates the lowest frequency range in loudspeaker systems. Subwoofers are used in audio systems for live concerts, movie theatres, home theatres, gaming consoles, cars, etc. During the last decades, numerical simulations have emerged as a cost- and time-efficient complement to traditional experiments in ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-80092-9

    authors: Bokhari AH,Berggren M,Noreland D,Wadbro E

    更新日期:2021-01-08 00:00:00

  • Prognostic relevance of UCH-L1 and α-internexin in pancreatic neuroendocrine tumors.

    abstract::Prognostic biomarkers for the pancreatic neuroendocrine tumors are needed. Proteomic study on insulinoma has been rarely reported. We identified the differential expression of proteins between insulinoma and their paired tissues by proteomic analysis, and evaluated the prognostic significance of specific proteins in p...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-02051-1

    authors: Song YL,Yu R,Qiao XW,Bai CM,Lu CM,Xiao Y,Zhong DR,Chen J,Zhao YP,Zhang TP,Song TT,Gao HL,Wan YH,Shen L,Chen J,Lv B,Hao JJ,Zhang Y,Tang L,Chen YJ

    更新日期:2017-05-19 00:00:00

  • Quantitative proteomics analysis of zebrafish exposed to sub-lethal dosages of β-methyl-amino-L-alanine (BMAA).

    abstract::The non-protein amino acid β-methylamino-L-alanine (BMAA) is a neurotoxin present in microalgae and shown to accumulate in the food web. BMAA has been linked to the complex neurodegenerative disorder of Guam and to increased incidents sporadic ALS. Two main neurotoxic routes are suggested; an excitotoxic by acting as ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep29631

    authors: Frøyset AK,Khan EA,Fladmark KE

    更新日期:2016-07-12 00:00:00

  • Trace elements and C and N isotope composition in two mushroom species from a mine-spill contaminated site.

    abstract::Fungi play a key role in the functioning of soil in terrestrial ecosystems, and in particular in the remediation of degraded soils. The contribution of fungi to carbon and nutrient cycles, along with their capability to mobilise soil trace elements, is well-known. However, the importance of life history strategy for t...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-63194-2

    authors: Gil-Martínez M,Navarro-Fernández CM,Murillo JM,Domínguez MT,Marañón T

    更新日期:2020-04-15 00:00:00

  • Design Strategy to Create Antibody Mimetics Harbouring Immobilised Complementarity Determining Region Peptides for Practical Use.

    abstract::Monoclonal antibodies (mAbs) are attractive therapeutics for treating a wide range of human disorders, and bind to the antigen through their complementarity-determining regions (CDRs). Small stable proteins containing structurally retained CDRs are promising alternatives to mAbs. In this report, we present a method to...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-57713-4

    authors: Kadonosono T,Yimchuen W,Ota Y,See K,Furuta T,Shiozawa T,Kitazawa M,Goto Y,Patil A,Kuchimaru T,Kizaka-Kondoh S

    更新日期:2020-01-21 00:00:00

  • Sea ice breakup and marine melt of a retreating tidewater outlet glacier in northeast Greenland (81°N).

    abstract::Rising temperatures in the Arctic cause accelerated mass loss from the Greenland Ice Sheet and reduced sea ice cover. Tidewater outlet glaciers represent direct connections between glaciers and the ocean where melt rates at the ice-ocean interface are influenced by ocean temperature and circulation. However, few measu...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-05089-3

    authors: Bendtsen J,Mortensen J,Lennert K,K Ehn J,Boone W,Galindo V,Hu YB,Dmitrenko IA,Kirillov SA,Kjeldsen KK,Kristoffersen Y,G Barber D,Rysgaard S

    更新日期:2017-07-10 00:00:00

  • Author Correction: Probabilistic Movement Models Show that Postural Control Precedes and Predicts Volitional Motor Control.

    abstract::An amendment to this paper has been published and can be accessed via a link at the top of the paper. ...

    journal_title:Scientific reports

    pub_type: 已发布勘误

    doi:10.1038/s41598-020-63129-x

    authors: Rueckert E,Čamernik J,Peters J,Babič J

    更新日期:2020-04-16 00:00:00

  • VirusMapper: open-source nanoscale mapping of viral architecture through super-resolution microscopy.

    abstract::The nanoscale molecular assembly of mammalian viruses during their infectious life cycle remains poorly understood. Their small dimensions, generally bellow the 300nm diffraction limit of light microscopes, has limited most imaging studies to electron microscopy. The recent development of super-resolution (SR) light m...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep29132

    authors: Gray RD,Beerli C,Pereira PM,Scherer KM,Samolej J,Bleck CK,Mercer J,Henriques R

    更新日期:2016-07-04 00:00:00

  • Genomic epidemiology of Mycobacterium tuberculosis in Santa Catarina, Southern Brazil.

    abstract::Mycobacterium tuberculosis (M.tb), the pathogen responsible for tuberculosis (TB) poses as the major cause of death among infectious diseases. The knowledge about the molecular diversity of M.tb enables the implementation of more effective surveillance and control measures and, nowadays, Whole Genome Sequencing (WGS) ...

    journal_title:Scientific reports

    pub_type: 临床试验,杂志文章

    doi:10.1038/s41598-020-69755-9

    authors: Verza M,Scheffer MC,Salvato RS,Schorner MA,Barazzetti FH,Machado HM,Medeiros TF,Rovaris DB,Portugal I,Viveiros M,Perdigão J,Kritski A,Bazzo ML

    更新日期:2020-07-30 00:00:00

  • Cytogenetic and agronomic characterization of intergeneric hybrids between Saccharum spp. hybrid and Erianthus arundinaceus.

    abstract::In sugarcane (Saccharum spp. hybrid) breeding, introgression of useful genes via intergeneric hybridization is a powerful strategy for improving the crop productivity. Erianthus arundinaceus shows great potential in terms of useful traits; however, little is known about the cytogenetic and agronomic characteristics of...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-38316-6

    authors: Pachakkil B,Terajima Y,Ohmido N,Ebina M,Irei S,Hayashi H,Takagi H

    更新日期:2019-02-11 00:00:00

  • The contribution of super typhoons to tropical cyclone activity in response to ENSO.

    abstract::Western North Pacific tropical cyclone (TC) activity is known to have a significant response to El Niño and Southern Oscillation (ENSO). Among the TC intensity classifications, "super typhoon", is widely used as a symbolic word for warning people about the potential for experiencing the most severe typhoon. This study...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-41561-y

    authors: Kang NY,Kim D,Elsner JB

    更新日期:2019-03-25 00:00:00

  • Air-like plasmonics with ultralow-refractive-index silica aerogels.

    abstract::The coupling of the surface plasmon near-field into the sensing medium is key to the sensitivity of surface plasmon-based sensing devices. A low-index dielectric is necessary for the sensing medium to support a highly-penetrating surface plasmon evanescent field that extends well into the dielectric medium. The air-li...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-38859-2

    authors: Kim Y,Baek S,Gupta P,Kim C,Chang K,Ryu SP,Kang H,Kim WS,Myoung J,Park W,Kim K

    更新日期:2019-02-19 00:00:00

  • FANCD2 functions as a critical factor downstream of MiTF to maintain the proliferation and survival of melanoma cells.

    abstract::Proteins involved in genetic stability maintenance and safeguarding DNA replication act not only against cancer initiation but could also play a major role in sustaining cancer progression. Here, we report that the FANC pathway is highly expressed in metastatic melanoma harboring the oncogenic microphthalmia-associate...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep36539

    authors: Bourseguin J,Bonet C,Renaud E,Pandiani C,Boncompagni M,Giuliano S,Pawlikowska P,Karmous-Benailly H,Ballotti R,Rosselli F,Bertolotto C

    更新日期:2016-11-09 00:00:00

  • Neuroprotective effects of apigenin against inflammation, neuronal excitability and apoptosis in an induced pluripotent stem cell model of Alzheimer's disease.

    abstract::Alzheimer's disease (AD) is one of the most prevalent neurodegenerative diseases, yet current therapeutic treatments are inadequate due to a complex disease pathogenesis. The plant polyphenol apigenin has been shown to have anti-inflammatory and neuroprotective properties in a number of cell and animal models; however...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep31450

    authors: Balez R,Steiner N,Engel M,Muñoz SS,Lum JS,Wu Y,Wang D,Vallotton P,Sachdev P,O'Connor M,Sidhu K,Münch G,Ooi L

    更新日期:2016-08-12 00:00:00

  • Organic-Silica Interactions in Saline: Elucidating the Structural Influence of Calcium in Low-Salinity Enhanced Oil Recovery.

    abstract::Enhanced oil recovery using low-salinity solutions to sweep sandstone reservoirs is a widely-practiced strategy. The mechanisms governing this remain unresolved. Here, we elucidate the role of Ca2+ by combining chemical force microscopy (CFM) and molecular dynamics (MD) simulations. We probe the influence of electroly...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-10327-9

    authors: Desmond JL,Juhl K,Hassenkam T,Stipp SLS,Walsh TR,Rodger PM

    更新日期:2017-09-08 00:00:00

  • Effect of nitrogen application rate on yield, forage quality, and animal performance in a tropical pasture.

    abstract::A three-year-long field experiment was conducted in a continuous grazing system with a variable stocking rate to evaluate effects of increasing nitrogen levels in Marandu grass (Brachiaria brizantha Hochst ex A. Rich Stapf "marandu") on herbage mass, forage accumulation rate (FAR), forage quality, stocking rate (SR), ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44138-x

    authors: Delevatti LM,Cardoso AS,Barbero RP,Leite RG,Romanzini EP,Ruggieri AC,Reis RA

    更新日期:2019-05-20 00:00:00

  • Sustainability is possible despite greed - Exploring the nexus between profitability and sustainability in common pool resource systems.

    abstract::The sustainable use of common pool resources has become a significant global challenge. It is now widely accepted that specific mechanisms such as community-based management strategies, institutional responses such as resource privatization, information availability and emergent social norms can be used to constrain i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-02151-y

    authors: Osten FBV,Kirley M,Miller T

    更新日期:2017-05-23 00:00:00

  • Investigation of biomarkers alterations after an acute tissue trauma in human trapezius muscle, using microdialysis.

    abstract::Alterations in muscle milieu are suggested as important activity of peripheral drive in patients with chronic musculoskeletal pain (CMP). Microdialysis (MD) has been used in monitoring altered metabolic response pattern in muscles. However, the insertion of MD probe causes a local tissue trauma. Whether and how metabo...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-21185-4

    authors: Sørensen LB,Gazerani P,Wåhlén K,Ghafouri N,Gerdle B,Ghafouri B

    更新日期:2018-02-14 00:00:00

  • Functional characterization of the principal sigma factor RpoD of phytoplasmas via an in vitro transcription assay.

    abstract::Phytoplasmas (class, Mollicutes) are insect-transmissible and plant-pathogenic bacteria that multiply intracellularly in both plants and insects through host switching. Our previous study revealed that phytoplasmal sigma factor rpoD of OY-M strain (rpoDOY) could be a key regulator of host switching, because the expres...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep11893

    authors: Miura C,Komatsu K,Maejima K,Nijo T,Kitazawa Y,Tomomitsu T,Yusa A,Himeno M,Oshima K,Namba S

    更新日期:2015-07-07 00:00:00