Task complexity interacts with state-space uncertainty in the arbitration between model-based and model-free learning.

Abstract:

:It has previously been shown that the relative reliability of model-based and model-free reinforcement-learning (RL) systems plays a role in the allocation of behavioral control between them. However, the role of task complexity in the arbitration between these two strategies remains largely unknown. Here, using a combination of novel task design, computational modelling, and model-based fMRI analysis, we examined the role of task complexity alongside state-space uncertainty in the arbitration process. Participants tended to increase model-based RL control in response to increasing task complexity. However, they resorted to model-free RL when both uncertainty and task complexity were high, suggesting that these two variables interact during the arbitration process. Computational fMRI revealed that task complexity interacts with neural representations of the reliability of the two systems in the inferior prefrontal cortex.

journal_name

Nat Commun

journal_title

Nature communications

authors

Kim D,Park GY,O Doherty JP,Lee SW

doi

10.1038/s41467-019-13632-1

subject

Has Abstract

pub_date

2019-12-16 00:00:00

pages

5738

issue

1

issn

2041-1723

pii

10.1038/s41467-019-13632-1

journal_volume

10

pub_type

杂志文章
  • The complex structure of GRL0617 and SARS-CoV-2 PLpro reveals a hot spot for antiviral drug discovery.

    abstract::SARS-CoV-2 is the pathogen responsible for the COVID-19 pandemic. The SARS-CoV-2 papain-like cysteine protease (PLpro) has been implicated in playing important roles in virus maturation, dysregulation of host inflammation, and antiviral immune responses. The multiple functions of PLpro render it a promising drug targe...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-020-20718-8

    authors: Fu Z,Huang B,Tang J,Liu S,Liu M,Ye Y,Liu Z,Xiong Y,Zhu W,Cao D,Li J,Niu X,Zhou H,Zhao YJ,Zhang G,Huang H

    更新日期:2021-01-20 00:00:00

  • MicroRNA-141 suppresses prostate cancer stem cells and metastasis by targeting a cohort of pro-metastasis genes.

    abstract::MicroRNAs play important roles in regulating tumour development, progression and metastasis. Here we show that one of the miR-200 family members, miR-141, is under-expressed in several prostate cancer (PCa) stem/progenitor cell populations in both xenograft and primary patient tumours. Enforced expression of miR-141 i...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms14270

    authors: Liu C,Liu R,Zhang D,Deng Q,Liu B,Chao HP,Rycaj K,Takata Y,Lin K,Lu Y,Zhong Y,Krolewski J,Shen J,Tang DG

    更新日期:2017-01-23 00:00:00

  • Author Correction: Ultrafast bridge planarization in donor-π-acceptor copolymers drives intramolecular charge transfer.

    abstract::The original version of this Article omitted the following from the Acknowledgements:"Satish Patil thanks Department of Science and Technology, New Delhi, India for a Swarnajayanti fellowship."This has now been corrected in both the PDF and HTML versions of the Article. ...

    journal_title:Nature communications

    pub_type: 杂志文章,已发布勘误

    doi:10.1038/s41467-017-02574-1

    authors: Roy P,Jha A,Yasarapudi VB,Ram T,Puttaraju B,Patil S,Dasgupta J

    更新日期:2018-01-03 00:00:00

  • Transcriptomic signatures of NK cells suggest impaired responsiveness in HIV-1 infection and increased activity post-vaccination.

    abstract::Natural killer (NK) cells limit viral replication by direct recognition of infected cells, antibody-dependent cellular cytotoxicity (ADCC), and releasing cytokines. Although growing evidence supports NK cell antiviral immunity in HIV-1 infection, further knowledge of their response is necessary. Here we show that NK c...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-018-03618-w

    authors: Costanzo MC,Kim D,Creegan M,Lal KG,Ake JA,Currier JR,Streeck H,Robb ML,Michael NL,Bolton DL,Steers NJ,Eller MA

    更新日期:2018-03-23 00:00:00

  • A highly stable prefusion RSV F vaccine derived from structural analysis of the fusion mechanism.

    abstract::Respiratory syncytial virus (RSV) causes acute lower respiratory tract infections and is the leading cause of infant hospitalizations. Recently, a promising vaccine antigen based on the RSV fusion protein (RSV F) stabilized in the native prefusion conformation has been described. Here we report alternative strategies ...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms9143

    authors: Krarup A,Truan D,Furmanova-Hollenstein P,Bogaert L,Bouchier P,Bisschop IJM,Widjojoatmodjo MN,Zahn R,Schuitemaker H,McLellan JS,Langedijk JPM

    更新日期:2015-09-03 00:00:00

  • The locust genome provides insight into swarm formation and long-distance flight.

    abstract::Locusts are one of the world's most destructive agricultural pests and represent a useful model system in entomology. Here we present a draft 6.5 Gb genome sequence of Locusta migratoria, which is the largest animal genome sequenced so far. Our findings indicate that the large genome size of L. migratoria is likely to...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms3957

    authors: Wang X,Fang X,Yang P,Jiang X,Jiang F,Zhao D,Li B,Cui F,Wei J,Ma C,Wang Y,He J,Luo Y,Wang Z,Guo X,Guo W,Wang X,Zhang Y,Yang M,Hao S,Chen B,Ma Z,Yu D,Xiong Z,Zhu Y,Fan D,Han L,Wang B,Chen Y,Wang J

    更新日期:2014-01-01 00:00:00

  • Glycogen controls Caenorhabditis elegans lifespan and resistance to oxidative stress.

    abstract::A high-sugar diet has been associated with reduced lifespan in organisms ranging from worms to mammals. However, the mechanisms underlying the harmful effects of glucose are poorly understood. Here we establish a causative relationship between endogenous glucose storage in the form of glycogen, resistance to oxidative...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms15868

    authors: Gusarov I,Pani B,Gautier L,Smolentseva O,Eremina S,Shamovsky I,Katkova-Zhukotskaya O,Mironov A,Nudler E

    更新日期:2017-06-19 00:00:00

  • Publisher Correction: Encryption and steganography of synthetic gene circuits.

    abstract::The original version of this Article contained an error in Fig. 4. In the lower part of the three gene circuit diagrams in panel b, the flat-headed arrow linking lambdaCI to the tetR promoter incorrectly pointed to the tetR gene body. This has now been corrected in the HTML and PDF versions of this Article. ...

    journal_title:Nature communications

    pub_type: 杂志文章,已发布勘误

    doi:10.1038/s41467-018-07844-0

    authors: Purcell O,Wang J,Siuti P,Lu TK

    更新日期:2019-01-08 00:00:00

  • Author Correction: Re-designing Interleukin-12 to enhance its safety and potential as an anti-tumor immunotherapeutic agent.

    abstract::The originally published version of this Article contained errors in Figure 4. In panel b, the square and diamond labels associated with the uppermost survival curve were incorrectly displayed as 'n' and 'u', respectively. These errors have now been corrected in both the PDF and HTML versions of the Article. ...

    journal_title:Nature communications

    pub_type: 杂志文章,已发布勘误

    doi:10.1038/s41467-017-02205-9

    authors: Wang P,Li X,Wang J,Gao D,Li Y,Li H,Chu Y,Zhang Z,Liu H,Jiang G,Cheng Z,Wang S,Dong J,Feng B,Chard LS,Lemoine NR,Wang Y

    更新日期:2018-01-10 00:00:00

  • Land-use emissions play a critical role in land-based mitigation for Paris climate targets.

    abstract::Scenarios that limit global warming to below 2 °C by 2100 assume significant land-use change to support large-scale carbon dioxide (CO2) removal from the atmosphere by afforestation/reforestation, avoided deforestation, and Biomass Energy with Carbon Capture and Storage (BECCS). The more ambitious mitigation scenarios...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-018-05340-z

    authors: Harper AB,Powell T,Cox PM,House J,Huntingford C,Lenton TM,Sitch S,Burke E,Chadburn SE,Collins WJ,Comyn-Platt E,Daioglou V,Doelman JC,Hayman G,Robertson E,van Vuuren D,Wiltshire A,Webber CP,Bastos A,Boysen L,Ciais

    更新日期:2018-08-07 00:00:00

  • The structural basis of promiscuity in small multidrug resistance transporters.

    abstract::By providing broad resistance to environmental biocides, transporters from the small multidrug resistance (SMR) family drive the spread of multidrug resistance cassettes among bacterial populations. A fundamental understanding of substrate selectivity by SMR transporters is needed to identify the types of selective pr...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-020-19820-8

    authors: Kermani AA,Macdonald CB,Burata OE,Ben Koff B,Koide A,Denbaum E,Koide S,Stockbridge RB

    更新日期:2020-11-27 00:00:00

  • Clonal replacement and heterogeneity in breast tumors treated with neoadjuvant HER2-targeted therapy.

    abstract::Genomic changes observed across treatment may result from either clonal evolution or geographically disparate sampling of heterogeneous tumors. Here we use computational modeling based on analysis of fifteen primary breast tumors and find that apparent clonal change between two tumor samples can frequently be explaine...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-019-08593-4

    authors: Caswell-Jin JL,McNamara K,Reiter JG,Sun R,Hu Z,Ma Z,Ding J,Suarez CJ,Tilk S,Raghavendra A,Forte V,Chin SF,Bardwell H,Provenzano E,Caldas C,Lang J,West R,Tripathy D,Press MF,Curtis C

    更新日期:2019-02-08 00:00:00

  • Graphene-enabled electron microscopy and correlated super-resolution microscopy of wet cells.

    abstract::The application of electron microscopy to hydrated biological samples has been limited by high-vacuum operating conditions. Traditional methods utilize harsh and laborious sample dehydration procedures, often leading to structural artefacts and creating difficulties for correlating results with high-resolution fluores...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms8384

    authors: Wojcik M,Hauser M,Li W,Moon S,Xu K

    更新日期:2015-06-11 00:00:00

  • All-optical regenerator of multi-channel signals.

    abstract::One of the main reasons why nonlinear-optical signal processing (regeneration, logic, etc.) has not yet become a practical alternative to electronic processing is that the all-optical elements with nonlinear input-output relationship have remained inherently single-channel devices (just like their electronic counterpa...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-017-00874-0

    authors: Li L,Patki PG,Kwon YB,Stelmakh V,Campbell BD,Annamalai M,Lakoba TI,Vasilyev M

    更新日期:2017-10-12 00:00:00

  • Transcription reinitiation by recycling RNA polymerase that diffuses on DNA after releasing terminated RNA.

    abstract::Despite extensive studies on transcription mechanisms, it is unknown how termination complexes are disassembled, especially in what order the essential components dissociate. Our single-molecule fluorescence study unveils that RNA transcript release precedes RNA polymerase (RNAP) dissociation from the DNA template muc...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-019-14200-3

    authors: Kang W,Ha KS,Uhm H,Park K,Lee JY,Hohng S,Kang C

    更新日期:2020-01-23 00:00:00

  • Anomalous circular bulk photovoltaic effect in BiFeO3 thin films with stripe-domain pattern.

    abstract::Multiferroic bismuth ferrite, BiFeO3, offers a vast landscape to study the interplay between different ferrroic orders. Another aspect which is equally exciting, and yet underutilized, is the possibility of large-scale ordering of domains. Along with symmetry-driven bulk photovoltaic effect, BiFeO3 presents opportunit...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-020-20446-z

    authors: Knoche DS,Steimecke M,Yun Y,Mühlenbein L,Bhatnagar A

    更新日期:2021-01-12 00:00:00

  • A meta-analysis of global fungal distribution reveals climate-driven patterns.

    abstract::The evolutionary and environmental factors that shape fungal biogeography are incompletely understood. Here, we assemble a large dataset consisting of previously generated mycobiome data linked to specific geographical locations across the world. We use this dataset to describe the distribution of fungal taxa and to l...

    journal_title:Nature communications

    pub_type: 杂志文章,meta分析

    doi:10.1038/s41467-019-13164-8

    authors: Větrovský T,Kohout P,Kopecký M,Machac A,Man M,Bahnmann BD,Brabcová V,Choi J,Meszárošová L,Human ZR,Lepinay C,Lladó S,López-Mondéjar R,Martinović T,Mašínová T,Morais D,Navrátilová D,Odriozola I,Štursová M,Švec K,Tl

    更新日期:2019-11-13 00:00:00

  • Transposable element expression in tumors is associated with immune infiltration and increased antigenicity.

    abstract::Profound global loss of DNA methylation is a hallmark of many cancers. One potential consequence of this is the reactivation of transposable elements (TEs) which could stimulate the immune system via cell-intrinsic antiviral responses. Here, we develop REdiscoverTE, a computational method for quantifying genome-wide T...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-019-13035-2

    authors: Kong Y,Rose CM,Cass AA,Williams AG,Darwish M,Lianoglou S,Haverty PM,Tong AJ,Blanchette C,Albert ML,Mellman I,Bourgon R,Greally J,Jhunjhunwala S,Chen-Harris H

    更新日期:2019-11-19 00:00:00

  • Spin transport and Hanle effect in silicon nanowires using graphene tunnel barriers.

    abstract::Spin-based devices offer non-volatile, scalable, low power and reprogrammable functionality for emerging device technologies. Here we fabricate nanoscale spintronic devices with ferromagnetic metal/single-layer graphene tunnel barriers used to generate spin accumulation and spin currents in a silicon nanowire transpor...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms8541

    authors: van 't Erve OM,Friedman AL,Li CH,Robinson JT,Connell J,Lauhon LJ,Jonker BT

    更新日期:2015-06-19 00:00:00

  • Gelation process visualized by aggregation-induced emission fluorogens.

    abstract::Alkaline-urea aqueous solvent system provides a novel and important approach for the utilization of polysaccharide. As one of the most important polysaccharide, chitosan can be well dissolved in this solvent system, and the resultant hydrogel material possesses unique and excellent properties. Thus the sound understan...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms12033

    authors: Wang Z,Nie J,Qin W,Hu Q,Tang BZ

    更新日期:2016-06-23 00:00:00

  • Author Correction: Pan-cancer deconvolution of tumour composition using DNA methylation.

    abstract::The original version of this Article contained an error in Figure 4. In panel a, the colour code for hot and cold clusters was inadvertently inverted. In the correct version of panel a, the hot clusters are blue and the cold clusters are yellow. This error has now been corrected in both the PDF and HTML versions of th...

    journal_title:Nature communications

    pub_type: 杂志文章,已发布勘误

    doi:10.1038/s41467-018-07155-4

    authors: Chakravarthy A,Furness A,Joshi K,Ghorani E,Ford K,Ward MJ,King EV,Lechner M,Marafioti T,Quezada SA,Thomas GJ,Feber A,Fenton TR

    更新日期:2018-11-02 00:00:00

  • Photoswitchable semiconductor nanocrystals with self-regulating photochromic Förster resonance energy transfer acceptors.

    abstract::Photoswitchable molecules and nanoparticles constitute superior biosensors for a wide range of industrial, research and biomedical applications. Rendered reversible by spontaneous or deterministic means, such probes facilitate many of the techniques in fluorescence microscopy that surpass the optical resolution dictat...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms7036

    authors: Díaz SA,Gillanders F,Jares-Erijman EA,Jovin TM

    更新日期:2015-01-16 00:00:00

  • Giant non-reciprocity at the subwavelength scale using angular momentum-biased metamaterials.

    abstract::Breaking time-reversal symmetry enables the realization of non-reciprocal devices, such as isolators and circulators, of fundamental importance in microwave and photonic communication systems. This effect is almost exclusively achieved today through magneto-optical phenomena, which are incompatible with integrated tec...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms3407

    authors: Sounas DL,Caloz C,Alù A

    更新日期:2013-01-01 00:00:00

  • Src-transformed cells hijack mitosis to extrude from the epithelium.

    abstract::At the initial stage of carcinogenesis single mutated cells appear within an epithelium. Mammalian in vitro experiments show that potentially cancerous cells undergo live apical extrusion from normal monolayers. However, the mechanism underlying this process in vivo remains poorly understood. Mosaic expression of the ...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-018-07163-4

    authors: Anton KA,Kajita M,Narumi R,Fujita Y,Tada M

    更新日期:2018-11-08 00:00:00

  • Atomically precise edge chlorination of nanographenes and its application in graphene nanoribbons.

    abstract::Chemical functionalization is one of the most powerful and widely used strategies to control the properties of nanomaterials, particularly in the field of graphene. However, the ill-defined structure of the present functionalized graphene inhibits atomically precise structural characterization and structure-correlated...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms3646

    authors: Tan YZ,Yang B,Parvez K,Narita A,Osella S,Beljonne D,Feng X,Müllen K

    更新日期:2013-01-01 00:00:00

  • Protecting tropical forests from the rapid expansion of rubber using carbon payments.

    abstract::Expansion of Hevea brasiliensis rubber plantations is a resurgent driver of deforestation, carbon emissions, and biodiversity loss in Southeast Asia. Southeast Asian rubber extent is massive, equivalent to 67% of oil palm, with rapid further expansion predicted. Results-based carbon finance could dis-incentivise fores...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-018-03287-9

    authors: Warren-Thomas EM,Edwards DP,Bebber DP,Chhang P,Diment AN,Evans TD,Lambrick FH,Maxwell JF,Nut M,O'Kelly HJ,Theilade I,Dolman PM

    更新日期:2018-03-02 00:00:00

  • Layer- and cell type-selective co-transmission by a basal forebrain cholinergic projection to the olfactory bulb.

    abstract::Cholinergic neurons in the basal forebrain project heavily to the main olfactory bulb, the first processing station in the olfactory pathway. The projections innervate multiple layers of the main olfactory bulb and strongly influence odor discrimination, detection, and learning. The precise underlying circuitry of thi...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-017-00765-4

    authors: Case DT,Burton SD,Gedeon JY,Williams SG,Urban NN,Seal RP

    更新日期:2017-09-21 00:00:00

  • Cobalt-catalyzed deoxygenative triborylation of allylic ethers to access 1,1,3-triborylalkanes.

    abstract::Polyborylated organic compounds have been emerging as versatile building blocks in chemical synthesis. Here we report a selective cobalt-catalyzed deoxygenative 1,1,3-triborylation reaction of allylic ethers with pinacolborane to prepare 1,1,3-triborylalkane compounds. With naturally abundant and/or synthetic cinnamic...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/s41467-020-19039-7

    authors: Teo WJ,Yang X,Poon YY,Ge S

    更新日期:2020-10-15 00:00:00

  • Polarization maintaining single-mode low-loss hollow-core fibres.

    abstract::Hollow-core fibre (HCF) is a powerful technology platform offering breakthrough performance improvements in sensing, communications, higher-power pulse delivery and other applications. Free from the usual constraints on what materials can guide light, it promises qualitatively new and ideal operating regimes: precisio...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms6085

    authors: Fini JM,Nicholson JW,Mangan B,Meng L,Windeler RS,Monberg EM,DeSantolo A,DiMarcello FV,Mukasa K

    更新日期:2014-10-28 00:00:00

  • Ultrasensitive and label-free molecular-level detection enabled by light phase control in magnetoplasmonic nanoantennas.

    abstract::Systems allowing label-free molecular detection are expected to have enormous impact on biochemical sciences. Research focuses on materials and technologies based on exploiting localized surface plasmon resonances in metallic nanostructures. The reason for this focused attention is their suitability for single-molecul...

    journal_title:Nature communications

    pub_type: 杂志文章

    doi:10.1038/ncomms7150

    authors: Maccaferri N,Gregorczyk KE,de Oliveira TV,Kataja M,van Dijken S,Pirzadeh Z,Dmitriev A,Åkerman J,Knez M,Vavassori P

    更新日期:2015-02-02 00:00:00