Habitual control of goal selection in humans.

Abstract:

:Humans choose actions based on both habit and planning. Habitual control is computationally frugal but adapts slowly to novel circumstances, whereas planning is computationally expensive but can adapt swiftly. Current research emphasizes the competition between habits and plans for behavioral control, yet many complex tasks instead favor their integration. We consider a hierarchical architecture that exploits the computational efficiency of habitual control to select goals while preserving the flexibility of planning to achieve those goals. We formalize this mechanism in a reinforcement learning setting, illustrate its costs and benefits, and experimentally demonstrate its spontaneous application in a sequential decision-making task.

authors

Cushman F,Morris A

doi

10.1073/pnas.1506367112

subject

Has Abstract

pub_date

2015-11-10 00:00:00

pages

13817-22

issue

45

eissn

0027-8424

issn

1091-6490

pii

1506367112

journal_volume

112

pub_type

杂志文章
  • Human cytomegalovirus in a SCID-hu mouse: thymic epithelial cells are prominent targets of viral replication.

    abstract::Animal models of human cytomegalovirus (CMV) infections have not been available to study pathogenesis or to evaluate antiviral drugs. Severe combined immunodeficient mice implanted with human fetal tissues (SCID-hu) were found to support CMV replication and may provide a model for this species-specific virus. When con...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.90.1.104

    authors: Mocarski ES,Bonyhadi M,Salimi S,McCune JM,Kaneshima H

    更新日期:1993-01-01 00:00:00

  • Phenotypic and functional characterization of adult brain neuropoiesis.

    abstract::The modern concept of neurogenesis in the adult brain is predicated on the premise that multipotent glial cells give rise to new neurons throughout life. Although extensive evidence exists indicating that this is the case, the transition from glial to neuronal phenotype remains poorly understood. A unique monolayer ce...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0503965102

    authors: Scheffler B,Walton NM,Lin DD,Goetz AK,Enikolopov G,Roper SN,Steindler DA

    更新日期:2005-06-28 00:00:00

  • Two functionally distinct E2/E3 pairs coordinate sequential ubiquitination of a common substrate in Caenorhabditis elegans development.

    abstract::Ubiquitination, the crucial posttranslational modification that regulates the eukaryotic proteome, is carried out by a trio of enzymes, known as E1 [ubiquitin (Ub)-activating enzyme], E2 (Ub-conjugating enzyme), and E3 (Ub ligase). Although most E2s can work with any of the three mechanistically distinct classes of E3...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1705060114

    authors: Dove KK,Kemp HA,Di Bona KR,Reiter KH,Milburn LJ,Camacho D,Fay DS,Miller DL,Klevit RE

    更新日期:2017-08-08 00:00:00

  • Trophic and size structure of West Indian bird communities.

    abstract::Much discussion has occurred in recent years on whether observed patterns of structure in island bird communities are the result of competitive interactions among species or independent rates of colonization and extinction. Here two patterns of structure are presented for birds on 12 West Indian islands. Each of four ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.5.1563

    authors: Faaborg J

    更新日期:1982-03-01 00:00:00

  • A unique basaltic micrometeorite expands the inventory of solar system planetary crusts.

    abstract::Micrometeorites with diameter approximately 100-200 microm dominate the flux of extraterrestrial matter on Earth. The vast majority of micrometeorites are chemically, mineralogically, and isotopically related to carbonaceous chondrites, which amount to only 2.5% of meteorite falls. Here, we report the discovery of the...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0900328106

    authors: Gounelle M,Chaussidon M,Morbidelli A,Barrat JA,Engrand C,Zolensky ME,McKeegan KD

    更新日期:2009-04-28 00:00:00

  • Isolation of a thermostable enzyme variant by cloning and selection in a thermophile.

    abstract::We developed a method for rapidly generating thermostable enzyme variants. Our strategy is to introduce the gene coding for a given enzyme from a mesophilic organism into a thermophile, Bacillus stearothermophilus. Variants that retain the enzymatic activity at the higher growth temperatures of the thermophile are the...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.83.3.576

    authors: Liao H,McKenzie T,Hageman R

    更新日期:1986-02-01 00:00:00

  • Niche adaptation limits bacteriophage predation of Vibrio cholerae in a nutrient-poor aquatic environment.

    abstract::Vibrio cholerae, the causative agent of cholera, has reservoirs in fresh and brackish water where it interacts with virulent bacteriophages. Phages are the most abundant biological entity on earth and coevolve with bacteria. It was reported that concentrations of phage and V. cholerae inversely correlate in aquatic re...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1810138116

    authors: Silva-Valenzuela CA,Camilli A

    更新日期:2019-01-29 00:00:00

  • Gene expression in oligodendrocytes during remyelination reveals cholesterol homeostasis as a therapeutic target in multiple sclerosis.

    abstract::Regional differences in neurons, astrocytes, oligodendrocytes, and microglia exist in the brain during health, and regional differences in the transcriptome may occur for each cell type during neurodegeneration. Multiple sclerosis (MS) is multifocal, and regional differences in the astrocyte transcriptome occur in exp...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1821306116

    authors: Voskuhl RR,Itoh N,Tassoni A,Matsukawa MA,Ren E,Tse V,Jang E,Suen TT,Itoh Y

    更新日期:2019-05-14 00:00:00

  • Controlled expression of transgenes introduced by in vivo electroporation.

    abstract::In vivo electroporation is a powerful technique for the introduction of genes into organisms. Temporal and spatial regulation of expression of introduced genes, or of RNAi, would further enhance the utility of this method. Here we demonstrate conditional regulation of gene expression from electroporated plasmids in th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0610155104

    authors: Matsuda T,Cepko CL

    更新日期:2007-01-16 00:00:00

  • Identification of an animal omega-3 fatty acid desaturase by heterologous expression in Arabidopsis.

    abstract::In animals, fatty acid desaturases catalyze key reactions in the synthesis of arachidonic acid and other polyunsaturated fatty acids. A search of the Caenorhabditis elegans DNA databases, using the sequences of Arabidopsis genes, identified several putative desaturases. Here we describe the characterization of the fir...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.4.1142

    authors: Spychalla JP,Kinney AJ,Browse J

    更新日期:1997-02-18 00:00:00

  • Resolving the HONO formation mechanism in the ionosphere via ab initio molecular dynamic simulations.

    abstract::Solar emission produces copious nitrosonium ions (NO(+)) in the D layer of the ionosphere, 60 to 90 km above the Earth's surface. NO(+) is believed to transfer its charge to water clusters in that region, leading to the formation of gaseous nitrous acid (HONO) and protonated water cluster. The dynamics of this reactio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1601651113

    authors: He R,Li L,Zhong J,Zhu C,Francisco JS,Zeng XC

    更新日期:2016-04-26 00:00:00

  • Evolution of the immunoglobulin kappa light chain locus in the rabbit: evidence for differential gene conversion events.

    abstract::The rabbit kappa light chain gene family is characterized by the presence of two constant region (C kappa) genes; the C kappa 1 gene encodes the constant region of the principal rabbit immunoglobulin light chain, the C kappa 2 gene being not or very poorly expressed in domestic rabbits. There exist four major K1 allel...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.83.14.5180

    authors: Akimenko MA,Mariamé B,Rougeon F

    更新日期:1986-07-01 00:00:00

  • Genetic analysis of homomeric interactions of human immunodeficiency virus type 1 integrase using the yeast two-hybrid system.

    abstract::The retroviral integrase protein (IN) is responsible for catalyzing a concerted integration reaction in which the two termini of linear viral DNA are joined to host DNA. To probe the potential for IN to form protein multimers, we used the yeast two-hybrid system. The coexpression of a GAL4 DNA binding domain-IN fusion...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.90.22.10593

    authors: Kalpana GV,Goff SP

    更新日期:1993-11-15 00:00:00

  • Larval selectivity for yeast species by Drosophila mojavensis in natural substrates.

    abstract::The yeast flora found in the major substrates of Drosophila mojavensis and in larval guts was studied both qualitatively and quantitatively. Quantitative studies show that, in four of the five substrates tested, the larvae did not contain a random sample of the yeasts present in the substrates. One widely distributed ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.7.4435

    authors: Fogleman JC,Starmer WT,Heed WB

    更新日期:1981-07-01 00:00:00

  • Affecting gene expression by altering the length and sequence of the 5' leader.

    abstract::We have utilized a recombinant vector system designed to study gene control elements by fusing them to the Escherichia coli galactokinase gene (galK) to examine the effects of gene expression that result from introducing changes into the 5' noncoding leader region of the galK transcription unit. We varied the length o...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.81.24.7698

    authors: Johansen H,Schümperli D,Rosenberg M

    更新日期:1984-12-01 00:00:00

  • Toward high-energy-density, high-efficiency, and moderate-temperature chip-scale thermophotovoltaics.

    abstract::The challenging problem of ultra-high-energy-density, high-efficiency, and small-scale portable power generation is addressed here using a distinctive thermophotovoltaic energy conversion mechanism and chip-based system design, which we name the microthermophotovoltaic (μTPV) generator. The approach is predicted to be...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1301004110

    authors: Chan WR,Bermel P,Pilawa-Podgurski RC,Marton CH,Jensen KF,Senkevich JJ,Joannopoulos JD,Soljacic M,Celanovic I

    更新日期:2013-04-02 00:00:00

  • Repeated observation of breast tumor subtypes in independent gene expression data sets.

    abstract::Characteristic patterns of gene expression measured by DNA microarrays have been used to classify tumors into clinically relevant subgroups. In this study, we have refined the previously defined subtypes of breast tumors that could be distinguished by their distinct patterns of gene expression. A total of 115 malignan...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0932692100

    authors: Sorlie T,Tibshirani R,Parker J,Hastie T,Marron JS,Nobel A,Deng S,Johnsen H,Pesich R,Geisler S,Demeter J,Perou CM,Lønning PE,Brown PO,Børresen-Dale AL,Botstein D

    更新日期:2003-07-08 00:00:00

  • Earliest isotopic evidence in the Maya region for animal management and long-distance trade at the site of Ceibal, Guatemala.

    abstract::This study uses a multiisotope (carbon, nitrogen, oxygen, and strontium) approach to examine early animal management in the Maya region. An analysis of faunal specimens across almost 2,000 years (1000 BC to AD 950) at the site of Ceibal, Guatemala, reveals the earliest evidence for live-traded dogs and possible captiv...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 历史文章,杂志文章

    doi:10.1073/pnas.1713880115

    authors: Sharpe AE,Emery KF,Inomata T,Triadan D,Kamenov GD,Krigbaum J

    更新日期:2018-04-03 00:00:00

  • Expression profiles of multiple genes in single neurons of Alzheimer's disease.

    abstract::Many changes have been described in the brains of Alzheimer's disease (AD) patients, including loss of neurons and formation of senile plaques and neurofibrillary tangles. The molecular mechanisms underlying these pathologies are unclear. Northern blot, dot-blot, and reverse transcription-coupled PCR analyses have dem...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.16.9620

    authors: Chow N,Cox C,Callahan LM,Weimer JM,Guo L,Coleman PD

    更新日期:1998-08-04 00:00:00

  • Extrachromosomal element capture and the evolution of multiple replication origins in archaeal chromosomes.

    abstract::In all three domains of life, DNA replication begins at specialized loci termed replication origins. In bacteria, replication initiates from a single, clearly defined site. In contrast, eukaryotic organisms exploit a multitude of replication origins, dividing their genomes into an array of short contiguous units. Rece...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0700206104

    authors: Robinson NP,Bell SD

    更新日期:2007-04-03 00:00:00

  • Potentials of the National Corn Genome Initiative.

    abstract::The present paper summarizes future needs in information and tools, technology, infrastructure, training, funding, and bioinformatics, to provide the genomic knowledge and tools for breeding and biotechnological goals in maize. The National Corn Genome Initiative (NCGA) has developed through actions taken by the Natio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.5.2029

    authors: Coe EH

    更新日期:1998-03-03 00:00:00

  • Regulatory CD8 T cells that recognize Qa-1 expressed by CD4 T-helper cells inhibit rejection of heart allografts.

    abstract::Induction of longstanding immunologic tolerance is essential for survival of transplanted organs and tissues. Despite recent advances in immunosuppression protocols, allograft damage inflicted by antibody specific for donor organs continues to represent a major obstacle to graft survival. Here we report that activatio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1918950117

    authors: Choi JY,Eskandari SK,Cai S,Sulkaj I,Assaker JP,Allos H,AlHaddad J,Muhsin SA,Alhussain E,Mansouri A,Yeung MY,Seelen MAJ,Kim HJ,Cantor H,Azzi JR

    更新日期:2020-03-17 00:00:00

  • Interaction of the Wiskott-Aldrich syndrome protein with sorting nexin 9 is required for CD28 endocytosis and cosignaling in T cells.

    abstract::The Wiskott-Aldrich syndrome protein (WASp) plays a major role in coupling T cell antigen receptor (TCR) stimulation to induction of actin cytoskeletal changes required for T cell activation. Here, we report that WASp inducibly binds the sorting nexin 9 (SNX9) in T cells and that WASp, SNX9, p85, and CD28 colocalize w...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0610543104

    authors: Badour K,McGavin MK,Zhang J,Freeman S,Vieira C,Filipp D,Julius M,Mills GB,Siminovitch KA

    更新日期:2007-01-30 00:00:00

  • Molecular mechanisms for the subversion of MyD88 signaling by TcpC from virulent uropathogenic Escherichia coli.

    abstract::The Toll/IL-1 receptor (TIR) domains are crucial signaling modules during innate immune responses involving the Toll-like receptors (TLRs) and IL-1 receptor (IL-1R). Myeloid differential factor 88 (MyD88) is a central TIR domain-containing adapter molecule responsible for nearly all TLR-mediated signaling and is targe...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1215770110

    authors: Snyder GA,Cirl C,Jiang J,Chen K,Waldhuber A,Smith P,Römmler F,Snyder N,Fresquez T,Dürr S,Tjandra N,Miethke T,Xiao TS

    更新日期:2013-04-23 00:00:00

  • Antibodies to liver cell adhesion molecule perturb inductive interactions and alter feather pattern and structure.

    abstract::Cell adhesion molecules (CAMs) may act as regulators of morphogenesis by constraining cell motion, forming borders, and controlling intercellular communications that lead to embryonic induction. This postulated causal role of CAMs in inductive events was tested here in an in vitro system of feather induction. In the d...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.83.21.8235

    authors: Gallin WJ,Chuong CM,Finkel LH,Edelman GM

    更新日期:1986-11-01 00:00:00

  • Sigma factors, asymmetry, and the determination of cell fate in Bacillus subtilis.

    abstract::Soon after the initiation of sporulation, Bacillus subtilis divides asymmetrically to produce sister cells that have very different developmental fates. Recently, it has been proposed that the differential gene expression which begins soon after this division is due to cell-specific activation of the transcription fac...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.9.3849

    authors: Lewis PJ,Partridge SR,Errington J

    更新日期:1994-04-26 00:00:00

  • Vinpocetine inhibits NF-kappaB-dependent inflammation via an IKK-dependent but PDE-independent mechanism.

    abstract::Inflammation is a hallmark of many diseases, such as atherosclerosis, chronic obstructive pulmonary disease, arthritis, infectious diseases, and cancer. Although steroids and cyclooxygenase inhibitors are effective antiinflammatory therapeutical agents, they may cause serious side effects. Therefore, developing unique...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0914414107

    authors: Jeon KI,Xu X,Aizawa T,Lim JH,Jono H,Kwon DS,Abe J,Berk BC,Li JD,Yan C

    更新日期:2010-05-25 00:00:00

  • On the dynamical basis of the classification of normal galaxies.

    abstract::Some realistic galaxy models have been found to support discrete unstable spiral modes. Here, through the study of the relevant physical mechanisms and an extensive numerical investigation of the properties of the dominant modes in a wide class of galactic equilibria, we show how spiral structures are excited with dif...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.12.3908

    authors: Haass J,Bertin G,Lin CC

    更新日期:1982-06-01 00:00:00

  • Chemoattraction of male gametes by a pheromone produced by female gametes of Chlamydomonas.

    abstract::In isogamous species of Chlamydomonas, such as Chlamydomonas reinhardtii and Chlamydomonas eugametos, the sexual process involves the use of flagella agglutinins by which the gametes of compatible strains adhere through chance encounter and ultimately pair and fuse to form zygotes. In a newly described heterogamous sp...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.2.641

    authors: Starr RC,Marner FJ,Jaenicke L

    更新日期:1995-01-17 00:00:00

  • Temperature dependence of the isotope chemistry of the heavy elements.

    abstract::The temperature coefficient of equilibrium isotope fractionation in the heavy elements is shown to be larger at high temperatures than that expected from the well-studied vibrational isotope effects. The difference in the isotopic behavior of the heavy elements as compared with the light elements is due to the large n...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.18.9393

    authors: Bigeleisen J

    更新日期:1996-09-03 00:00:00