Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum.

Abstract:

:Behavioral and neural evidence reveal a prospective goal-directed decision process that relies on mental simulation of the environment, and a retrospective habitual process that caches returns previously garnered from available choices. Artificial systems combine the two by simulating the environment up to some depth and then exploiting habitual values as proxies for consequences that may arise in the further future. Using a three-step task, we provide evidence that human subjects use such a normative plan-until-habit strategy, implying a spectrum of approaches that interpolates between habitual and goal-directed responding. We found that increasing time pressure led to shallower goal-directed planning, suggesting that a speed-accuracy tradeoff controls the depth of planning with deeper search leading to more accurate evaluation, at the cost of slower decision-making. We conclude that subjects integrate habit-based cached values directly into goal-directed evaluations in a normative manner.

authors

Keramati M,Smittenaar P,Dolan RJ,Dayan P

doi

10.1073/pnas.1609094113

subject

Has Abstract

pub_date

2016-11-08 00:00:00

pages

12868-12873

issue

45

eissn

0027-8424

issn

1091-6490

pii

1609094113

journal_volume

113

pub_type

杂志文章
  • Oxidative DNA damage is epigenetic by regulating gene transcription via base excision repair.

    abstract::Reactive oxygen species (ROS) have emerged as important cellular-signaling agents for cellular survival. Herein, we demonstrate that ROS-mediated oxidation of DNA to yield 8-oxo-7,8-dihydroguanine (OG) in gene promoters is a signaling agent for gene activation. Enhanced gene expression occurs when OG is formed in guan...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1619809114

    authors: Fleming AM,Ding Y,Burrows CJ

    更新日期:2017-03-07 00:00:00

  • Direct evidence for a predominantly exolytic processive mechanism for depolymerization of heparin-like glycosaminoglycans by heparinase I.

    abstract::Heparinase I from Flavobacterium heparinum has important uses for elucidating the complex sequence heterogeneity of heparin-like glycosaminoglycans (HLGAGs). Understanding the biological function of HLGAGs has been impaired by the limited methods for analysis of pure or mixed oligosaccharide fragments. Here, we use me...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.8.4182

    authors: Ernst S,Rhomberg AJ,Biemann K,Sasisekharan R

    更新日期:1998-04-14 00:00:00

  • Identification and modulation of a caveolae-dependent signal pathway that regulates plasminogen activator inhibitor-1 in insulin-resistant adipocytes.

    abstract::Plasminogen activator inhibitor-1 (PAI-1) plays an important role in the pathogenesis of obesity-driven type 2 diabetes mellitus and associated cardiovascular complications. Here, we show that perturbation of caveolar microdomains leads to insulin resistance and concomitant up-regulation of PAI-1 in 3T3L1 adipocytes. ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0405278101

    authors: Venugopal J,Hanashiro K,Yang ZZ,Nagamine Y

    更新日期:2004-12-07 00:00:00

  • In vivo antagonism of a T cell response by an endogenously expressed ligand.

    abstract::3.L2 T cell receptor transgenic T cells are activated by the 64-76 peptide of the mouse hemoglobin d beta chain [Hb(64-76)], and their response is antagonized by the position 72 alanine substitution of this peptide (A72). To test the effect of this altered peptide ligand (APL) on 3.L2 T cell function in vivo, a transg...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.24.14332

    authors: Basu D,Williams CB,Allen PM

    更新日期:1998-11-24 00:00:00

  • Empirical laws of survival and evolution: their universality and implications.

    abstract::Presented analysis of human and fly life tables proves that with the specified accuracy their entire survival and mortality curves are uniquely determined by a single point (e.g., by the birth mortality q(0)), according to the law, which is universal for species as remote as humans and flies. Mortality at any age decr...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.26.15368

    authors: Azbel' MY

    更新日期:1999-12-21 00:00:00

  • J protein cochaperone of the mitochondrial inner membrane required for protein import into the mitochondrial matrix.

    abstract::The major Hsp70 of the mitochondrial matrix (Ssc1 in yeast) is critically important for the translocation of proteins from the cytosol, across the mitochondrial inner membrane, and into the matrix. Tim44, a peripheral inner membrane protein with limited sequence similarity to the J domain of J-type cochaperones, tethe...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1936150100

    authors: D'Silva PD,Schilke B,Walter W,Andrew A,Craig EA

    更新日期:2003-11-25 00:00:00

  • Bacteria are different: observations, interpretations, speculations, and opinions about the mechanisms of adaptive evolution in prokaryotes.

    abstract::To some extent, the genetic theory of adaptive evolution in bacteria is a simple extension of that developed for sexually reproducing eukaryotes. In other, fundamental ways, the process of adaptive evolution in bacteria is quantitatively and qualitatively different from that of organisms for which recombination is an ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章,评审

    doi:10.1073/pnas.97.13.6981

    authors: Levin BR,Bergstrom CT

    更新日期:2000-06-20 00:00:00

  • Membrane localization of MinD is mediated by a C-terminal motif that is conserved across eubacteria, archaea, and chloroplasts.

    abstract::MinD is a widely conserved ATPase that has been demonstrated to play a pivotal role in selection of the division site in eubacteria and chloroplasts. It is a member of the large ParA superfamily of ATPases that are characterized by a deviant Walker-type ATP-binding motif. MinD localizes to the cytoplasmic face of the ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.232590599

    authors: Szeto TH,Rowland SL,Rothfield LI,King GF

    更新日期:2002-11-26 00:00:00

  • De novo expression of intercellular-adhesion molecule 1 in melanoma correlates with increased risk of metastasis.

    abstract::The 89-kDa cell surface glycoprotein, P3.58, is detectable on advanced human melanomas in situ but not on benign melanocytes or early melanomas. cDNA cloning of P3.58 from melanoma cells was accomplished by screening a lambda zap expression vector library with monoclonal antibodies produced against the denatured antig...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.86.2.641

    authors: Johnson JP,Stade BG,Holzmann B,Schwäble W,Riethmüller G

    更新日期:1989-01-01 00:00:00

  • Regulation of ROMK1 K+ channel activity involves phosphorylation processes.

    abstract::An inwardly rectifying, ATP-regulated K+ channel with a distinctive molecular architecture, ROMK1, was recently cloned from rat kidney. Using patch clamp techniques, we have investigated the regulation of ROMK1 with particular emphasis on phosphorylation/dephosphorylation processes. Spontaneous channel rundown occurre...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.17.8077

    authors: McNicholas CM,Wang W,Ho K,Hebert SC,Giebisch G

    更新日期:1994-08-16 00:00:00

  • The solubilization of model Alzheimer tangles: reversing the beta-sheet conformation induced by aluminum with silicates.

    abstract::Neurofibrillary tangles are one of two lesions found in the brain of Alzheimer disease victims. With synthetic peptide fragments of human neurofilament NF-M17 (Glu-Glu-Lys-Gly-Lys-Ser-Pro- Val-Pro-Lys-Ser-Pro-Val-Glu-Glu-Lys-Gly, phosphorylated and unphosphorylated), CD studies were done to examine the effect of sodiu...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.23.11232

    authors: Fasman GD,Moore CD

    更新日期:1994-11-08 00:00:00

  • A human peripheral blood monocyte-derived subset acts as pluripotent stem cells.

    abstract::We have identified, cultured, characterized, and propagated adult pluripotent stem cells (PSC) from a subset of human peripheral blood monocytes. These cells, which in appearance resemble fibroblasts, expand in the presence of macrophage colony-stimulating factor and display monocytic and hematopoietic stem cell marke...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0536882100

    authors: Zhao Y,Glesne D,Huberman E

    更新日期:2003-03-04 00:00:00

  • What drives the translocation of proteins?

    abstract::We propose that protein translocation across membranes is driven by biased random thermal motion. This "Brownian ratchet" mechanism depends on chemical asymmetries between the cis and trans sides of the membrane. Several mechanisms could contribute to rectifying the thermal motion of the protein, such as binding and d...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.89.9.3770

    authors: Simon SM,Peskin CS,Oster GF

    更新日期:1992-05-01 00:00:00

  • A pointwise estimate for fractionary derivatives with applications to partial differential equations.

    abstract::This article emphasizes the role played by a remarkable pointwise inequality satisfied by fractionary derivatives in order to obtain maximum principles and Lp-decay of solutions of several interesting partial differential equations. In particular, there are applications to quasigeostrophic flows, in two space variable...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2036515100

    authors: Cordoba A,Cordoba D

    更新日期:2003-12-23 00:00:00

  • The human sex-reversing ATRX gene has a homologue on the marsupial Y chromosome, ATRY: implications for the evolution of mammalian sex determination.

    abstract::Mutations in the ATRX gene on the human X chromosome cause X-linked alpha-thalassemia and mental retardation. XY patients with deletions or mutations in this gene display varying degrees of sex reversal, implicating ATRX in the development of the human testis. To explore further the role of ATRX in mammalian sex diffe...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.230424497

    authors: Pask A,Renfree MB,Marshall Graves JA

    更新日期:2000-11-21 00:00:00

  • Translational frameshifting generates the gamma subunit of DNA polymerase III holoenzyme.

    abstract::The dnaX gene (previously called dnaZX) of Escherichia coli has only one open reading frame for a 71-kDa polypeptide from which two distinct DNA polymerase III holoenzyme subunits, tau (71 kDa) and gamma (47 kDa), are produced. To determine how the gamma subunit is generated, we examined the influence of mutations in ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.7.2516

    authors: Tsuchihashi Z,Kornberg A

    更新日期:1990-04-01 00:00:00

  • F1-ATPase conformational cycle from simultaneous single-molecule FRET and rotation measurements.

    abstract::Despite extensive studies, the structural basis for the mechanochemical coupling in the rotary molecular motor F1-ATPase (F1) is still incomplete. We performed single-molecule FRET measurements to monitor conformational changes in the stator ring-α3β3, while simultaneously monitoring rotations of the central shaft-γ. ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1524720113

    authors: Sugawa M,Okazaki K,Kobayashi M,Matsui T,Hummer G,Masaike T,Nishizaka T

    更新日期:2016-05-24 00:00:00

  • An alternative pathway for rod signals in the rodent retina: rod photoreceptors, cone bipolar cells, and the localization of glutamate receptors.

    abstract::In the mammalian retina, extensive processing of spatiotemporal and chromatic information occurs. One key principle in signal transfer through the retina is parallel processing. Two of these parallel pathways are the ON- and OFF-channels transmitting light and dark signals. This dual system is created in the outer ple...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.24.14130

    authors: Hack I,Peichl L,Brandstätter JH

    更新日期:1999-11-23 00:00:00

  • Bivalent domains enforce transcriptional memory of DNA methylated genes in cancer cells.

    abstract::Silencing of multiple cancer-related genes is associated with de novo methylation of linked CpG islands. Additionally, bivalent histone modification profiles characterized by the juxtaposition of active and inactive histone marks have been observed in genes that become hypermethylated in cancer. It is unknown how thes...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0810133105

    authors: Rodriguez J,Muñoz M,Vives L,Frangou CG,Groudine M,Peinado MA

    更新日期:2008-12-16 00:00:00

  • Telomerase activity in the regenerative basal layer of the epidermis inhuman skin and in immortal and carcinoma-derived skin keratinocytes.

    abstract::Cellular senescence is defined by the limited proliferative capacity of normal cultured cells. Immortal cells overcome this regulation and proliferate indefinitively. One step in the immortalization process may be reactivation of telomerase activity, a ribonucleoprotein complex, which, by de novo synthesized telomeric...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.13.6476

    authors: Härle-Bachor C,Boukamp P

    更新日期:1996-06-25 00:00:00

  • Genome-wide RNAi screening identifies protein damage as a regulator of osmoprotective gene expression.

    abstract::The detection, stabilization, and repair of stress-induced damage are essential requirements for cellular life. All cells respond to osmotic stress-induced water loss with increased expression of genes that mediate accumulation of organic osmolytes, solutes that function as chemical chaperones and restore osmotic home...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0602987103

    authors: Lamitina T,Huang CG,Strange K

    更新日期:2006-08-08 00:00:00

  • DNA bending induced by Cro protein binding as demonstrated by gel electrophoresis.

    abstract::We report an approach for studying protein-induced DNA bends in solution that is based on measuring the sizes of circular DNA molecules by using two-dimensional gel electrophoresis. These circular fragments are obtained by ligating short synthetic oligonucleotides containing a protein-recognition region in the presenc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.88.12.5331

    authors: Lyubchenko Y,Shlyakhtenko L,Chernov B,Harrington RE

    更新日期:1991-06-15 00:00:00

  • Molecular cloning and amplification of the adenylate cyclase gene.

    abstract::A segment of DNA containing cya, the gene for adenylate cyclase [ATP pyrophosphate-lyase (cyclizing), EC 4.6.1.1], has been isolated from Salmonella typhimurium. The phage lambda gt4 was used as a cloning vector and adenylate cyclase-positive hybrid phages were isolated that complemented adenylate cyclase-negative bac...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.8.4684

    authors: Wang JY,Clegg DO,Koshland DE Jr

    更新日期:1981-08-01 00:00:00

  • TRPM8 activation attenuates inflammatory responses in mouse models of colitis.

    abstract::Transient Receptor Potential Melastatin-8 (TRPM8), a recently identified member of the transient receptor potential (TRP) family of ion channels, is activated by mild cooling and by chemical compounds such as the supercooling agent, icilin. Since cooling, possibly involving TRPM8 stimulation, diminishes injury-induced...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1217431110

    authors: Ramachandran R,Hyun E,Zhao L,Lapointe TK,Chapman K,Hirota CL,Ghosh S,McKemy DD,Vergnolle N,Beck PL,Altier C,Hollenberg MD

    更新日期:2013-04-30 00:00:00

  • Peroxisome biogenesis in the yeast Hansenula polymorpha is controlled by a complex set of interacting gene products.

    abstract::We have studied the genetic interactions between mutant alleles in 12 genes, designated PER1-PER12, which are essential for peroxisome biogenesis in the yeast Hansenula polymorpha. Recessive mutations in any of these genes determined three different morphological phenotypes: (i) complete absence of peroxisomes (Per-);...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.90.16.7470

    authors: Titorenko VI,Waterham HR,Cregg JM,Harder W,Veenhuis M

    更新日期:1993-08-15 00:00:00

  • On the fluctuations of sums of independent random variables.

    abstract::If X(1), X(2),... are independent random variables with zero expectation and finite variances, the cumulative sums S(n) are, on the average, of the order of magnitude S(n), where S(n) (2) = E(S(n) (2)). The occasional maxima of the ratios S(n)/S(n) are surprisingly large and the problem is to estimate the extent of th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.63.3.637

    authors: Feller W

    更新日期:1969-07-01 00:00:00

  • IRAK-1 bypasses priming and directly links TLRs to rapid NLRP3 inflammasome activation.

    abstract::Pathogenic infections and tissue injuries trigger the assembly of inflammasomes, cytosolic protein complexes that activate caspase-1, leading to cleavage of pro-IL-1β and pro-IL-18 and to pyroptosis, a proinflammatory cell death program. Although microbial recognition by Toll-like receptors (TLRs) is known to induce t...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1320294111

    authors: Lin KM,Hu W,Troutman TD,Jennings M,Brewer T,Li X,Nanda S,Cohen P,Thomas JA,Pasare C

    更新日期:2014-01-14 00:00:00

  • Two-dimensional infrared spectra reveal relaxation of the nonnucleoside inhibitor TMC278 complexed with HIV-1 reverse transcriptase.

    abstract::The two nitrile groups at the wings of the nonnucleoside HIV-1 reverse transcriptase (RT) inhibitor TMC278 are both identified in high-sensitivity 2D IR spectroscopy experiments of the HIV-1 RT/TMC278 complex. The vibrational spectra indicate that the two arms of the inhibitor sense quite different environments within...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0709320104

    authors: Fang C,Bauman JD,Das K,Remorino A,Arnold E,Hochstrasser RM

    更新日期:2008-02-05 00:00:00

  • Chlorophyll and carotenoid binding in a simple red algal light-harvesting complex crosses phylogenetic lines.

    abstract::The membrane proteins of peripheral light-harvesting complexes (LHCs) bind chlorophylls and carotenoids and transfer energy to the reaction centers for photosynthesis. LHCs of chlorophytes, chromophytes, dinophytes, and rhodophytes are similar in that they have three transmembrane regions and several highly conserved ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.031587198

    authors: Grabowski B,Cunningham FX Jr,Gantt E

    更新日期:2001-02-27 00:00:00

  • The solution structure of the N-terminal domain of E3L shows a tyrosine conformation that may explain its reduced affinity to Z-DNA in vitro.

    abstract::The N-terminal domain of the vaccinia virus protein E3L (Z alpha(E3L)) is essential for full viral pathogenicity in mice. It has sequence similarity to the high-affinity human Z-DNA-binding domains Z alpha(ADAR1) and Z alpha(DLM1). Here, we report the solution structure of Z alpha(E3L) and the chemical shift map of it...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0308612100

    authors: Kahmann JD,Wecking DA,Putter V,Lowenhaupt K,Kim YG,Schmieder P,Oschkinat H,Rich A,Schade M

    更新日期:2004-03-02 00:00:00