Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy.

Abstract:

:Decision-making in a natural environment depends on a hierarchy of interacting decision processes. A high-level strategy guides ongoing choices, and the outcomes of those choices determine whether or not the strategy should change. When the right decision strategy is uncertain, as in most natural settings, feedback becomes ambiguous because negative outcomes may be due to limited information or bad strategy. Disambiguating the cause of feedback requires active inference and is key to updating the strategy. We hypothesize that the expected accuracy of a choice plays a crucial rule in this inference, and setting the strategy depends on integration of outcome and expectations across choices. We test this hypothesis with a task in which subjects report the net direction of random dot kinematograms with varying difficulty while the correct stimulus-response association undergoes invisible and unpredictable switches every few trials. We show that subjects treat negative feedback as evidence for a switch but weigh it with their expected accuracy. Subjects accumulate switch evidence (in units of log-likelihood ratio) across trials and update their response strategy when accumulated evidence reaches a bound. A computational framework based on these principles quantitatively explains all aspects of the behavior, providing a plausible neural mechanism for the implementation of hierarchical multiscale decision processes. We suggest that a similar neural computation-bounded accumulation of evidence-underlies both the choice and switches in the strategy that govern the choice, and that expected accuracy of a choice represents a key link between the levels of the decision-making hierarchy.

authors

Purcell BA,Kiani R

doi

10.1073/pnas.1524685113

subject

Has Abstract

pub_date

2016-08-02 00:00:00

pages

E4531-40

issue

31

eissn

0027-8424

issn

1091-6490

pii

1524685113

journal_volume

113

pub_type

杂志文章
  • Structural analysis of a carcinogen-induced genomic rearrangement event.

    abstract::We have explored the mechanism of genomic rearrangement in a hamster fibroblast cell culture system in which rearrangements are induced 5' to the endogenous thymidine kinase gene by chemical carcinogen treatment. The wild-type region around one rearrangement breakpoint was cloned and sequenced. With this sequence info...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.89.3.942

    authors: Barr FG,Davis RJ,Eichenfield L,Emanuel BS

    更新日期:1992-02-01 00:00:00

  • Kinase-dependent structural role of DNA-PKcs during immunoglobulin class switch recombination.

    abstract::The catalytic subunit of DNA-dependent protein kinase (DNA-PKcs) is a classical nonhomologous end-joining (cNHEJ) factor. Loss of DNA-PKcs diminished mature B cell class switch recombination (CSR) to other isotypes, but not IgG1. Here, we show that expression of the kinase-dead DNA-PKcs (DNA-PKcsKD/KD ) severely compr...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1808490115

    authors: Crowe JL,Shao Z,Wang XS,Wei PC,Jiang W,Lee BJ,Estes VM,Alt FW,Zha S

    更新日期:2018-08-21 00:00:00

  • Genome-wide identification of tissue-specific enhancers in the Ciona tadpole.

    abstract::Less than 100 cis-regulatory DNAs have been characterized in the context of transgenic metazoan embryos. Here we investigate the feasibility of conducting a genome-wide search for tissue-specific enhancers in the ascidian Ciona intestinalis. A total of 138 random genomic DNA fragments with an average size of 1.7 kb we...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.052024999

    authors: Harafuji N,Keys DN,Levine M

    更新日期:2002-05-14 00:00:00

  • The Drosophila homologue of vertebrate myogenic-determination genes encodes a transiently expressed nuclear protein marking primary myogenic cells.

    abstract::We have isolated a cDNA clone, called Dmyd for Drosophila myogenic-determination gene, that encodes a protein with structural and functional characteristics similar to the members of the vertebrate MyoD family. Dmyd clone encodes a polypeptide of 332 amino acids with 82% identity to MyoD in the 41 amino acids of the p...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.88.9.3782

    authors: Paterson BM,Walldorf U,Eldridge J,Dübendorfer A,Frasch M,Gehring WJ

    更新日期:1991-05-01 00:00:00

  • Heritable, population-wide damage to cells as the driving force of neoplastic transformation.

    abstract::Prolonged incubation of NIH 3T3 cells under the growth constraint of confluence results in the death of some cells in a manner suggestive of apoptosis. Successive rounds of prolonged incubation at confluence of the surviving cells produce increasing neoplastic transformation in the form of increments in saturation den...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.11.4843

    authors: Rubin H,Yao A,Chow M

    更新日期:1995-05-23 00:00:00

  • Linkage between retinal ganglion cell density and the nonuniform spatial integration across the visual field.

    abstract::The ability to integrate visual information over space is a fundamental component of human pattern vision. Regardless of whether it is for detecting luminance contrast or for recognizing objects in a cluttered scene, the position of the target in the visual field governs the size of a window within which visual inform...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1817076116

    authors: Kwon M,Liu R

    更新日期:2019-02-26 00:00:00

  • Ubiquitin degradation with its substrate, or as a monomer in a ubiquitination-independent mode, provides clues to proteasome regulation.

    abstract::The mechanisms that regulate the ubiquitin (Ub)-proteasome system's own components, although critically important, are largely unknown. Ub, a principal component of the system, must be maintained at adequate levels to support cellular homeostasis under basal and stressed conditions. It was suggested that Ub is degrade...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0905746106

    authors: Shabek N,Herman-Bachinsky Y,Ciechanover A

    更新日期:2009-07-21 00:00:00

  • Tertiary structure of apolipoprotein A-I in nascent high-density lipoproteins.

    abstract::Understanding the function of high-density lipoprotein (HDL) requires detailed knowledge of the structure of its primary protein, apolipoprotein A-I (APOA1). However, APOA1 flexibility and HDL heterogeneity have confounded decades of efforts to determine high-resolution structures and consistent models. Here, molecula...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1721181115

    authors: Pourmousa M,Song HD,He Y,Heinecke JW,Segrest JP,Pastor RW

    更新日期:2018-05-15 00:00:00

  • Evolution of behavior by density-dependent natural selection.

    abstract::Theories of density-dependent natural selection predict that evolution should favor those genotypes with the highest per capita rates of population growth under the current density conditions. These theories are silent about the mechanisms that may give rise to these increases in density-dependent growth rates. We hav...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.88.23.10905

    authors: Guo PZ,Mueller LD,Ayala FJ

    更新日期:1991-12-01 00:00:00

  • Polarons in DNA.

    abstract::Many experiments have been done to determine how far and how freely holes can move along the stack of base pairs in DNA. The results of these experiments are usually described in terms of a parameter beta under the assumption that it describes an exponential decay with distance. The reported values range from beta < 0...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.050074497

    authors: Conwell EM,Rakhmanova SV

    更新日期:2000-04-25 00:00:00

  • Amplification and deregulation of MYC following Epstein-Barr virus infection of a human B-cell line.

    abstract::In Epstein-Barr virus (EBV)-positive Burkitt lymphoma (BL) the role of EBV in the translocation and deregulation of the MYC oncogene remains unknown. By utilizing an EBV-negative BL (BJAB) and several EBV-positive sublines derived from it by in vitro infection, it was possible to show that the presence of the virus wa...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.84.16.5838

    authors: Lacy J,Summers WP,Watson M,Glazer PM,Summers WC

    更新日期:1987-08-01 00:00:00

  • A de novo missense mutation of the beta subunit of the epithelial sodium channel causes hypertension and Liddle syndrome, identifying a proline-rich segment critical for regulation of channel activity.

    abstract::Liddle syndrome is a mendelian form of hypertension characterized by constitutively elevated renal Na reabsorption that can result from activating mutations in the beta or gamma subunit of the epithelial Na channel. All reported mutations have deleted the last 45-76 normal amino acids from the cytoplasmic C terminus o...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.25.11495

    authors: Hansson JH,Schild L,Lu Y,Wilson TA,Gautschi I,Shimkets R,Nelson-Williams C,Rossier BC,Lifton RP

    更新日期:1995-12-05 00:00:00

  • Heme oxygenase induction mediates the photoimmunoprotective activity of UVA radiation in the mouse.

    abstract::In contrast to the immunosuppressive potential of UVB (280-320 nm) radiation in experimental animals and humans, UVA (320-400 nm) radiation at environmentally relevant doses appears to be immunologically inert. However, such exposure to UVA radiation has been observed unexpectedly to induce resistance to UVB-induced i...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.16.9317

    authors: Reeve VE,Tyrrell RM

    更新日期:1999-08-03 00:00:00

  • Specific disruption of vimentin filament organization in monkey kidney CV-1 cells by diphtheria toxin, exotoxin A, and cycloheximide.

    abstract::We have examined the effect of diphtheria toxin, Pseudomonas aeruginosa exotoxin A, and cycloheximide on the CV-1 cell cytoskeleton. Within a few hours after producing an inhibition of cellular protein synthesis, all these agents specifically disrupted the organization of the vimentin filament system with no discernab...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.77.12.7267

    authors: Sharpe AH,Chen LB,Murphy JR,Fields BN

    更新日期:1980-12-01 00:00:00

  • Physical interaction between the serotonin transporter and neuronal nitric oxide synthase underlies reciprocal modulation of their activity.

    abstract::The spatiotemporal regulation of neurotransmitter transporters involves proteins that interact with their intracellular domains. Using a proteomic approach, we identified several proteins that interact with the C terminus of the serotonin transporter (SERT). These included neuronal nitric oxide synthase (nNOS), a PSD-...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0610964104

    authors: Chanrion B,Mannoury la Cour C,Bertaso F,Lerner-Natoli M,Freissmuth M,Millan MJ,Bockaert J,Marin P

    更新日期:2007-05-08 00:00:00

  • Reducing the number of inferior treatments in clinical trials.

    abstract::In clinical trials comparing two treatments, one would often like to control the probability of erroneous decision while minimizing not the total sample size but the number of patients given the inferior treatment. To do this obviously requires that one use a datadependent allocation rule for the two treatments rather...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 临床试验,杂志文章

    doi:10.1073/pnas.69.10.2993

    authors: Flehinger BJ,Louis TA,Robbins H,Singer BH

    更新日期:1972-10-01 00:00:00

  • Targeted overexpression of protein kinase C beta2 isoform in myocardium causes cardiomyopathy.

    abstract::Increased cardiovascular mortality occurs in diabetic patients with or without coronary artery disease and is attributed to the presence of diabetic cardiomyopathy. One potential mechanism is hyperglycemia that has been reported to activate protein kinase C (PKC), preferentially the beta isoform, which has been associ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.17.9320

    authors: Wakasaki H,Koya D,Schoen FJ,Jirousek MR,Ways DK,Hoit BD,Walsh RA,King GL

    更新日期:1997-08-19 00:00:00

  • Synthesis of Rauscher murine leukemia virus-specific polypeptides in vitro.

    abstract::The biosynthesis of specific polypeptides directed by purified viral messenger RNA from JLS-V9 cells infected with Rauscher leukemia virus has been studied in a rabbit reticulocyte lysate. The 35S viral mRNA gives rise to two major products of 65,000 and 72,000 molecular weight. The synthesis of specific polypeptides ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.73.2.356

    authors: Gielkens AL,Van Zaane D,Bloemers HP,Bloemendal H

    更新日期:1976-02-01 00:00:00

  • Fixation and fate of C and N in the cyanobacterium Trichodesmium using nanometer-scale secondary ion mass spectrometry.

    abstract::The marine cyanobacterium Trichodesmium is ubiquitous in tropical and subtropical seas and is an important contributor to global N and C cycling. We sought to characterize metabolic uptake patterns in individual Trichodesmium IMS-101 cells by quantitatively imaging (13)C and (15)N uptake with high-resolution secondary...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0810547106

    authors: Finzi-Hart JA,Pett-Ridge J,Weber PK,Popa R,Fallon SJ,Gunderson T,Hutcheon ID,Nealson KH,Capone DG

    更新日期:2009-04-14 00:00:00

  • Mutations in the telomerase component NHP2 cause the premature ageing syndrome dyskeratosis congenita.

    abstract::Dyskeratosis congenita is a premature aging syndrome characterized by muco-cutaneous features and a range of other abnormalities, including early greying, dental loss, osteoporosis, and malignancy. Dyskeratosis congenita cells age prematurely and have very short telomeres. Patients have mutations in genes that encode ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0800042105

    authors: Vulliamy T,Beswick R,Kirwan M,Marrone A,Digweed M,Walne A,Dokal I

    更新日期:2008-06-10 00:00:00

  • Amplification of DNA from preserved specimens shows blowflies were preadapted for the rapid evolution of insecticide resistance.

    abstract::Mutations of esterase 3 confer two forms of organophosphate resistance on contemporary Australasian Lucilia cuprina. One form, called diazinon resistance, is slightly more effective against commonly used insecticides and is now more prevalent than the other form, called malathion resistance. We report here that the si...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0509590103

    authors: Hartley CJ,Newcomb RD,Russell RJ,Yong CG,Stevens JR,Yeates DK,La Salle J,Oakeshott JG

    更新日期:2006-06-06 00:00:00

  • The Arabidopsis SUMO E3 ligase SIZ1 controls phosphate deficiency responses.

    abstract::Plants sense phosphate (Pi) deficiency and initiate signaling that controls adaptive responses necessary for Pi acquisition. Herein, evidence establishes that AtSIZ1 is a plant small ubiquitin-like modifier (SUMO) E3 ligase and is a focal controller of Pi starvation-dependent responses. T-DNA insertional mutated allel...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0500778102

    authors: Miura K,Rus A,Sharkhuu A,Yokoi S,Karthikeyan AS,Raghothama KG,Baek D,Koo YD,Jin JB,Bressan RA,Yun DJ,Hasegawa PM

    更新日期:2005-05-24 00:00:00

  • DNA methylation in the gene body influences MeCP2-mediated gene repression.

    abstract::Rett syndrome is a severe neurodevelopmental disorder caused by mutations in the methyl-CpG binding protein gene (MECP2). MeCP2 is a methyl-cytosine binding protein that is proposed to function as a transcriptional repressor. However, multiple gene expression studies comparing wild-type and MeCP2-deficient neurons hav...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1618737114

    authors: Kinde B,Wu DY,Greenberg ME,Gabel HW

    更新日期:2016-12-27 00:00:00

  • 15N NMR study of a mixture of uniformly labeled tRNAs.

    abstract::15N NMR spectra were taken of 15N-enriched tRNA extracted from bakers yeast; ammonium sulfate was used as a nitrogen source. The increase in the degree of denaturation of tRNA, which occurs with increase in temperature from 30 degrees C to 70 degrees C, resulted in no large changes in 15N chemical shifts at acidic and...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.16.4834

    authors: Gonnella NC,Birdseye TR,Nee M,Roberts JD

    更新日期:1982-08-01 00:00:00

  • Infection of cultured central nervous system neurons with a defective herpes simplex virus 1 vector results in stable expression of Escherichia coli beta-galactosidase.

    abstract::We have developed a defective herpes simplex virus (HSV) vector system that permits the introduction of virtually any gene into mammalian central nervous system neurons. The prototype vector, pHSVlac, contains a transcription unit that places the Escherichia coli lacZ gene under the control of the HSV-1 immediate earl...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.3.1149

    authors: Geller AI,Freese A

    更新日期:1990-02-01 00:00:00

  • Confronting and resolving competing values behind conservation objectives.

    abstract::Diverse motivations for preserving nature both inspire and hinder its conservation. Optimal conservation strategies may differ radically depending on the objective. For example, creating nature reserves may prevent extinctions through protecting severely threatened species, whereas incentivizing farmland hedgerows may...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1504788112

    authors: Karp DS,Mendenhall CD,Callaway E,Frishkoff LO,Kareiva PM,Ehrlich PR,Daily GC

    更新日期:2015-09-01 00:00:00

  • Genome sequencing and comparative analysis of Saccharomyces cerevisiae strain YJM789.

    abstract::We sequenced the genome of Saccharomyces cerevisiae strain YJM789, which was derived from a yeast isolated from the lung of an AIDS patient with pneumonia. The strain is used for studies of fungal infections and quantitative genetics because of its extensive phenotypic differences to the laboratory reference strain, i...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0701291104

    authors: Wei W,McCusker JH,Hyman RW,Jones T,Ning Y,Cao Z,Gu Z,Bruno D,Miranda M,Nguyen M,Wilhelmy J,Komp C,Tamse R,Wang X,Jia P,Luedi P,Oefner PJ,David L,Dietrich FS,Li Y,Davis RW,Steinmetz LM

    更新日期:2007-07-31 00:00:00

  • Spatially localized generation of nucleotide sequence-specific DNA damage.

    abstract::Psoralens linked to triplex-forming oligonucleotides (psoTFOs) have been used in conjunction with laser-induced two-photon excitation (TPE) to damage a specific DNA target sequence. To demonstrate that TPE can initiate photochemistry resulting in psoralen-DNA photoadducts, target DNA sequences were incubated with psoT...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.201409698

    authors: Oh DH,King BA,Boxer SG,Hanawalt PC

    更新日期:2001-09-25 00:00:00

  • Anthropogenic strath terrace formation caused by reduced sediment retention.

    abstract::Across North America, human activities have been shown to cause river incision into unconsolidated alluvium. Human-caused erosion through bedrock, however, has only been observed in local and isolated outcrops. Here, we test whether splash-dam logging, which decreased in-stream alluvial cover by removing much of the a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1814627116

    authors: Schanz SA,Montgomery DR,Collins BD

    更新日期:2019-04-30 00:00:00

  • The law of perceptual stability: abastract foundations.

    abstract::Confronted with an object of perception, an individual will spontaneously try to identify unambiguously and consistently all its parts; except in rare instances of "illusory phenomena," he will immediately succeed. This elementary fact is formalized in a law of visual perception. It is used to define sets of stable st...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.4.2049

    authors: Shiman LG

    更新日期:1978-04-01 00:00:00