Neural signature of fictive learning signals in a sequential investment task.

Abstract:

:Reinforcement learning models now provide principled guides for a wide range of reward learning experiments in animals and humans. One key learning (error) signal in these models is experiential and reports ongoing temporal differences between expected and experienced reward. However, these same abstract learning models also accommodate the existence of another class of learning signal that takes the form of a fictive error encoding ongoing differences between experienced returns and returns that "could-have-been-experienced" if decisions had been different. These observations suggest the hypothesis that, for all real-world learning tasks, one should expect the presence of both experiential and fictive learning signals. Motivated by this possibility, we used a sequential investment game and fMRI to probe ongoing brain responses to both experiential and fictive learning signals generated throughout the game. Using a large cohort of subjects (n = 54), we report that fictive learning signals strongly predict changes in subjects' investment behavior and correlate with fMRI signals measured in dopaminoceptive structures known to be involved in valuation and choice.

authors

Lohrenz T,McCabe K,Camerer CF,Montague PR

doi

10.1073/pnas.0608842104

subject

Has Abstract

pub_date

2007-05-29 00:00:00

pages

9493-8

issue

22

eissn

0027-8424

issn

1091-6490

pii

0608842104

journal_volume

104

pub_type

杂志文章
  • Reorganization of an arid ecosystem in response to recent climate change.

    abstract::Natural ecosystems contain many individuals and species interacting with each other and with their abiotic environment. Such systems can be expected to exhibit complex dynamics in which small perturbations can be amplified to cause large changes. Here, we document the reorganization of an arid ecosystem that has occur...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.18.9729

    authors: Brown JH,Valone TJ,Curtin CG

    更新日期:1997-09-02 00:00:00

  • Binding of RNA template to a complex of HIV-1 reverse transcriptase/primer/template.

    abstract::HIV-1 reverse transcriptase (RT) catalyzes the synthesis of DNA from DNA or RNA templates. During this process, it must transfer its primer from one template to another RNA or DNA template. Binary complexes made of RT and a primer/template bind an additional single-stranded RNA molecule of the same nucleotide sequence...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.21.11279

    authors: Canard B,Sarfati R,Richardson CC

    更新日期:1997-10-14 00:00:00

  • Maintenance of pre-mRNA secondary structure by epistatic selection.

    abstract::Linkage disequilibrium between polymorphisms in a natural population may result from various evolutionary forces, including random genetic drift due to sampling of gametes during reproduction, restricted migration between subpopulations in a subdivided population, or epistatic selection. In this report, we present evi...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.20.9047

    authors: Kirby DA,Muse SV,Stephan W

    更新日期:1995-09-26 00:00:00

  • Sinuous flow in metals.

    abstract::Annealed metals are surprisingly difficult to cut, involving high forces and an unusually thick "chip." This anomaly has long been explained, based on ex situ observations, using a model of smooth plastic flow with uniform shear to describe material removal by chip formation. Here we show that this phenomenon is actua...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1509165112

    authors: Yeung H,Viswanathan K,Compton WD,Chandrasekar S

    更新日期:2015-08-11 00:00:00

  • grassy tillers1 promotes apical dominance in maize and responds to shade signals in the grasses.

    abstract::The shape of a plant is largely determined by regulation of lateral branching. Branching architecture can vary widely in response to both genotype and environment, suggesting regulation by a complex interaction of autonomous genetic factors and external signals. Tillers, branches initiated at the base of grass plants,...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1102819108

    authors: Whipple CJ,Kebrom TH,Weber AL,Yang F,Hall D,Meeley R,Schmidt R,Doebley J,Brutnell TP,Jackson DP

    更新日期:2011-08-16 00:00:00

  • Dpb11, which interacts with DNA polymerase II(epsilon) in Saccharomyces cerevisiae, has a dual role in S-phase progression and at a cell cycle checkpoint.

    abstract::DPB11, a gene that suppresses mutations in two essential subunits of Saccharomyces cerevisiae DNA polymerase II(epsilon) encoded by POL2 and DPB2, was isolated on a multicopy plasmid. The nucleotide sequence of the DPB11 gene revealed an open reading frame predicting an 87-kDa protein. This protein is homologous to th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.25.11791

    authors: Araki H,Leem SH,Phongdara A,Sugino A

    更新日期:1995-12-05 00:00:00

  • Net charge per residue modulates conformational ensembles of intrinsically disordered proteins.

    abstract::Intrinsically disordered proteins (IDPs) adopt heterogeneous ensembles of conformations under physiological conditions. Understanding the relationship between amino acid sequence and conformational ensembles of IDPs can help clarify the role of disorder in physiological function. Recent studies revealed that polar IDP...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0911107107

    authors: Mao AH,Crick SL,Vitalis A,Chicoine CL,Pappu RV

    更新日期:2010-05-04 00:00:00

  • Scaling regions for food web properties.

    abstract::The robustness of eight common food web properties is examined with respect to web size. We show that the current controversy concerning the scale dependence or scale invariance of these properties can be resolved by accounting for scaling constraints introduced by webs of very small size. We demonstrate statistically...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.4.1247

    authors: Bersier LF,Sugihara G

    更新日期:1997-02-18 00:00:00

  • Signal transduction by activated mNotch: importance of proteolytic processing and its regulation by the extracellular domain.

    abstract::Previous studies imply that the intracellular domain of Notch1 must translocate to the nucleus for its activity. In this study, we demonstrate that a mNotch1 mutant protein that lacks its extracellular domain but retains its membrane-spanning region becomes proteolytically processed on its intracellular surface and, a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.4.1683

    authors: Kopan R,Schroeter EH,Weintraub H,Nye JS

    更新日期:1996-02-20 00:00:00

  • Repeated challenge with prion disease: the risk of infection and impact on incubation period.

    abstract::Natural exposure to prion disease is likely to occur throughout successive challenges, yet most experiments focus on single large doses of infectious material. We analyze the results from an experiment in which rodents were exposed to multiple doses of feed contaminated with the scrapie agent. We formally define hypot...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1833677100

    authors: Gravenor MB,Stallard N,Curnow R,McLean AR

    更新日期:2003-09-16 00:00:00

  • Ultrathin dendrimer-graphene oxide composite film for stable cycling lithium-sulfur batteries.

    abstract::Lithium-sulfur batteries (Li-S batteries) have attracted intense interest because of their high specific capacity and low cost, although they are still hindered by severe capacity loss upon cycling caused by the soluble lithium polysulfide intermediates. Although many structure innovations at the material and device l...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1620809114

    authors: Liu W,Jiang J,Yang KR,Mi Y,Kumaravadivel P,Zhong Y,Fan Q,Weng Z,Wu Z,Cha JJ,Zhou H,Batista VS,Brudvig GW,Wang H

    更新日期:2017-04-04 00:00:00

  • Method to extract multiple states in F1-ATPase rotation experiments from jump distributions.

    abstract::A method is proposed for analyzing fast (10 μs) single-molecule rotation trajectories in F1 adenosinetriphosphatase ([Formula: see text]-ATPase). This method is based on the distribution of jumps in the rotation angle that occur in the transitions during the steps between subsequent catalytic dwells. The method is com...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1915314116

    authors: Volkán-Kacsó S,Le LQ,Zhu K,Su H,Marcus RA

    更新日期:2019-12-17 00:00:00

  • Mouse lipin-1 and lipin-2 cooperate to maintain glycerolipid homeostasis in liver and aging cerebellum.

    abstract::The three lipin phosphatidate phosphatase (PAP) enzymes catalyze a step in glycerolipid biosynthesis, the conversion of phosphatidate to diacylglycerol. Lipin-1 is critical for lipid synthesis and homeostasis in adipose tissue, liver, muscle, and peripheral nerves. Little is known about the physiological role of lipin...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1205221109

    authors: Dwyer JR,Donkor J,Zhang P,Csaki LS,Vergnes L,Lee JM,Dewald J,Brindley DN,Atti E,Tetradis S,Yoshinaga Y,De Jong PJ,Fong LG,Young SG,Reue K

    更新日期:2012-09-11 00:00:00

  • Recognition and surprise alter the human visual evoked response.

    abstract::Event-related brain potentials (ERPs) to colored slides contained a late positive component that was significantly enhanced when adults recognized the person, place, or painting in the photograph. Additionally, two late components change in amplitude, corresponding to the amount of surprise reported. Because subjects ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.6.2121

    authors: Neville H,Snyder E,Woods D,Galambos R

    更新日期:1982-03-01 00:00:00

  • Molecular specialization of breast vasculature: a breast-homing phage-displayed peptide binds to aminopeptidase P in breast vasculature.

    abstract::In vivo phage display identifies peptides that selectively home to the vasculature of individual organs, tissues, and tumors. Here we report the identification of a cyclic nonapeptide, CPGPEGAGC, which homes to normal breast tissue with a 100-fold selectivity over nontargeted phage. The homing of the phage is inhibite...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.251687998

    authors: Essler M,Ruoslahti E

    更新日期:2002-02-19 00:00:00

  • Skeletal matrices, muci, and the origin of invertebrate calcification.

    abstract::The sudden appearance of calcified skeletons among many different invertebrate taxa at the Precambrian-Cambrian transition may have required minor reorganization of preexisting secretory functions. In particular, features of the skeletal organic matrix responsible for regulating crystal growth by inhibition may be der...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.4.1554

    authors: Marin F,Smith M,Isa Y,Muyzer G,Westbroek P

    更新日期:1996-02-20 00:00:00

  • Electron collisions with atoms, ions, molecules, and surfaces: Fundamental science empowering advances in technology.

    abstract::Electron collisions with atoms, ions, molecules, and surfaces are critically important to the understanding and modeling of low-temperature plasmas (LTPs), and so in the development of technologies based on LTPs. Recent progress in obtaining experimental benchmark data and the development of highly sophisticated compu...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1606132113

    authors: Bartschat K,Kushner MJ

    更新日期:2016-06-28 00:00:00

  • Regulation of hemoglobin synthesis in a murine erythroblastic leukemic cell: the requirement for replication to induce hemoglobin synthesis.

    abstract::The induction of hemoglobin synthesis by dimethylsulfoxide in cells infected with Friend leukemia virus has been shown to depend on the number of cell divisions after the addition of the inducing agent. In asynchronous cultures the cells have a generation time of 24 hr, and hemoglobin synthesis occurs after 48 hr in t...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.71.11.4551

    authors: McClintock PR,Papaconstantinou J

    更新日期:1974-11-01 00:00:00

  • Control of cell membrane tension by myosin-I.

    abstract::All cell functions that involve membrane deformation or a change in cell shape (e.g., endocytosis, exocytosis, cell motility, and cytokinesis) are regulated by membrane tension. While molecular contacts between the plasma membrane and the underlying actin cytoskeleton are known to make significant contributions to mem...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0901641106

    authors: Nambiar R,McConnell RE,Tyska MJ

    更新日期:2009-07-21 00:00:00

  • Dynamical principles in biological processes: a model of charge migration in proteins and DNA.

    abstract::The generalized master equations (GMEs) that contain multiple time scales have been derived quantum mechanically. The GME method has then been applied to a model of charge migration in proteins that invokes the hole hopping between local amino acid sites driven by the torsional motions of the floppy backbones. This mo...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.140196597

    authors: Schlag EW,Yang DY,Sheu SY,Selzle HL,Lin SH,Rentzepis PM

    更新日期:2000-08-29 00:00:00

  • Identification of a natural soluble neuropilin-1 that binds vascular endothelial growth factor: In vivo expression and antitumor activity.

    abstract::Neuropilin-1 (NRP1) is a 130-kDa transmembrane receptor for semaphorins, mediators of neuronal guidance, and for vascular endothelial growth factor 165 (VEGF(165)), an angiogenesis factor. A 2.2-kb truncated NRP1 cDNA was cloned that encodes a 644-aa soluble NRP1 (sNRP1) isoform containing just the a/CUB and b/coagula...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.040337597

    authors: Gagnon ML,Bielenberg DR,Gechtman Z,Miao HQ,Takashima S,Soker S,Klagsbrun M

    更新日期:2000-03-14 00:00:00

  • Tuning the Baird aromatic triplet-state energy of cyclooctatetraene to maximize the self-healing mechanism in organic fluorophores.

    abstract::Bright, photostable, and nontoxic fluorescent contrast agents are critical for biological imaging. "Self-healing" dyes, in which triplet states are intramolecularly quenched, enable fluorescence imaging by increasing fluorophore brightness and longevity, while simultaneously reducing the generation of reactive oxygen ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2006517117

    authors: Pati AK,El Bakouri O,Jockusch S,Zhou Z,Altman RB,Fitzgerald GA,Asher WB,Terry DS,Borgia A,Holsey MD,Batchelder JE,Abeywickrama C,Huddle B,Rufa D,Javitch JA,Ottosson H,Blanchard SC

    更新日期:2020-09-29 00:00:00

  • Waves and stimulus-modulated dynamics in an oscillating olfactory network.

    abstract::The temporal dynamics of electrical activity in an olfactory organ, the procerebral lobe of the terrestrial mollusc Limax maximus, is studied. The lobe exhibits intrinsic oscillations in its field potential. Intracellular recordings show that the lobe contains two classes of neurons, both with activity phase-locked to...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.2.669

    authors: Delaney KR,Gelperin A,Fee MS,Flores JA,Gervais R,Tank DW,Kleinfeld D

    更新日期:1994-01-18 00:00:00

  • An atomic resolution view of ICAM recognition in a complex between the binding domains of ICAM-3 and integrin alphaLbeta2.

    abstract::Within the Ig superfamily (IgSF), intercellular adhesion molecules (ICAMs) form a subfamily that binds the leukocyte integrin alphaLbeta2. We report a 1.65-A-resolution crystal structure of the ICAM-3 N-terminal domain (D1) in complex with the inserted domain, the ligand-binding domain of alphaLbeta2. This high-resolu...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0500200102

    authors: Song G,Yang Y,Liu JH,Casasnovas JM,Shimaoka M,Springer TA,Wang JH

    更新日期:2005-03-01 00:00:00

  • Chemical ecology: a view from the pharmaceutical industry.

    abstract::Biological diversity reflects an underlying molecular diversity. The molecules found in nature may be regarded as solutions to challenges that have been confronted and overcome during molecular evolution. As our understanding of these solutions deepens, the efficiency with which we can discover and/or design new treat...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章,评审

    doi:10.1073/pnas.92.1.75

    authors: Caporale LH

    更新日期:1995-01-03 00:00:00

  • Minimal mechanistic model of siRNA-dependent target RNA slicing by recombinant human Argonaute 2 protein.

    abstract::Argonaute (Ago) proteins are the key component of the RNA-induced silencing complex and mediate RNA interference (RNAi) in association with small RNAs. Although overall the mechanism of RNAi is well understood, many molecular details of this complex process are not. Here we report about in-depth steady-state and, in p...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1217838110

    authors: Deerberg A,Willkomm S,Restle T

    更新日期:2013-10-29 00:00:00

  • Brain-blood barrier? Yes and no.

    abstract::Ventriculo-cisternal perfusion of horseradish peroxidase (HRP) in the mouse brain has demonstrated that a brain-blood barrier exists at the microvascular endothelium in brain parenchyma but not in the median eminence of the hypothalamus. The brain-blood barrier is similar to the blood-brain barrier in that: tight junc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.80.23.7352

    authors: Broadwell RD,Balin BJ,Salcman M,Kaplan RS

    更新日期:1983-12-01 00:00:00

  • Circadian organization of the mammalian retina.

    abstract::The mammalian retina contains an endogenous circadian pacemaker that broadly regulates retinal physiology and function, yet the cellular origin and organization of the mammalian retinal circadian clock remains unclear. Circadian clock neurons generate daily rhythms via cell-autonomous autoregulatory clock gene network...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0601940103

    authors: Ruan GX,Zhang DQ,Zhou T,Yamazaki S,McMahon DG

    更新日期:2006-06-20 00:00:00

  • Solution structure and dynamics of a de novo designed three-helix bundle protein.

    abstract::Although de novo protein design is an important endeavor with implications for understanding protein folding, until now, structures have been determined for only a few 25- to 30-residue designed miniproteins. Here, the NMR solution structure of a complex 73-residue three-helix bundle protein, alpha3D, is reported. The...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.10.5486

    authors: Walsh ST,Cheng H,Bryson JW,Roder H,DeGrado WF

    更新日期:1999-05-11 00:00:00

  • Dual-color fluorescence imaging distinguishes tumor cells from induced host angiogenic vessels and stromal cells.

    abstract::We have developed a simple yet powerful technique for delineating the morphological events of tumor-induced angiogenesis and other tumor-induced host processes with dual-color fluorescence. The method clearly images implanted tumors and adjacent stroma, distinguishing unambiguously the host and tumor-specific componen...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2436101100

    authors: Yang M,Li L,Jiang P,Moossa AR,Penman S,Hoffman RM

    更新日期:2003-11-25 00:00:00