Chaos in learning a simple two-person game.

Abstract:

:We investigate the problem of learning to play the game of rock-paper-scissors. Each player attempts to improve her/his average score by adjusting the frequency of the three possible responses, using reinforcement learning. For the zero sum game the learning process displays Hamiltonian chaos. Thus, the learning trajectory can be simple or complex, depending on initial conditions. We also investigate the non-zero sum case and show that it can give rise to chaotic transients. This is, to our knowledge, the first demonstration of Hamiltonian chaos in learning a basic two-person game, extending earlier findings of chaotic attractors in dissipative systems. As we argue here, chaos provides an important self-consistency condition for determining when players will learn to behave as though they were fully rational. That chaos can occur in learning a simple game indicates one should use caution in assuming real people will learn to play a game according to a Nash equilibrium strategy.

authors

Sato Y,Akiyama E,Farmer JD

doi

10.1073/pnas.032086299

keywords:

subject

Has Abstract

pub_date

2002-04-02 00:00:00

pages

4748-51

issue

7

eissn

0027-8424

issn

1091-6490

pii

99/7/4748

journal_volume

99

pub_type

杂志文章
  • KSHV LANA acetylation-selective acidic domain reader sequence mediates virus persistence.

    abstract::Viruses modulate biochemical cellular pathways to permit infection. A recently described mechanism mediates selective protein interactions between acidic domain readers and unacetylated, lysine-rich regions, opposite of bromodomain function. Kaposi´s sarcoma (KS)-associated herpesvirus (KSHV) is tightly linked with KS...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2004809117

    authors: Juillard F,de Miranda MP,Li S,Franco A,Seixas AF,Liu B,Álvarez ÁL,Tan M,Szymula A,Kaye KM,Simas JP

    更新日期:2020-09-08 00:00:00

  • Searching for missing heritability: designing rare variant association studies.

    abstract::Genetic studies have revealed thousands of loci predisposing to hundreds of human diseases and traits, revealing important biological pathways and defining novel therapeutic hypotheses. However, the genes discovered to date typically explain less than half of the apparent heritability. Because efforts have largely foc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1322563111

    authors: Zuk O,Schaffner SF,Samocha K,Do R,Hechter E,Kathiresan S,Daly MJ,Neale BM,Sunyaev SR,Lander ES

    更新日期:2014-01-28 00:00:00

  • Spontaneous transmitter release is critical for the induction of long-term and intermediate-term facilitation in Aplysia.

    abstract::Long-term plasticity can differ from short-term in recruiting the growth of new synaptic connections, a process that requires the participation of both the presynaptic and postsynaptic components of the synapse. How does information about synaptic plasticity spread from its site of origin to recruit the other componen...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1206914109

    authors: Jin I,Puthanveettil S,Udo H,Karl K,Kandel ER,Hawkins RD

    更新日期:2012-06-05 00:00:00

  • pRB plays an essential role in cell cycle arrest induced by DNA damage.

    abstract::To maintain genome stability, cells with damaged DNA must arrest to allow repair of mutations before replication. Although several key components required to elicit this arrest have been discovered, much of the pathway remains elusive. Here we report that pRB acts as a central mediator of the proliferative block induc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.20.11945

    authors: Harrington EA,Bruce JL,Harlow E,Dyson N

    更新日期:1998-09-29 00:00:00

  • Localization of c-ras oncogene family on human germ-line chromosomes.

    abstract::The c-ras family is a set of c-onc genes that are highly conserved in vertebrates. The genes in this family are homologous to the transforming genes of Harvey and Kirsten murine sarcoma viruses (v-Ha-ras and v-Ki-ras, respectively). Using an in situ molecular hybridization method, we detected three sites on the human ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.80.15.4794

    authors: Jhanwar SC,Neel BG,Hayward WS,Chaganti RS

    更新日期:1983-08-01 00:00:00

  • Limits of long-term selection against Neandertal introgression.

    abstract::Several studies have suggested that introgressed Neandertal DNA was subjected to negative selection in modern humans. A striking observation in support of this is an apparent monotonic decline in Neandertal ancestry observed in modern humans in Europe over the past 45,000 years. Here, we show that this decline is an a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1814338116

    authors: Petr M,Pääbo S,Kelso J,Vernot B

    更新日期:2019-01-29 00:00:00

  • Architecture of a minimal signaling pathway explains the T-cell response to a 1 million-fold variation in antigen affinity and dose.

    abstract::T cells must respond differently to antigens of varying affinity presented at different doses. Previous attempts to map peptide MHC (pMHC) affinity onto T-cell responses have produced inconsistent patterns of responses, preventing formulations of canonical models of T-cell signaling. Here, a systematic analysis of T-c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1608820113

    authors: Lever M,Lim HS,Kruger P,Nguyen J,Trendel N,Abu-Shah E,Maini PK,van der Merwe PA,Dushek O

    更新日期:2016-10-25 00:00:00

  • Human cytomegalovirus latency alters the cellular secretome, inducing cluster of differentiation (CD)4+ T-cell migration and suppression of effector function.

    abstract::After primary infection, human cytomegalovirus (HCMV) persists as a life-long latent infection, with host immunosuppression often resulting in clinical reactivation. During lytic infection, major changes in the expression of secreted cellular proteins (the secretome) occur that have profound effects on host-cell inter...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1204836109

    authors: Mason GM,Poole E,Sissons JG,Wills MR,Sinclair JH

    更新日期:2012-09-04 00:00:00

  • Defined microbiota transplant restores Th17/RORγt+ regulatory T cell balance in mice colonized with inflammatory bowel disease microbiotas.

    abstract::The building evidence for the contribution of microbiota to human disease has spurred an effort to develop therapies that target the gut microbiota. This is particularly evident in inflammatory bowel diseases (IBDs), where clinical trials of fecal microbiota transplantation have shown some efficacy. To aid the develop...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1922189117

    authors: Britton GJ,Contijoch EJ,Spindler MP,Aggarwala V,Dogan B,Bongers G,San Mateo L,Baltus A,Das A,Gevers D,Borody TJ,Kaakoush NO,Kamm MA,Mitchell H,Paramsothy S,Clemente JC,Colombel JF,Simpson KW,Dubinsky MC,Grinspan A,

    更新日期:2020-09-01 00:00:00

  • A regulated RNA binding protein also possesses aconitase activity.

    abstract::A clone for the iron-responsive element (IRE)-binding protein (IRE-BP) has been transfected and expressed in mouse fibroblasts. The IRE-BP gene product binds IREs with high affinity and specificity. Amino acid alignments reveal that the IRE-BP is 30% identical to mitochondrial aconitase. The 18 active site residues of...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.88.22.10109

    authors: Kaptain S,Downey WE,Tang C,Philpott C,Haile D,Orloff DG,Harford JB,Rouault TA,Klausner RD

    更新日期:1991-11-15 00:00:00

  • The X-linked lymphoproliferative disease gene product SAP associates with PAK-interacting exchange factor and participates in T cell activation.

    abstract::SLAM (signaling lymphocyte activation molecule)-associated protein (SAP) is a Src homology 2 (SH2) domain-containing adaptor expressed in T cells and natural killer cells. Its essential role in immune responses is underscored by the recent finding that mutations in SAP result in a rare but fatal X-linked lymphoprolife...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0606624103

    authors: Gu C,Tangye SG,Sun X,Luo Y,Lin Z,Wu J

    更新日期:2006-09-26 00:00:00

  • Initial hepatic removal of chylomicron remnants is unaffected but endocytosis is delayed in mice lacking the low density lipoprotein receptor.

    abstract::Two endocytic receptors, the low density lipoprotein (LDL) receptor (LDLR) and the LDLR-related protein (LRP), are thought to act in concert in the hepatic uptake of partially metabolized dietary lipoproteins, the chylomicron remnants. We have evaluated the role of these two receptors in the hepatic metabolism of chyl...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.10.4611

    authors: Herz J,Qiu SQ,Oesterle A,DeSilva HV,Shafi S,Havel RJ

    更新日期:1995-05-09 00:00:00

  • Crystal structure of the Holliday junction migration motor protein RuvB from Thermus thermophilus HB8.

    abstract::We report here the crystal structure of the RuvB motor protein from Thermus thermophilus HB8, which drives branch migration of the Holliday junction during homologous recombination. RuvB has a crescent-like architecture consisting of three consecutive domains, the first two of which are involved in ATP binding and hyd...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.031470598

    authors: Yamada K,Kunishima N,Mayanagi K,Ohnishi T,Nishino T,Iwasaki H,Shinagawa H,Morikawa K

    更新日期:2001-02-13 00:00:00

  • Energy depletion retards the loss of membrane transport during reticulocyte maturation.

    abstract::The effect of metabolic depletion on the maturation-associated loss of membrane functions has been studied by using sheep reticulocytes incubated in vitro at 37 degrees C for periods up to 41 hr. ATP was either maintained with glucose, adenosine plus inosine, or depleted with 2-deoxyglucose plus arsenate. Two membrane...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.80.16.4978

    authors: Weigensberg AM,Blostein R

    更新日期:1983-08-01 00:00:00

  • Gelation-driven component selection in the generation of constitutional dynamic hydrogels based on guanine-quartet formation.

    abstract::The guanosine hydrazide 1 yields a stable supramolecular hydrogel based on the formation of a guanine quartet (G-quartet) in presence of metal cations. The effect of various parameters (concentration, nature of metal ion, and temperature) on the properties of this gel has been studied. Proton NMR spectroscopy is shown...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0501663102

    authors: Sreenivasachary N,Lehn JM

    更新日期:2005-04-26 00:00:00

  • Akt1 and Akt2 protein kinases differentially contribute to macrophage polarization.

    abstract::Activated macrophages are described as classically activated or M1 type and alternatively activated or M2 type, depending on their response to proinflammatory stimuli and the expression of genetic markers including iNOS, arginase1, Ym1, and Fizz1. Here we report that Akt kinases differentially contribute to macrophage...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1119038109

    authors: Arranz A,Doxaki C,Vergadi E,Martinez de la Torre Y,Vaporidi K,Lagoudaki ED,Ieronymaki E,Androulidaki A,Venihaki M,Margioris AN,Stathopoulos EN,Tsichlis PN,Tsatsanis C

    更新日期:2012-06-12 00:00:00

  • Molecular cloning and amplification of the adenylate cyclase gene.

    abstract::A segment of DNA containing cya, the gene for adenylate cyclase [ATP pyrophosphate-lyase (cyclizing), EC 4.6.1.1], has been isolated from Salmonella typhimurium. The phage lambda gt4 was used as a cloning vector and adenylate cyclase-positive hybrid phages were isolated that complemented adenylate cyclase-negative bac...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.8.4684

    authors: Wang JY,Clegg DO,Koshland DE Jr

    更新日期:1981-08-01 00:00:00

  • Binding properties of a cell adhesion molecule from neural tissue.

    abstract::We have previously identified and purified a cell surface glycoprotein from retina and brain, called neural cell adhesion molecule or N-CAM, that appears to be involved in neural cell--cell adhesion, the fasciculation of neurites, and the formation of normal tissue patterns in the retina. The present studies reveal th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.2.685

    authors: Rutishauser U,Hoffman S,Edelman GM

    更新日期:1982-01-01 00:00:00

  • In vitro translation of hypoxanthine/guanine phosphoribosyltransferase mRNA: characterization of a mouse neuroblastoma cell line that has elevated levels of hypoxanthine/guanine phosphoribosyltransferase protein.

    abstract::Antibody specific for the native form of Chinese hamster hypoxanthine/guanine phosphoribosyltransferase (HPRT; IMP:pyrophosphate phosphoribosyltransferase, EC 2.4.2.8) was used to detect the synthesis of HPRT protein in a rabbit reticulocyte lysate translation system primed with mRNA from Chinese hamster tissues and c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.11.6977

    authors: Melton DW,Konecki DS,Ledbetter DH,Hejtmancik JF,Caskey CT

    更新日期:1981-11-01 00:00:00

  • Export and stability of naturally intronless mRNAs require specific coding region sequences and the TREX mRNA export complex.

    abstract::A great deal is known about the export of spliced mRNAs, but little is known about the export of mRNAs encoded by human cellular genes that naturally lack introns. Here, we investigated the requirements for export of three naturally intronless mRNAs (HSPB3, IFN-α1, and IFN-β1). Significantly, we found that all three m...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1113076108

    authors: Lei H,Dias AP,Reed R

    更新日期:2011-11-01 00:00:00

  • Potent neutralization of hepatitis A virus reveals a receptor mimic mechanism and the receptor recognition site.

    abstract::Hepatitis A virus (HAV) infects ∼1.4 million people annually and, although there is a vaccine, there are no licensed therapeutic drugs. HAV is unusually stable (making disinfection problematic) and little is known of how it enters cells and releases its RNA. Here we report a potent HAV-specific monoclonal antibody, R1...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1616502114

    authors: Wang X,Zhu L,Dang M,Hu Z,Gao Q,Yuan S,Sun Y,Zhang B,Ren J,Kotecha A,Walter TS,Wang J,Fry EE,Stuart DI,Rao Z

    更新日期:2017-01-24 00:00:00

  • Identification of a cell protein (FIP-3) as a modulator of NF-kappaB activity and as a target of an adenovirus inhibitor of tumor necrosis factor alpha-induced apoptosis.

    abstract::FIP-3 (14.7K interacting protein) was discovered during a search for cell proteins that could interact with an adenovirus protein (Ad E3-14.7K) that had been shown to prevent tumor necrosis factor (TNF)-alpha-induced cytolysis. FIP-3, which contains leucine zippers and a zinc finger domain, inhibits both basal and ind...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.3.1042

    authors: Li Y,Kang J,Friedman J,Tarassishin L,Ye J,Kovalenko A,Wallach D,Horwitz MS

    更新日期:1999-02-02 00:00:00

  • Gallstones play a significant role in Salmonella spp. gallbladder colonization and carriage.

    abstract::Salmonella enterica serovar Typhi can colonize the gallbladder and persist in an asymptomatic carrier state that is frequently associated with the presence of gallstones. We have shown that salmonellae form bile-mediated biofilms on human gallstones and cholesterol-coated surfaces in vitro. Here, we test the hypothesi...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1000862107

    authors: Crawford RW,Rosales-Reyes R,Ramírez-Aguilar Mde L,Chapa-Azuela O,Alpuche-Aranda C,Gunn JS

    更新日期:2010-03-02 00:00:00

  • Regulation of the self-renewal probability in Hydra stem cell clones.

    abstract::Hydra interstitial stem cells continuously give rise to daughter stem cells as well as precursors for nerve and nematocyte differentiation. Growth of the stem cell population is controlled by the self-renewal probability (Ps): Ps is the fraction of stem cell daughters that remain stem cells in each generation. We have...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.2.886

    authors: David CN,MacWilliams H

    更新日期:1978-02-01 00:00:00

  • Absence of interference in photoexcitation of triplets.

    abstract::Kinetics of growth and decay of triplet states of molecules at known orientation in a magnetic field have been measured. Amplitudes of the zero field eigenstates in each of the eigenstates at finite field were varied by choice of orientation. No interference between the amplitudes of the zero field states was found in...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.72.11.4203

    authors: Felix CC,Weissman SI

    更新日期:1975-11-01 00:00:00

  • S1P3 receptor-induced reorganization of epithelial tight junctions compromises lung barrier integrity and is potentiated by TNF.

    abstract::Pulmonary pathologies including adult respiratory distress syndrome are characterized by disruption of pulmonary integrity and edema compromising respiratory function. Sphingosine 1-phosphate (S1P) is a lipid mediator synthesized and/or stored in mast cells, platelets, and epithelial cells, with production up-regulate...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章,收录出版

    doi:10.1073/pnas.0501997102

    authors: Gon Y,Wood MR,Kiosses WB,Jo E,Sanna MG,Chun J,Rosen H

    更新日期:2005-06-28 00:00:00

  • Infection of tobacco mesophyll protoplasts by tobacco mosaic virus.

    abstract::It was proved that the protoplasts prepared from mesophyll of Nicotiana tabacum are infected by tobacco mosaic virus. The infection occurred when purified tobacco mosaic virus particles were added to a protoplast suspension in the presence of poly-L-ornithine. The virus multiplied in these protoplasts to a level of 10...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.64.3.843

    authors: Takebe I,Otsuki Y

    更新日期:1969-11-01 00:00:00

  • Antigen induces chronic idiotype suppression.

    abstract::Hapten coupled to isologous gamma globulin can substitute for anti-idiotypic antibody in the induction of neonatal chronic idiotype suppression. The immunologically suppressed animals fail to express an idiotypically defined subset of anti-hapten antibodies in later life and harbor regulatory T cells that prevent the ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.82.12.4217

    authors: Tokuhisa T,Rajewsky K

    更新日期:1985-06-01 00:00:00

  • Evidence for hydrophobic region within heavy chains of mouse B lymphocyte membrane-bound IgM.

    abstract::The gel filtration behavior, in the presence of detergents, of membrane-bound IgM from normal mouse spleen B lymphocytes was compared to that of secretory IgM from mouse plasma cells. The proteins were labeled either by surface radioiodination or biosynthetically with radioactive amino acids. Cell lysates were fractio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.76.11.5515

    authors: Vassalli P,Tedghi R,Lisowska-Bernstein B,Tartakoff A,Jaton JC

    更新日期:1979-11-01 00:00:00

  • Histone packing in the nucleosome core particle of chromatin.

    abstract::The chromatin core particle DNA conformation deduced in broad outline by Finch et al. [Finch, J. T., Lutter, L. C., Rhodes, D., Brown, R. S., Rushton, B., Levitt, M. & Klug, A. (1977) Nature 269, 29-36] can be described in detail using other available experimental results. Histone binding sites compatible with the pat...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.8.3649

    authors: Carter CW Jr

    更新日期:1978-08-01 00:00:00