Projective simulation for artificial intelligence.

Abstract:

:We propose a model of a learning agent whose interaction with the environment is governed by a simulation-based projection, which allows the agent to project itself into future situations before it takes real action. Projective simulation is based on a random walk through a network of clips, which are elementary patches of episodic memory. The network of clips changes dynamically, both due to new perceptual input and due to certain compositional principles of the simulation process. During simulation, the clips are screened for specific features which trigger factual action of the agent. The scheme is different from other, computational, notions of simulation, and it provides a new element in an embodied cognitive science approach to intelligent action and learning. Our model provides a natural route for generalization to quantum-mechanical operation and connects the fields of reinforcement learning and quantum computation.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Briegel HJ,De las Cuevas G

doi

10.1038/srep00400

subject

Has Abstract

pub_date

2012-01-01 00:00:00

pages

400

issn

2045-2322

journal_volume

2

pub_type

杂志文章
  • Intravitreal ranibizumab reduced ocular blood flow and aqueous cytokine levels and improved retinal morphology in patients with diabetic macular edema.

    abstract::We investigated the relationship between aqueous cytokine levels, changes in ocular blood flow, and morphological and functional improvements after intravitreal ranibizumab injection (IRI) in treatment-naïve eyes with center-involving diabetic macular edema (DME). Thirty-three eligible patients with DME (33 eyes) were...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-78792-3

    authors: Mizui T,Noma H,Yasuda K,Kanemaki T,Goto H,Shimura M

    更新日期:2020-12-10 00:00:00

  • Impact of dietary resistant starch type 4 on human gut microbiota and immunometabolic functions.

    abstract::Dietary modulation of the gut microbiota impacts human health. Here we investigated the hitherto unknown effects of resistant starch type 4 (RS4) enriched diet on gut microbiota composition and short-chain fatty acid (SCFA) concentrations in parallel with host immunometabolic functions in twenty individuals with signs...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep28797

    authors: Upadhyaya B,McCormack L,Fardin-Kia AR,Juenemann R,Nichenametla S,Clapper J,Specker B,Dey M

    更新日期:2016-06-30 00:00:00

  • Growth of high quality and uniformity AlGaN/GaN heterostructures on Si substrates using a single AlGaN layer with low Al composition.

    abstract::By employing a single AlGaN layer with low Al composition, high quality and uniformity AlGaN/GaN heterostructures have been successfully grown on Si substrates by metal-organic chemical vapor deposition (MOCVD). The heterostructures exhibit a high electron mobility of 2150 cm(2)/Vs with an electron density of 9.3 × 10...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep23020

    authors: Cheng J,Yang X,Sang L,Guo L,Zhang J,Wang J,He C,Zhang L,Wang M,Xu F,Tang N,Qin Z,Wang X,Shen B

    更新日期:2016-03-10 00:00:00

  • Statistical Modeling of Heart Rate Variability to Unravel the Factors Affecting Autonomic Regulation in Preterm Infants.

    abstract::Analyzing heart rate variability (HRV) in preterm infants can help track maturational changes and subclinical signatures of disease. We conducted an observational study to characterize the effect of demographic and cardiorespiratory factors on three features of HRV using a linear mixed-effects model. HRV-features were...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44209-z

    authors: Joshi R,Kommers D,Guo C,Bikker JW,Feijs L,van Pul C,Andriessen P

    更新日期:2019-05-22 00:00:00

  • Cross-reactivity and expansion of dengue-specific T cells during acute primary and secondary infections in humans.

    abstract::Serotype-cross-reactive memory T cells responding to secondary dengue virus (DENV) infection are thought to contribute to disease. However, epitope-specific T cell responses have not been thoroughly compared between subjects with primary versus secondary DENV infection. We studied CD8(+) T cells specific for the HLA-A...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep00051

    authors: Friberg H,Bashyam H,Toyosaki-Maeda T,Potts JA,Greenough T,Kalayanarooj S,Gibbons RV,Nisalak A,Srikiatkhachorn A,Green S,Stephens HA,Rothman AL,Mathew A

    更新日期:2011-01-01 00:00:00

  • Delivery of the gene encoding the tumor suppressor Sef into prostate tumors by therapeutic-ultrasound inhibits both tumor angiogenesis and growth.

    abstract::Carcinomas constitute over 80% of all human cancer types with no effective therapy for metastatic disease. Here, we demonstrate, for the first time, the efficacy of therapeutic-ultrasound (TUS) to deliver a human tumor suppressor gene, hSef-b, to prostate tumors in vivo. Sef is downregulated in various human carcinoma...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-12408-1

    authors: Mishel S,Shneyer B,Korsensky L,Goldshmidt-Tran O,Haber T,Machluf M,Ron D

    更新日期:2017-11-08 00:00:00

  • Peptide Capping Agent Design for Gold (111) Facet by Molecular Simulation and Experimental Approaches.

    abstract::The stochastic tunneling-basin hopping method (STUN-BH) was utilized to obtain the most stable peptide S7 configuration (Ac-Ser-Ser-Phe-Pro-Gln-Pro-Asn-CONH2) adsorbed on Au(111) facet. After the most stable S7 configuration was found, molecular dynamics (MD) simulation was conducted to investigate the thermal stabili...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-59144-7

    authors: Lin CH,Ju SP,Su JW,Li DE

    更新日期:2020-02-07 00:00:00

  • A Bio-inspired Hypoxia Sensor using HIF1a-Oxygen-Dependent Degradation Domain.

    abstract::Functional imaging has become an important tool in oncology because it not only provides information about the size and localization of the tumour, but also about the pathophysiological features of the tumoural cells. One of the characteristic features of some tumour types is that their fast growth leads to deficient ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-43618-4

    authors: Iglesias P,Penas C,Barral-Cagiao L,Pazos E,Costoya JA

    更新日期:2019-05-08 00:00:00

  • Effectiveness of hysteroscopic resection of a uterine caesarean niche can be predicted: a prospective cohort study.

    abstract::This study aimed to develop and validate a model for the preoperative prediction of the effectiveness of hysteroscopic resection of a uterine cesarean niche in patients with postmenstrual spotting. The predictive model was developed in a primary prospective cohort consisting of 208 patients with niche treated by hyste...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-74622-8

    authors: Zhu Q,He X,Jiang L,Liang G,Zhu C,Pan H,Zhang J,Huirne JA

    更新日期:2020-10-15 00:00:00

  • Combined volatolomics for monitoring of human body chemistry.

    abstract::Analysis of volatile organic compounds (VOCs) is a promising approach for non-invasive, fast and potentially inexpensive diagnostics. Here, we present a new methodology for profiling the body chemistry by using the volatile fraction of molecules in various body fluids. Using mass spectrometry and cross-reactive nanoma...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep04611

    authors: Broza YY,Zuri L,Haick H

    更新日期:2014-04-09 00:00:00

  • Micro-epidemiology and spatial heterogeneity of P. vivax parasitaemia in riverine communities of the Peruvian Amazon: A multilevel analysis.

    abstract::Malaria has steadily increased in the Peruvian Amazon over the last five years. This study aimed to determine the parasite prevalence and micro-geographical heterogeneity of Plasmodium vivax parasitaemia in communities of the Peruvian Amazon. Four cross-sectional active case detection surveys were conducted between Ma...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-07818-0

    authors: Carrasco-Escobar G,Gamboa D,Castro MC,Bangdiwala SI,Rodriguez H,Contreras-Mancilla J,Alava F,Speybroeck N,Lescano AG,Vinetz JM,Rosas-Aguirre A,Llanos-Cuentas A

    更新日期:2017-08-14 00:00:00

  • In-situ fabrication of macroporous films for dye-sensitised solar cells: formation of the scattering layer and the gelation of electrolytes.

    abstract::Dye-sensitised solar cells (DSCs) are a promising substitute for conventional silicon solar cells. A scattering layer of submicrometer pores or particles has been widely introduced to achieve a high light-harvesting efficiency. However, many such fabrication processes require high temperatures and multiple steps to pr...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep05375

    authors: Ha SJ,Moon JH

    更新日期:2014-07-09 00:00:00

  • Serum neurofilament light chain levels as a biomarker of neuroaxonal injury and severity of oxaliplatin-induced peripheral neuropathy.

    abstract::We set out to determine the usability of serum neurofilament light chain (sNfL), serum glial fibrillary acidic protein (sGFAP), and retinal parameters by using optical coherence tomography (OCT) as reliable biomarkers of the progression of oxaliplatin-induced peripheral neuropathy (OIPN). Forty-three patients schedule...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-64511-5

    authors: Kim SH,Choi MK,Park NY,Hyun JW,Lee MY,Kim HJ,Jung SK,Cha Y

    更新日期:2020-05-14 00:00:00

  • Early antiretroviral therapy on reducing HIV transmission in China: strengths, weaknesses and next focus of the program.

    abstract::Early antiretroviral therapy (ART) initiation is a recommended public health approach for the prevention of HIV-1 transmission. In this cohort study, we included 13132 serodiscordant couples. ART was initiated for patients with CD4+ T cell counts less than 200 cells/uL, 350 cells/uL, and 500 cells/uL respectively. Thi...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-21791-2

    authors: Liu P,Tang Z,Lan G,Zhu Q,Chen H,You Y,Yang X,Liang S,Chen Y,Xing H,Liao L,Feng Y,Shen Z,Ruan Y,Shao Y

    更新日期:2018-02-21 00:00:00

  • Isoform-specific Inhibition of N-methyl-D-aspartate Receptors by Bile Salts.

    abstract::The N-methyl-D-aspartate subfamily of ionotropic glutamate receptors (NMDARs) is well known for its important roles in the central nervous system (CNS), e.g. learning and memory formation. Besides the CNS, NMDARs are also expressed in numerous peripheral tissues including the pancreas, kidney, stomach, and blood cells...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-46496-y

    authors: Koch A,Bonus M,Gohlke H,Klöcker N

    更新日期:2019-07-11 00:00:00

  • MBSTAR: multiple instance learning for predicting specific functional binding sites in microRNA targets.

    abstract::MicroRNA (miRNA) regulates gene expression by binding to specific sites in the 3'untranslated regions of its target genes. Machine learning based miRNA target prediction algorithms first extract a set of features from potential binding sites (PBSs) in the mRNA and then train a classifier to distinguish targets from no...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep08004

    authors: Bandyopadhyay S,Ghosh D,Mitra R,Zhao Z

    更新日期:2015-01-23 00:00:00

  • Alcohol consumption before pregnancy causes detrimental fetal development and maternal metabolic disorders.

    abstract::Alcohol consumption before or during pregnancy poses serious health risks to the fetus; however, the underlying mechanisms involved remain obscure. Here, we investigated whether ethanol consumption before pregnancy affects maternal or fetal health and whether pharmacological inhibition of CYP2E1, a major ethanol oxida...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-66971-1

    authors: Lee YJ,Kim JY,Lee DY,Park KJ,Kim GH,Kim JE,Roh GS,Lim JY,Koo S,Lim NK,Park HY,Kim WH

    更新日期:2020-06-22 00:00:00

  • Preoperative handgrip strength is not associated with complications and health-related quality of life after surgery for colorectal cancer.

    abstract::Colorectal cancer (CRC) treatment is associated with a high morbidity which may result in a reduced health-related quality of life (HRQoL). The pre-operative measurement of handgrip strength (HGS) might be a tool to predict the patient's outcome after CRC surgery. The aim of this study was to evaluate the association ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-69806-1

    authors: van Heinsbergen M,Konsten JL,Bours MJL,Bouvy ND,Weijenberg MP,Janssen-Heijnen ML

    更新日期:2020-08-03 00:00:00

  • Characterization of biological variation of peripheral blood immune cytome in an Indian cohort.

    abstract::Immune parameters show characteristic normal baseline levels and variance in the population. We characterised the degree of inter-individual and within-individual variation over one-year time period in 33 immune cell subsets by flow cytometry in peripheral blood mononuclear cells from 43 healthy young adult volunteers...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-51294-7

    authors: Kanodia P,Kaur G,Coshic P,Chatterjee K,Neeman T,George A,Rath S,Bal V,Prabhu SB

    更新日期:2019-10-14 00:00:00

  • Author Correction: Genetic structure of Mycoplasma ovipneumoniae informs pathogen spillover dynamics between domestic and wild Caprinae in the western United States.

    abstract::An amendment to this paper has been published and can be accessed via a link at the top of the paper. ...

    journal_title:Scientific reports

    pub_type: 已发布勘误

    doi:10.1038/s41598-020-63944-2

    authors: Kamath PL,Manlove K,Cassirer EF,Cross PC,Besser TE

    更新日期:2020-04-22 00:00:00

  • OsKinesin-13A is an active microtubule depolymerase involved in glume length regulation via affecting cell elongation.

    abstract::Grain size is an important trait influencing both the yield and quality of rice and its major determinant is glume size. However, how glume size is regulated remains largely unknown. Here, we report the characterization of OsKinesin-13A, which regulates cell elongation and glume length in rice. The mutant of OsKinesin...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep09457

    authors: Deng ZY,Liu LT,Li T,Yan S,Kuang BJ,Huang SJ,Yan CJ,Wang T

    更新日期:2015-03-25 00:00:00

  • Philippines-Taiwan Oscillations and its connection to tropical cyclone frequency in the western North Pacific Ocean.

    abstract::An atmospheric component of the Philippine-Taiwan Oscillations (PTOa) is used to examine its potential connection with tropical cyclone (TC) frequency in the western North Pacific in the period of 1979-2014. During positive PTOa years, more TCs are observed in the tropical western Pacific south of 18 °N where cyclonic...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-35617-8

    authors: Chang YK,Miyazawa Y,Kodaira T,Behera S

    更新日期:2018-11-29 00:00:00

  • Arsenic resistance strategy in Pantoea sp. IMH: Organization, function and evolution of ars genes.

    abstract::Pantoea sp. IMH is the only bacterium found in genus Pantoea with a high As resistance capacity, but its molecular mechanism is unknown. Herein, the organization, function, and evolution of ars genes in IMH are studied starting with analysis of the whole genome. Two ars systems - ars1 (arsR1B1C1H1) and ars2 (arsR2B2C2...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep39195

    authors: Wang L,Zhuang X,Zhuang G,Jing C

    更新日期:2016-12-14 00:00:00

  • Analysis of L-arginine:glycine amidinotransferase-, creatine- and homoarginine-dependent gene regulation in the murine heart.

    abstract::L-arginine:glycine amidinotransferase (AGAT) and its metabolites creatine and homoarginine (HA) have been linked to cardiovascular pathologies in both human and murine studies, but the underlying molecular mechanisms are poorly understood. Here, we report the first analysis of heart transcriptome variation using micro...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-61638-3

    authors: Jensen M,Müller C,Choe CU,Schwedhelm E,Zeller T

    更新日期:2020-03-16 00:00:00

  • Variable protein homeostasis in housekeeping and non-housekeeping pathways under mycotoxins stress.

    abstract::Transcript levels are the primary factor determining protein levels, but for the majority of genes, fold changes in transcript levels are larger than the corresponding changes in protein levels, a phenomenon that is termed "protein homeostasis". However, this phenomenon is not well characterized in the context of envi...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44305-0

    authors: Sun Y,Wen J,Chen R,Deng Y

    更新日期:2019-05-24 00:00:00

  • MEK inhibition enhances the response to tyrosine kinase inhibitors in acute myeloid leukemia.

    abstract::FMS-like tyrosine kinase 3 (FLT3) is a key driver of acute myeloid leukemia (AML). Several tyrosine kinase inhibitors (TKIs) targeting FLT3 have been evaluated clinically, but their effects are limited when used in monotherapy due to the emergence of drug-resistance. Thus, a better understanding of drug-resistance pat...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-54901-9

    authors: Morales ML,Arenas A,Ortiz-Ruiz A,Leivas A,Rapado I,Rodríguez-García A,Castro N,Zagorac I,Quintela-Fandino M,Gómez-López G,Gallardo M,Ayala R,Linares M,Martínez-López J

    更新日期:2019-12-09 00:00:00

  • Pitch sensation involves stochastic resonance.

    abstract::Pitch is a complex hearing phenomenon that results from elicited and self-generated cochlear vibrations. Read-off vibrational information is relayed higher up the auditory pathway, where it is then condensed into pitch sensation. How this can adequately be described in terms of physics has largely remained an open que...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep02676

    authors: Martignoli S,Gomez F,Stoop R

    更新日期:2013-01-01 00:00:00

  • Label fusion method combining pixel greyscale probability for brain MR segmentation.

    abstract::Multi-atlas-based segmentation (MAS) methods have demonstrated superior performance in the field of automatic image segmentation, and label fusion is an important part of MAS methods. In this paper, we propose a label fusion method that incorporates pixel greyscale probability information. The proposed method combines...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-54527-x

    authors: Wang M,Li P

    更新日期:2019-11-29 00:00:00

  • NMR studies on the interactions between yeast Vta1 and Did2 during the multivesicular bodies sorting pathway.

    abstract::As an AAA-ATPase, Vps4 is important for function of multivesicular bodies (MVB) sorting pathway, which involves in cellular phenomena ranging from receptor down-regulation to viral budding to cytokinesis. The activity of Vps4 is stimulated by the interactions between Vta1 N-terminus (named as Vta1NTD) and Did2 fragmen...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep38710

    authors: Shen J,Yang Z,Wang J,Zhao B,Lan W,Wang C,Zhang X,Wild CJ,Liu M,Xu Z,Cao C

    更新日期:2016-12-07 00:00:00

  • A novel mechanism of ERK1/2 regulation in smooth muscle involving acetylation of the ERK1/2 scaffold IQGAP1.

    abstract::Ceramide, a bioactive lipid and signaling molecule associated with cardiovascular disease, is known to activate extracellular signal regulated kinases 1 and 2 (ERK1/2). Here, we determined that the effect of ceramide on ERK1/2 is mediated by ceramide signaling on an ERK scaffold protein, IQ motif containing GTPase act...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-09434-4

    authors: Vetterkind S,Lin QQ,Morgan KG

    更新日期:2017-08-24 00:00:00