A training algorithm for networks of high-variability reservoirs.

Abstract:

:Physical reservoir computing approaches have gained increased attention in recent years due to their potential for low-energy high-performance computing. Despite recent successes, there are bounds to what one can achieve simply by making physical reservoirs larger. Therefore, we argue that a switch from single-reservoir computing to multi-reservoir and even deep physical reservoir computing is desirable. Given that error backpropagation cannot be used directly to train a large class of multi-reservoir systems, we propose an alternative framework that combines the power of backpropagation with the speed and simplicity of classic training algorithms. In this work we report our findings on a conducted experiment to evaluate the general feasibility of our approach. We train a network of 3 Echo State Networks to perform the well-known NARMA-10 task, where we use intermediate targets derived through backpropagation. Our results indicate that our proposed method is well-suited to train multi-reservoir systems in an efficient way.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Freiberger M,Bienstman P,Dambre J

doi

10.1038/s41598-020-71549-y

subject

Has Abstract

pub_date

2020-09-02 00:00:00

pages

14451

issue

1

issn

2045-2322

pii

10.1038/s41598-020-71549-y

journal_volume

10

pub_type

杂志文章
  • Image Quality and Radiation Dose for Prospectively Triggered Coronary CT Angiography: 128-Slice Single-Source CT versus First-Generation 64-Slice Dual-Source CT.

    abstract::This study sought to compare the image quality and radiation dose of coronary computed tomography angiography (CCTA) from prospectively triggered 128-slice CT (128-MSCT) versus dual-source 64-slice CT (DSCT). The study was approved by the Medical Ethics Committee at Tongji Medical College of Huazhong University of Sci...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep34795

    authors: Gu J,Shi HS,Han P,Yu J,Ma GN,Wu S

    更新日期:2016-10-18 00:00:00

  • Modelling of substrate access and substrate binding to cephalosporin acylases.

    abstract::Semisynthetic cephalosporins are widely used antibiotics currently produced by different chemical steps under harsh conditions, which results in a considerable amount of toxic waste. Biocatalytic synthesis by the cephalosporin acylase from Pseudomonas sp. strain N176 is a promising alternative. Despite intensive engin...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-48849-z

    authors: Ferrario V,Fischer M,Zhu Y,Pleiss J

    更新日期:2019-08-27 00:00:00

  • Multi-photon absorption limits to heralded single photon sources.

    abstract::Single photons are of paramount importance to future quantum technologies, including quantum communication and computation. Nonlinear photonic devices using parametric processes offer a straightforward route to generating photons, however additional nonlinear processes may come into play and interfere with these sourc...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep03087

    authors: Husko CA,Clark AS,Collins MJ,De Rossi A,Combrié S,Lehoucq G,Rey IH,Krauss TF,Xiong C,Eggleton BJ

    更新日期:2013-11-04 00:00:00

  • Glycine triggers a non-ionotropic activity of GluN2A-containing NMDA receptors to confer neuroprotection.

    abstract::Ionotropic activation of NMDA receptors (NMDARs) requires agonist glutamate and co-agonist glycine. Here we show that glycine enhances the activation of cell survival-promoting kinase Akt in cultured cortical neurons in which both the channel activity of NMDARs and the glycine receptors are pre-inhibited. The effect o...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep34459

    authors: Hu R,Chen J,Lujan B,Lei R,Zhang M,Wang Z,Liao M,Li Z,Wan Y,Liu F,Feng H,Wan Q

    更新日期:2016-10-03 00:00:00

  • Tetrameric structure of the restriction DNA glycosylase R.PabI in complex with nonspecific double-stranded DNA.

    abstract::R.PabI is a type II restriction enzyme that recognizes the 5'-GTAC-3' sequence and belongs to the HALFPIPE superfamily. Although most restriction enzymes cleave phosphodiester bonds at specific sites by hydrolysis, R.PabI flips the guanine and adenine bases of the recognition sequence out of the DNA helix and hydrolyz...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep35197

    authors: Wang D,Miyazono KI,Tanokura M

    更新日期:2016-10-12 00:00:00

  • The short isoform of extended synaptotagmin-2 controls Ca2+ dynamics in T cells via interaction with STIM1.

    abstract::Ca2+ release-activated Ca2+ (CRAC) channels elevate cytoplasmic Ca2+ concentration, which is essential for T cell activation, differentiation and effector functions. T cell receptor stimulation induces depletion of the endoplasmic reticulum (ER) Ca2+ stores, which is sensed by stromal interaction molecule 1 (STIM1). S...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-71489-7

    authors: Woo JS,Sun Z,Srikanth S,Gwack Y

    更新日期:2020-09-02 00:00:00

  • Predictive value of suvmax changes between two sequential post-therapeutic FDG-pet in head and neck squamous cell carcinomas.

    abstract::18-flurodesoxyglucose position emission tomography (FDG-PET) with computed tomography (CT) or magnetic resonance imaging (MRI) is a broadly accepted tool for pretherapeutic staging and post-therapeutic assessment of response. The prognostic value of sequential post-therapeutic FDG-PETs and the impact of change in meta...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-73914-3

    authors: Stadler TM,Hüllner MW,Broglie MA,Morand GB

    更新日期:2020-10-07 00:00:00

  • AutoImpute: Autoencoder based imputation of single-cell RNA-seq data.

    abstract::The emergence of single-cell RNA sequencing (scRNA-seq) technologies has enabled us to measure the expression levels of thousands of genes at single-cell resolution. However, insufficient quantities of starting RNA in the individual cells cause significant dropout events, introducing a large number of zero counts in t...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-34688-x

    authors: Talwar D,Mongia A,Sengupta D,Majumdar A

    更新日期:2018-11-05 00:00:00

  • Analysis of microRNA and Gene Expression Profiles in Alzheimer's Disease: A Meta-Analysis Approach.

    abstract::Understanding the molecular mechanisms underlying Alzheimer's disease (AD) is necessary for the diagnosis and treatment of this neurodegenerative disorder. It is therefore important to detect the most important genes and miRNAs, which are associated with molecular events, and studying their interactions for recognitio...

    journal_title:Scientific reports

    pub_type: 杂志文章,meta分析

    doi:10.1038/s41598-018-20959-0

    authors: Moradifard S,Hoseinbeyki M,Ganji SM,Minuchehr Z

    更新日期:2018-03-19 00:00:00

  • Quantifying biodiversity trade-offs in the face of widespread renewable and unconventional energy development.

    abstract::The challenge of balancing biodiversity protection with economic growth is epitomized by the development of renewable and unconventional energy, whose adoption is aimed at stemming the impacts of global climate change, yet has outpaced our understanding of biodiversity impacts. We evaluated the potential conflict betw...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-64501-7

    authors: Popescu VD,Munshaw RG,Shackelford N,Montesino Pouzols F,Dubman E,Gibeau P,Horne M,Moilanen A,Palen WJ

    更新日期:2020-05-05 00:00:00

  • Copy number gains of the putative CRKL oncogene in laryngeal squamous cell carcinoma result in strong nuclear expression of the protein and influence cell proliferation and migration.

    abstract::Laryngeal squamous cell carcinoma is a major medical problem worldwide. Although our understanding of genetic changes and their consequences in laryngeal cancer has opened new therapeutic pathways over the years, the diagnostic as well as treatment options still need to be improved. In our previous study, we identifie...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-56870-5

    authors: Kostrzewska-Poczekaj M,Bednarek K,Jarmuz-Szymczak M,Bodnar M,Filas V,Marszalek A,Bartochowska A,Grenman R,Kiwerska K,Szyfter K,Giefing M

    更新日期:2020-01-08 00:00:00

  • Circulating and tumor-infiltrating mucosal associated invariant T (MAIT) cells in colorectal cancer patients.

    abstract::Mucosal associated invariant T (MAIT) cells are important for immune defense against infectious pathogens and regulate the pathogenesis of various inflammatory diseases. However, their roles in the development of colorectal cancer (CRC) are still unclear. This study examined the phenotype, distribution, clinical relev...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep20358

    authors: Ling L,Lin Y,Zheng W,Hong S,Tang X,Zhao P,Li M,Ni J,Li C,Wang L,Jiang Y

    更新日期:2016-02-03 00:00:00

  • Hidden Hypocalcemia as a Risk Factor for Cardiovascular Events and All-Cause Mortality among Patients Undergoing Incident Hemodialysis.

    abstract::Lower corrected calcium (cCa) levels are associated with a better prognosis among incident dialysis patients. However, cCa frequently overestimates ionized calcium (iCa) levels. The prognostic importance of the true calcium status defined by iCa remains to be revealed. We conducted a retrospective cohort study of inci...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-61459-4

    authors: Yamaguchi S,Hamano T,Doi Y,Oka T,Kajimoto S,Kubota K,Yasuda S,Shimada K,Matsumoto A,Hashimoto N,Sakaguchi Y,Matsui I,Isaka Y

    更新日期:2020-03-10 00:00:00

  • Insights into the 400 million-year-old eyes of giant sea scorpions (Eurypterida) suggest the structure of Palaeozoic compound eyes.

    abstract::Sea scorpions (Eurypterida, Chelicerata) of the Lower Devonian (~400 Mya) lived as large, aquatic predators. The structure of modern chelicerate eyes is very different from that of mandibulate compound eyes [Mandibulata: Crustacea and Tracheata (Hexapoda, such as insects, and Myriapoda)]. Here we show that the visual ...

    journal_title:Scientific reports

    pub_type: 历史文章,杂志文章

    doi:10.1038/s41598-019-53590-8

    authors: Schoenemann B,Poschmann M,Clarkson ENK

    更新日期:2019-11-28 00:00:00

  • Cardiotrophin-1 is inversely associated with obesity in non-diabetic individuals.

    abstract::Cardiotrophin-1 is known to be a key regulator of energy homeostasis, as well as glucose and lipid metabolism in vivo. However, there are inconsistent results of the association between cardiotrophin-1 and obesity in humans, possibly confounded by hyperglycemia. Therefore, the aim of this study was to investigate the ...

    journal_title:Scientific reports

    pub_type: 临床试验,杂志文章

    doi:10.1038/srep17438

    authors: Hung HC,Lu FH,Wu HT,Ou HY,Yang YC,Wu JS,Chang CJ

    更新日期:2015-12-01 00:00:00

  • Hydrothermal synthesis of novel 1-aminoperylene diimide/TiO2/MoS2 composite with enhanced photocatalytic activity.

    abstract::1-aminoperylene diimide/TiO2/MoS2 composite (NH2-PDI/TiO2/MoS2) with ordered structure was prepared by hydrothermal synthesis method. The composite was characterized by XRD, SEM, FTIR, XPS, BET, DRS, PL, EIS, Raman, photocurrent, and Mott-Schottky plots spectroscopy. The potential positions of the conduction and valen...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-78894-y

    authors: Ma Y,Wang Y,Jiang T,Zhang F,Li X,Zhu Y

    更新日期:2020-12-15 00:00:00

  • Arsenite-loaded nanoparticles inhibit PARP-1 to overcome multidrug resistance in hepatocellular carcinoma cells.

    abstract::Hepatocellular carcinoma (HCC) is one of the highest incidences in cancers; however, traditional chemotherapy often suffers from low efficiency caused by drug resistance. Herein, we report an arsenite-loaded dual-drug (doxorubicin and arsenic trioxide, i.e., DOX and ATO) nanomedicine system (FeAsOx@SiO2-DOX, Combo NP)...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep31009

    authors: Liu H,Zhang Z,Chi X,Zhao Z,Huang D,Jin J,Gao J

    更新日期:2016-08-03 00:00:00

  • Soluble epoxide hydrolase inhibition decreases reperfusion injury after focal cerebral ischemia.

    abstract::Epoxyeicosatrienoic acids (EETs) are produced by cytochrome P450 epoxygenases from arachidonic acid, and their rapid metabolism is mainly through soluble epoxide hydrolase (sEH). EETs exert vasodilatory, anti-inflammatory, anti-apoptotic, and pro-angiogenic effects. Administration of sEH inhibitors before or at the on...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-23504-1

    authors: Tu R,Armstrong J,Lee KSS,Hammock BD,Sapirstein A,Koehler RC

    更新日期:2018-03-27 00:00:00

  • ShadowR: a novel chromoprotein with reduced non-specific binding and improved expression in living cells.

    abstract::Here we developed an orange light-absorbing chromoprotein named ShadowR as a novel acceptor for performing fluorescence lifetime imaging microscopy-based Förster resonance energy transfer (FLIM-FRET) measurement in living cells. ShadowR was generated by replacing hydrophobic amino acids located at the surface of the c...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-48604-4

    authors: Murakoshi H,Horiuchi H,Kosugi T,Onda M,Sato A,Koga N,Nabekura J

    更新日期:2019-08-19 00:00:00

  • Study of the Dynamic Development Law of Overburden Breakage on Mining Faces.

    abstract::Based on the geological conditions of overburden rock, the dynamic development law of overburden breakage was investigated by theoretical analysis and similarity model experiments in this paper. The formula of the compressive strength and No. ratio was obtained by testing the compressive strength of cylinder samples o...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-63526-2

    authors: Zhu H,Fang S,Huo Y,Guo J,Wu Y,Hu L

    更新日期:2020-04-16 00:00:00

  • K-core robustness in ecological and financial networks.

    abstract::In many real-world networks, the ability to withstand targeted or global attacks; extinctions; or shocks is vital to the survival of the network itself, and of dependent structures such as economies (for financial networks) or even the planet (for ecosystems). Previous attempts to characterise robustness include neste...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-59959-4

    authors: Burleson-Lesser K,Morone F,Tomassone MS,Makse HA

    更新日期:2020-02-25 00:00:00

  • Interplay between 3'-UTR polymorphisms in the methylenetetrahydrofolate reductase (MTHFR) gene and the risk of ischemic stroke.

    abstract::Stroke incidence is a multifactorial disease and especially hyperhomocysteinemia is associated with a higher risk of stroke. Previous studies have reported a folate metabolism disorder associated with the MTHFR gene. We investigated four single nucleotide polymorphisms in the MTHFR 3'-UTR [2572 C > A (rs4846049), 4869...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-12668-x

    authors: Kim JO,Park HS,Ryu CS,Shin JW,Kim J,Oh SH,Kim OJ,Kim NK

    更新日期:2017-09-29 00:00:00

  • The infinite possible growth ambients that support single-wall carbon nanotube forest growth.

    abstract::We report the virtually infinite possible carbon feedstocks which support the highly efficient growth of single-wall carbon nanotubes (SWCNTs) using on the water-assisted chemical vapor deposition method. Our results demonstrate that diverse varieties of carbon feedstocks, in the form of hydrocarbons, spanning saturat...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep03334

    authors: Kimura H,Goto J,Yasuda S,Sakurai S,Yumura M,Futaba DN,Hata K

    更新日期:2013-11-26 00:00:00

  • Identification of DKK-1 as a novel mediator of statin effects in human endothelial cells.

    abstract::This study shows that DKK-1, a member of the Dickkopf family and a regulator of the Wnt pathways, represents a novel target of statins which, through the inhibition of HMG-CoA reductase and of non-steroidal isoprenoid intermediates, exert extra-beneficial effect in preventing atherosclerosis beyond their effect on the...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-35119-7

    authors: Pontremoli M,Brioschi M,Baetta R,Ghilardi S,Banfi C

    更新日期:2018-11-12 00:00:00

  • Improving ultrasound images with elevational angular compounding based on acoustic refraction.

    abstract::Ultrasound imaging is affected by coherent noise or speckle, which reduces contrast and overall image quality and degrades the diagnostic precision of the collected images. Elevational angular compounding (EAC) is an attractive means of addressing this limitation, since it reduces speckle noise while operating in real...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-75092-8

    authors: Afshari P,Zakian C,Ntziachristos V

    更新日期:2020-10-23 00:00:00

  • Study on analytical characteristics of Nicotiana tabacum L., cv. Solaris biomass for potential uses in nutrition and biomethane production.

    abstract::In order to limit the smoking tobacco sector crisis, a new non-GMO Nicotiana tabacum L. cv. Solaris was proposed as oil seed crop. Residues of oil extraction were successfully used in swine nutrition. The aim of this study was to explore the full potential of this innovative tobacco cultivar as multitasking feedstock ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-53237-8

    authors: Fatica A,Di Lucia F,Marino S,Alvino A,Zuin M,De Feijter H,Brandt B,Tommasini S,Fantuz F,Salimei E

    更新日期:2019-11-14 00:00:00

  • Synthesis of an arrayed sgRNA library targeting the human genome.

    abstract::Clustered regularly interspaced short palindromic repeats (CRISPR) in conjunction with CRISPR-associated proteins (Cas) can be employed to introduce double stand breaks into mammalian genomes at user-defined loci. The endonuclease activity of the Cas complex can be targeted to a specific genomic region using a single ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep14987

    authors: Schmidt T,Schmid-Burgk JL,Hornung V

    更新日期:2015-10-08 00:00:00

  • Unraveling a molecular determinant for clathrin-independent internalization of the M2 muscarinic acetylcholine receptor.

    abstract::Endocytosis and postendocytic sorting of G-protein-coupled receptors (GPCRs) is important for the regulation of both their cell surface density and signaling profile. Unlike the mechanisms of clathrin-dependent endocytosis (CDE), the mechanisms underlying the control of GPCR signaling by clathrin-independent endocytos...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep11408

    authors: Wan M,Zhang W,Tian Y,Xu C,Xu T,Liu J,Zhang R

    更新日期:2015-06-22 00:00:00

  • Scaffold-Hopping from Synthetic Drugs by Holistic Molecular Representation.

    abstract::The discovery of novel ligand chemotypes allows to explore uncharted regions in chemical space, thereby potentially improving synthetic accessibility, potency, and the drug-likeness of molecules. Here, we demonstrate the scaffold-hopping ability of the new Weighted Holistic Atom Localization and Entity Shape (WHALES) ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-34677-0

    authors: Grisoni F,Merk D,Byrne R,Schneider G

    更新日期:2018-11-07 00:00:00

  • Transcriptional repressor domain of MBD1 is intrinsically disordered and interacts with its binding partners in a selective manner.

    abstract::Methylation of DNA CpG sites is a major mechanism of epigenetic gene silencing and plays important roles in cell division, development and carcinogenesis. One of its regulators is the 64-residue C-terminal Transcriptional Repressor Domain (the TRD) of MBD1, which recruits several repressor proteins such as MCAF1, HDAC...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep04896

    authors: Hameed UF,Lim J,Zhang Q,Wasik MA,Yang D,Swaminathan K

    更新日期:2014-05-09 00:00:00