Stepwise PathNet: a layer-by-layer knowledge-selection-based transfer learning algorithm.

Abstract:

:Some neural network can be trained by transfer learning, which uses a pre-trained neural network as the source task, for a small target task's dataset. The performance of the transfer learning depends on the knowledge (i.e., layers) selected from the pre-trained network. At present, this knowledge is usually chosen by humans. The transfer learning method PathNet automatically selects pre-trained modules or adjustable modules in a modular neural network. However, PathNet requires modular neural networks as the pre-trained networks, therefore non-modular pre-trained neural networks are currently unavailable. Consequently, PathNet limits the versatility of the network structure. To address this limitation, we propose Stepwise PathNet, which regards the layers of a non-modular pre-trained neural network as the module in PathNet and selects the layers automatically through training. In an experimental validation of transfer learning from InceptionV3 pre-trained on the ImageNet dataset to networks trained on three other datasets (CIFAR-100, SVHN and Food-101), Stepwise PathNet was up to 8% and 10% more accurate than finely tuned and from-scratch approaches, respectively. Also, some of the selected layers were not supported by the layer functions assumed in PathNet.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Imai S,Kawai S,Nobuhara H

doi

10.1038/s41598-020-64165-3

subject

Has Abstract

pub_date

2020-05-18 00:00:00

pages

8132

issue

1

issn

2045-2322

pii

10.1038/s41598-020-64165-3

journal_volume

10

pub_type

杂志文章
  • A rational experimental approach to identify correctly the working voltage window of aqueous-based supercapacitors.

    abstract::It is common to find in the literature different values for the working voltage window (WVW) range for aqueous-based supercapacitors. In many cases, even with the best intentions of the widening the operating voltage window, the measured current using the cyclic voltammetry (CV) technique includes a significant contri...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-75851-7

    authors: Nunes WG,Freitas BGA,Beraldo RM,Filho RM,Da Silva LM,Zanin H

    更新日期:2020-11-05 00:00:00

  • Gene set of chemosensory receptors in the polyembryonic endoparasitoid Macrocentrus cingulum.

    abstract::Insects are extremely successful animals whose odor perception is very prominent due to their sophisticated olfactory system. The main chemosensory organ, antennae play a critical role in detecting odor in ambient environment before initiating appropriate behavioral responses. The antennal chemosensory receptor genes ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep24078

    authors: Ahmed T,Zhang T,Wang Z,He K,Bai S

    更新日期:2016-04-19 00:00:00

  • Enhanced high-frequency absorption of anisotropic Fe3O4/graphene nanocomposites.

    abstract::Anisotropic Fe3O4 nanoparticle and a series of its graphene composites have been successfully prepared as high-frequency absorbers. The crystal structure, morphology and magnetic property of the samples were detailed characterized through X-ray diffractometer (XRD), transmission electron microscopy (TEM) and vibrating...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep25075

    authors: Yin Y,Zeng M,Liu J,Tang W,Dong H,Xia R,Yu R

    更新日期:2016-05-04 00:00:00

  • Circulating VEGF and eNOS variations as predictors of outcome in metastatic colorectal cancer patients receiving bevacizumab.

    abstract::Novel predictive biomarkers are needed to improve patient selection and optimize the use of bevacizumab (B) in metastatic colorectal cancer. We analyzed the potential of five circulating biomarkers to predict B efficacy and monitor response. Peripheral blood samples collected at baseline, at the first clinical evaluat...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-01420-0

    authors: Marisi G,Scarpi E,Passardi A,Nanni O,Ragazzini A,Valgiusti M,Casadei Gardini A,Neri LM,Frassineti GL,Amadori D,Ulivi P

    更新日期:2017-05-02 00:00:00

  • Cancer cells grown in 3D under fluid flow exhibit an aggressive phenotype and reduced responsiveness to the anti-cancer treatment doxorubicin.

    abstract::3D laboratory models of cancer are designed to recapitulate the biochemical and biophysical characteristics of the tumour microenvironment and aim to enable studies of cancer, and new therapeutic modalities, in a physiologically-relevant manner. We have developed an in vitro 3D model comprising a central high-density ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-68999-9

    authors: Azimi T,Loizidou M,Dwek MV

    更新日期:2020-07-21 00:00:00

  • Nanofibrous asymmetric collagen/curcumin membrane containing aspirin-loaded PLGA nanoparticles for guided bone regeneration.

    abstract::The goal of the current study was to develop an asymmetric guided bone regeneration (GBR) membrane benefiting from curcumin and aspirin. The membrane was prepared using electrospinning technique and then was physic-chemically characterized by the conventional methods. The release profile of aspirin from the prepared m...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-75454-2

    authors: Ghavimi MA,Bani Shahabadi A,Jarolmasjed S,Memar MY,Maleki Dizaj S,Sharifi S

    更新日期:2020-10-23 00:00:00

  • Robust Statistical Detection of Power-Law Cross-Correlation.

    abstract::We show that widely used approaches in statistical physics incorrectly indicate the existence of power-law cross-correlations between financial stock market fluctuations measured over several years and the neuronal activity of the human brain lasting for only a few minutes. While such cross-correlations are nonsensica...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep27089

    authors: Blythe DA,Nikulin VV,Müller KR

    更新日期:2016-06-02 00:00:00

  • Emission of direct-gap band in germanium with Ge-GeSn layers on one-dimensional structure.

    abstract::In our experiment, it was observed that the emission of direct-gap band in germanium with Ge-GeSn layers on one-dimensional (1D) structure. The results of experiment and calculation demonstrate that the uniaxial tensile strain in the (111) and (110) direction can efficiently transform Ge to a direct bandgap material w...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep24802

    authors: Huang ZM,Huang WQ,Liu SR,Dong TG,Wang G,Wu XK,Qin CJ

    更新日期:2016-04-21 00:00:00

  • Traumatic Brain Injury Leads to Accelerated Atherosclerosis in Apolipoprotein E Deficient Mice.

    abstract::Traumatic brain injury (TBI) has been associated with atherosclerosis and cardiovascular mortality in humans. However the causal relationship between TBI and vascular disease is unclear. This study investigated the direct role of TBI on vascular disease using a murine model of atherosclerosis. Apolipoprotein E deficie...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-23959-2

    authors: Wang J,Su E,Wang H,Guo C,Lawrence DA,Eitzman DT

    更新日期:2018-04-04 00:00:00

  • Epoxy pre-polymers as new and effective materials for corrosion inhibition of carbon steel in acidic medium: Computational and experimental studies.

    abstract::Present study is designed for the synthesis, characterization and corrosion inhibition behavior of two diamine aromatic epoxy pre-polymers (DAEPs) namely, N1,N1,N2,N2-tetrakis (oxiran-2-ylmethyl) benzene-1,2-diamine (DAEP1) and 4-methyl-N1,N1,N2,N2-tetrakis (oxiran-2-ylmethyl) benzene-1,2-diamine (DAEP2) for carbon st...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-48284-0

    authors: Dagdag O,Safi Z,Hsissou R,Erramli H,El Bouchti M,Wazzan N,Guo L,Verma C,Ebenso EE,El Harfi A

    更新日期:2019-08-12 00:00:00

  • Analysis of L-arginine:glycine amidinotransferase-, creatine- and homoarginine-dependent gene regulation in the murine heart.

    abstract::L-arginine:glycine amidinotransferase (AGAT) and its metabolites creatine and homoarginine (HA) have been linked to cardiovascular pathologies in both human and murine studies, but the underlying molecular mechanisms are poorly understood. Here, we report the first analysis of heart transcriptome variation using micro...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-61638-3

    authors: Jensen M,Müller C,Choe CU,Schwedhelm E,Zeller T

    更新日期:2020-03-16 00:00:00

  • Dyssynergic patterns of defecation in constipated adolescents and young adults with anorectal malformations.

    abstract::We aimed to evaluate the etiologies of constipation in patients with anorectal malformations having a good prognosis for bowel control but a high risk of constipation. We included twenty-five patients from the Odense university hospital in Denmark. Patients were subjected to colon transit time examination and high res...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-76841-5

    authors: Bjørsum-Meyer T,Christensen P,Baatrup G,Jakobsen MS,Asmussen J,Qvist N

    更新日期:2020-11-12 00:00:00

  • Discordance in HER2 Status in Gastro-esophageal Adenocarcinomas: A Systematic Review and Meta-analysis.

    abstract::Trastuzumab combined with chemotherapy is standard of care for HER2 positive advanced gastro-esophageal cancers. The reported prevalence of HER2 discordance between primary tumors and corresponding metastases varies, hampering uniform patient selection for HER2 targeted therapy. This meta-analysis explores the influen...

    journal_title:Scientific reports

    pub_type: 杂志文章,meta分析

    doi:10.1038/s41598-017-03304-9

    authors: Creemers A,Ter Veer E,de Waal L,Lodder P,Hooijer GKJ,van Grieken NCT,Bijlsma MF,Meijer SL,van Oijen MGH,van Laarhoven HWM

    更新日期:2017-06-09 00:00:00

  • A Silk Fibroin Bio-Transient Solution Processable Memristor.

    abstract::Today's electronic devices are fabricated using highly toxic materials and processes which limits their applications in environmental sensing applications and mandates complex encapsulation methods in biological and medical applications. This paper proposes a fully resorbable high density bio-compatible and environmen...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-15395-5

    authors: Yong J,Hassan B,Liang Y,Ganesan K,Rajasekharan R,Evans R,Egan G,Kavehei O,Li J,Chana G,Nasr B,Skafidas E

    更新日期:2017-11-07 00:00:00

  • The interaction of Ag2O nanoparticles with Escherichia coli: inhibition-sterilization process.

    abstract::Silver-based antibacterial agents have obtained wide attention due to the fact that bacteria in the environment is ubiquitous, which has become one of the most difficult problems for human health. However, the antibacterial mechanism and process are still inconclusive. Here, Ag2O nanoparticles (NPs) with uniform spher...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-021-81305-5

    authors: Li D,Chen S,Zhang K,Gao N,Zhang M,Albasher G,Shi J,Wang C

    更新日期:2021-01-18 00:00:00

  • Complete genome sequences of Streptococcus pyogenes type strain reveal 100%-match between PacBio-solo and Illumina-Oxford Nanopore hybrid assemblies.

    abstract::We present the first complete, closed genome sequences of Streptococcus pyogenes strains NCTC 8198T and CCUG 4207T, the type strain of the type species of the genus Streptococcus and an important human pathogen that causes a wide range of infectious diseases. S. pyogenes NCTC 8198T and CCUG 4207T are derived from depo...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-68249-y

    authors: Salvà-Serra F,Jaén-Luchoro D,Jakobsson HE,Gonzales-Siles L,Karlsson R,Busquets A,Gomila M,Bennasar-Figueras A,Russell JE,Fazal MA,Alexander S,Moore ERB

    更新日期:2020-07-15 00:00:00

  • Disorder and defects are not intrinsic to boron carbide.

    abstract::A unique combination of useful properties in boron-carbide, such as extreme hardness, excellent fracture toughness, a low density, a high melting point, thermoelectricity, semi-conducting behavior, catalytic activity and a remarkably good chemical stability, makes it an ideal material for a wide range of technological...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep19330

    authors: Mondal S,Bykova E,Dey S,Ali SI,Dubrovinskaia N,Dubrovinsky L,Parakhonskiy G,van Smaalen S

    更新日期:2016-01-18 00:00:00

  • The neural correlates of integrated aesthetics between moral and facial beauty.

    abstract::Facial beauty and moral beauty have been suggested to be two significant forms of social aesthetics. However, it remains unknown the extent to which there are neural underpinnings of the integration of these two forms of beauty. In the present study, participants were asked to make general aesthetic judgments of facia...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-38553-3

    authors: Luo Q,Yu M,Li Y,Mo L

    更新日期:2019-02-13 00:00:00

  • Gearing Up the Human Ankle-Foot System to Reduce Energy Cost of Fast Walking.

    abstract::During locomotion, the human ankle-foot system dynamically alters its gearing, or leverage of the ankle joint on the ground. Shifting ankle-foot gearing regulates speed of plantarflexor (i.e., calf muscle) contraction, which influences economy of force production. Here, we tested the hypothesis that manipulating ankle...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-65626-5

    authors: Ray SF,Takahashi KZ

    更新日期:2020-05-29 00:00:00

  • Caveolin-2 deficiency induces a rapid anti-tumor immune response prior to regression of implanted murine lung carcinoma tumors.

    abstract::Immunosuppression is critical for tumor growth and metastasis as well as obstacle to effective immunotherapy. Here, we demonstrate that host deficiency in caveolin-2, a member of caveolin protein family, increases M1-polarized tumor-associated macrophage (TAM) and CD8 T cell infiltration into subcutaneously implanted ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-55368-4

    authors: Liu Y,Qi X,Li G,Sowa G

    更新日期:2019-12-12 00:00:00

  • Antibodies against a short region of PfRipr inhibit Plasmodium falciparum merozoite invasion and PfRipr interaction with Rh5 and SEMA7A.

    abstract::Plasmodium falciparum merozoite invasion into erythrocytes is an essential step of the blood-stage cycle, survival of parasites, and malaria pathogenesis. P. falciparum merozoite Rh5 interacting protein (PfRipr) forms a complex with Rh5 and CyRPA in sequential molecular events leading to erythrocyte invasion. Recently...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-63611-6

    authors: Nagaoka H,Kanoi BN,Ntege EH,Aoki M,Fukushima A,Tsuboi T,Takashima E

    更新日期:2020-04-20 00:00:00

  • A decadal analysis of bioeroding sponge cover on the inshore Great Barrier Reef.

    abstract::Decreasing coral cover on the Great Barrier Reef (GBR) may provide opportunities for rapid growth and expansion of other taxa. The bioeroding sponges Cliona spp. are strong competitors for space and may take advantage of coral bleaching, damage, and mortality. Benthic surveys of the inshore GBR (2005-2014) revealed th...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-02196-z

    authors: Ramsby BD,Hoogenboom MO,Whalan S,Webster NS,Thompson A

    更新日期:2017-06-02 00:00:00

  • Increased blood COASY DNA methylation levels a potential biomarker for early pathology of Alzheimer's disease.

    abstract::Early diagnosis of dementia including Alzheimer's disease (AD) is an urgent medical and welfare issue. However, to date, no simple biometrics have been available. We reported that blood DNA methylation levels of the COASY gene, which encodes coenzyme A synthase, were increased in individuals with AD and amnestic mild ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-69248-9

    authors: Kobayashi N,Shinagawa S,Niimura H,Kida H,Nagata T,Tagai K,Shimada K,Oka N,Shikimoto R,Noda Y,Nakajima S,Mimura M,Shigeta M,Kondo K

    更新日期:2020-07-22 00:00:00

  • Treatment with etanercept and low monocyte concentration contribute to the risk of invasive aspergillosis in patients post allogeneic stem cell transplantation.

    abstract::Invasive aspergillosis (IA) is a life-threatening complication among allogeneic hematopoietic stem cell transplant (alloSCT) recipients. Despite well known risk factors and different available assays, diagnosis of invasive aspergillosis remains challenging. 103 clinical variables from patients with hematological malig...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-53504-8

    authors: Zoran T,Weber M,Springer J,White PL,Bauer J,Schober A,Löffler C,Seelbinder B,Hünniger K,Kurzai O,Scherag A,Schäuble S,Morton CO,Einsele H,Linde J,Löffler J

    更新日期:2019-11-21 00:00:00

  • Three-dimensional reconstruction of laryngeal cancer with whole organ serial immunohistochemical sections.

    abstract::Three-dimensional (3D) image reconstruction of tumors based on serial histological sectioning is one of the most powerful methods for accurate high-resolution visualization of tumor structures. However, 3D histological reconstruction of whole tumor has not yet been achieved. We established a high-resolution 3D model o...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-76081-7

    authors: Tian J,Qian B,Zhang S,Guo R,Zhang H,Jeannon JP,Jin R,Feng X,Zhan Y,Liu J,He P,Guo J,Li L,Jia Y,Huang F,Wang B

    更新日期:2020-11-03 00:00:00

  • Analysis of coupling between magnetic dipoles enhanced by metasurfaces for wireless power transfer efficiency improvement.

    abstract::In this paper, we investigate the possibility of improving efficiency in non-radiative wireless power transfer (WPT) using metasurfaces embedded between two current varying coils and present a complete theoretical analysis of this system. We use a point-dipole approximation to calculate the fields of the coils. Based ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-33174-8

    authors: Younesiraad H,Bemani M

    更新日期:2018-10-05 00:00:00

  • Natural Intermediate Band in I 2 -II-IV-VI4 Quaternary Chalcogenide Semiconductors.

    abstract::An intermediate band in the band gap of semiconductors is fundamental to the development of the intermediate band solar cells, but it is usually produced artificially, which imposes technical challenges on the experimental realization. Here we found that there are natural intermediate bands in the band gaps of the I2-...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-19935-5

    authors: Liu Q,Cai Z,Han D,Chen S

    更新日期:2018-01-25 00:00:00

  • Chemical and structural stability of lithium-ion battery electrode materials under electron beam.

    abstract::The investigation of chemical and structural dynamics in battery materials is essential to elucidation of structure-property relationships for rational design of advanced battery materials. Spatially resolved techniques, such as scanning/transmission electron microscopy (S/TEM), are widely applied to address this chal...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep05694

    authors: Lin F,Markus IM,Doeff MM,Xin HL

    更新日期:2014-07-16 00:00:00

  • Characterization of miR-200 family members as blood biomarkers for human and laying hen ovarian cancer.

    abstract::MicroRNA-200 (miR-200) family is highly expressed in ovarian cancer. We evaluated the levels of family members relative to the internal control miR-103a in ovarian cancer and control blood specimens collected from American and Hong Kong Chinese institutions, as well as from a laying hen spontaneous ovarian cancer mode...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-77068-0

    authors: Choi PW,Bahrampour A,Ng SK,Liu SK,Qiu W,Xie F,Kuo WP,Kwong J,Hales KH,Hales DB,Wong KK,Norwitz ER,Chow CK,Berkowitz RS,Ng SW

    更新日期:2020-11-18 00:00:00

  • Experimental proof of emergent subharmonic attenuation zones in a nonlinear locally resonant metamaterial.

    abstract::High-performance locally resonant metamaterials represent the next frontier in materials technology due to their extraordinary properties obtained through materials design, enabling a variety of potential applications. The most exceptional feature of locally resonant metamaterials is the subwavelength size of their un...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-68894-3

    authors: Zega V,Silva PB,Geers MGD,Kouznetsova VG

    更新日期:2020-07-21 00:00:00