Variability and reproducibility in deep learning for medical image segmentation.

Abstract:

:Medical image segmentation is an important tool for current clinical applications. It is the backbone of numerous clinical diagnosis methods, oncological treatments and computer-integrated surgeries. A new class of machine learning algorithm, deep learning algorithms, outperforms the results of classical segmentation in terms of accuracy. However, these techniques are complex and can have a high range of variability, calling the reproducibility of the results into question. In this article, through a literature review, we propose an original overview of the sources of variability to better understand the challenges and issues of reproducibility related to deep learning for medical image segmentation. Finally, we propose 3 main recommendations to address these potential issues: (1) an adequate description of the framework of deep learning, (2) a suitable analysis of the different sources of variability in the framework of deep learning, and (3) an efficient system for evaluating the segmentation results.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Renard F,Guedria S,Palma N,Vuillerme N

doi

10.1038/s41598-020-69920-0

subject

Has Abstract

pub_date

2020-08-13 00:00:00

pages

13724

issue

1

issn

2045-2322

pii

10.1038/s41598-020-69920-0

journal_volume

10

pub_type

杂志文章
  • Alteration of PD-L1 expression and its prognostic impact after concurrent chemoradiation therapy in non-small cell lung cancer patients.

    abstract::Concurrent chemoradiation therapy (CCRT) is the treatment of choice for locally advanced non-small cell lung cancer (LA-NSCLC). Several clinical trials that combine programmed cell death 1 (PD-1) axis inhibitors with radiotherapy are in development for patients with LA-NSCLC. However, the effect of CCRT on programmed ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-11949-9

    authors: Fujimoto D,Uehara K,Sato Y,Sakanoue I,Ito M,Teraoka S,Nagata K,Nakagawa A,Kosaka Y,Otsuka K,Imai Y,Hamakawa H,Takahashi Y,Kokubo M,Tomii K

    更新日期:2017-09-12 00:00:00

  • Hyperactivation of mTORC1 disrupts cellular homeostasis in cerebellar Purkinje cells.

    abstract::Mammalian target of rapamycin (mTOR) is a central regulator of cellular metabolism. The importance of mTORC1 signaling in neuronal development and functions has been highlighted by its strong relationship with many neurological and neuropsychiatric diseases. Previous studies demonstrated that hyperactivation of mTORC1...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-38730-4

    authors: Sakai Y,Kassai H,Nakayama H,Fukaya M,Maeda T,Nakao K,Hashimoto K,Sakagami H,Kano M,Aiba A

    更新日期:2019-02-26 00:00:00

  • Revealing of Core Shell Effect on Frequency-Dependent Properties of Bi-based Relaxor/Ferroelectric Ceramic Composites.

    abstract::In this study, electromechanical characteristics of (1-x) Bi0.5Na0.5TiO3-xSrTiO3 (ST26, x = 0.26)/(1-y) Bi0.5Na0.5TiO3-ySrTiO3 (ST10, y = 0.1) (matrix/seed) composites were studied. The ST26 (high relaxor phase) and ST10 (a relaxor ferroelectric (RF), high ferroelectric phase) composite with large (r-ST26-ST10) and sm...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-32133-7

    authors: Saleem M,Hwan LD,Kim IS,Kim MS,Maqbool A,Nisar U,Pervez SA,Farooq U,Farooq MU,Khalil HMW,Jeong SJ

    更新日期:2018-09-20 00:00:00

  • Creeping motion of self interstitial atom clusters in tungsten.

    abstract::The formation and motion features of self interstitial atom (SIA) clusters in tungsten are studied by molecular dynamics (MD) simulations. The static calculations show that the SIA clusters are stable with binding energy over 2 eV. The SIA clusters exhibit a fast one dimensional (1D) motion along 〈111〉. Through analys...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep05096

    authors: Zhou WH,Zhang CG,Li YG,Zeng Z

    更新日期:2014-05-28 00:00:00

  • Assessment of physical inactivity and locomotor dysfunction in adults with visual impairment.

    abstract::To evaluate the association between vision-related quality of life (QoL), physical inactivity, and locomotor dysfunction in subjects with visual impairment.This cross-sectional study included 215 visually impaired subjects recruited from six ophthalmology departments in Japan. The physical inactivity and locomotor dys...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-30599-z

    authors: Inoue S,Kawashima M,Hiratsuka Y,Nakano T,Tamura H,Ono K,Murakami A,Tsubota K,Yamada M

    更新日期:2018-08-13 00:00:00

  • Machine-learning Approach for the Development of a Novel Predictive Model for the Diagnosis of Hepatocellular Carcinoma.

    abstract::Because of its multifactorial nature, predicting the presence of cancer using a single biomarker is difficult. We aimed to establish a novel machine-learning model for predicting hepatocellular carcinoma (HCC) using real-world data obtained during clinical practice. To establish a predictive model, we developed a mach...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44022-8

    authors: Sato M,Morimoto K,Kajihara S,Tateishi R,Shiina S,Koike K,Yatomi Y

    更新日期:2019-05-30 00:00:00

  • Highly efficient CRISPR/Cas9-mediated transgene knockin at the H11 locus in pigs.

    abstract::Transgenic pigs play an important role in producing higher quality food in agriculture and improving human health when used as animal models for various human diseases in biomedicine. Production of transgenic pigs, however, is a lengthy and inefficient process that hinders research using pig models. Recent application...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep14253

    authors: Ruan J,Li H,Xu K,Wu T,Wei J,Zhou R,Liu Z,Mu Y,Yang S,Ouyang H,Chen-Tsai RY,Li K

    更新日期:2015-09-18 00:00:00

  • Estimating the probability of dengue virus introduction and secondary autochthonous cases in Europe.

    abstract::Given the speed of air travel, diseases even with a short viremia such as dengue can be easily exported to dengue naïve areas within 24 hours. We set out to estimate the risk of dengue virus introductions via travelers into Europe and number of secondary autochthonous cases as a result of the introduction. We applied ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-22590-5

    authors: Massad E,Amaku M,Coutinho FAB,Struchiner CJ,Burattini MN,Khan K,Liu-Helmersson J,Rocklöv J,Kraemer MUG,Wilder-Smith A

    更新日期:2018-03-15 00:00:00

  • The deubiquitylating enzyme UCHL3 regulates Ku80 retention at sites of DNA damage.

    abstract::Non-homologous end-joining (NHEJ), which can promote genomic instability when dysfunctional, is a major DNA double-strand break (DSB) repair pathway. Although ubiquitylation of the core NHEJ factor, Ku (Ku70-Ku80), which senses broken DNA ends, is important for its removal from sites of damage upon completion of NHEJ,...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-36235-0

    authors: Nishi R,Wijnhoven PWG,Kimura Y,Matsui M,Konietzny R,Wu Q,Nakamura K,Blundell TL,Kessler BM

    更新日期:2018-12-17 00:00:00

  • Structural mechanism of JH delivery in hemolymph by JHBP of silkworm, Bombyx mori.

    abstract::Juvenile hormone (JH) plays crucial roles in many aspects of the insect life. All the JH actions are initiated by transport of JH in the hemolymph as a complex with JH-binding protein (JHBP) to target tissues. Here, we report structural mechanism of JH delivery by JHBP based upon the crystal and solution structures of...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep00133

    authors: Suzuki R,Fujimoto Z,Shiotsuki T,Tsuchiya W,Momma M,Tase A,Miyazawa M,Yamazaki T

    更新日期:2011-01-01 00:00:00

  • Real-time locating and speed measurement of fibre fuse using optical frequency-domain reflectometry.

    abstract::We propose and experimentally demonstrate real-time locating and speed measurement of fibre fuse by analysing the Doppler shift of reflected light using optical frequency-domain reflectometry (OFDR). Our method can detect the start of a fibre fuse within 200 ms which is equivalent to a propagation distance of about 10...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep25585

    authors: Jiang S,Ma L,Fan X,Wang B,He Z

    更新日期:2016-05-05 00:00:00

  • Presence of heterocyclic amine carcinogens in home-cooked and fast-food camel meat burgers commonly consumed in Saudi Arabia.

    abstract::Heterocyclic amines (HCAs) are formed by cooking protein-rich foods, for instance, meat and fish, and are listed as possible human carcinogens. In the present study, the presence of five potential HCAs (IQ, MeIQ, MeIQx, 4,8-DiMeIQx, and PhIP) in cooked camel meat burgers was analyzed for the first time. The analysis w...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-01968-x

    authors: Rizwan Khan M,Naushad M,Abdullah Alothman Z

    更新日期:2017-05-10 00:00:00

  • microRNA Expression in Ethnic Specific Early Stage Breast Cancer: an Integration and Comparative Analysis.

    abstract::Breast cancer (BC) has a higher incidence in young Lebanese woman as compared to the West. We assessed the microRNA (miRNA) microarray profile of tissues derived from Lebanese patients with early BC and performed mRNA-miRNA integration analysis. 173 miRNAs were significantly dysregulated in 45 BC versus 17 normal adja...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-16978-y

    authors: Nassar FJ,Talhouk R,Zgheib NK,Tfayli A,El Sabban M,El Saghir NS,Boulos F,Jabbour MN,Chalala C,Boustany RM,Kadara H,Zhang Z,Zheng Y,Joyce B,Hou L,Bazarbachi A,Calin G,Nasr R

    更新日期:2017-12-04 00:00:00

  • Nest substrate reflects incubation style in extant archosaurs with implications for dinosaur nesting habits.

    abstract::Dinosaurs thrived and reproduced in various regions worldwide, including the Arctic. In order to understand their nesting in diverse or extreme environments, the relationships between nests, nesting environments, and incubation methods in extant archosaurs were investigated. Statistical analyses reveal that species of...

    journal_title:Scientific reports

    pub_type: 历史文章,杂志文章

    doi:10.1038/s41598-018-21386-x

    authors: Tanaka K,Zelenitsky DK,Therrien F,Kobayashi Y

    更新日期:2018-03-15 00:00:00

  • Postnatal development of the small intestinal mucosa drives age-dependent, regio-selective susceptibility to Escherichia coli K1 infection.

    abstract::The strong age dependency of neonatal systemic infection with Escherichia coli K1 can be replicated in the neonatal rat. Gastrointestinal (GI) colonization of two-day-old (P2) rats leads to invasion of the blood within 48 h of initiation of colonization; pups become progressively less susceptible to infection over the...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-00123-w

    authors: Birchenough GM,Dalgakiran F,Witcomb LA,Johansson ME,McCarthy AJ,Hansson GC,Taylor PW

    更新日期:2017-03-06 00:00:00

  • Respiratory tract infections among French Hajj pilgrims from 2014 to 2017.

    abstract::Respiratory tract infections (RTIs) are common among Hajj pilgrims, but risk factors for RTIs and respiratory pathogen acquisition during the Hajj are not clearly identified. Based on previous studies, most frequent pathogens acquired by Hajj pilgrims were investigated: rhinovirus, human coronaviruses, influenza virus...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-54370-0

    authors: Hoang VT,Ali-Salem S,Belhouchat K,Meftah M,Sow D,Dao TL,Ly TDA,Drali T,Ninove L,Yezli S,Alotaibi B,Raoult D,Parola P,Pommier de Santi V,Gautret P

    更新日期:2019-11-28 00:00:00

  • Controllable Phase Transformation and Mid-infrared Emission from Er(3+)-Doped Hexagonal-/Cubic-NaYF4 Nanocrystals.

    abstract::The morphology of hexagonal phase NaYF4:Er(3+) nanorods synthesized by hydrothermal method changed greatly after a continuing calcination, along with a phase transformation to cubic phase. Photoluminescence (PL) spectra indicated that mid-infrared (MIR) emission was obtained in both hexagonal and cubic phase NaYF4:Er(...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep29871

    authors: Yang D,Chen D,He H,Pan Q,Xiao Q,Qiu J,Dong G

    更新日期:2016-07-25 00:00:00

  • 24-hour-restraint stress induces long-term depressive-like phenotypes in mice.

    abstract::There is an increasing risk of mental disorders, such as acute stress disorder (ASD), post-traumatic stress disorder (PTSD) and depression among survivors who were trapped in rubble during earthquake. Such long-term impaction of a single acute restraint stress has not been extensively explored. In this study, we subje...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep32935

    authors: Chu X,Zhou Y,Hu Z,Lou J,Song W,Li J,Liang X,Chen C,Wang S,Yang B,Chen L,Zhang X,Song J,Dong Y,Chen S,He L,Xie Q,Chen X,Li W

    更新日期:2016-09-09 00:00:00

  • A large-scale population study of early life factors influencing left-handedness.

    abstract::Hand preference is a conspicuous variation in human behaviour, with a worldwide proportion of around 90% of people preferring to use the right hand for many tasks, and 10% the left hand. We used the large cohort of the UK biobank (~500,000 participants) to study possible relations between early life factors and adult ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-37423-8

    authors: de Kovel CGF,Carrión-Castillo A,Francks C

    更新日期:2019-01-24 00:00:00

  • Protein SUMOylation regulates insulin secretion at multiple stages.

    abstract::Type-II Diabetes Mellitus (T2DM) is one of the fastest growing public health issues of modern times, consuming 12% of worldwide health budgets and affecting an estimated 400 million people. A key pathological trait associated with this disease is the failure of normal glucose-stimulated insulin secretion (GSIS) from p...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-39681-6

    authors: Davey JS,Carmichael RE,Craig TJ

    更新日期:2019-02-27 00:00:00

  • Twisting phase and intensity of light with plasmonic metasurfaces.

    abstract::Twisting light in both phase and intensity has recently drawn great interests in various fields related to light-matter interactions such as optical manipulation of particles and quantum entanglement of photons. Conventionally, bulky optical components are required to produce such twisted optical beams, which signific...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-23382-7

    authors: Zhang Y,Yang X,Gao J

    更新日期:2018-03-20 00:00:00

  • The PSMP-CCR2 interactions trigger monocyte/macrophage-dependent colitis.

    abstract::Monocytes/macrophages have been found to be an important component of colitis. However, the key chemokine that initiates the CCR2+ monocytes migration from circulation to colitis tissue remains to be undiscovered. PC3-secreted microprotein (PSMP) is a novel chemokine whose receptor is CCR2. The physiological and patho...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-05255-7

    authors: Pei X,Zheng D,She S,Ma J,Guo C,Mo X,Zhang Y,Song Q,Zhang Y,Ma D,Wang Y

    更新日期:2017-07-11 00:00:00

  • PCSK9 inhibition as a novel therapeutic target for alcoholic liver disease.

    abstract::Alcoholic liver disease (ALD) causes significant morbidity and mortality, and pharmacological treatment options are limited. In this study, we evaluated the PCSK9 inhibitor alirocumab, a monoclonal antibody that robustly reduces low-density lipoprotein cholesterol (LDL-C), for the treatment of ALD using a rat model of...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-53603-6

    authors: Lee JS,Mukhopadhyay P,Matyas C,Trojnar E,Paloczi J,Yang YR,Blank BA,Savage C,Sorokin AV,Mehta NN,Vendruscolo JCM,Koob GF,Vendruscolo LF,Pacher P,Lohoff FW

    更新日期:2019-11-20 00:00:00

  • Early endosome motility mediates α-amylase production and cell differentiation in Aspergillus oryzae.

    abstract::Recent research in filamentous fungi has revealed that the motility of an endocytic organelle early endosome (EE) has a versatile role in many physiological functions. Here, to further examine the motility of EEs in the industrially important fungus Aspergillus oryzae, we visualized these organelles via the Rab5 homol...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-16163-1

    authors: Togo Y,Higuchi Y,Katakura Y,Takegawa K

    更新日期:2017-11-17 00:00:00

  • Scaling and correlation properties of RR and QT intervals at the cellular level.

    abstract::We study complex scaling properties of RR and QT intervals of electrocardiograms (ECGs) with their equivalences at the cellular level, that is, inter-beat intervals (IBI) and field potential durations (FPD) of spontaneously beating human-induced pluripotent stem cell-derived cardiomyocyte (hiPSC-CM) aggregates. Our de...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-40247-9

    authors: Kim J,Shah D,Potapov I,Latukka J,Aalto-Setälä K,Räsänen E

    更新日期:2019-03-06 00:00:00

  • Author Correction: Efficient Characterization and Classification of Contrast Sensitivity Functions in Aging.

    abstract::A correction to this article has been published and is linked from the HTML and PDF versions of this paper. The error has not been fixed in the paper. ...

    journal_title:Scientific reports

    pub_type: 已发布勘误

    doi:10.1038/s41598-019-42527-w

    authors: Yan FF,Hou F,Lu ZL,Hu X,Huang CB

    更新日期:2019-04-12 00:00:00

  • Sensitive real-time monitoring of refractive indexes using a novel graphene-based optical sensor.

    abstract::Based on the polarization-sensitive absorption of graphene under conditions of total internal reflection, a novel optical sensor combining graphene and a microfluidic structure was constructed to achieve the sensitive real-time monitoring of refractive indexes. The atomic thickness and strong broadband absorption of g...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep00908

    authors: Xing F,Liu ZB,Deng ZC,Kong XT,Yan XQ,Chen XD,Ye Q,Zhang CP,Chen YS,Tian JG

    更新日期:2012-01-01 00:00:00

  • In-situ Liquid Phase Epitaxy: Another Strategy to Synthesize Heterostructured Core-shell Composites.

    abstract::Core-shell Nb2O5/TiO2 composite with hierarchical heterostructure is successfully synthesized In-situ by a facile template-free and acid-free solvothermal method based on the mechanism of liquid phase epitaxy. The chemical circumstance change induced by the alcoholysis of NbCl5 is utilized tactically to trigger core-s...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep25260

    authors: Wen Z,Wang G

    更新日期:2016-04-28 00:00:00

  • Approximating the maximum tibial coverage in total knee arthroplasty does not necessarily result in implant malrotation.

    abstract::Traditionally, the practice of the tibial component placement in total knee arthroplasty has focused on achieving maximum coverage without malrotation. However, the concept of maximizing coverage has not been well defined or researched and yet biased results are often produced. This study aimed to evaluate the effect ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-67613-2

    authors: Shao L,Wu XD,Wang T,Liu XK,Xu W,Huang W,Zeng ZM

    更新日期:2020-06-29 00:00:00

  • Genetic structure and differentiation in Dendrocalamus sinicus (Poaceae: Bambusoideae) populations provide insight into evolutionary history and speciation of woody bamboos.

    abstract::Evolutionary processes, speciation in woody bamboos are presently little understood. Here we used Dendrocalamus sinicus Chia & J.L. Sun as a model species to investigate dispersal or vicariance speciation in woody bamboos. Variation in three chloroplast DNA (cpDNA) fragments and eight simple sequence repeat markers (S...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-35269-8

    authors: Yang JB,Dong YR,Wong KM,Gu ZJ,Yang HQ,Li Z

    更新日期:2018-11-16 00:00:00