Radiomics in nuclear medicine: robustness, reproducibility, standardization, and how to avoid data analysis traps and replication crisis.

Abstract:

:Radiomics in nuclear medicine is rapidly expanding. Reproducibility of radiomics studies in multicentre settings is an important criterion for clinical translation. We therefore performed a meta-analysis to investigate reproducibility of radiomics biomarkers in PET imaging and to obtain quantitative information regarding their sensitivity to variations in various imaging and radiomics-related factors as well as their inherent sensitivity. Additionally, we identify and describe data analysis pitfalls that affect the reproducibility and generalizability of radiomics studies. After a systematic literature search, 42 studies were included in the qualitative synthesis, and data from 21 were used for the quantitative meta-analysis. Data concerning measurement agreement and reliability were collected for 21 of 38 different factors associated with image acquisition, reconstruction, segmentation and radiomics-specific processing steps. Variations in voxel size, segmentation and several reconstruction parameters strongly affected reproducibility, but the level of evidence remained weak. Based on the meta-analysis, we also assessed inherent sensitivity to variations of 110 PET image biomarkers. SUVmean and SUVmax were found to be reliable, whereas image biomarkers based on the neighbourhood grey tone difference matrix and most biomarkers based on the size zone matrix were found to be highly sensitive to variations, and should be used with care in multicentre settings. Lastly, we identify 11 data analysis pitfalls. These pitfalls concern model validation and information leakage during model development, but also relate to reporting and the software used for data analysis. Avoiding such pitfalls is essential for minimizing bias in the results and to enable reproduction and validation of radiomics studies.

authors

Zwanenburg A

doi

10.1007/s00259-019-04391-8

subject

Has Abstract

pub_date

2019-12-01 00:00:00

pages

2638-2655

issue

13

eissn

1619-7070

issn

1619-7089

pii

10.1007/s00259-019-04391-8

journal_volume

46

pub_type

杂志文章,评审
  • Detection and cellular localisation of the synthetic soluble macromolecular drug carrier pHPMA.

    abstract::Synthetic macromolecules such as copolymers of N-(2-hydroxypropyl)methacrylamide (pHPMA) are potential carriers for the delivery of drugs owing to their ability to passively accumulate in solid tumours [enhanced permeation and retention (EPR) effect]. To gain further knowledge about the biodistribution and the cellula...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-002-0835-0

    authors: Kissel M,Peschke P,Subr V,Ulbrich K,Strunz AM,Kühnlein R,Debus J,Friedrich E

    更新日期:2002-08-01 00:00:00

  • Cardiac 82Rubidium PET/CT: initial European experience.

    abstract:PURPOSE:Myocardial perfusion with PET/CT has advantages over conventional SPECT. We describe our initial European experience using (82)Rubidium-PET/CT, as part of a clinical myocardial perfusion service. METHODS:We studied the first 100 patients (64 male; 36 female, mean age = 60: SD +/-12.5y, mean body mass index = 3...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-007-0537-8

    authors: Groves AM,Speechly-Dick ME,Dickson JC,Kayani I,Endozo R,Blanchard P,Shastry M,Prvulovich E,Waddington WA,Ben-Haim S,Bomanji JB,McEwan JR,Ell PJ

    更新日期:2007-12-01 00:00:00

  • Kinetic modeling and parametric imaging with dynamic PET for oncological applications: general considerations, current clinical applications, and future perspectives.

    abstract::Dynamic PET (dPET) studies have been used until now primarily within research purposes. Although it is generally accepted that the information provided by dPET is superior to that of conventional static PET acquisitions acquired usually 60 min post injection of the radiotracer, the duration of dynamic protocols, the l...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-020-04843-6

    authors: Dimitrakopoulou-Strauss A,Pan L,Sachpekidis C

    更新日期:2021-01-01 00:00:00

  • ¹⁸F-FLT    and ¹⁸F-FDOPA PET kinetics in recurrent brain tumors.

    abstract:PURPOSE:In this study, kinetic parameters of the cellular proliferation tracer (18)F-3'-deoxy-3'-fluoro-L-thymidine (FLT) and the amino acid probe 3,4-dihydroxy-6-(18)F-fluoro-L-phenylalanine (FDOPA) were measured before and early after the start of therapy, and were used to predict the overall survival (OS) of patient...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-013-2678-2

    authors: Wardak M,Schiepers C,Cloughesy TF,Dahlbom M,Phelps ME,Huang SC

    更新日期:2014-06-01 00:00:00

  • Biodistribution, toxicity and radiation dosimetry studies of the serotonin transporter radioligand 4-[18F]-ADAM in rats and monkeys.

    abstract:PURPOSE:4-[(18)F]-ADAM is a potent serotonin transport imaging agent. We studied its toxicity in rats and radiation dosimetry in monkeys before human studies are undertaken. METHODS:Single and multiple-dosage toxicity studies were conducted in Sprague-Dawley rats. Male and female rats were injected intravenously with ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-009-1281-z

    authors: Huang YY,Ma KH,Tseng TW,Chou TK,Ng H,Mirsalis JC,Fu YK,Chu TC,Huang WS,Shiue CY

    更新日期:2010-03-01 00:00:00

  • In vivo positron emission tomography imaging with [¹¹C]ABP688: binding variability and specificity for the metabotropic glutamate receptor subtype 5 in baboons.

    abstract:PURPOSE:Metabotropic glutamate receptor subtype 5 (mGluR5) dysfunction has been implicated in several disorders. [(11)C]ABP688, a positron emission tomography (PET) ligand targeting mGluR5, could be a valuable tool in the development of novel therapeutics for these disorders by establishing in vivo drug occupancy. Due ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-010-1723-7

    authors: DeLorenzo C,Milak MS,Brennan KG,Kumar JS,Mann JJ,Parsey RV

    更新日期:2011-06-01 00:00:00

  • Dosimetric parameters predicting contralateral liver hypertrophy after unilobar radioembolization of hepatocellular carcinoma.

    abstract:PURPOSE:This study aimed at identifying prior therapy dosimetric parameters using 99mTc-labeled macro-aggregates of albumin (MAA) that are associated with contralateral hepatic hypertrophy occurring after unilobar radioembolization of hepatocellular carcinoma (HCC) performed with 90Y-loaded glass microspheres. METHODS...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-017-3845-7

    authors: Palard X,Edeline J,Rolland Y,Le Sourd S,Pracht M,Laffont S,Lenoir L,Boudjema K,Ugen T,Brun V,Mesbah H,Haumont LA,Loyer P,Garin E

    更新日期:2018-03-01 00:00:00

  • PET-MR image fusion in soft tissue sarcoma: accuracy, reliability and practicality of interactive point-based and automated mutual information techniques.

    abstract::The fusion of functional positron emission tomography (PET) data with anatomical magnetic resonance (MR) or computed tomography images, using a variety of interactive and automated techniques, is becoming commonplace, with the technique of choice dependent on the specific application. The case of PET-MR image fusion i...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-002-0994-z

    authors: Somer EJ,Marsden PK,Benatar NA,Goodey J,O'Doherty MJ,Smith MA

    更新日期:2003-01-01 00:00:00

  • 188Re-loaded lipid nanocapsules as a promising radiopharmaceutical carrier for internal radiotherapy of malignant gliomas.

    abstract:PURPOSE:Lipid nanocapsules (LNC) entrapping lipophilic complexes of (188)Re ((188)Re(S(3)CPh)(2)(S(2)CPh) [(188)Re-SSS]) were investigated as a novel radiopharmaceutical carrier for internal radiation therapy of malignant gliomas. The present study was designed to evaluate the efficacy of intra-cerebral administration ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-008-0735-z

    authors: Allard E,Hindre F,Passirani C,Lemaire L,Lepareur N,Noiret N,Menei P,Benoit JP

    更新日期:2008-10-01 00:00:00

  • Quantification of temporal changes in calcium score in active atherosclerotic plaque in major vessels by 18F-sodium fluoride PET/CT.

    abstract:PURPOSE:Our aim was to assess whether 18F-NaF PET/CT is able to predict progression of the CT calcium score. METHODS:Between August 2007 and November 2015, 34 patients (18 women, 16 men; age, mean ± standard deviation, 57.5 ± 13.9 years; age range 19-78 years) with malignancy or orthopaedic disease were enrolled in th...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-017-3680-x

    authors: Ishiwata Y,Kaneta T,Nawata S,Hino-Shishikura A,Yoshida K,Inoue T

    更新日期:2017-08-01 00:00:00

  • Highlights of the European Association of Nuclear Medicine Congress, Athens, Greece, 30 September to 4 October 2006.

    abstract::The 2006 EANM Congress, held in Athens, Greece, was once again a major event in the nuclear medicine scientific and educational calendar. The scientific programme, which included the second biennial ISRTRD meeting, confirmed the major developments taking place in (1) the diagnostic and prognostic uses of nuclear medic...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type:

    doi:10.1007/s00259-006-0327-8

    authors: McKillop JH,Martin-Comin J,Knapp FF Jr,Britten AJ

    更新日期:2007-02-01 00:00:00

  • Assessment of errors caused by X-ray scatter and use of contrast medium when using CT-based attenuation correction in PET.

    abstract:PURPOSE:Quantitative image reconstruction in positron emission tomography (PET) requires an accurate attenuation map of the object under study for the purpose of attenuation correction. Current dual-modality PET/CT systems offer significant advantages over stand-alone PET, including decreased overall scanning time and ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-006-0086-6

    authors: Ay MR,Zaidi H

    更新日期:2006-11-01 00:00:00

  • PET hypoxia imaging with FAZA: reproducibility at baseline and during fractionated radiotherapy in tumour-bearing mice.

    abstract:PURPOSE:Tumour hypoxia is linked to treatment resistance. Positron emission tomography (PET) using hypoxia tracers such as fluoroazomycin arabinoside (FAZA) may allow identification of patients with hypoxic tumours and the monitoring of the efficacy of hypoxia-targeting treatment. Since hypoxia PET is characterized by ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-012-2258-x

    authors: Busk M,Mortensen LS,Nordsmark M,Overgaard J,Jakobsen S,Hansen KV,Theil J,Kallehauge JF,D'Andrea FP,Steiniche T,Horsman MR

    更新日期:2013-01-01 00:00:00

  • Positron emission tomography changes management, improves prognostic stratification and is superior to gallium scintigraphy in patients with low-grade lymphoma: results of a multicentre prospective study.

    abstract:PURPOSE:Positron emission tomography (PET) was evaluated in low-grade non-Hodgkin lymphoma (NHL) to determine its impact on staging and management and to compare PET and gallium scans. METHODS:PET resulted in management plan changes in 74 patients with untreated low-grade NHL stages I to III. Patient outcomes to 12 mo...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,多中心研究

    doi:10.1007/s00259-008-0958-z

    authors: Scott AM,Gunawardana DH,Wong J,Kirkwood I,Hicks RJ,Ho Shon I,Ramshaw JE,Robins P

    更新日期:2009-03-01 00:00:00

  • Long-term prognostic implications of myocardial perfusion imaging in octogenarians: an all-comer, cohort study.

    abstract:PURPOSE:Evaluation of the long-term prognostic value of myocardial perfusion imaging (MPI) in octogenarians. METHODS:Six hundred and twenty-nine octogenarians [51% previous myocardial infarction (MI) or revascularization] who underwent single-isotope MPI (78% 201Tl, 22% 99mTc-tetrofosmin) with exercise (38% Bruce, 2% ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-017-3739-8

    authors: Katsikis A,Theodorakos A,Manira V,Papaioannou S,Kolovou G,Voudris V,Koutelou M

    更新日期:2017-08-01 00:00:00

  • Influx rate constant of 18F-FDG increases in metastatic lymph nodes of non-small cell lung cancer patients.

    abstract:PURPOSE:Primary tumor (PT) and metastatic lymph node (MLN) status have a great influence on diagnosis and treatment of lung cancer. Our main purpose was to investigate the imaging characteristics of PT or MLN by applying the 18F-FDG PET dynamic modeling approach for non-small cell lung cancer (NSCLC). METHODS:Dynamic ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-020-04682-5

    authors: Yang M,Lin Z,Xu Z,Li D,Lv W,Yang S,Liu Y,Cao Y,Cao Q,Jin H

    更新日期:2020-05-01 00:00:00

  • AI-based applications in hybrid imaging: how to build smart and truly multi-parametric decision models for radiomics.

    abstract:INTRODUCTION:The quantitative imaging features (radiomics) that can be obtained from the different modalities of current-generation hybrid imaging can give complementary information with regard to the tumour environment, as they measure different morphologic and functional imaging properties. These multi-parametric ima...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-019-04414-4

    authors: Castiglioni I,Gallivanone F,Soda P,Avanzo M,Stancanello J,Aiello M,Interlenghi M,Salvatore M

    更新日期:2019-12-01 00:00:00

  • 68Ga-PSMA-11 PET/CT in recurrent prostate cancer: efficacy in different clinical stages of PSA failure after radical therapy.

    abstract:OBJECTIVES:The primary objective was the evaluation of Gallium 68 (68Ga)-prostate-specific membrane antigen (PSMA)-11 positron emission tomography/computed tomography (PET/CT) detection rate, for identifying the site of prostate cancer (PCa) relapse (local vs systemic), stratifying the population according to different...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-018-4189-7

    authors: Ceci F,Castellucci P,Graziani T,Farolfi A,Fonti C,Lodi F,Fanti S

    更新日期:2019-01-01 00:00:00

  • Diagnostic manifestations of total hemispheric glucose metabolism ratio in neuronal network diaschisis: diagnostic implications in Alzheimer's disease and mild cognitive impairment.

    abstract:PURPOSE:We tested the hypothesis that lateralized hemispheric glucose metabolism may have diagnostic implications in Alzheimer's disease (AD) and mild cognitive impairment (MCI). METHODS:We performed FDG-PET/CT in 23 patients (mean age 63.7 years, range 50-78, 17 females) diagnosed with AD (n = 15) or MCI (n = 8) duri...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-018-4248-0

    authors: Segtnan EA,Majdi A,Constantinescu C,Grupe P,Gerke O,Dali HÍ,Strøm OE,Holm J,Alavi A,Sadigh-Eteghad S,Wermuth L,Hildebrandt MG,Gjedde A,Høilund-Carlsen PF

    更新日期:2019-05-01 00:00:00

  • Inter-institution preference-based variability of ejection fraction and volumes using quantitative gated SPECT with 99mTc-tetrofosmin: a multicentre study involving 106 hospitals.

    abstract:PURPOSE:Inter-institution reproducibility of gated SPECT quantification based on institutional preferences was evaluated. This sort of variability is crucial for a multicentre study when many hospitals are involved. METHODS:A total of 106 institutes participated in this study and were grouped according to their use of...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,多中心研究

    doi:10.1007/s00259-005-1916-7

    authors: Nakajima K,Nishimura T

    更新日期:2006-02-01 00:00:00

  • Changes in myocardial perfusion due to physical exercise in patients with stable coronary artery disease.

    abstract:PURPOSE:Percutaneous transluminal coronary angioplasty (PTCA) is one of the main therapy options for patients with coronary artery disease (CAD), resulting in an improvement in myocardial perfusion and exercise capacity. Nevertheless, studies have also demonstrated a positive effect of regular exercise training on myoc...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-005-1768-1

    authors: Kendziorra K,Walther C,Foerster M,Möbius-Winkler S,Conradi K,Schuler G,Sabri O,Hambrecht R,Kluge R

    更新日期:2005-07-01 00:00:00

  • FDG PET/CT imaging in detecting and guiding management of invasive fungal infections: a retrospective comparison to conventional CT imaging.

    abstract:PURPOSE:Invasive fungal infections (IFIs) are common in immunocompromised patients. While early diagnosis can reduce otherwise high morbidity and mortality, conventional CT has suboptimal sensitivity and specificity. Small studies have suggested that the use of FDG PET/CT may improve the ability to detect IFI. The obje...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-018-4062-8

    authors: Douglas AP,Thursky KA,Worth LJ,Drummond E,Hogg A,Hicks RJ,Slavin MA

    更新日期:2019-01-01 00:00:00

  • 18F-FDG hybrid PET in patients with suspected spondylitis.

    abstract::This study investigated the value of fluorine-18 2'-deoxy-2-fluoro- D-glucose (FDG) imaging with a double-headed gamma camera operated in coincidence (hybrid PET) detection mode in patients with suspected spondylitis. Comparison was made with conventional nuclear medicine imaging modalities and magnetic resonance imag...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-001-0719-8

    authors: Gratz S,Dörner J,Fischer U,Behr TM,Béhé M,Altenvoerde G,Meller J,Grabbe E,Becker W

    更新日期:2002-04-01 00:00:00

  • Quantification of 5-HT(1A) receptors in human brain using p-MPPF kinetic modelling and PET.

    abstract::Serotonin-1A (5-HT(1A)) receptors are implicated in neurochemical mechanisms underlying anxiety and depression and their treatment. Animal studies have suggested that 4-(2'-methoxyphenyl)-1-[2'-[ N-(2"-pyridinyl)- p-[(18)F]fluorobenzamido] ethyl] piperazine ( p-MPPF) may be a suitable positron emission tomography (PET...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-001-0684-2

    authors: Sanabria-Bohórquez SM,Biver F,Damhaut P,Wikler D,Veraart C,Goldman S

    更新日期:2002-01-01 00:00:00

  • Predictive value of early and late residual 18F-fluorodeoxyglucose and 18F-fluorothymidine uptake using different SUV measurements in patients with non-small-cell lung cancer treated with erlotinib.

    abstract:PURPOSE:To evaluate the predictive value of early and late residual (18)F-fluorodeoxyglucose (FDG) and (18)F-fluorothymidine (FLT) uptake using different SUV measurements in PET in patients with advanced non-small-cell lung cancer (NSCLC) treated with erlotinib. METHODS:We retrospectively reviewed data from 30 patient...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-012-2118-8

    authors: Kobe C,Scheffler M,Holstein A,Zander T,Nogova L,Lammertsma AA,Boellaard R,Neumaier B,Ullrich RT,Dietlein M,Wolf J,Kahraman D

    更新日期:2012-07-01 00:00:00

  • Myocardial perfusion quantitation with 15O-labelled water PET: high reproducibility of the new cardiac analysis software (Carimas).

    abstract:PURPOSE:Carimas (Cardiac Image Analysis System) is a new software package developed at the Turku PET Centre for the quantitation of PET studies of the heart with a broad range of tracers. The goal of this study was to assess the reproducibility of results the package provides for myocardial perfusion (MP) quantitation ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-009-1143-8

    authors: Nesterov SV,Han C,Mäki M,Kajander S,Naum AG,Helenius H,Lisinen I,Ukkonen H,Pietilä M,Joutsiniemi E,Knuuti J

    更新日期:2009-10-01 00:00:00

  • Current knowledge on the sensitivity of the (68)Ga-somatostatin receptor positron emission tomography and the SUVmax reference range for management of pancreatic neuroendocrine tumours.

    abstract::Physiologically increased pancreatic uptake at the head/uncinate process is observed in more than one-third of patients after injection of one of the three (68)Ga-labelled octreotide-based peptides used for somatostatin (sst) receptor (r) imaging. There are minor differences between these (68)Ga-sstr-binding peptides ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-016-3395-4

    authors: Virgolini I,Gabriel M,Kroiss A,von Guggenberg E,Prommegger R,Warwitz B,Nilica B,Roig LG,Rodrigues M,Uprimny C

    更新日期:2016-10-01 00:00:00

  • Distinct [18F]THK5351 binding patterns in primary progressive aphasia variants.

    abstract:PURPOSE:To assess the binding of the PET tracer [18F]THK5351 in patients with different primary progressive aphasia (PPA) variants and its correlation with clinical deficits. The majority of patients with nonfluent variant (NFV) and logopenic variant (LV) PPA have underlying tauopathy of the frontotemporal lobar or Alz...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-018-4075-3

    authors: Schaeverbeke J,Evenepoel C,Declercq L,Gabel S,Meersmans K,Bruffaerts R,Adamczuk K,Dries E,Van Bouwel K,Sieben A,Pijnenburg Y,Peeters R,Bormans G,Van Laere K,Koole M,Dupont P,Vandenberghe R

    更新日期:2018-12-01 00:00:00

  • Gallium-labelled peptides for imaging of inflammation.

    abstract::Inflammation plays a major role in the development of many diseases. This review article summarizes recent research in the field of in vivo imaging of inflammation. Novel methodologies using PET with (68)Ga peptides targeting, for example, vascular adhesion protein 1 are discussed. ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-011-1987-6

    authors: Roivainen A,Jalkanen S,Nanni C

    更新日期:2012-02-01 00:00:00

  • Spatial and quantitative mapping of glycolysis and hypoxia in glioblastoma as a predictor of radiotherapy response and sites of relapse.

    abstract:INTRODUCTION:Tumor hypoxia is a centerpiece of disease progression mechanisms such as neoangiogenesis or aggressive hypoxia-resistant malignant cells selection that impacts on radiotherapy strategies. Early identification of regions at risk for recurrence and prognostic-based classification of patients is a necessity t...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-020-04706-0

    authors: Leimgruber A,Hickson K,Lee ST,Gan HK,Cher LM,Sachinidis JI,O'Keefe GJ,Scott AM

    更新日期:2020-06-01 00:00:00