Radiomics in nuclear medicine: robustness, reproducibility, standardization, and how to avoid data analysis traps and replication crisis.

Abstract:

:Radiomics in nuclear medicine is rapidly expanding. Reproducibility of radiomics studies in multicentre settings is an important criterion for clinical translation. We therefore performed a meta-analysis to investigate reproducibility of radiomics biomarkers in PET imaging and to obtain quantitative information regarding their sensitivity to variations in various imaging and radiomics-related factors as well as their inherent sensitivity. Additionally, we identify and describe data analysis pitfalls that affect the reproducibility and generalizability of radiomics studies. After a systematic literature search, 42 studies were included in the qualitative synthesis, and data from 21 were used for the quantitative meta-analysis. Data concerning measurement agreement and reliability were collected for 21 of 38 different factors associated with image acquisition, reconstruction, segmentation and radiomics-specific processing steps. Variations in voxel size, segmentation and several reconstruction parameters strongly affected reproducibility, but the level of evidence remained weak. Based on the meta-analysis, we also assessed inherent sensitivity to variations of 110 PET image biomarkers. SUVmean and SUVmax were found to be reliable, whereas image biomarkers based on the neighbourhood grey tone difference matrix and most biomarkers based on the size zone matrix were found to be highly sensitive to variations, and should be used with care in multicentre settings. Lastly, we identify 11 data analysis pitfalls. These pitfalls concern model validation and information leakage during model development, but also relate to reporting and the software used for data analysis. Avoiding such pitfalls is essential for minimizing bias in the results and to enable reproduction and validation of radiomics studies.

authors

Zwanenburg A

doi

10.1007/s00259-019-04391-8

subject

Has Abstract

pub_date

2019-12-01 00:00:00

pages

2638-2655

issue

13

eissn

1619-7070

issn

1619-7089

pii

10.1007/s00259-019-04391-8

journal_volume

46

pub_type

杂志文章,评审
  • The added value of [18F]fluoro-L-DOPA PET in the diagnosis of hyperinsulinism of infancy: a retrospective study involving 49 children.

    abstract:PURPOSE:Neuroendocrine diseases are a heterogeneous group of entities with the ability to take up amine precursors, such as L-DOPA, and convert them into biogenic amines, such as dopamine. Congenital hyperinsulinism of infancy (HI) is a neuroendocrine disease secondary to either focal adenomatous hyperplasia or a diffu...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-007-0498-y

    authors: Ribeiro MJ,Boddaert N,Bellanné-Chantelot C,Bourgeois S,Valayannopoulos V,Delzescaux T,Jaubert F,Nihoul-Fékété C,Brunelle F,De Lonlay P

    更新日期:2007-12-01 00:00:00

  • FDG-PET for preoperative staging of bladder cancer.

    abstract:PURPOSE:The presence of lymph node involvement (N) and distant metastasis (M) in patients with invasive bladder carcinoma is a major determinant of survival and, therefore, a pivotal element in the therapeutic management. The aim of this prospective study was to evaluate the use of( 18)F-fluorodeoxyglucose positron emi...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-005-1886-9

    authors: Drieskens O,Oyen R,Van Poppel H,Vankan Y,Flamen P,Mortelmans L

    更新日期:2005-12-01 00:00:00

  • Effect of adjuvant lithium on thyroxine (T4) concentration after radioactive iodine therapy.

    abstract:PURPOSE:To study the effect of adjuvant lithium on serum thyroxine (T4) concentrations in patients treated with radioactive iodine (RAI) therapy in our environment. METHODS:This was a prospective simple randomized comparative, experimental cohort study of patients with hyperthyroidism referred for RAI ablation therapy...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1007/s00259-016-3388-3

    authors: Hammond EN,Vangu MD

    更新日期:2016-10-01 00:00:00

  • Preoperative [18F]FDG PET/CT maximum standardized uptake value predicts recurrence of uterine cervical cancer.

    abstract:PURPOSE:To determine if preoperative [(18)F]FDG-PET/CT imaging has prognostic significance in patients with uterine cervical cancer. METHODS:Patients with FIGO stage IB to IIA cervical cancer were imaged with integrated FDG PET/CT before radical surgery. The relationship between the maximum standardized uptake value (...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-010-1413-5

    authors: Chung HH,Nam BH,Kim JW,Kang KW,Park NH,Song YS,Chung JK,Kang SB

    更新日期:2010-08-01 00:00:00

  • Implementation and evaluation of an ordered subsets reconstruction algorithm for transmission PET studies using median root prior and inter-update median filtering.

    abstract::An ordered subsets (OS) reconstruction algorithm based on the median root prior (MRP) and inter-update median filtering was implemented for the reconstruction of low count statistics transmission (TR) scans. The OS-MRP-TR algorithm was evaluated using an experimental phantom, simulating positron emission tomography (P...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-002-1046-4

    authors: Bettinardi V,Alenius S,Numminen P,Teräs M,Gilardi MC,Fazio F,Ruotsalainen U

    更新日期:2003-02-01 00:00:00

  • 99mTc-labelled HYNIC-minigastrin with reduced kidney uptake for targeting of CCK-2 receptor-positive tumours.

    abstract:PURPOSE:Different attempts have been made to develop a suitable radioligand for targeting CCK-2 receptors in vivo, for staging of medullary thyroid carcinoma (MTC) and other receptor-expressing tumours. After initial successful clinical studies with [DTPA(0),D: Glu(1)]minigastrin (DTPA-MG0) radiolabelled with (111)In a...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-006-0348-3

    authors: von Guggenberg E,Dietrich H,Skvortsova I,Gabriel M,Virgolini IJ,Decristoforo C

    更新日期:2007-08-01 00:00:00

  • The need for standardisation of cardiac FDG PET imaging in the evaluation of myocardial viability in patients with chronic ischaemic left ventricular dysfunction.

    abstract::The evaluation of myocardial glucose utilisation with fluorine-18 fluorodeoxyglucose (FDG) and positron emission tomography is currently considered the most reliable tool for the identification of myocardial viability. However, the investigations using FDG imaging to predict improvement in left ventricular (LV) functi...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-002-0895-1

    authors: Knuuti J,Schelbert HR,Bax JJ

    更新日期:2002-09-01 00:00:00

  • Comparison of dopamine turnover, dopamine influx constant and activity ratio of striatum and occipital brain with ¹⁸F-dopa brain PET in normal controls and patients with Parkinson's disease.

    abstract:PURPOSE:The aim of the study was to estimate normal ranges and test-retest measures for various parameters characterising dopamine metabolism from a prolonged (18)F-dopa positron emission tomography (PET) measurement using a reference tissue model and compare their value for the detection of early Parkinson's disease (...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-011-1819-8

    authors: Oehme L,Perick M,Beuthien-Baumann B,Wolz M,Storch A,Löhle M,Herting B,Langner J,van den Hoff J,Reichmann H,Kotzerke J

    更新日期:2011-08-01 00:00:00

  • Validation of the dual-table autoradiographic method to quantify two sequential rCBFs in a single SPET session with N-isopropyl-[123I] p-iodoamphetamine.

    abstract::We evaluated an autoradiographic (ARG) method to calculate regional cerebral blood flow (rCBF) sequentially before and after an acetazolamide (ACZ) challenge in a single session of single-photon emission tomography (SPET) with two injections of N-isopropyl-[(123)I] p-iodoamphetamine (IMP). The method uses a table look...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-003-1180-7

    authors: Nishizawa S,Iida H,Tsuchida T,Ito H,Konishi J,Yonekura Y

    更新日期:2003-07-01 00:00:00

  • Differentiation of treatment-related changes from tumour progression: a direct comparison between dynamic FET PET and ADC values obtained from DWI MRI.

    abstract:BACKGROUND:Following brain cancer treatment, the capacity of anatomical MRI to differentiate neoplastic tissue from treatment-related changes (e.g., pseudoprogression) is limited. This study compared apparent diffusion coefficients (ADC) obtained by diffusion-weighted MRI (DWI) with static and dynamic parameters of O-(...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-019-04384-7

    authors: Werner JM,Stoffels G,Lichtenstein T,Borggrefe J,Lohmann P,Ceccon G,Shah NJ,Fink GR,Langen KJ,Kabbasch C,Galldiks N

    更新日期:2019-08-01 00:00:00

  • Evaluation of iterative reconstruction (OSEM) versus filtered back-projection for the assessment of myocardial glucose uptake and myocardial perfusion using dynamic PET.

    abstract:PURPOSE:Iterative reconstruction methods based on ordered-subset expectation maximisation (OSEM) has replaced filtered backprojection (FBP) in many clinical settings owing to the superior image quality. Whether OSEM is as accurate as FBP in quantitative positron emission tomography (PET) is uncertain. We compared the a...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-006-0198-z

    authors: Søndergaard HM,Madsen MM,Boisen K,Bøttcher M,Schmitz O,Nielsen TT,Bøtker HE,Hansen SB

    更新日期:2007-03-01 00:00:00

  • Positron emission tomography measurement of brain MAO-B inhibition in patients with Alzheimer's disease and elderly controls after oral administration of sembragiline.

    abstract:PURPOSE:In Alzheimer's disease (AD), increased metabolism of monoamines by monoamine oxidase type B (MAO-B) leads to the production of toxic reactive oxygen species (ROS), which are thought to contribute to disease pathogenesis. Inhibition of the MAO-B enzyme may restore brain levels of monoaminergic neurotransmitters,...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,多中心研究

    doi:10.1007/s00259-016-3510-6

    authors: Sturm S,Forsberg A,Nave S,Stenkrona P,Seneca N,Varrone A,Comley RA,Fazio P,Jamois C,Nakao R,Ejduk Z,Al-Tawil N,Akenine U,Halldin C,Andreasen N,Ricci B

    更新日期:2017-03-01 00:00:00

  • FDG PET/CT patterns of treatment failure of malignant pleural mesothelioma: relationship to histologic type, treatment algorithm, and survival.

    abstract:PURPOSE:This study investigated the diagnostic performance and prognostic value of fluorodeoxyglucose (FDG) positron emission tomography (PET)/CT in suspected malignant pleural mesothelioma (MPM) recurrence, in the context of patterns and intensity of FDG uptake, histologic type, and treatment algorithm. METHODS:Fifty...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-010-1704-x

    authors: Gerbaudo VH,Mamede M,Trotman-Dickenson B,Hatabu H,Sugarbaker DJ

    更新日期:2011-05-01 00:00:00

  • Ventilation/perfusion SPECT/CT findings in different lung lesions associated with COVID-19: a case series.

    abstract:PURPOSE:The aim of this series of cases is to show the aspects of ventilation/perfusion single-photon emission computed tomography combined with computed tomography (V/Q SPECT/CT) in patients hospitalized for COVID-19 pneumonia, with the worsening of respiratory symptoms raising the suspicion of a pulmonary embolism. P...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-020-04920-w

    authors: Cobes N,Guernou M,Lussato D,Queneau M,Songy B,Bonardel G,Grellier JF

    更新日期:2020-09-01 00:00:00

  • Value of (18)F-FDG PET/CT for therapeutic assessment of patients with polymyalgia rheumatica receiving tocilizumab as first-line treatment.

    abstract:PURPOSE:To evaluate the use of (18)F-FDG PET/CT for the assessment of tocilizumab (TCZ) as first-line treatment in patients with polymyalgia rheumatica (PMR). METHODS:Patients with PMR were prospectively enrolled in a multicentre clinical trial assessing TCZ therapy (the TENOR trial). The patients underwent FDG PET/CT...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,多中心研究

    doi:10.1007/s00259-015-3287-z

    authors: Palard-Novello X,Querellou S,Gouillou M,Saraux A,Marhadour T,Garrigues F,Abgral R,Salaün PY,Devauchelle-Pensec V

    更新日期:2016-04-01 00:00:00

  • The relationship between the dopaminergic system and depressive symptoms in cervical dystonia.

    abstract:PURPOSE:Cervical dystonia (CD) is associated with tremor/jerks (50%) and psychiatric complaints (17-70%). The dopaminergic system has been implicated in the pathophysiology of CD in animal and imaging studies. Dopamine may be related to the motor as well as non-motor symptoms of CD. CD is associated with reduced striat...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-017-3664-x

    authors: Zoons E,Tijssen MAJ,Dreissen YEM,Speelman JD,Smit M,Booij J

    更新日期:2017-08-01 00:00:00

  • Whole-body biodistribution, radiation absorbed dose, and brain SPET imaging with [123i]5-i-A-85380 in healthy human subjects.

    abstract::The biodistribution of radioactivity after the administration of a new tracer for alpha4beta2 nicotinic acetylcholine receptors (nAChRs), [123I]5-iodo-3-[2(S)-2-azetidinylmethoxy]pyridine (5-I-A-85380), was studied in ten healthy human subjects. Following administration of 98+/-6 MBq [123I]5-I-A-85380, serial whole-bo...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-001-0695-z

    authors: Fujita M,Seibyl JP,Vaupel DB,Tamagnan G,Early M,Zoghbi SS,Baldwin RM,Horti AG,KoreN AO,Mukhin AG,Khan S,Bozkurt A,Kimes AS,London ED,Innis RB

    更新日期:2002-02-01 00:00:00

  • Uptake kinetics and biodistribution of 14C-D-luciferin--a radiolabeled substrate for the firefly luciferase catalyzed bioluminescence reaction: impact on bioluminescence based reporter gene imaging.

    abstract:PURPOSE:Firefly luciferase catalyzes the oxidative decarboxylation of D: -luciferin to oxyluciferin in the presence of cofactors, producing bioluminescence. This reaction is used in optical bioluminescence-based molecular imaging approaches to detect the expression of the firefly luciferase reporter gene. Biokinetics a...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-008-0870-6

    authors: Berger F,Paulmurugan R,Bhaumik S,Gambhir SS

    更新日期:2008-12-01 00:00:00

  • Quantitation of dopamine transporter blockade by methylphenidate: first in vivo investigation using [123I]FP-CIT and a dedicated small animal SPECT.

    abstract:PURPOSE:The aim of this study was to investigate the feasibility of assessing dopamine transporter binding after treatment with methylphenidate in the rat using a recently developed high-resolution small animal single-photon emission computed tomograph (TierSPECT) and [123I]FP-CIT. METHODS:[123I]FP-CIT was administere...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-004-1615-9

    authors: Nikolaus S,Wirrwar A,Antke C,Arkian S,Schramm N,Müller HW,Larisch R

    更新日期:2005-03-01 00:00:00

  • PET/MRI: a different spin from under the rim.

    abstract:INTRODUCTION:Hybrid imaging is now widely accepted in cancer imaging with increasing use of PET/CT in clinical practice. The advantages of MRI compared to CT with respect to radiation exposure and soft-tissue lesion contrast, as well as the possibility of performing more sophisticated assessment of tissue chemistry, ha...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-008-0966-z

    authors: Hicks RJ,Lau EW

    更新日期:2009-03-01 00:00:00

  • Impact of staging with 18F-FDG-PET on outcome of patients with stage III non-small cell lung cancer: PET identifies potential survivors.

    abstract:PURPOSE:The aim of this study was to analyse the impact of FDG-PET staging on treatment results of neo-adjuvant radiochemotherapy in patients with advanced non-small cell lung cancer (NSCLC). We compared prospectively the outcome of two patient groups with stage III NSCLC undergoing the same neo-adjuvant radio-chemothe...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-006-0197-0

    authors: Eschmann SM,Friedel G,Paulsen F,Reimold M,Hehr T,Scheiderbauer J,Budach W,Kotzerke J,Bares R

    更新日期:2007-01-01 00:00:00

  • Quantification of [(123)I]PE2I binding to dopamine transporters with SPET.

    abstract::The iodinated cocaine derivative [(123)I]PE2I is a new selective ligand for in vivo studies of the dopamine transporter (DAT) with single-photon emission tomography (SPET). The aim of the present study was to describe a method for accurate quantification of binding data following a bolus injection of [(123)I]PE2I. Six...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 临床试验,杂志文章

    doi:10.1007/s00259-001-0742-9

    authors: Pinborg LH,Videbaek C,Svarer C,Yndgaard S,Paulson OB,Knudsen GM

    更新日期:2002-05-01 00:00:00

  • Evolving role of FDG PET imaging in assessing joint disorders: a systematic review.

    abstract::Assessing joint disorders has been a relatively recent and evolving application of 18F-2-fluoro-2-deoxy-D-glucose (FDG) positron emission tomography (PET) imaging. FDG is taken up by inflammatory cells, particularly when they are active as part of an ongoing inflammatory process. Hence FDG PET has been employed to ass...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s00259-011-1863-4

    authors: Carey K,Saboury B,Basu S,Brothers A,Ogdie A,Werner T,Torigian DA,Alavi A

    更新日期:2011-10-01 00:00:00

  • Model-based comparison of maternal and foetal organ doses from (99m)Tc pertechnetate, DMSA, DTPA, HDP, MAA and MAG(3) diagnostic intakes during pregnancy.

    abstract::Organ residence times were calculated for diagnostic intakes of (99m)Tc pertechnetate, 2,3-dimercaptosuccinic acid (DMSA), diethylene triamine penta-acetic acid (DTPA), hydroxymethylene diphosphonate (HDP), macroaggregated albumin (MAA) and mercapto-acetyltriglycine (MAG(3)) during the 1st and 3rd stages of pregnancy ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-002-0858-6

    authors: Saunders M,Palmer M,Preece A,Millard R

    更新日期:2002-10-01 00:00:00

  • The effect of 18F-florbetapir dose reduction on region-based classification of cortical amyloid deposition.

    abstract:UNLABELLED:There are specific dose recommendations for diagnostic amyloid PET imaging with 18F-florbetapir, but they may not apply to research studies using regional quantitative analysis. We, therefore, studied the effect of tracer dose reduction on the discriminative power of regional analysis. METHODS:Using bootstr...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-014-2842-3

    authors: Herholz K,Evans R,Anton-Rodriguez J,Hinz R,Matthews JC

    更新日期:2014-11-01 00:00:00

  • Neuroradiological advances detect abnormal neuroanatomy underlying neuropsychological impairments: the power of PET imaging.

    abstract::Medical imaging has made a major contribution to cerebral dysfunction due to inherited diseases, as well as injuries sustained with modern living, such as car accidents, falling down, and work-related injuries. These injuries, up until the introduction of sensitive techniques such as positron emission tomography (PET)...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章,收录出版

    doi:10.1007/s00259-013-2401-3

    authors: Hayempour BJ,Alavi A

    更新日期:2013-09-01 00:00:00

  • Memory-provoked rCBF-SPECT as a diagnostic tool in Alzheimer's disease?

    abstract:PURPOSE:Alzheimer's disease (AD) is a primary degenerative disease that progressively affects all brain functions, with devastating consequences for the patient, the patient's family and society. Rest regional cerebral blood flow (rCBF) could have a strategic role in differentiating between AD patients and normal contr...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-005-1874-0

    authors: Sundström T,Elgh E,Larsson A,Näsman B,Nyberg L,Riklund KA

    更新日期:2006-01-01 00:00:00

  • Correction to: 18F-DOPA PET/CT in brain tumors: impact on multidisciplinary brain tumor board decisions.

    abstract::Jérôme Barriere was inadvertently missing in the original version of this article. He has participated to the study design, protocol writing and inclusion of a significant number of patients. ...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 已发布勘误

    doi:10.1007/s00259-019-04321-8

    authors: Humbert O,Bourg V,Mondot L,Gal J,Bondiau PY,Fontaine D,Barriere J,Saada-Bouzid E,Paquet M,Chardin D,Almairac F,Vandenbos F,Darcourt J

    更新日期:2019-07-01 00:00:00

  • Automated analysis of small animal PET studies through deformable registration to an atlas.

    abstract:PURPOSE:This work aims to develop a methodology for automated atlas-guided analysis of small animal positron emission tomography (PET) data through deformable registration to an anatomical mouse model. METHODS:A non-rigid registration technique is used to put into correspondence relevant anatomical regions of rodent C...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-012-2188-7

    authors: Gutierrez DF,Zaidi H

    更新日期:2012-11-01 00:00:00

  • Comparison of (18)F-FLT PET and (18)F-FDG PET for preoperative staging in non-small cell lung cancer.

    abstract:PURPOSE:The nucleoside analog 3'-deoxy-3'-(18)F-fluorothymidine (FLT) has been introduced for imaging cell proliferation with positron emission tomography (PET). We prospectively compared the diagnostic efficacy of FLT PET with that of 2-deoxy-2-(18)F-fluoro-D-glucose (FDG) PET for the preoperative nodal and distant me...

    journal_title:European journal of nuclear medicine and molecular imaging

    pub_type: 杂志文章

    doi:10.1007/s00259-007-0613-0

    authors: Yamamoto Y,Nishiyama Y,Kimura N,Ishikawa S,Okuda M,Bandoh S,Kanaji N,Asakura M,Ohkawa M

    更新日期:2008-02-01 00:00:00