Selection bias in the reported performances of AD classification pipelines.

Abstract:

:The last decade has seen a great proliferation of supervised learning pipelines for individual diagnosis and prognosis in Alzheimer's disease. As more pipelines are developed and evaluated in the search for greater performance, only those results that are relatively impressive will be selected for publication. We present an empirical study to evaluate the potential for optimistic bias in classification performance results as a result of this selection. This is achieved using a novel, resampling-based experiment design that effectively simulates the optimisation of pipeline specifications by individuals or collectives of researchers using cross validation with limited data. Our findings indicate that bias can plausibly account for an appreciable fraction (often greater than half) of the apparent performance improvement associated with the pipeline optimisation, particularly in small samples. We discuss the consistency of our findings with patterns observed in the literature and consider strategies for bias reduction and mitigation.

journal_name

Neuroimage Clin

journal_title

NeuroImage. Clinical

authors

Mendelson AF,Zuluaga MA,Lorenzi M,Hutton BF,Ourselin S,Alzheimer's Disease Neuroimaging Initiative.

doi

10.1016/j.nicl.2016.12.018

subject

Has Abstract

pub_date

2016-12-24 00:00:00

pages

400-416

issn

2213-1582

pii

S2213-1582(16)30256-X

journal_volume

14

pub_type

杂志文章
  • Hypo-activity of the dorsolateral prefrontal cortex relates to increased reaction time variability in patients with schizophrenia.

    abstract::Increased reaction time intra-subject variability (RT-ISV) in fast decision tasks has been confirmed in patients with schizophrenia and has been hypothesized to result from a deficit in the control of attention. Here, an attentional task and functional brain imaging were used to probe the neural correlates of increase...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2019.101853

    authors: Panagiotaropoulou G,Thrapsanioti E,Pappa E,Grigoras C,Mylonas D,Karavasilis E,Velonakis G,Kelekis N,Smyrnis N

    更新日期:2019-01-01 00:00:00

  • Hippocampal CA1 subfield predicts episodic memory impairment in Parkinson's disease.

    abstract:OBJECTIVE:Parkinson's disease (PD) episodic memory impairments are common; however, it is not known whether these impairments are due to hippocampal pathology. Hippocampal Lewy-bodies emerge by Braak stage 4, but are not uniformly distributed. For instance, hippocampal CA1 Lewy-body pathology has been specifically asso...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2019.101824

    authors: La C,Linortner P,Bernstein JD,Ua Cruadhlaoich MAI,Fenesy M,Deutsch GK,Rutt BK,Tian L,Wagner AD,Zeineh M,Kerchner GA,Poston KL

    更新日期:2019-01-01 00:00:00

  • Abnormal amygdala subregional-sensorimotor connectivity correlates with positive symptom in schizophrenia.

    abstract::Altered resting-state functional connectivity (rsFC) of the amygdala has been demonstrated to be implicated in schizophrenia neuronal pathophysiology. However, whether rsFC of amygdala subregions is differentially affected in schizophrenia remains unclear. This study compared the functional networks of each amygdala s...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2020.102218

    authors: Zhang M,Yang F,Fan F,Wang Z,Hong X,Tan Y,Tan S,Hong LE

    更新日期:2020-01-01 00:00:00

  • Impact of chronic migraine attacks and their severity on the endogenous μ-opioid neurotransmission in the limbic system.

    abstract:OBJECTIVE:To evaluate, in vivo, the impact of ongoing chronic migraine (CM) attacks on the endogenous μ-opioid neurotransmission. BACKGROUND:CM is associated with cognitive-emotional dysfunction. CM is commonly associated with frequent acute medication use, including opioids. METHODS:We scanned 15 migraine patients d...

    journal_title:NeuroImage. Clinical

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.nicl.2019.101905

    authors: Jassar H,Nascimento TD,Kaciroti N,DosSantos MF,Danciu T,Koeppe RA,Smith YR,Bigal ME,Porreca F,Casey KL,Zubieta JK,DaSilva AF

    更新日期:2019-01-01 00:00:00

  • Connectome analysis with diffusion MRI in idiopathic Parkinson's disease: Evaluation using multi-shell, multi-tissue, constrained spherical deconvolution.

    abstract::Parkinson's disease (PD) is a progressive neurodegenerative disorder that affects extensive regions of the central nervous system. In this work, we evaluated the structural connectome of patients with PD, as mapped by diffusion-weighted MRI tractography and a multi-shell, multi-tissue (MSMT) constrained spherical deco...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2017.11.007

    authors: Kamagata K,Zalesky A,Hatano T,Di Biase MA,El Samad O,Saiki S,Shimoji K,Kumamaru KK,Kamiya K,Hori M,Hattori N,Aoki S,Pantelis C

    更新日期:2017-11-10 00:00:00

  • Deficits in cortical, diencephalic and midbrain gray matter in alcoholism measured by VBM: Effects of co-morbid substance abuse.

    abstract:OBJECTIVE:Alcoholism has been associated with a widespread pattern of gray matter atrophy. This study sought to investigate the spectrum of volume alterations in a population of alcoholics with only alcohol dependence, polysubstance abusing alcoholics, and a comparison population of healthy controls. METHOD:Thirty-sev...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2013.03.013

    authors: Grodin EN,Lin H,Durkee CA,Hommer DW,Momenan R

    更新日期:2013-04-01 00:00:00

  • Multivariate pattern analysis strategies in detection of remitted major depressive disorder using resting state functional connectivity.

    abstract::Understanding abnormal resting-state functional connectivity of distributed brain networks may aid in probing and targeting mechanisms involved in major depressive disorder (MDD). To date, few studies have used resting state functional magnetic resonance imaging (rs-fMRI) to attempt to discriminate individuals with MD...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2016.02.018

    authors: Bhaumik R,Jenkins LM,Gowins JR,Jacobs RH,Barba A,Bhaumik DK,Langenecker SA

    更新日期:2016-03-02 00:00:00

  • Relative contributions of lesion location and lesion size to predictions of varied language deficits in post-stroke aphasia.

    abstract::Despite the widespread use of lesion-symptom mapping (LSM) techniques to study associations between location of brain damage and language deficits, the prediction of language deficits from lesion location remains a substantial challenge. The present study examined several factors which may impact lesion-symptom predic...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2018.10.017

    authors: Thye M,Mirman D

    更新日期:2018-01-01 00:00:00

  • 9.4 T MR microscopy of the substantia nigra with pathological validation in controls and disease.

    abstract:BACKGROUND:The anatomy of the substantia nigra on conventional MRI is controversial. Even using histological techniques it is difficult to delineate with certainty from surrounding structures. We sought to define the anatomy of the SN using high field spin-echo MRI of pathological material in which we could study the a...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2016.11.015

    authors: Massey LA,Miranda MA,Al-Helli O,Parkes HG,Thornton JS,So PW,White MJ,Mancini L,Strand C,Holton J,Lees AJ,Revesz T,Yousry TA

    更新日期:2016-11-17 00:00:00

  • Atypical excitation-inhibition balance in autism captured by the gamma response to contextual modulation.

    abstract::Atypical visual perception in people with autism spectrum disorders (ASD) is hypothesized to stem from an imbalance in excitatory and inhibitory processes in the brain. We used neuronal oscillations in the gamma frequency range (30-90 Hz), which emerge from a balanced interaction of excitation and inhibition in the br...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2013.06.015

    authors: Snijders TM,Milivojevic B,Kemner C

    更新日期:2013-07-02 00:00:00

  • Relevance of brain lesion location for cognition in vascular mild cognitive impairment.

    abstract:BACKGROUND:Vascular mild cognitive impairment (VMCI) is a potentially transitional state between normal aging and vascular dementia. The presence of macroscopic white matter lesions (WML) of moderate or severe extension on brain MRI is the hallmark of the VMCI. OBJECTIVE:To assess the clinical relevance of the frequen...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.nicl.2019.101789

    authors: Giorgio A,Di Donato I,De Leucio A,Zhang J,Salvadori E,Poggesi A,Diciotti S,Cosottini M,Ciulli S,Inzitari D,Pantoni L,Mascalchi M,Federico A,Dotti MT,De Stefano N,VMCI-Tuscany Study Group.

    更新日期:2019-01-01 00:00:00

  • Disconnected neuromagnetic networks in children born very preterm: Disconnected MEG networks in preterm children.

    abstract::Many children born very preterm (≤32 weeks) experience significant cognitive difficulties, but the biological basis of such problems has not yet been determined. Functional MRI studies have implicated altered functional connectivity; however, little is known regarding the spatiotemporal organization of brain networks ...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2015.08.016

    authors: Ye AX,AuCoin-Power M,Taylor MJ,Doesburg SM

    更新日期:2015-09-01 00:00:00

  • Specifically altered brain responses to threat in generalized anxiety disorder relative to social anxiety disorder and panic disorder.

    abstract:BACKGROUND:Despite considerable effort, the neurobiological underpinnings of hyper-responsive threat processing specific to patients suffering from generalized anxiety disorder (GAD) remain poorly understood. The current functional magnetic resonance imaging (fMRI) study aims to delineate GAD-specific brain activity du...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2016.09.023

    authors: Buff C,Brinkmann L,Neumeister P,Feldker K,Heitmann C,Gathmann B,Andor T,Straube T

    更新日期:2016-10-05 00:00:00

  • The diffeomorphometry of temporal lobe structures in preclinical Alzheimer's disease.

    abstract::This paper examines morphometry of MRI biomarkers derived from the network of temporal lobe structures including the amygdala, entorhinal cortex and hippocampus in subjects with preclinical Alzheimer's disease (AD). Based on template-centered population analysis, it is demonstrated that the structural markers of the a...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2013.09.001

    authors: Miller MI,Younes L,Ratnanather JT,Brown T,Trinh H,Postell E,Lee DS,Wang MC,Mori S,O'Brien R,Albert M,BIOCARD Research Team.

    更新日期:2013-09-16 00:00:00

  • Computational analysis in epilepsy neuroimaging: A survey of features and methods.

    abstract::Epilepsy affects 65 million people worldwide, a third of whom have seizures that are resistant to anti-epileptic medications. Some of these patients may be amenable to surgical therapy or treatment with implantable devices, but this usually requires delineation of discrete structural or functional lesion(s), which is ...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章,评审

    doi:10.1016/j.nicl.2016.02.013

    authors: Kini LG,Gee JC,Litt B

    更新日期:2016-02-23 00:00:00

  • Disrupted modular organization of primary sensory brain areas in schizophrenia.

    abstract::Abnormal brain resting-state functional connectivity has been consistently observed in patients affected by schizophrenia (SCZ) using functional MRI and other neuroimaging techniques. Graph theoretical methods provide a framework to investigate these defective functional interactions and their effects on the organizat...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2018.02.035

    authors: Bordier C,Nicolini C,Forcellini G,Bifone A

    更新日期:2018-03-01 00:00:00

  • APPswe/PS1dE9 mice with cortical amyloid pathology show a reduced NAA/Cr ratio without apparent brain atrophy: A MRS and MRI study.

    abstract::Transgenic animal models of Aβ pathology provide mechanistic insight into some aspects of Alzheimer disease (AD) pathology related to Aβ accumulation. Quantitative neuroimaging is a possible aid to improve translation of mechanistic findings in transgenic models to human end phenotypes of brain morphology or function....

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2017.06.009

    authors: Kuhla A,Rühlmann C,Lindner T,Polei S,Hadlich S,Krause BJ,Vollmar B,Teipel SJ

    更新日期:2017-06-09 00:00:00

  • Brain connectivity tracks effects of chemotherapy separately from behavioral measures.

    abstract::Several studies in cancer research have suggested that cognitive dysfunction following chemotherapy, referred to in lay terms as "chemobrain", is a serious problem. At present, the changes in integrative brain function that underlie such dysfunction remain poorly understood. Recent developments in neuroimaging suggest...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2019.101654

    authors: Kardan O,Reuter-Lorenz PA,Peltier S,Churchill NW,Misic B,Askren MK,Jung MS,Cimprich B,Berman MG

    更新日期:2019-01-01 00:00:00

  • Lack of response to disgusting food in the hypothalamus and related structures in Prader Willi syndrome.

    abstract:OBJECTIVE:To investigate, based on a putative abnormal neural processing of disgusting signals in Prader Willi syndrome (PWS) patients, the brain response to visual representations of disgusting food in PWS using functional MRI (fMRI). METHODS:Twenty-one genetically-confirmed PWS patients, 30 age- and sex-matched and ...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2019.101662

    authors: Blanco-Hinojo L,Pujol J,Esteba-Castillo S,Martínez-Vilavella G,Giménez-Palop O,Gabau E,Casamitjana L,Deus J,Novell R,Caixàs A

    更新日期:2019-01-01 00:00:00

  • Fatigue in Gulf War Illness is associated with tonically high activation in the executive control network.

    abstract::Gulf War Illness (GWI) is a chronic, multi-symptom illness that affects approximately 25% of Gulf veterans, with cognitive fatigue as one of its primary symptoms. Here, we investigated the neural networks associated with cognitive fatigue in GWI by asking 35 veterans with GWI and 25 healthy control subjects to perform...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2018.101641

    authors: Wylie GR,Genova H,Dobryakova E,DeLuca J,Chiaravalloti N,Falvo M,Cook D

    更新日期:2019-01-01 00:00:00

  • Simultaneous investigation of microvasculature and parenchyma in cerebral small vessel disease using intravoxel incoherent motion imaging.

    abstract:INTRODUCTION:Cerebral small vessel disease (cSVD) is associated with microvascular and parenchymal alterations. Intravoxel incoherent motion (IVIM) MRI has been proposed to simultaneously measure both the microvascular perfusion and parenchymal diffusivity. This study aimed to evaluate the application of IVIM in cSVD t...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2017.01.017

    authors: Wong SM,Zhang CE,van Bussel FC,Staals J,Jeukens CR,Hofman PA,van Oostenbrugge RJ,Backes WH,Jansen JF

    更新日期:2017-01-17 00:00:00

  • Evidence for decreased Neurologic Pain Signature activation following thoracic spinal manipulation in healthy volunteers and participants with neck pain.

    abstract:BACKGROUND CONTEXT:Spinal manipulation (SM) is a common treatment for neck and back pain, theorized to mechanically affect the spine leading to therapeutic mechanical changes. The link between specific mechanical effects and clinical improvement is not well supported. SM's therapeutic action may instead be partially me...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.nicl.2019.102042

    authors: Weber Ii KA,Wager TD,Mackey S,Elliott JM,Liu WC,Sparks CL

    更新日期:2019-01-01 00:00:00

  • Alzheimer's disease patients activate attention networks in a short-term memory task.

    abstract::Network functioning during cognitive tasks is of major interest in Alzheimer's disease (AD). Cognitive functioning in AD includes variable performance in short-term memory (STM). In most studies, the verbal STM functioning in AD patients has been interpreted within the phonological loop subsystem of Baddeley's working...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2019.101892

    authors: Kurth S,Bahri MA,Collette F,Phillips C,Majerus S,Bastin C,Salmon E

    更新日期:2019-01-01 00:00:00

  • Hemoglobin and mean platelet volume predicts diffuse T1-MRI white matter volume decrease in sickle cell disease patients.

    abstract::Sickle cell disease (SCD) is a life-threatening genetic condition. Patients suffer from chronic systemic and cerebral vascular disease that leads to early and cumulative neurological damage. Few studies have quantified the effects of this disease on brain morphometry and even fewer efforts have been devoted to older p...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2017.04.023

    authors: Choi S,Bush AM,Borzage MT,Joshi AA,Mack WJ,Coates TD,Leahy RM,Wood JC

    更新日期:2017-04-29 00:00:00

  • Functional connectivity of the Precuneus reflects effectiveness of visual restitution training in chronic hemianopia.

    abstract::Visual field defects in chronic hemianopia can improve through visual restitution training, yet not all patients benefit equally from this long and exhaustive procedure. Here, we asked if resting-state functional connectivity prior to visual restitution could predict training success. In two training sessions of eight...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2020.102292

    authors: Halbertsma HN,Elshout JA,Bergsma DP,Norris DG,Cornelissen FW,van den Berg AV,Haak KV

    更新日期:2020-01-01 00:00:00

  • Tissue-type mapping of gliomas.

    abstract:PURPOSE:To develop a statistical method of combining multimodal MRI (mMRI) of adult glial brain tumours to generate tissue heterogeneity maps that indicate tumour grade and infiltration margins. MATERIALS AND METHODS:We performed a retrospective analysis of mMRI from patients with histological diagnosis of glioma (n =...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2018.101648

    authors: Raschke F,Barrick TR,Jones TL,Yang G,Ye X,Howe FA

    更新日期:2019-01-01 00:00:00

  • White matter microstructure is associated with language in children born very preterm.

    abstract::Very preterm birth is associated with altered white matter microstructure and language difficulties, which may compromise communication, social function and academic achievement, but the relationship between these two factors is unclear. The aim of this study was to explore associations between white matter microstruc...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2018.09.020

    authors: Mürner-Lavanchy IM,Kelly CE,Reidy N,Doyle LW,Lee KJ,Inder T,Thompson DK,Morgan AT,Anderson PJ

    更新日期:2018-01-01 00:00:00

  • Relation of 18-F-Dopa PET with hypokinesia-rigidity, tremor and freezing in Parkinson's disease.

    abstract:INTRODUCTION:In this retrospective study concerning patients with Parkinson's disease (PD) scanned with 18-F-Dopa PET (N = 129), we looked for an association between reduced 18-F-Dopa uptake and the key PD symptoms tremor and hypokinesia-rigidity. We hypothesized to find a stronger correlation between dopaminergic depl...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2016.01.010

    authors: Pikstra ARA,van der Hoorn A,Leenders KL,de Jong BM

    更新日期:2016-01-12 00:00:00

  • Reduced binding of Pittsburgh Compound-B in areas of white matter hyperintensities.

    abstract::The amyloid imaging agent, Pittsburgh Compound-B, binds with high affinity to β-amyloid (Aβ) in the brain, and it is well established that PiB also shows non-specific retention in white matter (WM). However, little is known about retention of PiB in areas of white matter hyperintensities (WMH), abnormalities commonly ...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2015.09.009

    authors: Goodheart AE,Tamburo E,Minhas D,Aizenstein HJ,McDade E,Snitz BE,Price JC,Mathis CA,Lopez OL,Klunk WE,Cohen AD

    更新日期:2015-09-29 00:00:00

  • Disentangling the effects of age and mild traumatic brain injury on brain network connectivity: A resting state fMRI study.

    abstract:INTRODUCTION:Cognitive complaints are common shortly after mild traumatic brain injury (mTBI) but may persist up to years. Age-related cognitive decline can worsen these symptoms. However, effects of age on mTBI sequelae have scarcely been investigated. METHODS:Fifty-four mTBI patients (median age: 35 years, range 19-...

    journal_title:NeuroImage. Clinical

    pub_type: 杂志文章

    doi:10.1016/j.nicl.2020.102534

    authors: Bittencourt-Villalpando M,van der Horn HJ,Maurits NM,van der Naalt J

    更新日期:2020-12-22 00:00:00