Generalizability of machine learning for classification of schizophrenia based on resting-state functional MRI data.

Abstract:

:Machine learning has increasingly been applied to classification of schizophrenia in neuroimaging research. However, direct replication studies and studies seeking to investigate generalizability are scarce. To address these issues, we assessed within-site and between-site generalizability of a machine learning classification framework which achieved excellent performance in a previous study using two independent resting-state functional magnetic resonance imaging data sets collected from different sites and scanners. We established within-site generalizability of the classification framework in the main data set using cross-validation. Then, we trained a model in the main data set and investigated between-site generalization in the validated data set using external validation. Finally, recognizing the poor between-site generalization performance, we updated the unsupervised algorithm to investigate if transfer learning using additional unlabeled data were able to improve between-site classification performance. Cross-validation showed that the published classification procedure achieved an accuracy of 0.73 using majority voting across all selected components. External validation found a classification accuracy of 0.55 (not significant) and 0.70 (significant) using the direct and transfer learning procedures, respectively. The failure of direct generalization from one site to another demonstrates the limitation of within-site cross-validation and points toward the need to incorporate efforts to facilitate application of machine learning across multiple data sets. The improvement in performance with transfer learning highlights the importance of taking into account the properties of data when constructing predictive models across samples and sites. Our findings suggest that machine learning classification result based on a single study should be interpreted cautiously.

journal_name

Hum Brain Mapp

journal_title

Human brain mapping

authors

Cai XL,Xie DJ,Madsen KH,Wang YM,Bögemann SA,Cheung EFC,Møller A,Chan RCK

doi

10.1002/hbm.24797

subject

Has Abstract

pub_date

2020-01-01 00:00:00

pages

172-184

issue

1

eissn

1065-9471

issn

1097-0193

journal_volume

41

pub_type

杂志文章
  • Evolution of deep gray matter volume across the human lifespan.

    abstract::Magnetic resonance imaging of subcortical gray matter structures, which mediate behavior, cognition and the pathophysiology of several diseases, is crucial for establishing typical maturation patterns across the human lifespan. This single site study examines T1-weighted MPRAGE images of 3 healthy cohorts: (i) a cross...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23604

    authors: Narvacan K,Treit S,Camicioli R,Martin W,Beaulieu C

    更新日期:2017-08-01 00:00:00

  • Performing label-fusion-based segmentation using multiple automatically generated templates.

    abstract::Classically, model-based segmentation procedures match magnetic resonance imaging (MRI) volumes to an expertly labeled atlas using nonlinear registration. The accuracy of these techniques are limited due to atlas biases, misregistration, and resampling error. Multi-atlas-based approaches are used as a remedy and invol...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22092

    authors: Chakravarty MM,Steadman P,van Eede MC,Calcott RD,Gu V,Shaw P,Raznahan A,Collins DL,Lerch JP

    更新日期:2013-10-01 00:00:00

  • Individual differences in stop-related activity are inflated by the adaptive algorithm in the stop signal task.

    abstract::Research using the Stop Signal Task employing an adaptive algorithm to accommodate individual differences often report inferior performance on the task in individuals with ADHD, OCD, and substance use disorders compared to non-clinical controls. Furthermore, individuals with deficits in inhibitory control tend to show...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24075

    authors: D'Alberto N,Chaarani B,Orr CA,Spechler PA,Albaugh MD,Allgaier N,Wonnell A,Banaschewski T,Bokde ALW,Bromberg U,Büchel C,Quinlan EB,Conrod PJ,Desrivières S,Flor H,Fröhner JH,Frouin V,Gowland P,Heinz A,Itterman B,Mar

    更新日期:2018-08-01 00:00:00

  • Altered brain functional network dynamics in obsessive-compulsive disorder.

    abstract::Obsessive-compulsive disorder (OCD) is a debilitating and disabling neuropsychiatric disorder, whose neurobiological basis remains unclear. Although traditional static resting-state magnetic resonance imaging (rfMRI) studies have found aberrant functional connectivity (FC) in OCD, alterations in whole-brain FC and top...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25345

    authors: Luo L,Li Q,You W,Wang Y,Tang W,Li B,Yang Y,Sweeney JA,Li F,Gong Q

    更新日期:2021-02-01 00:00:00

  • Posterior cingulate activation during moral dilemma in adolescents.

    abstract::Neuroimaging research examining correlates of adolescent behavioral maturation has focused largely on issues related to higher cognitive development. Currently few studies have explored neural correlates of emotional reactivity in adolescent groups. In this study, we sought to examine the nature of posterior cingulate...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20436

    authors: Pujol J,Reixach J,Harrison BJ,Timoneda-Gallart C,Vilanova JC,Pérez-Alvarez F

    更新日期:2008-08-01 00:00:00

  • Neural correlates of successful semantic processing during propofol sedation.

    abstract::Sedation has a graded effect on brain responses to auditory stimuli: perceptual processing persists at sedation levels that attenuate more complex processing. We used fMRI in healthy volunteers sedated with propofol to assess changes in neural responses to spoken stimuli. Volunteers were scanned awake, sedated, and du...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22375

    authors: Adapa RM,Davis MH,Stamatakis EA,Absalom AR,Menon DK

    更新日期:2014-07-01 00:00:00

  • Variation in TREK1 gene linked to depression-resistant phenotype is associated with potentiated neural responses to rewards in humans.

    abstract::The TREK1 gene has been linked to a depression-resistant phenotype in rodents and antidepressant response in humans, but the neural mechanisms underlying these links are unclear. Because TREK1 is expressed in reward-related basal ganglia regions, it has been hypothesized that TREK1 genetic variation may be associated ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20858

    authors: Dillon DG,Bogdan R,Fagerness J,Holmes AJ,Perlis RH,Pizzagalli DA

    更新日期:2010-02-01 00:00:00

  • Modulative effects of COMT haplotype on age-related associations with brain morphology.

    abstract::Catechol-O-methyltransferase (COMT), located on chromosome 22q11.2, encodes an enzyme critical for dopamine flux in the prefrontal cortex. Genetic variants of COMT have been suggested to functionally manipulate prefrontal morphology and function in healthy adults. This study aims to investigate modulative roles of ind...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23161

    authors: Lee A,Qiu A

    更新日期:2016-06-01 00:00:00

  • Early changes in white matter pathways of the sensorimotor cortex in premanifest Huntington's disease.

    abstract:OBJECTIVES:To investigate the function-structure relationship of white matter within different stages of Huntington's disease (HD) using diffusion tensor imaging (DTI). EXPERIMENTAL DESIGN:From the TRACK-HD study, an early stage HD group and a premanifest gene carrier group (PMGC) were age-matched to two healthy contr...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21205

    authors: Dumas EM,van den Bogaard SJ,Ruber ME,Reilman RR,Stout JC,Craufurd D,Hicks SL,Kennard C,Tabrizi SJ,van Buchem MA,van der Grond J,Roos RA

    更新日期:2012-01-01 00:00:00

  • Lateralized auditory spatial perception and the contralaterality of cortical processing as studied with functional magnetic resonance imaging and magnetoencephalography.

    abstract::Functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) were used to study the relationships between lateralized auditory perception in humans and the contralaterality of processing in auditory cortex. Subjects listened to rapidly presented streams of short FM-sweep tone bursts to detect infreque...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:

    authors: Woldorff MG,Tempelmann C,Fell J,Tegeler C,Gaschler-Markefski B,Hinrichs H,Heinz HJ,Scheich H

    更新日期:1999-01-01 00:00:00

  • Diffusion tensor imaging of white matter and correlates to eye movement control and psychometric testing in children with prenatal alcohol exposure.

    abstract::Prenatal alcohol exposure (PAE) can cause central nervous system dysfunction and widespread structural anomalies as detected by magnetic resonance imaging (MRI). This study focused on diffusion tensor imaging (DTI) of white matter in a large sample of PAE participants that allowed us to examine correlations with behav...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23371

    authors: Paolozza A,Treit S,Beaulieu C,Reynolds JN

    更新日期:2017-01-01 00:00:00

  • fMRI study comparing names versus pictures of objects.

    abstract::We performed an fMRI one-back recognition study aimed at distinguishing the semantic versus perceptual aspects of how objects and their written forms are processed. There were three types of visually presented items: pictures (schematic drawings of objects); words identifying these objects; and a mixed condition in wh...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.10037

    authors: Sevostianov A,Horwitz B,Nechaev V,Williams R,Fromm S,Braun AR

    更新日期:2002-07-01 00:00:00

  • The anatomical scaffold underlying the functional centrality of known cortical hubs.

    abstract::Cortical hubs play a fundamental role in the functional architecture of brain connectivity at rest. However, the anatomical scaffold underlying their centrality is still under debate. Certainly, the brain function and anatomy are significantly entwined through synaptogenesis and pruning mechanisms that continuously re...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23721

    authors: de Pasquale F,Della Penna S,Sabatini U,Caravasso Falletta C,Peran P

    更新日期:2017-10-01 00:00:00

  • Transient perturbation of the left temporal cortex evokes plasticity-related reconfiguration of the lexical network.

    abstract::While much progress has been made in how brain organization supports language function, the language network's ability to adapt to immediate disturbances by means of reorganization remains unclear. The aim of this study was to examine acute reorganizational changes in brain activity related to conceptual and lexical r...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24860

    authors: Klaus J,Schutter DJLG,Piai V

    更新日期:2020-03-01 00:00:00

  • On the integrity of functional brain networks in schizophrenia, Parkinson's disease, and advanced age: Evidence from connectivity-based single-subject classification.

    abstract::Previous whole-brain functional connectivity studies achieved successful classifications of patients and healthy controls but only offered limited specificity as to affected brain systems. Here, we examined whether the connectivity patterns of functional systems affected in schizophrenia (SCZ), Parkinson's disease (PD...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23763

    authors: Pläschke RN,Cieslik EC,Müller VI,Hoffstaedter F,Plachti A,Varikuti DP,Goosses M,Latz A,Caspers S,Jockwitz C,Moebus S,Gruber O,Eickhoff CR,Reetz K,Heller J,Südmeyer M,Mathys C,Caspers J,Grefkes C,Kalenscher T,Langn

    更新日期:2017-12-01 00:00:00

  • Local and remote effects of transcranial direct current stimulation on the electrical activity of the motor cortical network.

    abstract::We systematically investigated the effects of cathodal and anodal Transcranial Direct Current Stimulation (CtDCS, AtDCS) on the electric activity of primary motor cortex during a motor task. High-density electroencephalography was used to define the spatial diffusion of tDCS after effects. Ten healthy subjects perform...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22322

    authors: Notturno F,Marzetti L,Pizzella V,Uncini A,Zappasodi F

    更新日期:2014-05-01 00:00:00

  • Putative protective neural mechanisms in prereaders with a family history of dyslexia who subsequently develop typical reading skills.

    abstract::Developmental dyslexia affects 40-60% of children with a familial risk (FHD+) compared to a general prevalence of 5-10%. Despite the increased risk, about half of FHD+ children develop typical reading abilities (FHD+Typical). Yet the underlying neural characteristics of favorable reading outcomes in at-risk children r...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24980

    authors: Yu X,Zuk J,Perdue MV,Ozernov-Palchik O,Raney T,Beach SD,Norton ES,Ou Y,Gabrieli JDE,Gaab N

    更新日期:2020-07-01 00:00:00

  • Spatial elongation of population receptive field profiles revealed by model-free fMRI back-projection.

    abstract::Estimates of visual field topographies in human visual cortex obtained through fMRI traveling wave techniques usually provide the parameters of population receptive field (pRF) location (polar angle, eccentricity) and receptive field size. These parameters are obtained by fitting the recorded data to a standard model ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24015

    authors: Merkel C,Hopf JM,Schoenfeld MA

    更新日期:2018-06-01 00:00:00

  • Frontal and parietal contributions to arithmetic fact retrieval: a parametric analysis of the problem-size effect.

    abstract::The goal of the present study was to investigate the neuroanatomical basis of arithmetic fact retrieval. The rationale was that areas playing a crucial role in arithmetic fact retrieval should show a systematic increase of activation with increasing retrieval effort. To achieve this goal, we utilized the problem-size ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21002

    authors: Jost K,Khader PH,Burke M,Bien S,Rösler F

    更新日期:2011-01-01 00:00:00

  • Effects of aripiprazole and haloperidol on neural activation during a simple motor task in healthy individuals: A functional MRI study.

    abstract::The dopaminergic system plays a key role in motor function and motor abnormalities have been shown to be a specific feature of psychosis. Due to their dopaminergic action, antipsychotic drugs may be expected to modulate motor function, but the precise effects of these drugs on motor function remain unclear. We carried...

    journal_title:Human brain mapping

    pub_type: 杂志文章,随机对照试验

    doi:10.1002/hbm.23485

    authors: Goozee R,O'Daly O,Handley R,Reis Marques T,Taylor H,McQueen G,Hubbard K,Pariante C,Mondelli V,Reinders AA,Dazzan P

    更新日期:2017-04-01 00:00:00

  • Detection of mild cognitive impairment in a community-dwelling population using quantitative, multiparametric MRI-based classification.

    abstract::Early and accurate mild cognitive impairment (MCI) detection within a heterogeneous, nonclinical population is needed to improve care for persons at risk of developing dementia. Magnetic resonance imaging (MRI)-based classification may aid early diagnosis of MCI, but has only been applied within clinical cohorts. We a...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24554

    authors: Bouts MJRJ,van der Grond J,Vernooij MW,Koini M,Schouten TM,de Vos F,Feis RA,Cremers LGM,Lechner A,Schmidt R,de Rooij M,Niessen WJ,Ikram MA,Rombouts SARB

    更新日期:2019-06-15 00:00:00

  • Disruptions in the left frontoparietal network underlie resting state endophenotypic markers in schizophrenia.

    abstract::Advances in functional brain imaging have improved the search for potential endophenotypic markers in schizophrenia. Here, we employed independent component analysis (ICA) and dynamic causal modeling (DCM) in resting state fMRI on a sample of 35 schizophrenia patients, 20 first-degree relatives and 35 control subjects...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23477

    authors: Chahine G,Richter A,Wolter S,Goya-Maldonado R,Gruber O

    更新日期:2017-04-01 00:00:00

  • Alterations in functional activation in euthymic bipolar disorder and schizophrenia during a working memory task.

    abstract::Dysfunctions in prefrontal cortical networks are thought to underlie working memory (WM) impairments consistently observed in both subjects with bipolar disorder and schizophrenia. It remains unclear, however, whether patterns of WM-related hemodynamic responses are similar in bipolar and schizophrenia subjects compar...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20820

    authors: Hamilton LS,Altshuler LL,Townsend J,Bookheimer SY,Phillips OR,Fischer J,Woods RP,Mazziotta JC,Toga AW,Nuechterlein KH,Narr KL

    更新日期:2009-12-01 00:00:00

  • Does stroke location predict walk speed response to gait rehabilitation?

    abstract:OBJECTIVES:Recovery of independent ambulation after stroke is a major goal. However, which rehabilitation regimen best benefits each individual is unknown and decisions are currently made on a subjective basis. Predictors of response to specific therapies would guide the type of therapy most appropriate for each patien...

    journal_title:Human brain mapping

    pub_type: 杂志文章,随机对照试验

    doi:10.1002/hbm.23059

    authors: Jones PS,Pomeroy VM,Wang J,Schlaug G,Tulasi Marrapu S,Geva S,Rowe PJ,Chandler E,Kerr A,Baron JC,SWIFT-Cast investigators.

    更新日期:2016-02-01 00:00:00

  • Altered integrity of the right arcuate fasciculus as a trait marker of schizophrenia: a sibling study using tractography-based analysis of the whole brain.

    abstract::Trait markers of schizophrenia aid the dissection of the heterogeneous phenotypes into distinct subtypes and facilitate the genetic underpinning of the disease. The microstructural integrity of the white matter tracts could serve as a trait marker of schizophrenia, and tractography-based analysis (TBA) is the current ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22686

    authors: Wu CH,Hwang TJ,Chen YJ,Hsu YC,Lo YC,Liu CM,Hwu HG,Liu CC,Hsieh MH,Chien YL,Chen CM,Tseng WY

    更新日期:2015-03-01 00:00:00

  • Neural mechanisms underlying the reward-related enhancement of motivation when remembering episodic memories with high difficulty.

    abstract::The motivation to receive rewards enhances episodic memories, and the motivation is modulated by task difficulty. In episodic retrieval, however, functional neuroimaging evidence regarding the motivation that mediates interactions between reward and task difficulty is scarce. The present fMRI study investigated this i...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23599

    authors: Shigemune Y,Tsukiura T,Nouchi R,Kambara T,Kawashima R

    更新日期:2017-07-01 00:00:00

  • Voxelwise and skeleton-based region of interest analysis of fetal alcohol syndrome and fetal alcohol spectrum disorders in young adults.

    abstract::Though fetal alcohol syndrome (FAS) and fetal alcohol spectrum disorders are among the most common developmental disorders, their understanding is incomplete. Diffusion tensor imaging (DTI), which is sensitive to microstructural organization in white matter, may provide a relevant measure in this population demonstrat...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20747

    authors: Li L,Coles CD,Lynch ME,Hu X

    更新日期:2009-10-01 00:00:00

  • Data-driven modeling of phase interactions between spontaneous MEG oscillations.

    abstract:OBJECTIVE:Synchronization between distributed rhythms in the brain is commonly assessed by estimating the synchronization strength from simultaneous measurements. This approach, however, does not elucidate the phase dynamics that underlies synchronization. For this, an explicit dynamical model is required. Based on the...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21099

    authors: Hindriks R,Bijma F,van Dijk BW,Stam CJ,van der Werf YY,van Someren EJ,de Munck JC,van der Vaart AW

    更新日期:2011-07-01 00:00:00

  • "Sparse" temporal sampling in auditory fMRI.

    abstract::The use of functional magnetic resonance imaging (fMRI) to explore central auditory function may be compromised by the intense bursts of stray acoustic noise produced by the scanner whenever the magnetic resonance signal is read out. We present results evaluating the use of one method to reduce the effect of the scann...

    journal_title:Human brain mapping

    pub_type: 临床试验,杂志文章

    doi:10.1002/(sici)1097-0193(1999)7:3<213::aid-hbm5>3.0

    authors: Hall DA,Haggard MP,Akeroyd MA,Palmer AR,Summerfield AQ,Elliott MR,Gurney EM,Bowtell RW

    更新日期:1999-01-01 00:00:00

  • Hemispheric specialization during mental imagery of brisk walking.

    abstract:OBJECTIVES:Brisk walking, a sensitive test to evaluate gait capacity in normal and pathological aging such as parkinsonism, is used as an alternative to classical fitness program for motor rehabilitation and may help to decrease the risk of cognitive deterioration observed with aging. In this study, we aimed to identif...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21255

    authors: Crémers J,Dessoullières A,Garraux G

    更新日期:2012-04-01 00:00:00