A decade of test-retest reliability of functional connectivity: A systematic review and meta-analysis.

Abstract:

BACKGROUND:Once considered mere noise, fMRI-based functional connectivity has become a major neuroscience tool in part due to early studies demonstrating its reliability. These fundamental studies revealed only the tip of the iceberg; over the past decade, many test-retest reliability studies have continued to add nuance to our understanding of this complex topic. A summary of these diverse and at times contradictory perspectives is needed. OBJECTIVES:We aimed to summarize the existing knowledge regarding test-retest reliability of functional connectivity at the most basic unit of analysis: the individual edge level. This entailed (1) a meta-analytic estimate of reliability and (2) a review of factors influencing reliability. METHODS:A search of Scopus was conducted to identify studies that estimated edge-level test-retest reliability. To facilitate comparisons across studies, eligibility was restricted to studies measuring reliability via the intraclass correlation coefficient (ICC). The meta-analysis included a random effects pooled estimate of mean edge-level ICC, with studies nested within datasets. The review included a narrative summary of factors influencing edge-level ICC. RESULTS:From an initial pool of 212 studies, 44 studies were identified for the qualitative review and 25 studies for quantitative meta-analysis. On average, individual edges exhibited a "poor" ICC of 0.29 (95% CI = 0.23 to 0.36). The most reliable measurements tended to involve: (1) stronger, within-network, cortical edges, (2) eyes open, awake, and active recordings, (3) more within-subject data, (4) shorter test-retest intervals, (5) no artifact correction (likely due in part to reliable artifact), and (6) full correlation-based connectivity with shrinkage. CONCLUSION:This study represents the first meta-analysis and systematic review investigating test-retest reliability of edge-level functional connectivity. Key findings suggest there is room for improvement, but care should be taken to avoid promoting reliability at the expense of validity. By pooling existing knowledge regarding this key facet of accuracy, this study supports broader efforts to improve inferences in the field.

journal_name

Neuroimage

journal_title

NeuroImage

authors

Noble S,Scheinost D,Constable RT

doi

10.1016/j.neuroimage.2019.116157

subject

Has Abstract

pub_date

2019-12-01 00:00:00

pages

116157

eissn

1053-8119

issn

1095-9572

pii

S1053-8119(19)30748-7

journal_volume

203

pub_type

杂志文章,meta分析
  • Randomness of resting-state brain oscillations encodes Gray's personality trait.

    abstract::Randomness of functional Magnetic Resonance Imaging (fMRI) resting-state time-series has recently been used as a biomarker for numerous disorders including Alzheimer's and Parkinson's disease as well as autism. To date, however, it remains unknown whether and to what degree personality traits are associated with the r...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.08.042

    authors: Hahn T,Dresler T,Ehlis AC,Pyka M,Dieler AC,Saathoff C,Jakob PM,Lesch KP,Fallgatter AJ

    更新日期:2012-01-16 00:00:00

  • Interhemispheric differences of sensory hand areas after monohemispheric stroke: MEG/MRI integrative study.

    abstract::Seventeen clinically stabilized monohemispheric stroke patients were studied in order to investigate the chronic topographical modifications induced on primary sensory cortical hand areas by a monohemispheric stroke within the middle cerebral artery territory. Magnetoencephalographic (MEG) localization of the cortical...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2000.0686

    authors: Rossini PM,Tecchio F,Pizzella V,Lupoi D,Cassetta E,Pasqualetti P

    更新日期:2001-08-01 00:00:00

  • Early detection of the chemical changes occurring during the induction and prevention of autoimmune-mediated demyelination detected by FT-IR imaging.

    abstract::Multiple sclerosis (MS) is an inflammatory, demyelinating and neurodegenerative disease of the central nervous system (CNS). Despite progress in understanding immunogenetic aspects of this disease, the mechanisms involved in lesion formation are unknown. To gain new insights into the neuropathology of MS, we used an i...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2009.09.053

    authors: Heraud P,Caine S,Campanale N,Karnezis T,McNaughton D,Wood BR,Tobin MJ,Bernard CC

    更新日期:2010-01-15 00:00:00

  • Arm training induced brain plasticity in stroke studied with serial positron emission tomography.

    abstract::We used serial positron emission tomography (PET) to study training-induced brain plasticity after severe hemiparetic stroke. Ten patients were randomized to either task-oriented arm training or to a control group and scanned before and after 22.6 +/- 1.6 days of treatment using passive movements as an activation para...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1006/nimg.2001.0757

    authors: Nelles G,Jentzen W,Jueptner M,Müller S,Diener HC

    更新日期:2001-06-01 00:00:00

  • Lack of generalizability of sex differences in the fMRI BOLD activity associated with language processing in adults.

    abstract::A lack of consensus exists as to whether there are sex differences in the fMRI BOLD signal correlates of language processing in the human brain. Here, whole-brain fMRI was used to examine the neural activity of 46 adults performing one of two sets of language tasks. Conservative quantitative and qualitative criteria i...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2008.12.034

    authors: Ihnen SK,Church JA,Petersen SE,Schlaggar BL

    更新日期:2009-04-15 00:00:00

  • The anthropomorphic brain: the mirror neuron system responds to human and robotic actions.

    abstract::In humans and monkeys the mirror neuron system transforms seen actions into our inner representation of these actions. Here we asked if this system responds also if we see an industrial robot perform similar actions. We localised the motor areas involved in the execution of hand actions, presented the same subjects bl...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.02.003

    authors: Gazzola V,Rizzolatti G,Wicker B,Keysers C

    更新日期:2007-05-01 00:00:00

  • Brain development and aging: overlapping and unique patterns of change.

    abstract::Early-life development is characterized by dramatic changes, impacting lifespan function more than changes in any other period. Developmental origins of neurocognitive late-life functions are acknowledged, but detailed longitudinal magnetic resonance imaging studies of brain maturation and direct comparisons with agin...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2012.11.039

    authors: Tamnes CK,Walhovd KB,Dale AM,Østby Y,Grydeland H,Richardson G,Westlye LT,Roddey JC,Hagler DJ Jr,Due-Tønnessen P,Holland D,Fjell AM,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2013-03-01 00:00:00

  • Decoding fMRI activity in the time domain improves classification performance.

    abstract::Most current functional Magnetic Resonance Imaging (fMRI) decoding analyses rely on statistical summaries of the data resulting from a deconvolution approach: each stimulation event is associated with a brain response. This standard approach leads to simple learning procedures, yet it is ill-suited for decoding events...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.08.018

    authors: Loula J,Varoquaux G,Thirion B

    更新日期:2018-10-15 00:00:00

  • Dynamic functional connectivity during task performance and rest predicts individual differences in attention across studies.

    abstract::Dynamic functional connectivity (DFC) aims to maximize resolvable information from functional brain scans by considering temporal changes in network structure. Recent work has demonstrated that static, i.e. time-invariant resting-state and task-based FC predicts individual differences in behavior, including attention....

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.11.057

    authors: Fong AHC,Yoo K,Rosenberg MD,Zhang S,Li CR,Scheinost D,Constable RT,Chun MM

    更新日期:2019-03-01 00:00:00

  • The z-spectrum from human blood at 7T.

    abstract::Chemical Exchange Saturation Transfer (CEST) has been used to assess healthy and pathological tissue in both animals and humans. However, the CEST signal from blood has not been fully assessed. This paper presents the CEST and nuclear Overhauser enhancement (NOE) signals detected in human blood measured via z-spectrum...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.10.053

    authors: Shah SM,Mougin OE,Carradus AJ,Geades N,Dury R,Morley W,Gowland PA

    更新日期:2018-02-15 00:00:00

  • Contextual interference in recognition memory with age.

    abstract::Previous behavioral research suggests that although elderly adults' memory benefits from supportive context, misleading or irrelevant contexts produce greater interference. In the present study, we use event-related fMRI to investigate age differences when processing contextual information to make recognition judgment...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.01.043

    authors: Gutchess AH,Hebrank A,Sutton BP,Leshikar E,Chee MW,Tan JC,Goh JO,Park DC

    更新日期:2007-04-15 00:00:00

  • Brain mechanisms for perceiving illusory lines in humans.

    abstract::Illusory contours (ICs) are perceptions of visual borders despite absent contrast gradients. The psychophysical and neurobiological mechanisms of IC processes have been studied across species and diverse brain imaging/mapping techniques. Nonetheless, debate continues regarding whether IC sensitivity results from a (pr...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.07.017

    authors: Anken J,Tivadar RI,Knebel JF,Murray MM

    更新日期:2018-11-01 00:00:00

  • Oxygen metabolism, oxygen extraction and positron emission tomography: Historical perspective and impact on basic and clinical neuroscience.

    abstract::Oxygen utilization is central to the human brain's high metabolic rate. Measurement of this fundamental process, in both disease and health, has been a focus of research attention over the last 35 years. This review plots the course of the use of oxygen-15 to study regional cerebral oxygen extraction and metabolism us...

    journal_title:NeuroImage

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuroimage.2011.12.036

    authors: Baron JC,Jones T

    更新日期:2012-06-01 00:00:00

  • fMRI reflects functional connectivity of human somatosensory cortex.

    abstract::Unilateral sensory stimulation reliably elicits contralateral somatotopic activation of primary (SI) and secondary (SII) somatosensory cortex. There is an ongoing debate about the occurrence and nature of concomitant ipsilateral SI and SII activation. Here we used functional magnetic resonance imaging (fMRI) in health...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.05.038

    authors: Blatow M,Nennig E,Durst A,Sartor K,Stippich C

    更新日期:2007-09-01 00:00:00

  • Effects of estrogen and testosterone treatment on serotonin transporter binding in the brain of surgically postmenopausal women--a PET study.

    abstract::Sex hormones and the serotonergic system interact in the regulation of mood, learning, memory and sexual behaviour. However, the mechanisms have not been fully explored. The serotonin transporter protein (5-HTT) regulates synaptic concentrations of serotonin and is a primary target for selective serotonin reuptake inh...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.neuroimage.2014.11.003

    authors: Jovanovic H,Kocoska-Maras L,Rådestad AF,Halldin C,Borg J,Hirschberg AL,Nordström AL

    更新日期:2015-02-01 00:00:00

  • The development of corpus callosum microstructure and associations with bimanual task performance in healthy adolescents.

    abstract::Cross-sectional and longitudinal volumetric studies suggest that the corpus callosum (CC) continues to mature structurally from infancy to adulthood. Diffusion tensor imaging (DTI) provides in vivo information about the directional organization of white matter microstructure and shows potential for elucidating even mo...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.10.018

    authors: Muetzel RL,Collins PF,Mueller BA,M Schissel A,Lim KO,Luciana M

    更新日期:2008-02-15 00:00:00

  • Amyloid and tau PET demonstrate region-specific associations in normal older people.

    abstract::β-amyloid (Aβ) and tau pathology become increasingly prevalent with age, however, the spatial relationship between the two pathologies remains unknown. We examined local (same region) and non-local (different region) associations between these 2 aggregated proteins in 46 normal older adults using [18F]AV-1451 (for tau...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.02.051

    authors: Lockhart SN,Schöll M,Baker SL,Ayakta N,Swinnerton KN,Bell RK,Mellinger TJ,Shah VD,O'Neil JP,Janabi M,Jagust WJ

    更新日期:2017-04-15 00:00:00

  • Neurite orientation dispersion and density imaging reveals white matter and hippocampal microstructure changes produced by Interleukin-6 in the TgCRND8 mouse model of amyloidosis.

    abstract::Extracellular β-amyloid (Aβ) plaque deposits and inflammatory immune activation are thought to alter various aspects of tissue microstructure, such as extracellular free water, fractional anisotropy and diffusivity, as well as the density and geometric arrangement of axonal processes. Quantifying these microstructural...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.116138

    authors: Colon-Perez LM,Ibanez KR,Suarez M,Torroella K,Acuna K,Ofori E,Levites Y,Vaillancourt DE,Golde TE,Chakrabarty P,Febo M

    更新日期:2019-11-15 00:00:00

  • Challenges in image-guided therapy system design.

    abstract::System development for image-guided therapy (IGT), or image-guided interventions (IGI), continues to be an area of active interest across academic and industry groups. This is an emerging field that is growing rapidly: major academic institutions and medical device manufacturers have produced IGT technologies that are...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.04.026

    authors: Dimaio S,Kapur T,Cleary K,Aylward S,Kazanzides P,Vosburgh K,Ellis R,Duncan J,Farahani K,Lemke H,Peters T,Lorensen WB,Gobbi D,Haller J,Clarke LL,Pizer S,Taylor R,Galloway R Jr,Fichtinger G,Hata N,Lawson K,Tempany

    更新日期:2007-01-01 00:00:00

  • Attention to speed of motion, speed discrimination, and task difficulty: an fMRI study.

    abstract::We studied the functional neuroanatomy of attention to speed of motion using functional magnetic resonance imaging in eight healthy subjects, who performed a speed discrimination (SID) task using a random textured pattern moving at a reference speed of 6 deg/s. During the control condition (DIM), with retinal stimulat...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2000.0587

    authors: Sunaert S,Van Hecke P,Marchal G,Orban GA

    更新日期:2000-06-01 00:00:00

  • A regression analysis study of the primary somatosensory cortex during pain.

    abstract::Several functional imaging studies of pain, using a number of different experimental paradigms and a variety of reference states, have failed to detect activations in the somatosensory cortices, while other imaging studies of pain have reported significant activations in these regions. The role of the somatosensory ar...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2002.1069

    authors: Petrovic P,Petersson KM,Hansson P,Ingvar M

    更新日期:2002-08-01 00:00:00

  • Developmental neural networks in children performing a Categorical N-Back Task.

    abstract::The prefrontal and temporal networks subserving object working memory tasks in adults have been reported as immature in young children; yet children are adequately capable of performing such tasks. We investigated the basis of this apparent contradiction using a complex object working memory task, a Categorical n-back...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2006.07.028

    authors: Ciesielski KT,Lesnik PG,Savoy RL,Grant EP,Ahlfors SP

    更新日期:2006-11-15 00:00:00

  • Fronto-cerebellar connectivity mediating cognitive processing speed.

    abstract::Processing speed is an important construct in understanding cognition. This study was aimed to control task specificity for understanding the neural mechanisms underlying cognitive processing speed. Forty young adult subjects performed attention tasks of two modalities (auditory and visual) and two levels of task rule...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.117556

    authors: Wong CHY,Liu J,Lee TMC,Tao J,Wong AWK,Chau BKH,Chen L,Chan CCH

    更新日期:2021-02-01 00:00:00

  • The C50m response: conditioned magnetocerebral activity recorded from the human brain.

    abstract::Recent advances in neuroimaging technology now permit a precise determination of the dynamics of specific neural activity underlying human associative learning. We used magnetoencephalography (MEG) to characterize the dynamics of conditioned responses (CRs) within auditory cortex during habituation, delay and trace co...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.neuroimage.2005.05.017

    authors: Moses SN,Martin T,Houck JM,Ilmoniemi RJ,Tesche CD

    更新日期:2005-10-01 00:00:00

  • Corticospinal properties are associated with sensorimotor performance in action video game players.

    abstract::Notwithstanding the apparent demands regarding fine motor skills that are required to perform in action video games, the motor nervous system of players has not been studied systematically. In the present study, we hypothesized to find differences in sensorimotor performance and corticospinal characteristics between a...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.117576

    authors: Giboin LS,Reunis T,Gruber M

    更新日期:2021-02-01 00:00:00

  • Common and distinct brain regions processing multisensory bodily signals for peripersonal space and body ownership.

    abstract::We take the feeling that our body belongs to us for granted. However, recent research has shown that it is possible to alter the subjective sensation of body ownership (BO) by manipulating multisensory bodily inputs. Several frontal and parietal regions are known to specifically process multisensory cues presented clo...

    journal_title:NeuroImage

    pub_type: 杂志文章,meta分析

    doi:10.1016/j.neuroimage.2016.12.052

    authors: Grivaz P,Blanke O,Serino A

    更新日期:2017-02-15 00:00:00

  • Effect of paroxetine and bupropion on human resting brain perfusion: an arterial spin labeling study.

    abstract::Due to the physiological coupling with metabolism, brain perfusion is a potential aid in understanding the effects of medication on neural activity in vivo. In this study, arterial spin labeling (ASL) was used to quantify the effect of seven days of administration of paroxetine (20 mg), bupropion (150 mg) on cerebral ...

    journal_title:NeuroImage

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.neuroimage.2012.03.014

    authors: Viviani R,Abler B,Seeringer A,Stingl JC

    更新日期:2012-07-16 00:00:00

  • SGPP: spatial Gaussian predictive process models for neuroimaging data.

    abstract::The aim of this paper is to develop a spatial Gaussian predictive process (SGPP) framework for accurately predicting neuroimaging data by using a set of covariates of interest, such as age and diagnostic status, and an existing neuroimaging data set. To achieve a better prediction, we not only delineate spatial associ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2013.11.018

    authors: Hyun JW,Li Y,Gilmore JH,Lu Z,Styner M,Zhu H

    更新日期:2014-04-01 00:00:00

  • Structure Tensor Informed Fiber Tractography (STIFT) by combining gradient echo MRI and diffusion weighted imaging.

    abstract::Structural connectivity research in the human brain in vivo relies heavily on fiber tractography in diffusion-weighted MRI (DWI). The accurate mapping of white matter pathways would gain from images with a higher resolution than the typical ~2mm isotropic DWI voxel size. Recently, high field gradient echo MRI (GE) has...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.10.078

    authors: Kleinnijenhuis M,Barth M,Alexander DC,van Cappellen van Walsum AM,Norris DG

    更新日期:2012-02-15 00:00:00

  • Detecting stable individual differences in the functional organization of the human basal ganglia.

    abstract::Moving from group level to individual level functional parcellation maps is a critical step for developing a rich understanding of the links between individual variation in functional network architecture and cognitive and clinical phenotypes. Still, the identification of functional units in the brain based on intrins...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2017.07.029

    authors: Garcia-Garcia M,Nikolaidis A,Bellec P,Craddock RC,Cheung B,Castellanos FX,Milham MP

    更新日期:2018-04-15 00:00:00