A framework for identifying treatment-covariate interactions in individual participant data network meta-analysis.


BACKGROUND:Stratified medicine seeks to identify patients most likely to respond to treatment. Individual participant data (IPD) network meta-analysis (NMA) models have greater power than individual trials to identify treatment-covariate interactions (TCIs). Treatment-covariate interactions contain "within" and "across" trial interactions, where the across-trial interaction is more susceptible to confounding and ecological bias. METHODS:We considered a network of IPD from 37 trials (5922 patients) for cervical cancer (2394 events), where previous research identified disease stage as a potential interaction covariate. We compare 2 models for NMA with TCIs: (1) 2 effects separating within- and across-trial interactions and (2) a single effect combining within- and across-trial interactions. We argue for a visual assessment of consistency of within- and across-trial interactions and consider more detailed aspects of interaction modelling, eg, common vs trial-specific effects of the covariate. This leads us to propose a practical framework for IPD NMA with TCIs. RESULTS:Following our framework, we found no evidence in the cervical cancer network for a treatment-stage interaction on the basis of the within-trial interaction. The NMA provided additional power for an across-trial interaction over and above the pairwise evidence. Following our proposed framework, we found that the within- and across-trial interactions should not be combined. CONCLUSION:Across-trial interactions are susceptible to confounding and ecological bias. It is important to separate the sources of evidence to check their consistency and identify which sources of evidence are driving the conclusion. Our framework provides practical guidance for researchers, reducing the risk of unduly optimistic interpretation of TCIs.


Res Synth Methods


Freeman SC,Fisher D,Tierney JF,Carpenter JR




Has Abstract


2018-09-01 00:00:00












  • A comparison of methods for meta-analysis of a small number of studies with binary outcomes.

    abstract::Meta-analyses often include only a small number of studies (≤5). Estimating between-study heterogeneity is difficult in this situation. An inaccurate estimation of heterogeneity can result in biased effect estimates and too narrow confidence intervals. The beta-binominal model has shown good statistical properties for...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Mathes T,Kuss O

    更新日期:2018-09-01 00:00:00

  • Empirical comparison of univariate and multivariate meta-analyses in Cochrane Pregnancy and Childbirth reviews with multiple binary outcomes.

    abstract:BACKGROUND:Multivariate meta-analysis (MVMA) jointly synthesizes effects for multiple correlated outcomes. The MVMA model is potentially more difficult and time-consuming to apply than univariate models, so if its use makes little difference to parameter estimates, it could be argued that it is redundant. METHODS:We a...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,meta分析


    authors: Price MJ,Blake HA,Kenyon S,White IR,Jackson D,Kirkham JJ,Neilson JP,Deeks JJ,Riley RD

    更新日期:2019-09-01 00:00:00

  • Multi-context versus context-specific qualitative evidence syntheses: combining the best of both.

    abstract::There is an increasing interest in the conduct of qualitative evidence syntheses (QES), particularly in the field of health care. Approaches to QES vary in the way they conduct a search, a critical appraisal or the data-analysis. To date, the use of multi-context versus context-specific QES has not yet been fully cons...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Hannes K,Harden A

    更新日期:2011-12-01 00:00:00

  • Guidance for deriving and presenting percentage study weights in meta-analysis of test accuracy studies.

    abstract::Percentage study weights in meta-analysis reveal the contribution of each study toward the overall summary results and are especially important when some studies are considered outliers or at high risk of bias. In meta-analyses of test accuracy reviews, such as a bivariate meta-analysis of sensitivity and specificity,...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Burke DL,Ensor J,Snell KIE,van der Windt D,Riley RD

    更新日期:2018-06-01 00:00:00

  • Combining individual participant and aggregated data in a meta-analysis with correlational studies.

    abstract::This paper presents methods for combining individual participant data (IPD) with aggregated study level data (AD) in a meta-analysis of correlational studies. Although medical researchers have employed IPD in a wide range of studies, only a single example exists in the social sciences. New policies at the National Sci...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Pigott T,Williams R,Polanin J

    更新日期:2012-12-01 00:00:00

  • Can abstract screening workload be reduced using text mining? User experiences of the tool Rayyan.

    abstract:BACKGROUND:One time-consuming aspect of conducting systematic reviews is the task of sifting through abstracts to identify relevant studies. One promising approach for reducing this burden uses text mining technology to identify those abstracts that are potentially most relevant for a project, allowing those abstracts ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Olofsson H,Brolund A,Hellberg C,Silverstein R,Stenström K,Österberg M,Dagerhamn J

    更新日期:2017-09-01 00:00:00

  • Meta-analysis of a binary outcome using individual participant data and aggregate data.

    abstract::In this paper, we develop meta-analysis models that synthesize a binary outcome from health-care studies while accounting for participant-level covariates. In particular, we show how to synthesize the observed event-risk across studies while accounting for the within-study association between participant-level covaria...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Riley RD,Steyerberg EW

    更新日期:2010-01-01 00:00:00

  • Meta-analysis combining parallel and crossover trials using generalised estimating equation method.

    abstract::Clinical trials have different designs: In late stage drug development, the parallel trial design is the most frequent one; however, the crossover design is not rare; different techniques are used to analyse their results. Although both designs measure the same treatment effect, combining parallel and crossover trials...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Curtin F

    更新日期:2017-09-01 00:00:00

  • Learning by doing-teaching systematic review methods in 8 weeks.

    abstract:OBJECTIVE:The objective of this paper is to describe the course "Systematic Reviews and Meta-analysis" at the Johns Hopkins Bloomberg School of Public Health. METHODS:A distinct feature of our course is a group project in which students, assigned to multi-disciplinary groups, conduct a systematic review. In-class sess...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Li T,Saldanha IJ,Vedula SS,Yu T,Rosman L,Twose C,N Goodman S,Dickersin K

    更新日期:2014-09-01 00:00:00

  • Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity.

    abstract::We describe how an appropriate interpretation of the Q-test depends on its power to detect a given typical amount of between-study variance (τ(2)) as well as prior beliefs on heterogeneity. We illustrate these concepts in an evaluation of 1011 meta-analyses of clinical trials with ⩾4 studies and binary outcomes. These...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Pereira TV,Patsopoulos NA,Salanti G,Ioannidis JP

    更新日期:2010-04-01 00:00:00

  • Variations of mixed methods reviews approaches: A case study.

    abstract::Conducting mixed methods reviews is challenging. The aim of this article is to describe a range of rationales for and approaches to mixed methods reviews, with a particular focus on one research group. A case study was conducted to describe the mixed methods review process used at the Department of Health and Social C...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Hong QN,Rees R,Sutcliffe K,Thomas J

    更新日期:2020-11-01 00:00:00

  • A Bayesian nonparametric test of significance chasing biases.

    abstract::There is a growing concern that much of the published research literature is distorted by the pursuit of statistically significant results. In a seminal article, Ioannidis and Trikalinos (2007, Clinical Trials) proposed an omnibus (I&T) test for significance chasing (SC) biases. This test compares the observed number ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Karabatsos G

    更新日期:2018-03-01 00:00:00

  • Identifying evidence for public health guidance: a comparison of citation searching with Web of Science and Google Scholar.

    abstract:AIM:To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence. METHOD:Forwards citation searching was performed using GS on a base set of 46 publication...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Levay P,Ainsworth N,Kettle R,Morgan A

    更新日期:2016-03-01 00:00:00

  • A scoping approach to systematically review published reviews: Adaptations and recommendations.

    abstract::Knowledge translation is a central focus of the health research community, which includes strategies to synthesize published research to support uptake within health care practice and policy arenas. Within the literature concerning review methodologies, a new discussion has emerged concerning methods that review and s...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审


    authors: Schultz A,Goertzen L,Rothney J,Wener P,Enns J,Halas G,Katz A

    更新日期:2018-03-01 00:00:00

  • Using systematic reviews in guideline development: the GRADE approach.

    abstract::Systematic reviews are essential to produce trustworthy guidelines. To assess the certainty of a body of evidence included in a systematic review the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group has developed an approach that is currently used by over 100 organisations, inclu...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Zhang Y,Akl EA,Schünemann HJ

    更新日期:2018-07-14 00:00:00

  • Random-effects models for meta-analytic structural equation modeling: review, issues, and illustrations.

    abstract::Meta-analytic structural equation modeling (MASEM) combines the techniques of meta-analysis and structural equation modeling for the purpose of synthesizing correlation or covariance matrices and fitting structural equation models on the pooled correlation or covariance matrix. Both fixed-effects and random-effects mo...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审


    authors: Cheung MW,Cheung SF

    更新日期:2016-06-01 00:00:00

  • Fixed effects and variance components estimation in three-level meta-analysis.

    abstract::Meta-analytic methods have been widely applied to education, medicine, and the social sciences. Much of meta-analytic data are hierarchically structured because effect size estimates are nested within studies, and in turn, studies can be nested within level-3 units such as laboratories or investigators, and so forth. ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Konstantopoulos S

    更新日期:2011-03-01 00:00:00

  • Precision of healthcare systematic review searches in a cross-sectional sample.

    abstract:BACKGROUND:In systematic reviews, search precision is generally traded off against the desire to retrieve all relevant studies; however, there is no published evidence on typical precision values. The objective of this study is to establish typical values for the precision of systematic review searches in healthcare. ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Sampson M,Tetzlaff J,Urquhart C

    更新日期:2011-06-01 00:00:00

  • Blurring the boundaries between synthesis and evaluation. A customized realist evaluative synthesis into adolescent risk behavior prevention.

    abstract::Realist methodologies have been increasingly advocated for the investigation of complex social issues. Public health programs, such as those designed to prevent adolescent risk behavior, are typically considered complex. In conducting a realist review of the empirical literature relating to such programs, we encounter...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Cooper C,Lhussier M,Carr S

    更新日期:2020-05-01 00:00:00

  • A historical review of publication bias.

    abstract::Publication bias is a well-known threat to the validity of meta-analyses and, more broadly, the reproducibility of scientific findings. When policies and recommendations are predicated on an incomplete evidence base, it undermines the goals of evidence-based decision-making. Great strides have been made in the last 50...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Marks-Anglin A,Chen Y

    更新日期:2020-11-01 00:00:00

  • Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources.

    abstract::Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, reca...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Gusenbauer M,Haddaway NR

    更新日期:2020-03-01 00:00:00

  • Meta-analysis of prognostic studies for a biomarker with a study-specific cutoff value.

    abstract::In prognostic studies, a summary statistic such as a hazard ratio is often reported between low-expression and high-expression groups of a biomarker with a study-specific cutoff value. Recently, several meta-analyses of prognostic studies have been reported, but these studies simply combined hazard ratios provided by ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Sadashima E,Hattori S,Takahashi K

    更新日期:2016-12-01 00:00:00

  • Modelling time-course relationships with multiple treatments: Model-based network meta-analysis for continuous summary outcomes.

    abstract:BACKGROUND:Model-based meta-analysis (MBMA) is increasingly used to inform drug-development decisions by synthesising results from multiple studies to estimate treatment, dose-response, and time-course characteristics. Network meta-analysis (NMA) is used in Health Technology Appraisals for simultaneously comparing effe...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Pedder H,Dias S,Bennetts M,Boucher M,Welton NJ

    更新日期:2019-06-01 00:00:00

  • Conducting gene set tests in meta-analyses of transcriptome expression data.

    abstract::Research synthesis, eg, by meta-analysis, is more and more considered in the area of high-dimensional data from molecular research such as gene and protein expression data, especially because most studies and experiments are performed with very small sample sizes. In contrast to most clinical and epidemiological trial...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Kosch R,Jung K

    更新日期:2019-03-01 00:00:00

  • Network meta-analysis of parametric survival curves.

    abstract::To inform health-care decision-making, treatments are often compared by synthesizing results from a number of randomized controlled trials. The meta-analysis may not only be focused on a particular pairwise comparison, but can also include multiple treatment comparisons by means of network meta-analysis. For time-to-e...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Ouwens MJ,Philips Z,Jansen JP

    更新日期:2010-07-01 00:00:00

  • Methods for documenting systematic review searches: a discussion of common issues.

    abstract:INTRODUCTION:As standardized reporting requirements for systematic reviews are being adopted more widely, review authors are under greater pressure to accurately record their search process. With careful planning, documentation to fulfill the Preferred Reporting Items for Systematic Reviews and Meta-Analyses requiremen...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Rader T,Mann M,Stansfield C,Cooper C,Sampson M

    更新日期:2014-06-01 00:00:00

  • Cross-hairs: a scatterplot for meta-analysis in R.

    abstract::We describe a meta-analytic scatterplot that indicates precision of points for two variables paired within studies; this is equivalent in form to a 'cross-hairs' plot used to portray specificity and sensitivity in diagnostic testing. At the user's discretion, the plot also displays boxplots for each of the X and Y var...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Brannick MT,Gültaş M

    更新日期:2017-03-01 00:00:00

  • Zero-cell corrections in random-effects meta-analyses.

    abstract::The standard estimator for the log odds ratio (the unconditional maximum likelihood estimator) and the delta-method estimator for its standard error are not defined if the corresponding 2 × 2 table contains at least one "zero cell". This is also an issue when estimating the overall log odds ratio in a meta-analysis. I...

    journal_title:Research synthesis methods

    pub_type: 杂志文章


    authors: Weber F,Knapp G,Ickstadt K,Kundt G,Glass Ä

    更新日期:2020-11-01 00:00:00

  • The meta-analytic big bang.

    abstract::This article looks at the impact of meta-analysis and then explores why meta-analysis was developed at the time and by the scholars it did in the social sciences in the 1970s. For the first problem, impact, it examines the impact of meta-analysis using citation network analysis. The impact is seen in the sciences, art...

    journal_title:Research synthesis methods

    pub_type: 历史文章,杂志文章


    authors: Shadish WR,Lecy JD

    更新日期:2015-09-01 00:00:00

  • The use of meta-analytic statistical significance testing.

    abstract::Meta-analysis multiplicity, the concept of conducting multiple tests of statistical significance within one review, is an underdeveloped literature. We address this issue by considering how Type I errors can impact meta-analytic results, suggest how statistical power may be affected through the use of multiplicity cor...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审


    authors: Polanin JR,Pigott TD

    更新日期:2015-03-01 00:00:00