A framework for identifying treatment-covariate interactions in individual participant data network meta-analysis.

Abstract:

BACKGROUND:Stratified medicine seeks to identify patients most likely to respond to treatment. Individual participant data (IPD) network meta-analysis (NMA) models have greater power than individual trials to identify treatment-covariate interactions (TCIs). Treatment-covariate interactions contain "within" and "across" trial interactions, where the across-trial interaction is more susceptible to confounding and ecological bias. METHODS:We considered a network of IPD from 37 trials (5922 patients) for cervical cancer (2394 events), where previous research identified disease stage as a potential interaction covariate. We compare 2 models for NMA with TCIs: (1) 2 effects separating within- and across-trial interactions and (2) a single effect combining within- and across-trial interactions. We argue for a visual assessment of consistency of within- and across-trial interactions and consider more detailed aspects of interaction modelling, eg, common vs trial-specific effects of the covariate. This leads us to propose a practical framework for IPD NMA with TCIs. RESULTS:Following our framework, we found no evidence in the cervical cancer network for a treatment-stage interaction on the basis of the within-trial interaction. The NMA provided additional power for an across-trial interaction over and above the pairwise evidence. Following our proposed framework, we found that the within- and across-trial interactions should not be combined. CONCLUSION:Across-trial interactions are susceptible to confounding and ecological bias. It is important to separate the sources of evidence to check their consistency and identify which sources of evidence are driving the conclusion. Our framework provides practical guidance for researchers, reducing the risk of unduly optimistic interpretation of TCIs.

journal_name

Res Synth Methods

authors

Freeman SC,Fisher D,Tierney JF,Carpenter JR

doi

10.1002/jrsm.1300

subject

Has Abstract

pub_date

2018-09-01 00:00:00

pages

393-407

issue

3

eissn

1759-2879

issn

1759-2887

journal_volume

9

pub_type

杂志文章
  • Bayesian meta-analysis of Cronbach's coefficient alpha to evaluate informative hypotheses.

    abstract::This paper proposes a new method to evaluate informative hypotheses for meta-analysis of Cronbach's coefficient alpha using a Bayesian approach. The coefficient alpha is one of the most widely used reliability indices. In meta-analyses of reliability, researchers typically form specific informative hypotheses beforeha...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1155

    authors: Okada K

    更新日期:2015-12-01 00:00:00

  • A historical review of publication bias.

    abstract::Publication bias is a well-known threat to the validity of meta-analyses and, more broadly, the reproducibility of scientific findings. When policies and recommendations are predicated on an incomplete evidence base, it undermines the goals of evidence-based decision-making. Great strides have been made in the last 50...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1452

    authors: Marks-Anglin A,Chen Y

    更新日期:2020-11-01 00:00:00

  • The use of meta-analytic statistical significance testing.

    abstract::Meta-analysis multiplicity, the concept of conducting multiple tests of statistical significance within one review, is an underdeveloped literature. We address this issue by considering how Type I errors can impact meta-analytic results, suggest how statistical power may be affected through the use of multiplicity cor...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审

    doi:10.1002/jrsm.1124

    authors: Polanin JR,Pigott TD

    更新日期:2015-03-01 00:00:00

  • The meta-analytic big bang.

    abstract::This article looks at the impact of meta-analysis and then explores why meta-analysis was developed at the time and by the scholars it did in the social sciences in the 1970s. For the first problem, impact, it examines the impact of meta-analysis using citation network analysis. The impact is seen in the sciences, art...

    journal_title:Research synthesis methods

    pub_type: 历史文章,杂志文章

    doi:10.1002/jrsm.1132

    authors: Shadish WR,Lecy JD

    更新日期:2015-09-01 00:00:00

  • Random-effects models for meta-analytic structural equation modeling: review, issues, and illustrations.

    abstract::Meta-analytic structural equation modeling (MASEM) combines the techniques of meta-analysis and structural equation modeling for the purpose of synthesizing correlation or covariance matrices and fitting structural equation models on the pooled correlation or covariance matrix. Both fixed-effects and random-effects mo...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审

    doi:10.1002/jrsm.1166

    authors: Cheung MW,Cheung SF

    更新日期:2016-06-01 00:00:00

  • Meta-analysis combining parallel and crossover trials using generalised estimating equation method.

    abstract::Clinical trials have different designs: In late stage drug development, the parallel trial design is the most frequent one; however, the crossover design is not rare; different techniques are used to analyse their results. Although both designs measure the same treatment effect, combining parallel and crossover trials...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1242

    authors: Curtin F

    更新日期:2017-09-01 00:00:00

  • A Bayesian nonparametric test of significance chasing biases.

    abstract::There is a growing concern that much of the published research literature is distorted by the pursuit of statistically significant results. In a seminal article, Ioannidis and Trikalinos (2007, Clinical Trials) proposed an omnibus (I&T) test for significance chasing (SC) biases. This test compares the observed number ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1269

    authors: Karabatsos G

    更新日期:2018-03-01 00:00:00

  • Can abstract screening workload be reduced using text mining? User experiences of the tool Rayyan.

    abstract:BACKGROUND:One time-consuming aspect of conducting systematic reviews is the task of sifting through abstracts to identify relevant studies. One promising approach for reducing this burden uses text mining technology to identify those abstracts that are potentially most relevant for a project, allowing those abstracts ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1237

    authors: Olofsson H,Brolund A,Hellberg C,Silverstein R,Stenström K,Österberg M,Dagerhamn J

    更新日期:2017-09-01 00:00:00

  • Identifying evidence for public health guidance: a comparison of citation searching with Web of Science and Google Scholar.

    abstract:AIM:To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence. METHOD:Forwards citation searching was performed using GS on a base set of 46 publication...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1158

    authors: Levay P,Ainsworth N,Kettle R,Morgan A

    更新日期:2016-03-01 00:00:00

  • How to critically read ecological meta-analyses.

    abstract::Meta-analysis offers ecologists a powerful tool for knowledge synthesis. Albeit a form of review, it also shares many similarities with primary empirical research. Consequently, critical reading of meta-analyses incorporates criteria from both sets of approaches particularly because ecology is a discipline that embrac...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,评审

    doi:10.1002/jrsm.1109

    authors: Lortie CJ,Stewart G,Rothstein H,Lau J

    更新日期:2015-06-01 00:00:00

  • Using systematic reviews in guideline development: the GRADE approach.

    abstract::Systematic reviews are essential to produce trustworthy guidelines. To assess the certainty of a body of evidence included in a systematic review the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group has developed an approach that is currently used by over 100 organisations, inclu...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1313

    authors: Zhang Y,Akl EA,Schünemann HJ

    更新日期:2018-07-14 00:00:00

  • Blurring the boundaries between synthesis and evaluation. A customized realist evaluative synthesis into adolescent risk behavior prevention.

    abstract::Realist methodologies have been increasingly advocated for the investigation of complex social issues. Public health programs, such as those designed to prevent adolescent risk behavior, are typically considered complex. In conducting a realist review of the empirical literature relating to such programs, we encounter...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1407

    authors: Cooper C,Lhussier M,Carr S

    更新日期:2020-05-01 00:00:00

  • Precision of healthcare systematic review searches in a cross-sectional sample.

    abstract:BACKGROUND:In systematic reviews, search precision is generally traded off against the desire to retrieve all relevant studies; however, there is no published evidence on typical precision values. The objective of this study is to establish typical values for the precision of systematic review searches in healthcare. ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.42

    authors: Sampson M,Tetzlaff J,Urquhart C

    更新日期:2011-06-01 00:00:00

  • Article alerts: Items from 2013.

    abstract::This eighth installment of 'Article Alerts' includes a print component with 200 methodological articles about research synthesis published in 2013. Since the preceding installment, more than 3400 articles, dissertations, book chapters, and other types of work in this methodological domain have been added to the archiv...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1299

    authors: Hafdahl AR

    更新日期:2018-06-01 00:00:00

  • Modelling time-course relationships with multiple treatments: Model-based network meta-analysis for continuous summary outcomes.

    abstract:BACKGROUND:Model-based meta-analysis (MBMA) is increasingly used to inform drug-development decisions by synthesising results from multiple studies to estimate treatment, dose-response, and time-course characteristics. Network meta-analysis (NMA) is used in Health Technology Appraisals for simultaneously comparing effe...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1351

    authors: Pedder H,Dias S,Bennetts M,Boucher M,Welton NJ

    更新日期:2019-06-01 00:00:00

  • Multi-context versus context-specific qualitative evidence syntheses: combining the best of both.

    abstract::There is an increasing interest in the conduct of qualitative evidence syntheses (QES), particularly in the field of health care. Approaches to QES vary in the way they conduct a search, a critical appraisal or the data-analysis. To date, the use of multi-context versus context-specific QES has not yet been fully cons...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.55

    authors: Hannes K,Harden A

    更新日期:2011-12-01 00:00:00

  • Conducting gene set tests in meta-analyses of transcriptome expression data.

    abstract::Research synthesis, eg, by meta-analysis, is more and more considered in the area of high-dimensional data from molecular research such as gene and protein expression data, especially because most studies and experiments are performed with very small sample sizes. In contrast to most clinical and epidemiological trial...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1337

    authors: Kosch R,Jung K

    更新日期:2019-03-01 00:00:00

  • Cross-hairs: a scatterplot for meta-analysis in R.

    abstract::We describe a meta-analytic scatterplot that indicates precision of points for two variables paired within studies; this is equivalent in form to a 'cross-hairs' plot used to portray specificity and sensitivity in diagnostic testing. At the user's discretion, the plot also displays boxplots for each of the X and Y var...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1220

    authors: Brannick MT,Gültaş M

    更新日期:2017-03-01 00:00:00

  • Zero-cell corrections in random-effects meta-analyses.

    abstract::The standard estimator for the log odds ratio (the unconditional maximum likelihood estimator) and the delta-method estimator for its standard error are not defined if the corresponding 2 × 2 table contains at least one "zero cell". This is also an issue when estimating the overall log odds ratio in a meta-analysis. I...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1460

    authors: Weber F,Knapp G,Ickstadt K,Kundt G,Glass Ä

    更新日期:2020-11-01 00:00:00

  • Meta-analysis combining parallel and cross-over trials with random effects.

    abstract::Meta-analysis can necessitate the combination of parallel and cross-over trial designs. Because of the differences in the trial designs and potential biases notably associated with the crossover trials, one often combines trials of the same designs only, which decreases the power of the meta-analysis. To combine resul...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1236

    authors: Curtin F

    更新日期:2017-09-01 00:00:00

  • Empirical comparison of univariate and multivariate meta-analyses in Cochrane Pregnancy and Childbirth reviews with multiple binary outcomes.

    abstract:BACKGROUND:Multivariate meta-analysis (MVMA) jointly synthesizes effects for multiple correlated outcomes. The MVMA model is potentially more difficult and time-consuming to apply than univariate models, so if its use makes little difference to parameter estimates, it could be argued that it is redundant. METHODS:We a...

    journal_title:Research synthesis methods

    pub_type: 杂志文章,meta分析

    doi:10.1002/jrsm.1353

    authors: Price MJ,Blake HA,Kenyon S,White IR,Jackson D,Kirkham JJ,Neilson JP,Deeks JJ,Riley RD

    更新日期:2019-09-01 00:00:00

  • Guidance for deriving and presenting percentage study weights in meta-analysis of test accuracy studies.

    abstract::Percentage study weights in meta-analysis reveal the contribution of each study toward the overall summary results and are especially important when some studies are considered outliers or at high risk of bias. In meta-analyses of test accuracy reviews, such as a bivariate meta-analysis of sensitivity and specificity,...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1283

    authors: Burke DL,Ensor J,Snell KIE,van der Windt D,Riley RD

    更新日期:2018-06-01 00:00:00

  • Meta-analysis of a binary outcome using individual participant data and aggregate data.

    abstract::In this paper, we develop meta-analysis models that synthesize a binary outcome from health-care studies while accounting for participant-level covariates. In particular, we show how to synthesize the observed event-risk across studies while accounting for the within-study association between participant-level covaria...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.4

    authors: Riley RD,Steyerberg EW

    更新日期:2010-01-01 00:00:00

  • Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources.

    abstract::Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, reca...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1378

    authors: Gusenbauer M,Haddaway NR

    更新日期:2020-03-01 00:00:00

  • Learning by doing-teaching systematic review methods in 8 weeks.

    abstract:OBJECTIVE:The objective of this paper is to describe the course "Systematic Reviews and Meta-analysis" at the Johns Hopkins Bloomberg School of Public Health. METHODS:A distinct feature of our course is a group project in which students, assigned to multi-disciplinary groups, conduct a systematic review. In-class sess...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1111

    authors: Li T,Saldanha IJ,Vedula SS,Yu T,Rosman L,Twose C,N Goodman S,Dickersin K

    更新日期:2014-09-01 00:00:00

  • Meta-analysis of prognostic studies for a biomarker with a study-specific cutoff value.

    abstract::In prognostic studies, a summary statistic such as a hazard ratio is often reported between low-expression and high-expression groups of a biomarker with a study-specific cutoff value. Recently, several meta-analyses of prognostic studies have been reported, but these studies simply combined hazard ratios provided by ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1201

    authors: Sadashima E,Hattori S,Takahashi K

    更新日期:2016-12-01 00:00:00

  • Combining individual participant and aggregated data in a meta-analysis with correlational studies.

    abstract::This paper presents methods for combining individual participant data (IPD) with aggregated study level data (AD) in a meta-analysis of correlational studies. Although medical researchers have employed IPD in a wide range of studies, only a single example exists in the social sciences. New policies at the National Sci...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1051

    authors: Pigott T,Williams R,Polanin J

    更新日期:2012-12-01 00:00:00

  • Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity.

    abstract::We describe how an appropriate interpretation of the Q-test depends on its power to detect a given typical amount of between-study variance (τ(2)) as well as prior beliefs on heterogeneity. We illustrate these concepts in an evaluation of 1011 meta-analyses of clinical trials with ⩾4 studies and binary outcomes. These...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.13

    authors: Pereira TV,Patsopoulos NA,Salanti G,Ioannidis JP

    更新日期:2010-04-01 00:00:00

  • Fixed effects and variance components estimation in three-level meta-analysis.

    abstract::Meta-analytic methods have been widely applied to education, medicine, and the social sciences. Much of meta-analytic data are hierarchically structured because effect size estimates are nested within studies, and in turn, studies can be nested within level-3 units such as laboratories or investigators, and so forth. ...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.35

    authors: Konstantopoulos S

    更新日期:2011-03-01 00:00:00

  • Checklists of methodological issues for review authors to consider when including non-randomized studies in systematic reviews.

    abstract:BACKGROUND:There is increasing interest from review authors about including non-randomized studies (NRS) in their systematic reviews of health care interventions. This series from the Ottawa Non-Randomized Studies Workshop consists of six papers identifying methodological issues when doing this. AIM:To format the guid...

    journal_title:Research synthesis methods

    pub_type: 杂志文章

    doi:10.1002/jrsm.1077

    authors: Wells GA,Shea B,Higgins JP,Sterne J,Tugwell P,Reeves BC

    更新日期:2013-03-01 00:00:00