Abstract:
BACKGROUND:Stratified medicine seeks to identify patients most likely to respond to treatment. Individual participant data (IPD) network meta-analysis (NMA) models have greater power than individual trials to identify treatment-covariate interactions (TCIs). Treatment-covariate interactions contain "within" and "across" trial interactions, where the across-trial interaction is more susceptible to confounding and ecological bias. METHODS:We considered a network of IPD from 37 trials (5922 patients) for cervical cancer (2394 events), where previous research identified disease stage as a potential interaction covariate. We compare 2 models for NMA with TCIs: (1) 2 effects separating within- and across-trial interactions and (2) a single effect combining within- and across-trial interactions. We argue for a visual assessment of consistency of within- and across-trial interactions and consider more detailed aspects of interaction modelling, eg, common vs trial-specific effects of the covariate. This leads us to propose a practical framework for IPD NMA with TCIs. RESULTS:Following our framework, we found no evidence in the cervical cancer network for a treatment-stage interaction on the basis of the within-trial interaction. The NMA provided additional power for an across-trial interaction over and above the pairwise evidence. Following our proposed framework, we found that the within- and across-trial interactions should not be combined. CONCLUSION:Across-trial interactions are susceptible to confounding and ecological bias. It is important to separate the sources of evidence to check their consistency and identify which sources of evidence are driving the conclusion. Our framework provides practical guidance for researchers, reducing the risk of unduly optimistic interpretation of TCIs.
journal_name
Res Synth Methodsjournal_title
Research synthesis methodsauthors
Freeman SC,Fisher D,Tierney JF,Carpenter JRdoi
10.1002/jrsm.1300subject
Has Abstractpub_date
2018-09-01 00:00:00pages
393-407issue
3eissn
1759-2879issn
1759-2887journal_volume
9pub_type
杂志文章abstract::This paper proposes a new method to evaluate informative hypotheses for meta-analysis of Cronbach's coefficient alpha using a Bayesian approach. The coefficient alpha is one of the most widely used reliability indices. In meta-analyses of reliability, researchers typically form specific informative hypotheses beforeha...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1155
更新日期:2015-12-01 00:00:00
abstract::Publication bias is a well-known threat to the validity of meta-analyses and, more broadly, the reproducibility of scientific findings. When policies and recommendations are predicated on an incomplete evidence base, it undermines the goals of evidence-based decision-making. Great strides have been made in the last 50...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1452
更新日期:2020-11-01 00:00:00
abstract::Meta-analysis multiplicity, the concept of conducting multiple tests of statistical significance within one review, is an underdeveloped literature. We address this issue by considering how Type I errors can impact meta-analytic results, suggest how statistical power may be affected through the use of multiplicity cor...
journal_title:Research synthesis methods
pub_type: 杂志文章,评审
doi:10.1002/jrsm.1124
更新日期:2015-03-01 00:00:00
abstract::This article looks at the impact of meta-analysis and then explores why meta-analysis was developed at the time and by the scholars it did in the social sciences in the 1970s. For the first problem, impact, it examines the impact of meta-analysis using citation network analysis. The impact is seen in the sciences, art...
journal_title:Research synthesis methods
pub_type: 历史文章,杂志文章
doi:10.1002/jrsm.1132
更新日期:2015-09-01 00:00:00
abstract::Meta-analytic structural equation modeling (MASEM) combines the techniques of meta-analysis and structural equation modeling for the purpose of synthesizing correlation or covariance matrices and fitting structural equation models on the pooled correlation or covariance matrix. Both fixed-effects and random-effects mo...
journal_title:Research synthesis methods
pub_type: 杂志文章,评审
doi:10.1002/jrsm.1166
更新日期:2016-06-01 00:00:00
abstract::Clinical trials have different designs: In late stage drug development, the parallel trial design is the most frequent one; however, the crossover design is not rare; different techniques are used to analyse their results. Although both designs measure the same treatment effect, combining parallel and crossover trials...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1242
更新日期:2017-09-01 00:00:00
abstract::There is a growing concern that much of the published research literature is distorted by the pursuit of statistically significant results. In a seminal article, Ioannidis and Trikalinos (2007, Clinical Trials) proposed an omnibus (I&T) test for significance chasing (SC) biases. This test compares the observed number ...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1269
更新日期:2018-03-01 00:00:00
abstract:BACKGROUND:One time-consuming aspect of conducting systematic reviews is the task of sifting through abstracts to identify relevant studies. One promising approach for reducing this burden uses text mining technology to identify those abstracts that are potentially most relevant for a project, allowing those abstracts ...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1237
更新日期:2017-09-01 00:00:00
abstract:AIM:To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence. METHOD:Forwards citation searching was performed using GS on a base set of 46 publication...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1158
更新日期:2016-03-01 00:00:00
abstract::Meta-analysis offers ecologists a powerful tool for knowledge synthesis. Albeit a form of review, it also shares many similarities with primary empirical research. Consequently, critical reading of meta-analyses incorporates criteria from both sets of approaches particularly because ecology is a discipline that embrac...
journal_title:Research synthesis methods
pub_type: 杂志文章,评审
doi:10.1002/jrsm.1109
更新日期:2015-06-01 00:00:00
abstract::Systematic reviews are essential to produce trustworthy guidelines. To assess the certainty of a body of evidence included in a systematic review the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group has developed an approach that is currently used by over 100 organisations, inclu...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1313
更新日期:2018-07-14 00:00:00
abstract::Realist methodologies have been increasingly advocated for the investigation of complex social issues. Public health programs, such as those designed to prevent adolescent risk behavior, are typically considered complex. In conducting a realist review of the empirical literature relating to such programs, we encounter...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1407
更新日期:2020-05-01 00:00:00
abstract:BACKGROUND:In systematic reviews, search precision is generally traded off against the desire to retrieve all relevant studies; however, there is no published evidence on typical precision values. The objective of this study is to establish typical values for the precision of systematic review searches in healthcare. ...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.42
更新日期:2011-06-01 00:00:00
abstract::This eighth installment of 'Article Alerts' includes a print component with 200 methodological articles about research synthesis published in 2013. Since the preceding installment, more than 3400 articles, dissertations, book chapters, and other types of work in this methodological domain have been added to the archiv...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1299
更新日期:2018-06-01 00:00:00
abstract:BACKGROUND:Model-based meta-analysis (MBMA) is increasingly used to inform drug-development decisions by synthesising results from multiple studies to estimate treatment, dose-response, and time-course characteristics. Network meta-analysis (NMA) is used in Health Technology Appraisals for simultaneously comparing effe...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1351
更新日期:2019-06-01 00:00:00
abstract::There is an increasing interest in the conduct of qualitative evidence syntheses (QES), particularly in the field of health care. Approaches to QES vary in the way they conduct a search, a critical appraisal or the data-analysis. To date, the use of multi-context versus context-specific QES has not yet been fully cons...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.55
更新日期:2011-12-01 00:00:00
abstract::Research synthesis, eg, by meta-analysis, is more and more considered in the area of high-dimensional data from molecular research such as gene and protein expression data, especially because most studies and experiments are performed with very small sample sizes. In contrast to most clinical and epidemiological trial...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1337
更新日期:2019-03-01 00:00:00
abstract::We describe a meta-analytic scatterplot that indicates precision of points for two variables paired within studies; this is equivalent in form to a 'cross-hairs' plot used to portray specificity and sensitivity in diagnostic testing. At the user's discretion, the plot also displays boxplots for each of the X and Y var...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1220
更新日期:2017-03-01 00:00:00
abstract::The standard estimator for the log odds ratio (the unconditional maximum likelihood estimator) and the delta-method estimator for its standard error are not defined if the corresponding 2 × 2 table contains at least one "zero cell". This is also an issue when estimating the overall log odds ratio in a meta-analysis. I...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1460
更新日期:2020-11-01 00:00:00
abstract::Meta-analysis can necessitate the combination of parallel and cross-over trial designs. Because of the differences in the trial designs and potential biases notably associated with the crossover trials, one often combines trials of the same designs only, which decreases the power of the meta-analysis. To combine resul...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1236
更新日期:2017-09-01 00:00:00
abstract:BACKGROUND:Multivariate meta-analysis (MVMA) jointly synthesizes effects for multiple correlated outcomes. The MVMA model is potentially more difficult and time-consuming to apply than univariate models, so if its use makes little difference to parameter estimates, it could be argued that it is redundant. METHODS:We a...
journal_title:Research synthesis methods
pub_type: 杂志文章,meta分析
doi:10.1002/jrsm.1353
更新日期:2019-09-01 00:00:00
abstract::Percentage study weights in meta-analysis reveal the contribution of each study toward the overall summary results and are especially important when some studies are considered outliers or at high risk of bias. In meta-analyses of test accuracy reviews, such as a bivariate meta-analysis of sensitivity and specificity,...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1283
更新日期:2018-06-01 00:00:00
abstract::In this paper, we develop meta-analysis models that synthesize a binary outcome from health-care studies while accounting for participant-level covariates. In particular, we show how to synthesize the observed event-risk across studies while accounting for the within-study association between participant-level covaria...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.4
更新日期:2010-01-01 00:00:00
abstract::Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, reca...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1378
更新日期:2020-03-01 00:00:00
abstract:OBJECTIVE:The objective of this paper is to describe the course "Systematic Reviews and Meta-analysis" at the Johns Hopkins Bloomberg School of Public Health. METHODS:A distinct feature of our course is a group project in which students, assigned to multi-disciplinary groups, conduct a systematic review. In-class sess...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1111
更新日期:2014-09-01 00:00:00
abstract::In prognostic studies, a summary statistic such as a hazard ratio is often reported between low-expression and high-expression groups of a biomarker with a study-specific cutoff value. Recently, several meta-analyses of prognostic studies have been reported, but these studies simply combined hazard ratios provided by ...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1201
更新日期:2016-12-01 00:00:00
abstract::This paper presents methods for combining individual participant data (IPD) with aggregated study level data (AD) in a meta-analysis of correlational studies. Although medical researchers have employed IPD in a wide range of studies, only a single example exists in the social sciences. New policies at the National Sci...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1051
更新日期:2012-12-01 00:00:00
abstract::We describe how an appropriate interpretation of the Q-test depends on its power to detect a given typical amount of between-study variance (τ(2)) as well as prior beliefs on heterogeneity. We illustrate these concepts in an evaluation of 1011 meta-analyses of clinical trials with ⩾4 studies and binary outcomes. These...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.13
更新日期:2010-04-01 00:00:00
abstract::Meta-analytic methods have been widely applied to education, medicine, and the social sciences. Much of meta-analytic data are hierarchically structured because effect size estimates are nested within studies, and in turn, studies can be nested within level-3 units such as laboratories or investigators, and so forth. ...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.35
更新日期:2011-03-01 00:00:00
abstract:BACKGROUND:There is increasing interest from review authors about including non-randomized studies (NRS) in their systematic reviews of health care interventions. This series from the Ottawa Non-Randomized Studies Workshop consists of six papers identifying methodological issues when doing this. AIM:To format the guid...
journal_title:Research synthesis methods
pub_type: 杂志文章
doi:10.1002/jrsm.1077
更新日期:2013-03-01 00:00:00