A comparison of the statistical performance of different meta-analysis models for the synthesis of subgroup effects from randomized clinical trials.

Abstract:

BACKGROUND:When investigating subgroup effects in meta-analysis, it is unclear whether accounting in meta-regression for between-trial variation in treatment effects, but not between-trial variation in treatment interaction effects when such effects are present, leads to biased estimates, coverage problems, or wrong standard errors, and whether the use of aggregate data (AD) or individual-patient-data (IPD) influences this assessment. METHODS:Seven different models were compared in a simulation study. Models differed regarding the use of AD or IPD, whether they accounted for between-trial variation in interaction effects, and whether they minimized the risk of ecological fallacy. RESULTS:Models that used IPD and that allowed for between-trial variation of the interaction effect had less bias, better coverage, and more accurate standard errors than models that used AD or ignored this variation. The main factor influencing the performance of models was whether they used IPD or AD. The model that used AD had a considerably worse performance than all models that used IPD, especially when a low number of trials was included in the analysis. CONCLUSIONS:The results indicate that IPD models that allow for the between-trial variation in interaction effects should be given preference whenever investigating subgroup effects within a meta-analysis.

journal_name

BMC Med Res Methodol

authors

da Costa BR,Sutton AJ

doi

10.1186/s12874-019-0831-8

subject

Has Abstract

pub_date

2019-10-26 00:00:00

pages

198

issue

1

issn

1471-2288

pii

10.1186/s12874-019-0831-8

journal_volume

19

pub_type

杂志文章
  • Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders.

    abstract:BACKGROUND:The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0772-2

    authors: Hall CL,Brown S,James M,Martin JL,Brown N,Selby K,Clarke J,Williams L,Sayal K,Hollis C,Groom MJ

    更新日期:2019-06-18 00:00:00

  • Can electronic search engines optimize screening of search results in systematic reviews: an empirical study.

    abstract:BACKGROUND:Most electronic search efforts directed at identifying primary studies for inclusion in systematic reviews rely on the optimal Boolean search features of search interfaces such as DIALOG and Ovid. Our objective is to test the ability of an Ultraseek search engine to rank MEDLINE records of the included studi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-7

    authors: Sampson M,Barrowman NJ,Moher D,Clifford TJ,Platt RW,Morrison A,Klassen TP,Zhang L

    更新日期:2006-02-24 00:00:00

  • Pan-Canadian assessment of pandemic immunization data collection: study methodology.

    abstract:BACKGROUND:The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems us...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-51

    authors: Pereira JA,Quach S,Heidebrecht C,Foisy J,Quan S,Finkelstein M,Sikora CA,Bettinger JA,Buckeridge DL,McCarthy A,Deeks S,Kwong JC,Public Health Agency of Canada\/Canadian Institutes of Health Research Influenza Research Network Vacc

    更新日期:2010-06-08 00:00:00

  • The thresholds for statistical and clinical significance - a five-step procedure for evaluation of intervention effects in randomised clinical trials.

    abstract:BACKGROUND:Thresholds for statistical significance are insufficiently demonstrated by 95% confidence intervals or P-values when assessing results from randomised clinical trials. First, a P-value only shows the probability of getting a result assuming that the null hypothesis is true and does not reflect the probabilit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-34

    authors: Jakobsen JC,Gluud C,Winkel P,Lange T,Wetterslev J

    更新日期:2014-03-04 00:00:00

  • Parental compliance--an emerging problem in Liverpool community child health surveys 1991-2006.

    abstract:BACKGROUND:Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school childre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-53

    authors: Koshy G,Brabin BJ

    更新日期:2012-04-20 00:00:00

  • National weighting of data from the Behavioral Risk Factor Surveillance System (BRFSS).

    abstract:BACKGROUND:The Behavioral Risk Factor Surveillance System (BRFSS) is a network of health-related telephone surveys--conducted by all 50 states, the District of Columbia, and participating US territories-that receive technical assistance from CDC. Data users often aggregate BRFSS state samples for national estimates wit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0255-7

    authors: Iachan R,Pierannunzi C,Healey K,Greenlund KJ,Town M

    更新日期:2016-11-15 00:00:00

  • Overview of systematic reviews of therapeutic ranges: methodologies and recommendations for practice.

    abstract:BACKGROUND:Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as upd...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-017-0363-z

    authors: Cooney L,Loke YK,Golder S,Kirkham J,Jorgensen A,Sinha I,Hawcutt D

    更新日期:2017-06-02 00:00:00

  • High-performing physicians are more likely to participate in a research study: findings from a quality improvement study.

    abstract:BACKGROUND:Participants in voluntary research present a different demographic profile than those who choose not to participate, affecting the generalizability of many studies. Efforts to evaluate these differences have faced challenges, as little information is available from non-participants. Leveraging data from a re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0809-6

    authors: Dahrouge S,Armstrong CD,Hogg W,Singh J,Liddy C

    更新日期:2019-08-07 00:00:00

  • Incomplete evidence: the inadequacy of databases in tracing published adverse drug reactions in clinical trials.

    abstract:BACKGROUND:We would expect information on adverse drug reactions in randomised clinical trials to be easily retrievable from specific searches of electronic databases. However, complete retrieval of such information may not be straightforward, for two reasons. First, not all clinical drug trials provide data on the fre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-1-7

    authors: Derry S,Loke YK,Aronson JK

    更新日期:2001-01-01 00:00:00

  • Strengthening policy coding methodologies to improve COVID-19 disease modeling and policy responses: a proposed coding framework and recommendations.

    abstract:BACKGROUND:In recent months, multiple efforts have sought to characterize COVID-19 social distancing policy responses. These efforts have used various coding frameworks, but many have relied on coding methodologies that may not adequately describe the gradient in social distancing policies as states "re-open." METHODS...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01174-w

    authors: Lane J,Garrison MM,Kelley J,Sarma P,Katz A

    更新日期:2020-12-08 00:00:00

  • A factorial cluster-randomised controlled trial combining home-environmental and early child development interventions to improve child health and development: rationale, trial design and baseline findings.

    abstract:BACKGROUND:Exposure to unhealthy environments and inadequate child stimulation are main risk factors that affect children's health and wellbeing in low- and middle-income countries. Interventions that simultaneously address several risk factors at the household level have great potential to reduce these negative effect...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00950-y

    authors: Hartinger SM,Nuño N,Hattendorf J,Verastegui H,Karlen W,Ortiz M,Mäusezahl D

    更新日期:2020-04-02 00:00:00

  • Novel study design to assess the utility of the copd assessment test in a primary care setting.

    abstract::The quality of a consultation provided by a physician can have a profound impact on the quality of care and patient engagement in treatment decisions. When the COPD Assessment Test (CAT) was developed, one of its aims was to aid the communication between physician and patient about the impact of COPD. We developed a n...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/1471-2288-13-63

    authors: Gruffydd-Jones K,Marsden H,Holmes S,Kardos P,Escamilla R,Dal Negro R,Roberts J,Nadeau G,Leather D,Jones P

    更新日期:2013-05-10 00:00:00

  • The Platino project: methodology of a multicenter prevalence survey of chronic obstructive pulmonary disease in major Latin American cities.

    abstract:BACKGROUND:The prevalence of Chronic Obstructive Pulmonary Disease (COPD) in many developed countries appears to be increasing. There is some evidence from Latin America that COPD is a growing cause of death, but information on prevalence is scant. It is possible that, due to the high frequency of smoking in these coun...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-15

    authors: Menezes AM,Victora CG,Perez-Padilla R,PLATINO Team.

    更新日期:2004-06-17 00:00:00

  • A statistical model to assess the risk of communicable diseases associated with multiple exposures in healthcare settings.

    abstract:BACKGROUND:The occurrence of communicable diseases (CD) depends on exposure to contagious persons. The effects of exposure to CD are delayed in time and contagious persons remain contagious for several days during which their contagiousness varies. Moreover when multiple exposures occur, it is difficult to know which e...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-26

    authors: Payet C,Voirin N,Vanhems P,Ecochard R

    更新日期:2013-02-20 00:00:00

  • Power and sample size determination for the group comparison of patient-reported outcomes using the Rasch model: impact of a misspecification of the parameters.

    abstract:BACKGROUND:Patient-reported outcomes (PRO) are important as endpoints in clinical trials and epidemiological studies. Guidelines for the development of PRO instruments and analysis of PRO data have emphasized the need to report methods used for sample size planning. The Raschpower procedure has been proposed for sample...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0011-4

    authors: Blanchin M,Guilleux A,Perrot B,Bonnaud-Antignac A,Hardouin JB,Sébille V

    更新日期:2015-03-15 00:00:00

  • Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)".

    abstract:BACKGROUND:The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of t...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-145

    authors: Resnik L,Borgia M,Ni P,Pirraglia PA,Jette A

    更新日期:2012-09-17 00:00:00

  • Lost productivity due to premature mortality in developed and emerging countries: an application to smoking cessation.

    abstract:BACKGROUND:Researchers and policy makers have determined that accounting for productivity costs, or "indirect costs," may be as important as including direct medical expenditures when evaluating the societal value of health interventions. These costs are also important when estimating the global burden of disease. The ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-87

    authors: Menzin J,Marton JP,Menzin JA,Willke RJ,Woodward RM,Federico V

    更新日期:2012-06-25 00:00:00

  • A randomised controlled trial to assess the effectiveness of offering study results as an incentive to increase response rates to postal questionnaires [ISRCTN26118436].

    abstract:BACKGROUND:Postal questionnaires are widely used to collect outcome data on participants. However, a poor response to questionnaires will reduce the statistical power of the study and may introduce bias. A meta analysis of ten trials offering study results, largely in the fields of education and marketing, was shown to...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-5-34

    authors: Cockayne S,Torgerson DJ

    更新日期:2005-10-26 00:00:00

  • Suitability of measures of self-reported medication adherence for routine clinical use: a systematic review.

    abstract:BACKGROUND:There is a recognised need to build primary care medication adherence services which are tailored to patients' needs. Continuous quality improvement of such services requires a regular working method of measuring adherence in order to monitor effectiveness. Self report has been considered the method of choic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-11-149

    authors: Garfield S,Clifford S,Eliasson L,Barber N,Willson A

    更新日期:2011-11-03 00:00:00

  • A systematic survey shows that reporting and handling of missing outcome data in networks of interventions is poor.

    abstract:BACKGROUND:To provide empirical evidence about prevalence, reporting and handling of missing outcome data in systematic reviews with network meta-analysis and acknowledgement of their impact on the conclusions. METHODS:We conducted a systematic survey including all published systematic reviews of randomized controlled...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0576-9

    authors: Spineli LM,Yepes-Nuñez JJ,Schünemann HJ

    更新日期:2018-10-24 00:00:00

  • A probit- log- skew-normal mixture model for repeated measures data with excess zeros, with application to a cohort study of paediatric respiratory symptoms.

    abstract:BACKGROUND:A zero-inflated continuous outcome is characterized by occurrence of "excess" zeros that more than a single distribution can explain, with the positive observations forming a skewed distribution. Mixture models are employed for regression analysis of zero-inflated data. Moreover, for repeated measures zero-i...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-55

    authors: Mahmud S,Lou WW,Johnston NW

    更新日期:2010-06-14 00:00:00

  • Using the Bernoulli trial approaches for detecting ordered alternatives.

    abstract:BACKGROUND:Diagnostic problems in clinical trials are sometimes ordinal. For example, colon tumor staging was performed according to the TNM classification. However, clinical data are limited by markedly small sample sizes in some stage. METHODS:We propose a distribution-free test for detecting ordered alternatives in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-148

    authors: Chang CH,Chin CC,Yu WW,Huang YY

    更新日期:2013-12-05 00:00:00

  • Accounting for misclassification bias of binary outcomes due to underscreening: a sensitivity analysis.

    abstract:BACKGROUND:Diagnostic tests are performed in a subset of the population who are at higher risk, resulting in undiagnosed cases among those who do not receive the test. This poses a challenge for estimating the prevalence of the disease in the study population, and also for studying the risk factors for the disease. ME...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0447-9

    authors: Zhang N,Cheng S,Ambroggio L,Florin TA,Macaluso M

    更新日期:2017-12-12 00:00:00

  • Relative performance of different exposure modeling approaches for sulfur dioxide concentrations in the air in rural western Canada.

    abstract:BACKGROUND:The main objective of this paper is to compare different methods for predicting the levels of SO2 air pollution in oil and gas producing area of rural western Canada. Month-long average air quality measurements were collected over a two-year period (2001-2002) at multiple locations, with some side-by-side me...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-43

    authors: Burstyn I,Cherry NM,Yasui Y,Kim HM

    更新日期:2008-07-04 00:00:00

  • Linkage of the CHHiP randomised controlled trial with primary care data: a study investigating ways of supplementing cancer trials and improving evidence-based practice.

    abstract:BACKGROUND:Randomised controlled trials (RCTs) are the gold standard for evidence-based practice. However, RCTs can have limitations. For example, translation of findings into practice can be limited by design features, such as inclusion criteria, not accurately reflecting clinical populations. In addition, it is expen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01078-9

    authors: Lemanska A,Byford RC,Cruickshank C,Dearnaley DP,Ferreira F,Griffin C,Hall E,Hinton W,de Lusignan S,Sherlock J,Faithfull S

    更新日期:2020-07-25 00:00:00

  • Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis.

    abstract:BACKGROUND:Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-45

    authors: Pinto D,Robertson MC,Hansen P,Abbott JH

    更新日期:2011-04-13 00:00:00

  • Imputation by the mean score should be avoided when validating a Patient Reported Outcomes questionnaire by a Rasch model in presence of informative missing data.

    abstract:BACKGROUND:Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-105

    authors: Hardouin JB,Conroy R,Sébille V

    更新日期:2011-07-14 00:00:00

  • Error in statistical tests of error in statistical tests.

    abstract:BACKGROUND:A recent paper found that terminal digits of statistical values in Nature deviated significantly from an equiprobable distribution, indicating errors or inconsistencies in rounding. This finding, as well as the discovery that a large percentage of p values were inconsistent with reported test statistics, led...

    journal_title:BMC medical research methodology

    pub_type: 评论,杂志文章

    doi:10.1186/1471-2288-6-45

    authors: Jeng M

    更新日期:2006-09-13 00:00:00

  • Validity of the International Physical Activity Questionnaire (IPAQ) for assessing moderate-to-vigorous physical activity and sedentary behaviour of older adults in the United Kingdom.

    abstract:BACKGROUND:In order to accurately measure and monitor levels of moderate-to-vigorous physical activity (MVPA) and sedentary behaviour (SB) in older adults, cost efficient and valid instruments are required. To date, the International Physical Activity Questionnaire (IPAQ) has not been validated with older adults (aged ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/s12874-018-0642-3

    authors: Cleland C,Ferguson S,Ellis G,Hunter RF

    更新日期:2018-12-22 00:00:00

  • Sample size calculation in multi-centre clinical trials.

    abstract:BACKGROUND:Multi-centre randomized controlled clinical trials play an important role in modern evidence-based medicine. Advantages of collecting data from more than one site are numerous, including accelerated recruitment and increased generalisability of results. Mixed models can be applied to account for potential cl...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0602-y

    authors: Harden M,Friede T

    更新日期:2018-11-29 00:00:00