Abstract:
BACKGROUND:Standard random-effects meta-analysis methods perform poorly when applied to few studies only. Such settings however are commonly encountered in practice. It is unclear, whether or to what extent small-sample-size behaviour can be improved by more sophisticated modeling. METHODS:We consider likelihood-based methods, the DerSimonian-Laird approach, Empirical Bayes, several adjustment methods and a fully Bayesian approach. Confidence intervals are based on a normal approximation, or on adjustments based on the Student-t-distribution. In addition, a linear mixed model and two generalized linear mixed models (GLMMs) assuming binomial or Poisson distributed numbers of events per study arm are considered for pairwise binary meta-analyses. We extract an empirical data set of 40 meta-analyses from recent reviews published by the German Institute for Quality and Efficiency in Health Care (IQWiG). Methods are then compared empirically as well as in a simulation study, based on few studies, imbalanced study sizes, and considering odds-ratio (OR) and risk ratio (RR) effect sizes. Coverage probabilities and interval widths for the combined effect estimate are evaluated to compare the different approaches. RESULTS:Empirically, a majority of the identified meta-analyses include only 2 studies. Variation of methods or effect measures affects the estimation results. In the simulation study, coverage probability is, in the presence of heterogeneity and few studies, mostly below the nominal level for all frequentist methods based on normal approximation, in particular when sizes in meta-analyses are not balanced, but improve when confidence intervals are adjusted. Bayesian methods result in better coverage than the frequentist methods with normal approximation in all scenarios, except for some cases of very large heterogeneity where the coverage is slightly lower. Credible intervals are empirically and in the simulation study wider than unadjusted confidence intervals, but considerably narrower than adjusted ones, with some exceptions when considering RRs and small numbers of patients per trial-arm. Confidence intervals based on the GLMMs are, in general, slightly narrower than those from other frequentist methods. Some methods turned out impractical due to frequent numerical problems. CONCLUSIONS:In the presence of between-study heterogeneity, especially with unbalanced study sizes, caution is needed in applying meta-analytical methods to few studies, as either coverage probabilities might be compromised, or intervals are inconclusively wide. Bayesian estimation with a sensibly chosen prior for between-trial heterogeneity may offer a promising compromise.
journal_name
BMC Med Res Methodoljournal_title
BMC medical research methodologyauthors
Seide SE,Röver C,Friede Tdoi
10.1186/s12874-018-0618-3subject
Has Abstractpub_date
2019-01-11 00:00:00pages
16issue
1issn
1471-2288pii
10.1186/s12874-018-0618-3journal_volume
19pub_type
杂志文章abstract:BACKGROUND:Measuring body mass index (BMI) has been proposed as a method of screening for preventive primary care and population surveillance of childhood obesity. However, the accuracy of routinely collected measurements has been questioned. The purpose of this study was to assess the reliability of height, length and...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0726-8
更新日期:2019-04-24 00:00:00
abstract:BACKGROUND:The aim was to describe a strategy for recruitment of healthy volunteers (HV) to a randomized trial that assessed the efficacy of different telephone techniques to assist HV in performing cardiac massage for vital emergency. Participation in the randomized trial was not financially compensated, however HV we...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-15-2
更新日期:2015-01-05 00:00:00
abstract:BACKGROUND:The likelihood ratio function (LR), the ratio of conditional probabilities of obtaining a specific marker value among those with the event of interest over those without, provides an easily interpretable way to quantify the update of the risk prediction due to the knowledge of the marker value. The LR has be...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0721-0
更新日期:2019-05-22 00:00:00
abstract::The quality of a consultation provided by a physician can have a profound impact on the quality of care and patient engagement in treatment decisions. When the COPD Assessment Test (CAT) was developed, one of its aims was to aid the communication between physician and patient about the impact of COPD. We developed a n...
journal_title:BMC medical research methodology
pub_type: 信件
doi:10.1186/1471-2288-13-63
更新日期:2013-05-10 00:00:00
abstract:BACKGROUND:E1684 was the pivotal adjuvant melanoma trial for establishment of high-dose interferon (IFN) as effective therapy of high-risk melanoma patients. E1690 was an intriguing effort to corroborate E1684, and the differences between the outcomes of these trials have embroiled the field in controversy over the pas...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-183
更新日期:2012-11-29 00:00:00
abstract:BACKGROUND:In Routine Outcome Monitoring (ROM) there is a high demand for short assessments. Computerized Adaptive Testing (CAT) is a promising method for efficient assessment. In this article, the efficiency of a CAT version of the Mood and Anxiety Symptom Questionnaire, - Anhedonic Depression scale (MASQ-AD) for use ...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-4
更新日期:2012-01-10 00:00:00
abstract:BACKGROUND:We developed and validated an automated database case definition for diabetes in children and youth to facilitate pharmacoepidemiologic investigations of medications and the risk of diabetes. METHODS:The present study was part of an in-progress retrospective cohort study of antipsychotics and diabetes in Te...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-128
更新日期:2012-08-24 00:00:00
abstract:BACKGROUND:Studies examining incident heart failure (HF) have been limited to select populations. To examine incident HF with broader generalizability, there is need to assemble a HF-free cohort using a geographically-diverse sample. We aimed to develop and validate a simple medication-based strategy for assembling a H...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0890-x
更新日期:2020-03-04 00:00:00
abstract:BACKGROUND:The Patient Reported Outcomes Measurement Information System 43-item short form (PROMIS-43) and the five-level EQ-5D (EQ-5D-5L) are recently developed measures of health-related quality of life (HRQL) that have potentially broad application in evaluating treatments and capturing burden of respiratory-related...
journal_title:BMC medical research methodology
pub_type: 杂志文章,多中心研究
doi:10.1186/1471-2288-14-78
更新日期:2014-06-16 00:00:00
abstract:BACKGROUND:Predicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01153-1
更新日期:2020-11-16 00:00:00
abstract:BACKGROUND:Available methods for the joint modelling of longitudinal and time-to-event outcomes have typically only allowed for a single longitudinal outcome and a solitary event time. In practice, clinical studies are likely to record multiple longitudinal outcomes. Incorporating all sources of data will improve the p...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-016-0212-5
更新日期:2016-09-07 00:00:00
abstract:BACKGROUND:Multilevel models for non-normal outcomes are widely used in medical and health sciences research. While methods for interpreting fixed effects are well-developed, methods to quantify and interpret random cluster variation and compare it with other sources of variation are less established. Random cluster va...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-018-0517-7
更新日期:2018-07-06 00:00:00
abstract:BACKGROUND:Claims databases are generally considered inadequate for obesity research due to suboptimal capture of body mass index (BMI) measurements. This might not be true for bariatric surgery because of reimbursement requirements and changes in coding systems. We assessed the availability and validity of claims-base...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01106-8
更新日期:2020-09-07 00:00:00
abstract:BACKGROUND:Discrete Choice Experiments (DCEs) are increasingly used in studies in healthcare research but there is still little empirical evidence for the predictive value of these hypothetical situations in similar real life circumstances. The aim of this paper is to compare the stated preferences in a DCE and the acc...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-015-0010-5
更新日期:2015-03-12 00:00:00
abstract:BACKGROUND:Recruitment to health research remains a major challenge. Innovation is required to meet policy commitments to help patients take part in health research. One innovation that may help meet those policy goals is the development of 'consent to contact' systems, where people give generic consent to be contacted...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0843-4
更新日期:2019-10-22 00:00:00
abstract:BACKGROUND:The reporting of randomised controlled trial (RCT) abstracts is of vital importance. The primary objective of this study was to investigate the association between structure format and RCT abstracts' quality of methodology reporting, informed by the current requirement and usage of structure formats by leadi...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-017-0469-3
更新日期:2018-01-10 00:00:00
abstract:BACKGROUND:When discussing results medical research articles often tear substantive and statistical (methodical) contributions apart, just as if both were independent. Consequently, reasoning on bias tends to be vague, unclear and superficial. This can lead to over-generalized, too narrow and misleading conclusions, es...
journal_title:BMC medical research methodology
pub_type: 杂志文章,评审
doi:10.1186/s12874-018-0490-1
更新日期:2018-04-17 00:00:00
abstract:BACKGROUND:A key component of the implementation process is identifying potential barriers and facilitators that need to be addressed. The Theoretical Domains Framework (TDF) is one of the most commonly used frameworks for this purpose. When applying the TDF, it is critical to understand the context in which behaviours...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01056-1
更新日期:2020-06-26 00:00:00
abstract:BACKGROUND:Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as upd...
journal_title:BMC medical research methodology
pub_type: 杂志文章,评审
doi:10.1186/s12874-017-0363-z
更新日期:2017-06-02 00:00:00
abstract:BACKGROUND:Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-11-105
更新日期:2011-07-14 00:00:00
abstract:BACKGROUND:Primary-care based randomized controlled trials (RCTs) build an important evidence base for general practice but little evidence exists about barriers to recruitment which often hamper such trials. We investigated the issues that impeded and facilitated recruitment to a clinical trial in general practice. M...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-015-0012-3
更新日期:2015-03-12 00:00:00
abstract:BACKGROUND:The primary aim of this study was to provide an estimate of effect size for the functional outcome of operative versus non-operative treatment for patients with an acute rupture of the Achilles tendon using accelerated rehabilitation for both groups of patients. The secondary aim was to assess the use of a c...
journal_title:BMC medical research methodology
pub_type: 杂志文章,随机对照试验
doi:10.1186/1471-2288-11-39
更新日期:2011-04-05 00:00:00
abstract:BACKGROUND:This paper discusses whether baseline demographic, socio-economic, health variables, length of follow-up and method of contacting the participants predict non-response to the invitation for a second assessment of lifestyle factors and body weight in the European multi-center EPIC-PANACEA study. METHODS:Over...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-148
更新日期:2012-09-24 00:00:00
abstract:BACKGROUND:Sero- prevalence studies often have a problem of missing data. Few studies report the proportion of missing data and even fewer describe the methods used to adjust the results for missing data. The objective of this review was to determine the analytical methods used for analysis in HIV surveys with missing ...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-00944-w
更新日期:2020-03-14 00:00:00
abstract:BACKGROUND:Multiple Imputation as usually implemented assumes that data are Missing At Random (MAR), meaning that the underlying missing data mechanism, given the observed data, is independent of the unobserved data. To explore the sensitivity of the inferences to departures from the MAR assumption, we applied the meth...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-73
更新日期:2012-06-08 00:00:00
abstract:BACKGROUND:Identifying and assessing degree and type of frailty among older persons is a major challenge when targeting high risk populations to identify preventive interventions. The Vulnerable Elders Survey-(VES-13) is a simple instrument to identify frailty defined as risk for death, functional decline or institutio...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-0910-x
更新日期:2020-02-05 00:00:00
abstract:BACKGROUND:Chronic Obstructive Pulmonary Disease (COPD) is currently the fifth leading cause of death in Australia, and there are marked differences in mortality trends between men and women. In this study, we have sought to model and forecast age related changes in COPD mortality over time for men and women separately...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-17
更新日期:2012-02-21 00:00:00
abstract:BACKGROUND:Small number of clusters and large variation of cluster sizes commonly exist in cluster-randomized trials (CRTs) and are often the critical factors affecting the validity and efficiency of statistical analyses. F tests are commonly used in the generalized linear mixed model (GLMM) to test intervention effect...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-015-0026-x
更新日期:2015-04-23 00:00:00
abstract:BACKGROUND:Epidemiologic studies often struggle to adequately represent populations and outcomes of interest. Differences in methodology, data analysis and research questions often mean that reviews and synthesis of the existing literature have significant limitations. The current paper details our experiences in combi...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-13-122
更新日期:2013-10-05 00:00:00
abstract:BACKGROUND:Although in health services survey research we strive for a high response rate, this must be balanced against the need to recruit participants ethically and considerately, particularly in surveys with a sensitive nature. In survey research there are no established recommendations to guide recruitment approac...
journal_title:BMC medical research methodology
pub_type: 临床试验,杂志文章
doi:10.1186/1471-2288-13-3
更新日期:2013-01-11 00:00:00