Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials.

Abstract:

BACKGROUND:Small number of clusters and large variation of cluster sizes commonly exist in cluster-randomized trials (CRTs) and are often the critical factors affecting the validity and efficiency of statistical analyses. F tests are commonly used in the generalized linear mixed model (GLMM) to test intervention effects in CRTs. The most challenging issue for the approximate Wald F test is the estimation of the denominator degrees of freedom (DDF). Some DDF approximation methods have been proposed, but their small sample performances in analysing binary outcomes in CRTs with few heterogeneous clusters are not well studied. METHODS:The small sample performances of five DDF approximations for the F test are compared and contrasted under CRT frameworks with simulations. Specifically, we illustrate how the intraclass correlation (ICC), sample size, and the variation of cluster sizes affect the type I error and statistical power when different DDF approximation methods in GLMM are used to test intervention effect in CRTs with binary outcomes. The results are also illustrated using a real CRT dataset. RESULTS:Our simulation results suggest that the Between-Within method maintains the nominal type I error rates even when the total number of clusters is as low as 10 and is robust to the variation of the cluster sizes. The Residual and Containment methods have inflated type I error rates when the cluster number is small (<30) and the inflation becomes more severe with increased variation in cluster sizes. In contrast, the Satterthwaite and Kenward-Roger methods can provide tests with very conservative type I error rates when the total cluster number is small (<30) and the conservativeness becomes more severe as variation in cluster sizes increases. Our simulations also suggest that the Between-Within method is statistically more powerful than the Satterthwaite or Kenward-Roger method in analysing CRTs with heterogeneous cluster sizes, especially when the cluster number is small. CONCLUSION:We conclude that the Between-Within denominator degrees of freedom approximation method for F tests should be recommended when the GLMM is used in analysing CRTs with binary outcomes and few heterogeneous clusters, due to its type I error properties and relatively higher power.

journal_name

BMC Med Res Methodol

authors

Li P,Redden DT

doi

10.1186/s12874-015-0026-x

subject

Has Abstract

pub_date

2015-04-23 00:00:00

pages

38

issn

1471-2288

pii

10.1186/s12874-015-0026-x

journal_volume

15

pub_type

杂志文章
  • Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies.

    abstract:BACKGROUND:Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0702-3

    authors: Harrison S,Henderson J,Alderdice F,Quigley MA

    更新日期:2019-03-20 00:00:00

  • Feasibility and validity of a statistical adjustment to reduce self-report bias of height and weight in wave 1 of the Add Health study.

    abstract:BACKGROUND:Bias in adolescent self-reported height and weight is well documented. Given the importance and widespread use of the National Longitudinal Study of Adolescent to Adult Health (Add Health) data for obesity research, we developed and tested the feasibility and validity of an empirically derived statistical co...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0227-y

    authors: Liechty JM,Bi X,Qu A

    更新日期:2016-09-22 00:00:00

  • Recruiting and motivating black subjects to complete a lengthy survey in a large cohort study: an exploration of different strategies.

    abstract:BACKGROUND:The effectiveness of multiple innovative recruitment strategies for enrolling Black/African American participants to the Adventist Health Study-2 (AHS-2) is described. The study's focus is diet and breast, prostate and colon cancer. METHODS:Promotions centered on trust, relationship building and incentives ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-46

    authors: Herring P,Butler T,Hall S,Bennett H,Montgomery SB,Fraser G

    更新日期:2014-04-03 00:00:00

  • Psychometric properties of the Chinese version of the spiritual care-giving scale (C-SCGS) in nursing practice.

    abstract:BACKGROUND:Spiritual care is defined as recognizing and responding to the needs of the human spirit when the individual is facing trauma, illness, or sadness. Providing spiritual care is one of the core aspects of holistic care, as it is significantly associated with patients' quality of life. The provision of optimal ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0662-7

    authors: Hu Y,Tiew LH,Li F

    更新日期:2019-01-23 00:00:00

  • Measuring health-related quality of life in chronic obstructive pulmonary disease: properties of the EQ-5D-5L and PROMIS-43 short form.

    abstract:BACKGROUND:The Patient Reported Outcomes Measurement Information System 43-item short form (PROMIS-43) and the five-level EQ-5D (EQ-5D-5L) are recently developed measures of health-related quality of life (HRQL) that have potentially broad application in evaluating treatments and capturing burden of respiratory-related...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-14-78

    authors: Lin FJ,Pickard AS,Krishnan JA,Joo MJ,Au DH,Carson SS,Gillespie S,Henderson AG,Lindenauer PK,McBurnie MA,Mularski RA,Naureckas ET,Vollmer WM,Lee TA,CONCERT Consortium.

    更新日期:2014-06-16 00:00:00

  • Evaluation of survival extrapolation in immuno-oncology using multiple pre-planned data cuts: learnings to aid in model selection.

    abstract:BACKGROUND:Due to limited duration of follow up in clinical trials of cancer treatments, estimates of lifetime survival benefits are typically derived using statistical extrapolation methods. To justify the method used, a range of approaches have been proposed including statistical goodness-of-fit tests and comparing e...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00997-x

    authors: Bullement A,Willis A,Amin A,Schlichting M,Hatswell AJ,Bharmal M

    更新日期:2020-05-06 00:00:00

  • Recruitment of adolescents with suicidal ideation in the emergency department: lessons from a randomized controlled pilot trial of a youth suicide prevention intervention.

    abstract:BACKGROUND:Emergency Departments (EDs) are a first point-of-contact for many youth with mental health and suicidality concerns and can serve as an effective recruitment source for randomized controlled trials (RCTs) of mental health interventions. However, recruitment in acute care settings is impeded by several challe...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01117-5

    authors: Tracey M,Finkelstein Y,Schachter R,Cleverley K,Monga S,Barwick M,Szatmari P,Moretti ME,Willan A,Henderson J,Korczak DJ

    更新日期:2020-09-14 00:00:00

  • Using the Bernoulli trial approaches for detecting ordered alternatives.

    abstract:BACKGROUND:Diagnostic problems in clinical trials are sometimes ordinal. For example, colon tumor staging was performed according to the TNM classification. However, clinical data are limited by markedly small sample sizes in some stage. METHODS:We propose a distribution-free test for detecting ordered alternatives in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-148

    authors: Chang CH,Chin CC,Yu WW,Huang YY

    更新日期:2013-12-05 00:00:00

  • Incomplete evidence: the inadequacy of databases in tracing published adverse drug reactions in clinical trials.

    abstract:BACKGROUND:We would expect information on adverse drug reactions in randomised clinical trials to be easily retrievable from specific searches of electronic databases. However, complete retrieval of such information may not be straightforward, for two reasons. First, not all clinical drug trials provide data on the fre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-1-7

    authors: Derry S,Loke YK,Aronson JK

    更新日期:2001-01-01 00:00:00

  • Attempting rigour and replicability in thematic analysis of qualitative research data; a case study of codebook development.

    abstract:BACKGROUND:Navigating the world of qualitative thematic analysis can be challenging. This is compounded by the fact that detailed descriptions of methods are often omitted from qualitative discussions. While qualitative research methodologies are now mature, there often remains a lack of fine detail in their descriptio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0707-y

    authors: Roberts K,Dowell A,Nie JB

    更新日期:2019-03-28 00:00:00

  • The Platino project: methodology of a multicenter prevalence survey of chronic obstructive pulmonary disease in major Latin American cities.

    abstract:BACKGROUND:The prevalence of Chronic Obstructive Pulmonary Disease (COPD) in many developed countries appears to be increasing. There is some evidence from Latin America that COPD is a growing cause of death, but information on prevalence is scant. It is possible that, due to the high frequency of smoking in these coun...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-15

    authors: Menezes AM,Victora CG,Perez-Padilla R,PLATINO Team.

    更新日期:2004-06-17 00:00:00

  • Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis.

    abstract:BACKGROUND:Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-45

    authors: Pinto D,Robertson MC,Hansen P,Abbott JH

    更新日期:2011-04-13 00:00:00

  • Bayesian methods in clinical trials: a Bayesian analysis of ECOG trials E1684 and E1690.

    abstract:BACKGROUND:E1684 was the pivotal adjuvant melanoma trial for establishment of high-dose interferon (IFN) as effective therapy of high-risk melanoma patients. E1690 was an intriguing effort to corroborate E1684, and the differences between the outcomes of these trials have embroiled the field in controversy over the pas...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-183

    authors: Ibrahim JG,Chen MH,Chu H

    更新日期:2012-11-29 00:00:00

  • Interpreter proxy versus healthcare interpreter for administration of patient surveys following arthroplasty: a pilot study.

    abstract:BACKGROUND:Clinical quality registries and other systems that conduct routine post-discharge surveillance of patient outcomes following surgery may have difficulty surveying patients who have limited proficiency in the language of the healthcare provider. Interpreter proxies (family and carers) are often used due to li...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0854-1

    authors: Xue D,Churches T,Armstrong E,Mittal R,Naylor JM,Harris IA

    更新日期:2019-11-14 00:00:00

  • Maximising response from GPs to questionnaire surveys: do length or incentives make a difference?

    abstract:BACKGROUND:General Practitioners (GPs) respond poorly to postal surveys. Consequently there is potential for reduced data quality and bias in the findings. In general population surveys, response to postal questionnaires may be improved by reducing their length and offering incentives. The aim of this study was to inve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-15-3

    authors: Cottrell E,Roddy E,Rathod T,Thomas E,Porcheret M,Foster NE

    更新日期:2015-01-06 00:00:00

  • Reliability of routinely collected anthropometric measurements in primary care.

    abstract:BACKGROUND:Measuring body mass index (BMI) has been proposed as a method of screening for preventive primary care and population surveillance of childhood obesity. However, the accuracy of routinely collected measurements has been questioned. The purpose of this study was to assess the reliability of height, length and...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0726-8

    authors: Carsley S,Parkin PC,Tu K,Pullenayegum E,Persaud N,Maguire JL,Birken CS,TARGet Kids! Collaboration.

    更新日期:2019-04-24 00:00:00

  • Using a social marketing framework to evaluate recruitment of a prospective study of genetic counseling and testing for the deaf community.

    abstract:BACKGROUND:Recruiting deaf and hard-of-hearing participants, particularly sign language-users, for genetics health service research is challenging due to communication barriers, mistrust toward genetics, and researchers' unfamiliarity with deaf people. Feelings of social exclusion and lack of social cohesion between re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-145

    authors: Kobayashi Y,Boudreault P,Hill K,Sinsheimer JS,Palmer CG

    更新日期:2013-11-25 00:00:00

  • A random effects variance shift model for detecting and accommodating outliers in meta-analysis.

    abstract:BACKGROUND:Meta-analysis typically involves combining the estimates from independent studies in order to estimate a parameter of interest across a population of studies. However, outliers often occur even under the random effects model. The presence of such outliers could substantially alter the conclusions in a meta-a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-19

    authors: Gumedze FN,Jackson D

    更新日期:2011-02-16 00:00:00

  • Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study.

    abstract:BACKGROUND:Growth Mixture Modeling (GMM) is commonly used to group individuals on their development over time, but convergence issues and impossible values are common. This can result in unreliable model estimates. Constraining variance parameters across classes or over time can solve these issues, but can also serious...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01154-0

    authors: Sijbrandij JJ,Hoekstra T,Almansa J,Peeters M,Bültmann U,Reijneveld SA

    更新日期:2020-11-12 00:00:00

  • Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

    abstract:BACKGROUND:Predicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01153-1

    authors: Kantidakis G,Putter H,Lancia C,Boer J,Braat AE,Fiocco M

    更新日期:2020-11-16 00:00:00

  • A proof of principle for using adaptive testing in Routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT.

    abstract:BACKGROUND:In Routine Outcome Monitoring (ROM) there is a high demand for short assessments. Computerized Adaptive Testing (CAT) is a promising method for efficient assessment. In this article, the efficiency of a CAT version of the Mood and Anxiety Symptom Questionnaire, - Anhedonic Depression scale (MASQ-AD) for use ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-4

    authors: Smits N,Zitman FG,Cuijpers P,den Hollander-Gijsman ME,Carlier IV

    更新日期:2012-01-10 00:00:00

  • Estimating cardiovascular disease incidence from prevalence: a spreadsheet based model.

    abstract:BACKGROUND:Disease incidence and prevalence are both core indicators of population health. Incidence is generally not as readily accessible as prevalence. Cohort studies and electronic health record systems are two major way to estimate disease incidence. The former is time-consuming and expensive; the latter is not av...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0288-y

    authors: Hu XF,Young K,Chan HM

    更新日期:2017-01-23 00:00:00

  • New journal selection for quantitative survey of infectious disease research: application for Asian trend analysis.

    abstract:BACKGROUND:Quantitative survey of research articles, as an application of bibliometrics, is an effective tool for grasping overall trends in various medical research fields. This type of survey has been also applied to infectious disease research; however, previous studies were insufficient as they underestimated artic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-67

    authors: Takahashi-Omoe H,Omoe K,Okabe N

    更新日期:2009-10-06 00:00:00

  • Estimating the loss of lifetime function using flexible parametric relative survival models.

    abstract:BACKGROUND:Within cancer care, dynamic evaluations of the loss in expectation of life provides useful information to patients as well as physicians. The loss of lifetime function yields the conditional loss in expectation of life given survival up to a specific time point. Due to the inevitable censoring in time-to-eve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0661-8

    authors: Jakobsen LH,Andersson TM,Biccler JL,El-Galaly TC,Bøgsted M

    更新日期:2019-01-28 00:00:00

  • Outcome-sensitive multiple imputation: a simulation study.

    abstract:BACKGROUND:Multiple imputation is frequently used to deal with missing data in healthcare research. Although it is known that the outcome should be included in the imputation model when imputing missing covariate values, it is not known whether it should be imputed. Similarly no clear recommendations exist on: the util...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0281-5

    authors: Kontopantelis E,White IR,Sperrin M,Buchan I

    更新日期:2017-01-09 00:00:00

  • Participant recruitment in sensitive surveys: a comparative trial of 'opt in' versus 'opt out' approaches.

    abstract:BACKGROUND:Although in health services survey research we strive for a high response rate, this must be balanced against the need to recruit participants ethically and considerately, particularly in surveys with a sensitive nature. In survey research there are no established recommendations to guide recruitment approac...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章

    doi:10.1186/1471-2288-13-3

    authors: Hunt KJ,Shlomo N,Addington-Hall J

    更新日期:2013-01-11 00:00:00

  • Heckman-type selection models to obtain unbiased estimates with missing measures outcome: theoretical considerations and an application to missing birth weight data.

    abstract:BACKGROUND:In low-income settings, key outcomes such as biomarkers or clinical assessments are often missing for a substantial proportion of the study population. The aim of this study was to assess the extent to which Heckman-type selection models can create unbiased estimates in such settings. METHODS:We introduce t...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0840-7

    authors: Koné S,Bonfoh B,Dao D,Koné I,Fink G

    更新日期:2019-12-09 00:00:00

  • Reported frequency of physical activity in a large epidemiological study: relationship to specific activities and repeatability over time.

    abstract:BACKGROUND:How overall physical activity relates to specific activities and how reported activity changes over time may influence interpretation of observed associations between physical activity and health. We examine the relationships between various physical activities self-reported at different times in a large coh...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-97

    authors: Armstrong ME,Cairns BJ,Green J,Reeves GK,Beral V,Million Women Study Collaborators.

    更新日期:2011-06-22 00:00:00

  • A methodological systematic review of what's wrong with meta-ethnography reporting.

    abstract:BACKGROUND:Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-119

    authors: France EF,Ring N,Thomas R,Noyes J,Maxwell M,Jepson R

    更新日期:2014-11-19 00:00:00

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-28

    authors: Godwin M,Ruhland L,Casson I,MacDonald S,Delva D,Birtwhistle R,Lam M,Seguin R

    更新日期:2003-12-22 00:00:00