A mixed methods case study investigating how randomised controlled trials (RCTs) are reported, understood and interpreted in practice.

Abstract:

BACKGROUND:While randomised controlled trials (RCTs) provide high-quality evidence to guide practice, much routine care is not based upon available RCTs. This disconnect between evidence and practice is not sufficiently well understood. This case study explores this relationship using a novel approach. Better understanding may improve trial design, conduct, reporting and implementation, helping patients benefit from the best available evidence. METHODS:We employed a case-study approach, comprising mixed methods to examine the case of interest: the primary outcome paper of a surgical RCT (the TIME trial). Letters and editorials citing the TIME trial's primary report underwent qualitative thematic analysis, and the RCT was critically appraised using validated tools. These analyses were compared to provide insight into how the TIME trial findings were interpreted and appraised by the clinical community. RESULTS:23 letters and editorials were studied. Most authorship included at least one academic (20/23) and one surgeon (21/23). Authors identified wide-ranging issues including confounding variables or outcome selection. Clear descriptions of bias or generalisability were lacking. Structured appraisal identified risks of bias. Non-RCT evidence was less critically appraised. Authors reached varying conclusions about the trial without consistent justification. Authors discussed aspects of internal and external validity covered by appraisal tools but did not use these methodological terms in their articles. CONCLUSIONS:This novel method for examining interpretation of an RCT in the clinical community showed that published responses identified limited issues with trial design. Responses did not provide coherent rationales for accepting (or not) trial results. Findings may suggest that authors lacked skills in appraisal of RCT design and conduct. Multiple case studies with cross-case analysis of other trials are needed.

journal_name

BMC Med Res Methodol

authors

Byrne BE,Rooshenas L,Lambert HS,Blazeby JM

doi

10.1186/s12874-020-01009-8

subject

Has Abstract

pub_date

2020-05-12 00:00:00

pages

112

issue

1

issn

1471-2288

pii

10.1186/s12874-020-01009-8

journal_volume

20

pub_type

杂志文章
  • The search for stable prognostic models in multiple imputed data sets.

    abstract:BACKGROUND:In prognostic studies model instability and missing data can be troubling factors. Proposed methods for handling these situations are bootstrapping (B) and Multiple imputation (MI). The authors examined the influence of these methods on model composition. METHODS:Models were constructed using a cohort of 58...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-81

    authors: Vergouw D,Heymans MW,Peat GM,Kuijpers T,Croft PR,de Vet HC,van der Horst HE,van der Windt DA

    更新日期:2010-09-17 00:00:00

  • Factors associated with reporting multiple causes of death.

    abstract:BACKGROUND:There is analytical potential for multiple cause of death data collected from death certificates. This study examines relationships of multiple causes of death as a function of factors available on the death certificate (demographics of decedent, place of death, type of certifier, disposal method, whether an...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-5-4

    authors: Wall MM,Huang J,Oswald J,McCullen D

    更新日期:2005-01-17 00:00:00

  • Recruitment strategies and yields for the Pathobiology of Prediabetes in a Biracial Cohort: a prospective natural history study of incident dysglycemia.

    abstract:BACKGROUND:The Pathobiology of Prediabetes in A Biracial Cohort study is a prospective evaluation of the transition from normal to impaired glucose regulation among African American and Caucasian adults with parental type 2 diabetes. This report describes recruitment strategies and relative yields for the 376 enrolled ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-64

    authors: Ebenibo S,Edeoga C,Ammons A,Egbuonu N,Dagogo-Jack S,Pathobiology of Prediabetes in a Biracial Cohort (POP-ABC) Research Group.

    更新日期:2013-05-10 00:00:00

  • Predictor characteristics necessary for building a clinically useful risk prediction model: a simulation study.

    abstract:BACKGROUND:Compelled by the intuitive appeal of predicting each individual patient's risk of an outcome, there is a growing interest in risk prediction models. While the statistical methods used to build prediction models are increasingly well understood, the literature offers little insight to researchers seeking to g...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0223-2

    authors: Schummers L,Himes KP,Bodnar LM,Hutcheon JA

    更新日期:2016-09-21 00:00:00

  • Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study.

    abstract:BACKGROUND:The choice between paper data collection methods and electronic data collection (EDC) methods has become a key question for clinical researchers. There remains a need to examine potential benefits, efficiencies, and innovations associated with an EDC system in a multi-center medical record review study. MET...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-7-23

    authors: Thwin SS,Clough-Gorr KM,McCarty MC,Lash TL,Alford SH,Buist DS,Enger SM,Field TS,Frost F,Wei F,Silliman RA

    更新日期:2007-06-18 00:00:00

  • Applying an intersectionality lens to the theoretical domains framework: a tool for thinking about how intersecting social identities and structures of power influence behaviour.

    abstract:BACKGROUND:A key component of the implementation process is identifying potential barriers and facilitators that need to be addressed. The Theoretical Domains Framework (TDF) is one of the most commonly used frameworks for this purpose. When applying the TDF, it is critical to understand the context in which behaviours...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01056-1

    authors: Etherington N,Rodrigues IB,Giangregorio L,Graham ID,Hoens AM,Kasperavicius D,Kelly C,Moore JE,Ponzano M,Presseau J,Sibley KM,Straus S

    更新日期:2020-06-26 00:00:00

  • Self-reported measures in health research for people with intellectual disabilities: an inclusive pilot study on suitability and reliability.

    abstract:BACKGROUND:The lack of suitable and reliable scales to measure self-reported health and health behaviour among people with intellectual disabilities (ID) is an important methodological challenge in health research. This study, which was undertaken together with co-researchers with ID, explores possibilities for self-re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0539-1

    authors: Vlot-van Anrooij K,Tobi H,Hilgenkamp TIM,Leusink GL,Naaldenberg J

    更新日期:2018-07-16 00:00:00

  • Pan-Canadian assessment of pandemic immunization data collection: study methodology.

    abstract:BACKGROUND:The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems us...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-51

    authors: Pereira JA,Quach S,Heidebrecht C,Foisy J,Quan S,Finkelstein M,Sikora CA,Bettinger JA,Buckeridge DL,McCarthy A,Deeks S,Kwong JC,Public Health Agency of Canada\/Canadian Institutes of Health Research Influenza Research Network Vacc

    更新日期:2010-06-08 00:00:00

  • Dynamic risk prediction for diabetes using biomarker change measurements.

    abstract:BACKGROUND:Dynamic risk models, which incorporate disease-free survival and repeated measurements over time, might yield more accurate predictions of future health status compared to static models. The objective of this study was to develop and apply a dynamic prediction model to estimate the risk of developing type 2 ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0812-y

    authors: Parast L,Mathews M,Friedberg MW

    更新日期:2019-08-14 00:00:00

  • Can a 'consent to contact' community help research teams overcome barriers to recruitment? The development and impact of the 'Research for the Future' community.

    abstract:BACKGROUND:Recruitment to health research remains a major challenge. Innovation is required to meet policy commitments to help patients take part in health research. One innovation that may help meet those policy goals is the development of 'consent to contact' systems, where people give generic consent to be contacted...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0843-4

    authors: Grady K,Gibson M,Bower P

    更新日期:2019-10-22 00:00:00

  • Using the Bernoulli trial approaches for detecting ordered alternatives.

    abstract:BACKGROUND:Diagnostic problems in clinical trials are sometimes ordinal. For example, colon tumor staging was performed according to the TNM classification. However, clinical data are limited by markedly small sample sizes in some stage. METHODS:We propose a distribution-free test for detecting ordered alternatives in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-148

    authors: Chang CH,Chin CC,Yu WW,Huang YY

    更新日期:2013-12-05 00:00:00

  • An exploration of how developers use qualitative evidence: content analysis and critical appraisal of guidelines.

    abstract:BACKGROUND:Clinical practice guidelines have become increasingly widely used to guide quality improvement of clinical practice. Qualitative research may be a useful way to improve the quality and implementation of guidelines. The methodology for qualitative evidence used in guidelines development is worthy of further r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01041-8

    authors: Wang YY,Liang DD,Lu C,Shi YX,Zhang J,Cao Y,Fang C,Huang D,Jin YH

    更新日期:2020-06-17 00:00:00

  • Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders.

    abstract:BACKGROUND:The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0772-2

    authors: Hall CL,Brown S,James M,Martin JL,Brown N,Selby K,Clarke J,Williams L,Sayal K,Hollis C,Groom MJ

    更新日期:2019-06-18 00:00:00

  • Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis.

    abstract:BACKGROUND:Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-45

    authors: Pinto D,Robertson MC,Hansen P,Abbott JH

    更新日期:2011-04-13 00:00:00

  • Power and sample size determination for the group comparison of patient-reported outcomes using the Rasch model: impact of a misspecification of the parameters.

    abstract:BACKGROUND:Patient-reported outcomes (PRO) are important as endpoints in clinical trials and epidemiological studies. Guidelines for the development of PRO instruments and analysis of PRO data have emphasized the need to report methods used for sample size planning. The Raschpower procedure has been proposed for sample...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0011-4

    authors: Blanchin M,Guilleux A,Perrot B,Bonnaud-Antignac A,Hardouin JB,Sébille V

    更新日期:2015-03-15 00:00:00

  • The methods and baseline characteristics of a VA randomized controlled study evaluating supported employment provided in primary care patient aligned care teams.

    abstract:BACKGROUND:This article describes the design and baseline sample of a single-site trial comparing Individual Placement and Support (IPS) supported employment delivered within a Veterans Health Administration (VHA) primary care Patient Aligned Care Team (PACT) to treatment-as-usual vocational rehabilitation (TAU-VR) tha...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-020-0919-1

    authors: Davis LL,Blansett CM,Mumba MN,MacVicar D,Toscano R,Pilkinton P,Gay W,Bartolucci A

    更新日期:2020-02-17 00:00:00

  • An accurate test for homogeneity of odds ratios based on Cochran's Q-statistic.

    abstract:BACKGROUND:A frequently used statistic for testing homogeneity in a meta-analysis of K independent studies is Cochran's Q. For a standard test of homogeneity the Q statistic is referred to a chi-square distribution with K-1 degrees of freedom. For the situation in which the effects of the studies are logarithms of odds...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0034-x

    authors: Kulinskaya E,Dollinger MB

    更新日期:2015-06-10 00:00:00

  • Development of an integrative coding framework for evaluating context within implementation science.

    abstract:BACKGROUND:This research aims to explore an identified gap in implementation science methodology, that is, how to assess context in implementation research. Context is among the strongest influences on implementation success but is a construct that is poorly understood and reported within the literature. Consequently, ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01044-5

    authors: Rogers L,De Brún A,McAuliffe E

    更新日期:2020-06-15 00:00:00

  • Bivariate random-effects meta-analysis and the estimation of between-study correlation.

    abstract:BACKGROUND:When multiple endpoints are of interest in evidence synthesis, a multivariate meta-analysis can jointly synthesise those endpoints and utilise their correlation. A multivariate random-effects meta-analysis must incorporate and estimate the between-study correlation (rhoB). METHODS:In this paper we assess ma...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-7-3

    authors: Riley RD,Abrams KR,Sutton AJ,Lambert PC,Thompson JR

    更新日期:2007-01-12 00:00:00

  • Prediction intervals for future BMI values of individual children: a non-parametric approach by quantile boosting.

    abstract:BACKGROUND:The construction of prediction intervals (PIs) for future body mass index (BMI) values of individual children based on a recent German birth cohort study with n = 2007 children is problematic for standard parametric approaches, as the BMI distribution in childhood is typically skewed depending on age. METHO...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-6

    authors: Mayr A,Hothorn T,Fenske N

    更新日期:2012-01-25 00:00:00

  • Clustering of continuous and binary outcomes at the general practice level in individually randomised studies in primary care - a review of 10 years of primary care trials.

    abstract:BACKGROUND:In randomised controlled trials, the assumption of independence of individual observations is fundamental to the design, analysis and interpretation of studies. However, in individually randomised trials in primary care, this assumption may be violated because patients are naturally clustered within primary ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00971-7

    authors: Stuart B,Becque T,Moore M,Little P

    更新日期:2020-04-15 00:00:00

  • Academic pediatric clinical research: factors associated with study implementation duration.

    abstract:BACKGROUND:The ethical, methodological, and technical aspects of pediatric research, often results in complications and delays in implementation. Our objective was to identify factors associated with the implementation duration of hospital-based pediatric studies. METHODS:All hospital-based pediatric studies sponsored...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0138-y

    authors: Meier-Girard D,Tibi A,Abdoul H,Prot-Labarthe S,Brion F,Bourdon O,Alberti C

    更新日期:2016-03-29 00:00:00

  • Resuming the discussion of AMSTAR: What can (should) be made better?

    abstract:BACKGROUND:Evidence syntheses, and in particular systematic reviews (SRs), have become one of the cornerstones of evidence-based health care. The Assessment of Multiple Systematic Reviews (AMSTAR) tool has become the most widely used tool for investigating the methodological quality of SRs and is currently undergoing r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0183-6

    authors: Wegewitz U,Weikert B,Fishta A,Jacobs A,Pieper D

    更新日期:2016-08-26 00:00:00

  • Lost productivity due to premature mortality in developed and emerging countries: an application to smoking cessation.

    abstract:BACKGROUND:Researchers and policy makers have determined that accounting for productivity costs, or "indirect costs," may be as important as including direct medical expenditures when evaluating the societal value of health interventions. These costs are also important when estimating the global burden of disease. The ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-87

    authors: Menzin J,Marton JP,Menzin JA,Willke RJ,Woodward RM,Federico V

    更新日期:2012-06-25 00:00:00

  • A comparison of the statistical performance of different meta-analysis models for the synthesis of subgroup effects from randomized clinical trials.

    abstract:BACKGROUND:When investigating subgroup effects in meta-analysis, it is unclear whether accounting in meta-regression for between-trial variation in treatment effects, but not between-trial variation in treatment interaction effects when such effects are present, leads to biased estimates, coverage problems, or wrong st...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0831-8

    authors: da Costa BR,Sutton AJ

    更新日期:2019-10-26 00:00:00

  • New journal selection for quantitative survey of infectious disease research: application for Asian trend analysis.

    abstract:BACKGROUND:Quantitative survey of research articles, as an application of bibliometrics, is an effective tool for grasping overall trends in various medical research fields. This type of survey has been also applied to infectious disease research; however, previous studies were insufficient as they underestimated artic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-67

    authors: Takahashi-Omoe H,Omoe K,Okabe N

    更新日期:2009-10-06 00:00:00

  • A systematic review to investigate the measurement properties of goal attainment scaling, towards use in drug trials.

    abstract:BACKGROUND:One of the main challenges for drug evaluation in rare diseases is the often heterogeneous course of these diseases. Traditional outcome measures may not be applicable for all patients, when they are in different stages of their disease. For instance, in Duchenne Muscular Dystrophy, the Six Minute Walk Test ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-016-0205-4

    authors: Gaasterland CM,Jansen-van der Weide MC,Weinreich SS,van der Lee JH

    更新日期:2016-08-17 00:00:00

  • Joint modelling of time-to-event and multivariate longitudinal outcomes: recent developments and issues.

    abstract:BACKGROUND:Available methods for the joint modelling of longitudinal and time-to-event outcomes have typically only allowed for a single longitudinal outcome and a solitary event time. In practice, clinical studies are likely to record multiple longitudinal outcomes. Incorporating all sources of data will improve the p...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0212-5

    authors: Hickey GL,Philipson P,Jorgensen A,Kolamunnage-Dona R

    更新日期:2016-09-07 00:00:00

  • Measurement properties of the Danish version of the Awareness and Beliefs about Cancer (ABC) measure.

    abstract:BACKGROUND:The International Cancer Benchmarking Partnership aims to study international differences in cancer survival and the possible causes. Participating countries are Australia, Canada, Norway, Sweden, Denmark and the UK and a particular focus area is differences in awareness and beliefs about cancer. In this con...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0352-2

    authors: Hvidberg L,Pedersen AF,Wulff CN,Carlsen AH,Vedsted P

    更新日期:2017-04-26 00:00:00

  • An evaluation of DistillerSR's machine learning-based prioritization tool for title/abstract screening - impact on reviewer-relevant outcomes.

    abstract:BACKGROUND:Systematic reviews often require substantial resources, partially due to the large number of records identified during searching. Although artificial intelligence may not be ready to fully replace human reviewers, it may accelerate and reduce the screening burden. Using DistillerSR (May 2020 release), we eva...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01129-1

    authors: Hamel C,Kelly SE,Thavorn K,Rice DB,Wells GA,Hutton B

    更新日期:2020-10-15 00:00:00