Statistical power of clinical trials increased while effect size remained stable: an empirical analysis of 136,212 clinical trials between 1975 and 2014.

Abstract:

OBJECTIVES:To study the statistical power of randomized clinical trials and examine developments over time. STUDY DESIGN AND SETTING:We analyzed the statistical power in 136,212 clinical trials between 1975 and 2014 extracted from meta-analyses from the Cochrane database of systematic reviews. We determined study power to detect standardized effect sizes, where power was based on the meta-analyzed effect size. Average power, effect size, and temporal patterns were examined for all meta-analyses and a subset of significant meta-analyses. RESULTS:The number of trials with power ≥80% was low (7%) but increased over time: from 5% in 1975-1979 to 9% in 2010-2014. In significant meta-analyses, the proportion of trials with sufficient power increased from 9% to 15% in these years (median power increased from 16% to 23%). This increase was mainly due to increasing sample sizes, while effect sizes remained stable with a median Cohen's h of 0.09 (interquartile range 0.04-0.22) and a median Cohen's d of 0.20 (0.11-0.40). CONCLUSION:This study demonstrates that sufficient power in clinical trials is still problematic, although the situation is slowly improving. Our data encourage further efforts to increase statistical power in clinical trials to guarantee rigorous and reproducible evidence-based medicine.

journal_name

J Clin Epidemiol

authors

Lamberink HJ,Otte WM,Sinke MRT,Lakens D,Glasziou PP,Tijdink JK,Vinkers CH

doi

10.1016/j.jclinepi.2018.06.014

subject

Has Abstract

pub_date

2018-10-01 00:00:00

pages

123-128

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(18)30140-9

journal_volume

102

pub_type

杂志文章
  • The Kaiser Permanente inpatient risk adjustment methodology was valid in an external patient population.

    abstract:OBJECTIVES:Accurately predicting hospital mortality is necessary to measure and compare patient care. External validation of predictive models is required to truly prove their utility. This study assessed the Kaiser Permanente inpatient risk adjustment methodology for hospital mortality in a patient population distinct...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2009.08.020

    authors: van Walraven C,Escobar GJ,Greene JD,Forster AJ

    更新日期:2010-07-01 00:00:00

  • Single pivotal trials with few corroborating characteristics were used for FDA approval of cancer therapies.

    abstract:BACKGROUND AND OBJECTIVE:Novel cancer therapies are often approved with evidence from a single pivotal trial alone. There are concerns about the credibility of this evidence. Higher validity may be indicated by five methodological and statistical characteristics of pivotal trial evidence that were described by the U.S....

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.05.033

    authors: Ladanie A,Speich B,Briel M,Sclafani F,Bucher HC,Agarwal A,Ioannidis JPA,Pereira TV,Kasenda B,Hemkens LG

    更新日期:2019-10-01 00:00:00

  • Including papers in languages other than English in systematic reviews: important, feasible, yet often omitted.

    abstract::A truly international and systematic review (SR) identifies and synthesizes relevant evidence regardless of the geographical provenance or language of publication. Despite recommendations, international SRs continue to exclude papers in languages other than English (LOE) at searching, screening, and analysis phases ei...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.03.004

    authors: Walpole SC

    更新日期:2019-07-01 00:00:00

  • Handling the reflective-formative measurement conundrum: a practical illustration based on sustainable employability.

    abstract:OBJECTIVES:Constructs capturing health or functioning can have reflective and/or formative measurement models. Although a construct's measurement model has extensive implications on the construction, validation, and use of a measurement instrument, measurement models are frequently wrongly or not explicitly specified. ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.07.007

    authors: Fleuren BPI,van Amelsvoort LGPM,Zijlstra FRH,de Grip A,Kant I

    更新日期:2018-11-01 00:00:00

  • Autoperception and satisfaction with health: two medical care markers in elderly hospitalized patients. Quality of life as an outcome estimate of clinical practice.

    abstract::This paper reports a prospective study, carried out in elderly patients hospitalized for acute illness, designed to evaluate the effectiveness of medical treatment from the point of view of quality of life (QoL). Patient's autoperception and satisfaction with health, the most relevant subjective estimates of QoL, were...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00237-k

    authors: Pérez Corral F,Abraira V

    更新日期:1995-08-01 00:00:00

  • Referral bias among health workers in studies using hospitalization as a proxy measure of the underlying incidence rate.

    abstract::Contacts with health services like hospitals or general practitioners are usually the only available proxy measure of incidence of disease in studies based on secondary data and differential referrals or care-seeking behavior often bias such proxy measures. In former analyses based on the Occupational Hospitalization ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(95)00554-4

    authors: Tüchsen F,Andersen O,Olsen J

    更新日期:1996-07-01 00:00:00

  • Different methods to assess quality of life from multiple follow-ups in a longitudinal asthma study.

    abstract:BACKGROUND AND OBJECTIVE:Serial measurements obtained during observational longitudinal studies offer the opportunity to describe the effects of chronic diseases on patient-centered outcomes such as quality of life. The purpose of this study was to assess serial Asthma Quality of Life Questionnaire (AQLQ) and SF-36 sco...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/S0895-4356(03)00248-8

    authors: Mancuso CA,Peterson MG

    更新日期:2004-01-01 00:00:00

  • Potentially unnecessary and wasteful clinical trial research detected in cumulative meta-epidemiological and trial sequential analysis.

    abstract:OBJECTIVE:The objective was to estimate the presence and extent to which potentially unnecessary and therefore maybe wasteful clinical trials regarding relevant interventions and outcomes in major clinical areas had been conducted. STUDY DESIGN AND SETTING:From current Cochrane collaboration systematic reviews in majo...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.11.003

    authors: Storz-Pfennig P

    更新日期:2017-02-01 00:00:00

  • Uncontrolled pearls, controlled evidence, meta-analysis and the individual patient.

    abstract::Medicine has been dominated by uncontrolled data, often of unproven validity and insufficient to answer clinically important questions pertaining to individual patients. Controlled clinical trials, when designed and conducted rigorously, offer advantages over uncontrolled data, but they cannot be done for everything a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00042-0

    authors: Ioannidis JP,Lau J

    更新日期:1998-08-01 00:00:00

  • Relationships of site of infarction and history of previous infarction with short- and long-term prognosis after acute myocardial infarction in Japan.

    abstract::We studied the outcome in 308 patients with acute myocardial infarction (MI) admitted to the coronary care unit of Kobe General Hospital. Short-term outcome (within 28 days after MI) and long-term outcome (more than 28 days) were examined with survival curves to find any relationship with a history of previous MI and ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90186-q

    authors: Nishi N,Nakanishi N,Kuroda K,Koizumi K,Yoshikawa J,Tatara K

    更新日期:1992-01-01 00:00:00

  • Incremental cost-effectiveness analysis: the optimal strategy depends on the strategy set.

    abstract::Evaluating the incremental cost-effectiveness of a technology is critical to understanding the impact of its adoption. The purpose of this study was to evaluate, using a particular example, how the specific alternatives selected for a cost-effectiveness analysis may influence the results of the analysis. In this examp...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00021-9

    authors: Cantor SB,Ganiats TG

    更新日期:1999-06-01 00:00:00

  • Relationships between change in aerobic fitness and changes in blood pressure and plasma lipids in men and women: the "Adelaide 1000" 4-year follow up.

    abstract::The aim was to assess relationships between increased aerobic fitness sustained over 4 years, and changes in blood pressure (SBP and DBP) and lipids. Measurements were made of BP, lipids, weight, and fitness in 1000 middle-aged men and women entering a fitness programme, and were repeated 2 and 4 years later. The 342 ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90052-3

    authors: Sedgwick AW,Thomas DW,Davies M

    更新日期:1993-02-01 00:00:00

  • Decline in mortality from heart disease in Denmark: some methodological problems.

    abstract::Mortality rates in Denmark from ischemic heart diseases (IHD), other heart diseases and unknown causes are presented for the period 1968-92. In all age groups, mortality from IHD is higher at the beginning of the period than at the end. For other heart disease, the plot of the mortality rate is U-shaped for the age gr...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00158-m

    authors: Juel K,Sjøl A

    更新日期:1995-04-01 00:00:00

  • Medical record validation of maternally reported history of preeclampsia.

    abstract:OBJECTIVE:In this study, we assessed the validity of maternally self-reported history of preeclampsia. STUDY DESIGN AND SETTING:This study was embedded in the Generation R Study, a population-based prospective cohort study. Data were obtained from prenatal questionnaires and one questionnaire obtained 2 months postpar...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.10.010

    authors: Coolman M,de Groot CJ,Jaddoe VW,Hofman A,Raat H,Steegers EA

    更新日期:2010-08-01 00:00:00

  • Clinical replicability of rehabilitation interventions in randomized controlled trials reported in main journals is inadequate.

    abstract:OBJECTIVE:The objective of this study was to study if randomized controlled trials (RCTs) in rehabilitation (a field where complex interventions prevail) published in main journals include all the details needed to replicate the intervention in clinical practice (clinical replicability). STUDY DESIGN AND SETTING:Forty...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.008

    authors: Negrini S,Arienti C,Pollet J,Engkasan JP,Francisco GE,Frontera WR,Galeri S,Gworys K,Kujawa J,Mazlan M,Rathore FA,Schillebeeckx F,Kiekens C,REREP study participants.

    更新日期:2019-10-01 00:00:00

  • The number needed to treat (NNT) can be adjusted for bias when the outcome is measured with error.

    abstract:BACKGROUND AND OBJECTIVE:We consider the number needed to treat (NNT) when the event of interest is defined by dichotomizing a continuous response at a threshold level. If the response is measured with error, the resulting NNT is biased. We consider methods to reduce this bias. METHODS:Bias adjustment was studied usin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.01.021

    authors: Marschner IC,Emberson J,Irwig L,Walter SD

    更新日期:2004-12-01 00:00:00

  • A study of the noninstrumented physical examination of the knee found high observer variability.

    abstract:OBJECTIVE:This study estimated the inter- and intraobserver reliability of a set of noninstrumented physical examination measures for knee pain in older adults. STUDY DESIGN AND SETTING:Forty-five patients from primary care, and 13 patients from secondary care, were each examined by two out of a team of three physical...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.11.004

    authors: Wood L,Peat G,Wilkie R,Hay E,Thomas E,Sim J

    更新日期:2006-05-01 00:00:00

  • Application of generalizability theory confirmed lower reliability of the standard gamble than the feeling thermometer.

    abstract:OBJECTIVES:Recent studies suggest that rating clinical marker states (CMS) does not improve the measurement properties of the standard gamble (SG) and only slightly improves those of the feeling thermometer (FT). The poor intrarater (test-retest) reliability of CMS may explain their meager performance. Further, lack of...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2007.03.010

    authors: Schünemann HJ,Norman G,Puhan MA,Ståhl E,Griffith L,Heels-Ansdell D,Montori VM,Wiklund I,Goldstein R,Mador MJ,Guyatt GH

    更新日期:2007-12-01 00:00:00

  • Comorbidity was associated with neurologic and psychiatric diseases: a general practice-based controlled study.

    abstract:BACKGROUND AND OBJECTIVE:To comprehensively examine comorbidity in unselected cohorts of patients with depression, stroke, multiple sclerosis (MS), Parkinson's disease/parkinsonism (PD/PKM), dementia, migraine, and epilepsy. METHODS:This cross-sectional study used morbidity data recorded by Dutch general practitioners...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.01.005

    authors: Nuyen J,Schellevis FG,Satariano WA,Spreeuwenberg PM,Birkner MD,van den Bos GA,Groenewegen PP

    更新日期:2006-12-01 00:00:00

  • Use of psychotropic drugs and pregnancy outcome.

    abstract::This study reports the use of psychotropic drugs and pregnancy outcome in a prospective survey carried out in northern Finland in 1985-1986, consisting of 7933 pregnant women and their 8030 births. Of the mothers, 120 (1.5%) used psychotropic drugs during pregnancy and of them 26 (0.3% of the total) used these drugs b...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00203-x

    authors: Larivaara P,Hartikainen AL,Rantakallio P

    更新日期:1996-11-01 00:00:00

  • GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence.

    abstract:OBJECTIVES:In this article, we describe how to include considerations about resource utilization when making recommendations according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. STUDY DESIGN AND SETTINGS:We focus on challenges with rating the confidence in effect estima...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.04.012

    authors: Brunetti M,Shemilt I,Pregno S,Vale L,Oxman AD,Lord J,Sisk J,Ruiz F,Hill S,Guyatt GH,Jaeschke R,Helfand M,Harbour R,Davoli M,Amato L,Liberati A,Schünemann HJ

    更新日期:2013-02-01 00:00:00

  • Reducing population stratification bias: stratum matching is better than exposure.

    abstract:OBJECTIVE:Genetic studies of complex human diseases rely heavily on the epidemiologic association paradigm, particularly the population-based case-control designs. This study aims to compare the matching effectiveness in terms of bias reduction between exposure matching and stratum matching. STUDY DESIGN AND SETTING:F...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.02.016

    authors: Lee WC,Wang LY

    更新日期:2009-01-01 00:00:00

  • The Chinese version of the Tampa Scale for Kinesiophobia was cross-culturally adapted and validated in patients with low back pain.

    abstract:OBJECTIVES:The aim of the present study was to obtain a cross-cultural adaptation and evaluation of a Simplified Chinese (SC) version of the Tampa Scale for Kinesiophobia (TSK) for use in patients with low back pain (LBP). STUDY DESIGN AND SETTING:The TSK was translated and adapted cross-culturally following internati...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.07.003

    authors: Wei X,Xu X,Zhao Y,Hu W,Bai Y,Li M

    更新日期:2015-10-01 00:00:00

  • Geriatrics index of comorbidity was the most accurate predictor of death in geriatric hospital among six comorbidity scores.

    abstract:OBJECTIVES:To compare the abilities of six validated comorbidity indices (Charlson index, cumulative illness rating scale [CIRS], index of coexistent diseases, Kaplan scale, geriatrics index of comorbidity [GIC], and chronic disease score) to predict adverse hospitalization outcomes (death during hospitalization, lengt...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.11.013

    authors: Zekry D,Loures Valle BH,Lardi C,Graf C,Michel JP,Gold G,Krause KH,Herrmann FR

    更新日期:2010-09-01 00:00:00

  • Insufficient cross-cultural adaptations and psychometric properties for many translated health assessment scales: a systematic review.

    abstract:OBJECTIVES:If researchers want to assess reliably different aspects of general health in the migrant populations, they need translations of internationally used health assessment scales with appropriate cross-cultural adaptations and satisfactory psychometric properties. A systematic review was performed to assess the ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.12.004

    authors: Uysal-Bozkir Ö,Parlevliet JL,de Rooij SE

    更新日期:2013-06-01 00:00:00

  • An observational study showed that explaining randomization using gambling-related metaphors and computer-agency descriptions impeded randomized clinical trial recruitment.

    abstract:OBJECTIVES:To explore how the concept of randomization is described by clinicians and understood by patients in randomized controlled trials (RCTs) and how it contributes to patient understanding and recruitment. STUDY DESIGN AND SETTING:Qualitative analysis of 73 audio recordings of recruitment consultations from fiv...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2018.02.018

    authors: Jepson M,Elliott D,Conefrey C,Wade J,Rooshenas L,Wilson C,Beard D,Blazeby JM,Birtle A,Halliday A,Stein R,Donovan JL,CSAW study group.,Chemorad study group.,POUT study group.,ACST-2 study group.,OPTIMA prelim study group.

    更新日期:2018-07-01 00:00:00

  • Quantifying the potential benefit of CA 125 screening for ovarian cancer.

    abstract::We develop a stochastic model of screening for ovarian cancer with serum levels of the CA 125 radioimmunoassay, a tumor-specific marker. The natural history of the disease is constructed using a four stage model characterized by a multivariate distribution for duration in each stage. Preserving its important features,...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90075-k

    authors: Skates SJ,Singer DE

    更新日期:1991-01-01 00:00:00

  • The utility of the international child and adolescent overweight guidelines for predicting coronary heart disease risk factors.

    abstract::The purpose of this study was to assess the association between the international overweight cutoffs for children and youth and coronary heart disease risk factors. The sample included 410 boys and 337 girls 9-18 years of age from the Québec Family Study. Participants were classified as normal weight or overweight usi...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00595-4

    authors: Katzmarzyk PT,Tremblay A,Pérusse L,Després JP,Bouchard C

    更新日期:2003-05-01 00:00:00

  • International classification of diseases and current procedural terminology codes underestimated thrombolytic use for ischemic stroke.

    abstract:BACKGROUND AND OBJECTIVE:To determine the accuracy of recently introduced International Classification of Diseases Ninth Revision (ICD-9) procedure and Current Procedural Terminology (CPT) codes designed for injection or infusion of thrombolytic agents. MATERIALS AND METHODS:We determined the accuracy of ICD-9 procedu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.01.004

    authors: Qureshi AI,Harris-Lane P,Siddiqi F,Kirmani JF

    更新日期:2006-08-01 00:00:00

  • The qualification period.

    abstract::For randomized trials that do not require prompt onset of therapy, a pre-admission preparation, called the qualification period, can deal with certain customary difficulties in design, analysis, and ethics. For the patients' baseline state, the qualification period can be used to "wash out" effects of previous treatme...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90208-q

    authors: Knipschild P,Leffers P,Feinstein AR

    更新日期:1991-01-01 00:00:00