Optimism bias leads to inconclusive results-an empirical study.

Abstract:

OBJECTIVE:Optimism bias refers to unwarranted belief in the efficacy of new therapies. We assessed the impact of optimism bias on a proportion of trials that did not answer their research question successfully and explored whether poor accrual or optimism bias is responsible for inconclusive results. STUDY DESIGN:Systematic review. SETTING:Retrospective analysis of a consecutive-series phase III randomized controlled trials (RCTs) performed under the aegis of National Cancer Institute Cooperative groups. RESULTS:Three hundred fifty-nine trials (374 comparisons) enrolling 150,232 patients were analyzed. Seventy percent (262 of 374) of the trials generated conclusive results according to the statistical criteria. Investigators made definitive statements related to the treatment preference in 73% (273 of 374) of studies. Investigators' judgments and statistical inferences were concordant in 75% (279 of 374) of trials. Investigators consistently overestimated their expected treatment effects but to a significantly larger extent for inconclusive trials. The median ratio of expected and observed hazard ratio or odds ratio was 1.34 (range: 0.19-15.40) in conclusive trials compared with 1.86 (range: 1.09-12.00) in inconclusive studies (P<0.0001). Only 17% of the trials had treatment effects that matched original researchers' expectations. CONCLUSION:Formal statistical inference is sufficient to answer the research question in 75% of RCTs. The answers to the other 25% depend mostly on subjective judgments, which at times are in conflict with statistical inference. Optimism bias significantly contributes to inconclusive results.

journal_name

J Clin Epidemiol

authors

Djulbegovic B,Kumar A,Magazin A,Schroen AT,Soares H,Hozo I,Clarke M,Sargent D,Schell MJ

doi

10.1016/j.jclinepi.2010.09.007

subject

Has Abstract

pub_date

2011-06-01 00:00:00

pages

583-93

issue

6

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(10)00317-3

journal_volume

64

pub_type

杂志文章,评审
  • Test-retest of self-reported exposure to artificial tanning devices, self-tanning creams, and sun sensitivity showed consistency.

    abstract:OBJECTIVE:Exposure to ultraviolet radiation has consistently been linked to an increased risk of melanoma. Epidemiologic studies are susceptible to measurement error, which can distort the magnitude of observed effects. Although the reliability of self-report of many sun exposure factors has been previously described i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.09.004

    authors: Beane Freeman LE,Dennis LK,Lynch CF,Lowe JB,Clarke WR

    更新日期:2005-04-01 00:00:00

  • Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects.

    abstract:OBJECTIVE:To assess whether nominally statistically significant effects in meta-analyses of clinical trials are true and whether their magnitude is inflated. STUDY DESIGN AND SETTING:Data from the Cochrane Database of Systematic Reviews 2005 (issue 4) and 2010 (issue 1) were used. We considered meta-analyses with bina...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.12.012

    authors: Pereira TV,Ioannidis JP

    更新日期:2011-10-01 00:00:00

  • Calculating additive treatment effects from multiple randomized trials provides useful estimates of combination therapies.

    abstract:OBJECTIVE:Many clinicians and decision makers want to know the combined effects of treatments that have not been evaluated in combination. It is possible to determine such treatment effects by making assumptions about the additive effects. We discuss here the prerequisites and methods of applying additivity assumptions...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2012.07.012

    authors: Mills EJ,Thorlund K,Ioannidis JP

    更新日期:2012-12-01 00:00:00

  • Estimating the prevalence of hypertension corrected for the effect of within-person variability in blood pressure.

    abstract::The objective of our study was to assess the applicability of using estimates of within-person variance (WPV) from reproducibility studies for a correction of blood pressure values in another study to improve the accuracy of the prevalence estimation of hypertension. Data were collected from two cross-sectional popula...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00228-6

    authors: Klungel OH,de Boer A,Paes AH,Nagelkerke NJ,Seidell JC,Bakker A

    更新日期:2000-11-01 00:00:00

  • Relationship of domain-specific measures of health to perceived overall health among older subjects.

    abstract::The associations between nine domain-specific measures of health (e.g., depressive symptoms, psychological distress, mental health, physical functioning, role functioning, social functioning, bodily pain, somatic symptoms, and chronic medical morbidity) and a single-item measure for perceived overall health were studi...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00234-5

    authors: Kempen GI,Miedema I,van den Bos GA,Ormel J

    更新日期:1998-01-01 00:00:00

  • Clinimetric and psychometric strategies for development of a health measurement scale.

    abstract::Clinimetrics and psychometrics, two accepted methods for developing multiitem health measurement scales, have fundamentally different aims and methods that have seldom been compared and never prospectively. The purpose of this study was to determine whether these two methodologies provided comparable scales in the dev...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/s0895-4356(98)00148-6

    authors: Marx RG,Bombardier C,Hogg-Johnson S,Wright JG

    更新日期:1999-02-01 00:00:00

  • Influence of gender in acute and long-term cardiac mortality after a first myocardial infarction. REGICOR Investigators.

    abstract::The effect of gender and other clinical variables on short-term and long-term cardiac mortality after a first transmural myocardial infarction (MI) was assessed in a population-based hospital register. A cohort of 1216 consecutive patients (1023 men and 193 women), 25-74 years old admitted to the only reference hospit...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)90016-7

    authors: Marrugat J,Antó JM,Sala J,Masiá R

    更新日期:1994-02-01 00:00:00

  • Weight and mortality in Finnish women.

    abstract::Mortality in relation to body mass index (BMI) was studied in 17,159 healthy Finnish women aged 25-79 followed up for a median of 12 years. Mortality from all cases was related to BMI only in non-smokers aged 25-64, among whom the mortality pattern was "U"-shaped, with a minimum in the second quintile of BMI (the refe...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90131-r

    authors: Rissanen A,Knekt P,Heliövaara M,Aromaa A,Reunanen A,Maatela J

    更新日期:1991-01-01 00:00:00

  • Statistical analysis of failure times in total joint replacement.

    abstract::Time to revision is an important criterion describing the quality of implants in total joint surgery. Estimates of failure probabilities are required to inform a patient about the risk of suffering a reoperation. Also, regression models are used for comparing different prosthesis designs. Typically, patients dying bef...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00371-7

    authors: Schwarzer G,Schumacher M,Maurer TB,Ochsner PE

    更新日期:2001-10-01 00:00:00

  • A prospective study of factors affecting age at menopause.

    abstract::This paper describes a multivariate analysis of a 3-year prospective study of the covariates of age at menopause among women who were randomly sampled from a general population. This approach avoids three problems that may account for the inconsistent results of prior studies: recall bias in retrospectively collected ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90044-9

    authors: Brambilla DJ,McKinlay SM

    更新日期:1989-01-01 00:00:00

  • Methodology for measuring health-state preferences--IV: Progress and a research agenda.

    abstract::Remaining questions relative to the measurement of health-state preferences are outlined and applications discussed. We recommend more widespread use of functional measurement to better understand preference structures. Further research should be conducted on the reliability and validity of preference values produced ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/0895-4356(89)90011-5

    authors: Froberg DG,Kane RL

    更新日期:1989-01-01 00:00:00

  • The validity of single-item, self-assessment questions as measures of adult physical activity.

    abstract::Individual energy expenditure (kcal/kg/day) was calculated from a detailed set of questions from the Health Promotion and Disease Prevention Supplement of the 1985 National Health Interview Survey. Responses to three single-item, self-assessment questions were compared to the energy expenditure variable to test criter...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90013-f

    authors: Weiss TW,Slater CH,Green LW,Kennedy VC,Albright DL,Wun CC

    更新日期:1990-01-01 00:00:00

  • US Food and Drug Administration documents can provide unpublished evidence relevant to systematic reviews.

    abstract:OBJECTIVES:A key systematic review (SR) methodology is comprehensive searching. The Drug Effectiveness Review Project (DERP) SRs search US Food and Drug Administration (FDA) documents to identify unpublished evidence. This study evaluates the success of those efforts. STUDY DESIGN AND SETTING:We examined DERP reports ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2013.05.006

    authors: McDonagh MS,Peterson K,Balshem H,Helfand M

    更新日期:2013-10-01 00:00:00

  • Examination by logistic regression modelling of the variables which increase the relative risk of elderly women falling compared to elderly men.

    abstract::In a community based, prospective study to determine risk factors for falls, 465 women and 296 men 70 years and over were followed for 1 year and 507 falls were documented. A greater proportion of women (32.7%) than men (23.0%) experienced at least one fall in which there was no or minimal external contribution. Using...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90110-b

    authors: Campbell AJ,Spears GF,Borrie MJ

    更新日期:1990-01-01 00:00:00

  • Relationships between change in aerobic fitness and changes in blood pressure and plasma lipids in men and women: the "Adelaide 1000" 4-year follow up.

    abstract::The aim was to assess relationships between increased aerobic fitness sustained over 4 years, and changes in blood pressure (SBP and DBP) and lipids. Measurements were made of BP, lipids, weight, and fitness in 1000 middle-aged men and women entering a fitness programme, and were repeated 2 and 4 years later. The 342 ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90052-3

    authors: Sedgwick AW,Thomas DW,Davies M

    更新日期:1993-02-01 00:00:00

  • Analysis of nonresponse bias in a population-based case-control study on lung cancer.

    abstract::The objective of this study was to identify characteristics of nonrespondents and late respondents in a population-based case-control study on lung cancer conducted in the city of Turin (Italy). Information about demographic and socioeconomic variables of 634 cases and 859 controls who responded to an interview, as we...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00455-9

    authors: Richiardi L,Boffetta P,Merletti F

    更新日期:2002-10-01 00:00:00

  • Simultaneous interval estimates of the odds ratio in studies with two or more comparisons.

    abstract::More than one odds ratio estimate will often arise from a single epidemiologic study. Examples of designs where this may occur include those where there is more than one case or control group, and investigations of several risk factors as part of the same study. Various methods for presenting multiple interval estimat...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90132-7

    authors: Holford TR,Walter SD,Dunnett CW

    更新日期:1989-01-01 00:00:00

  • Noncompliance in lifestyle intervention studies: the instrumental variable method provides insight into the bias.

    abstract:OBJECTIVE:In lifestyle intervention trials, participants of the control group often change their behavior despite the request to maintain their usual lifestyle pattern. These changes in the control group and changes in addition to the intended in the intervention group can lead to undesirable confounding effects. STUD...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.10.007

    authors: Hertogh EM,Schuit AJ,Peeters PH,Monninkhof EM

    更新日期:2010-08-01 00:00:00

  • Estimating age incidence from survey data with adjustments for recall errors.

    abstract::In this paper we propose a method and discuss the type of data required to estimate age incidence rates from population survey data. While surveys are typically designed to estimate the prevalence of a disease or medical condition, they can also be used to estimate incidence rates. A limitation of survey data, however...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90100-5

    authors: Stewart W,Brookmyer R,Van Natta M

    更新日期:1989-01-01 00:00:00

  • Evidence-Based Research Series-Paper 3: Using an Evidence-Based Research approach to place your results into context after the study is performed to ensure usefulness of the conclusion.

    abstract:BACKGROUND AND OBJECTIVE:There is considerable actual and potential waste in research. Using evidence-based research (EBR) can ensure the value of a new study. The aim of this article, the third in a series, is to describe an EBR approach to putting research results into context. STUDY DESIGN AND SETTING:EBR is the us...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.07.021

    authors: Lund H,Juhl CB,Nørgaard B,Draborg E,Henriksen M,Andreasen J,Christensen R,Nasser M,Ciliska D,Tugwell P,Clarke M,Blaine C,Martin J,Ban JW,Brunnhuber K,Robinson KA,Evidence-Based Research Network.

    更新日期:2021-01-01 00:00:00

  • "Precision" and "accuracy": two terms that are neither.

    abstract:OBJECTIVE:In some publications, the terms "precision" and "accuracy" are used as if they were synonyms for "reliability" and "validity." METHODS AND RESULTS:This article shows that these terms are neither precise nor accurate when used in this way. Scales can demonstrate high test-retest or interrater reliability (i.e...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2005.09.005

    authors: Streiner DL,Norman GR

    更新日期:2006-04-01 00:00:00

  • Getting more out of meta-analyses: a new approach to meta-analysis in light of unexplained heterogeneity.

    abstract:BACKGROUND AND OBJECTIVES:Meta-analyses sometimes summarize results in the presence of substantial unexplained between-study heterogeneity. As GRADE criteria highlight, unexplained heterogeneity reduces certainty in the evidence, resulting in limited confidence in average effect estimates. The aim of this paper is to p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.11.023

    authors: Saad A,Yekutieli D,Lev-Ran S,Gross R,Guyatt G

    更新日期:2019-03-01 00:00:00

  • Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.

    abstract::Administrative databases are increasingly used for studying outcomes of medical care. Valid inferences from such data require the ability to account for disease severity and comorbid conditions. We adapted a clinical comorbidity index, designed for use with medical records, for research relying on International Classi...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90133-8

    authors: Deyo RA,Cherkin DC,Ciol MA

    更新日期:1992-06-01 00:00:00

  • Systematic reviews of test accuracy should search a range of databases to identify primary studies.

    abstract:OBJECTIVE:To estimate the yield from searching a range of bibliographic databases and additional sources to identify test accuracy studies for systematic reviews. STUDY DESIGN AND SETTING:We examined eight systematic reviews and their database searches: MEDLINE, EMBASE, BIOSIS, Science Citation Index, LILACS, Pascal, ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2007.05.013

    authors: Whiting P,Westwood M,Burke M,Sterne J,Glanville J

    更新日期:2008-04-01 00:00:00

  • External validation of prognostic models for critically ill patients required substantial sample sizes.

    abstract:OBJECTIVE:To investigate the behavior of predictive performance measures that are commonly used in external validation of prognostic models for outcome at intensive care units (ICUs). STUDY DESIGN AND SETTING:Four prognostic models (Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluati...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.08.011

    authors: Peek N,Arts DG,Bosman RJ,van der Voort PH,de Keizer NF

    更新日期:2007-05-01 00:00:00

  • Redundant meta-analyses are common in genetic epidemiology.

    abstract:OBJECTIVES:The massive growth in the publication of meta-analyses may cause redundancy and wasted efforts. We performed a metaepidemiologic study to evaluate the extent of potential redundancy in published meta-analyses in genetic epidemiology. STUDY DESIGN AND SETTING:Using a sample of 38 index meta-analyses of genet...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2020.05.035

    authors: Sigurdson MK,Khoury MJ,Ioannidis JPA

    更新日期:2020-11-01 00:00:00

  • P. C. A. Louis and the birth of clinical epidemiology.

    abstract::Pierre Charles Alexandre Louis (1787-1872) has been the direct or indirect mentor of influential U.S. and English scientists in public health, epidemiology, medicine, and biostatistics during the 19th and 20th century. Louis was primarily a clinician, but his name has been more closely associated with the history of e...

    journal_title:Journal of clinical epidemiology

    pub_type: 传,历史文章,杂志文章

    doi:10.1016/s0895-4356(96)00294-6

    authors: Morabia A

    更新日期:1996-12-01 00:00:00

  • Beyond Mendelian randomization: how to interpret evidence of shared genetic predictors.

    abstract:OBJECTIVE:Mendelian randomization is a popular technique for assessing and estimating the causal effects of risk factors. If genetic variants which are instrumental variables for a risk factor are shown to be additionally associated with a disease outcome, then the risk factor is a cause of the disease. However, in man...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.08.001

    authors: Burgess S,Butterworth AS,Thompson JR

    更新日期:2016-01-01 00:00:00

  • Plasma fibrinogen and coronary risk factors: the Scottish Heart Health Study.

    abstract::Plasma fibrinogen was measured in a sample of 8824 men and women aged 40-59 years participating in the Scottish Heart Health Study, and related to cardiovascular risk factors. Women had higher fibrinogen levels than men. In both sexes, multivariate analysis showed that fibrinogen was positively associated with age, sm...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90075-z

    authors: Lee AJ,Smith WC,Lowe GD,Tunstall-Pedoe H

    更新日期:1990-01-01 00:00:00

  • A changing relationship between disability and survival in the elderly population: differences by age.

    abstract:BACKGROUND:Longitudinal studies estimating the association between disability and mortality in the elderly population have typically assumed disability constant through the follow-up study period. Current knowledge indicates that such assumptions may not be appropriate. Our purpose was to examine this association (disa...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00201-4

    authors: Lamarca R,Ferrer M,Andersen PK,Liestol K,Keiding N,Alonso J

    更新日期:2003-12-01 00:00:00