Empirical Consequences of Current Recommendations for the Design and Interpretation of Noninferiority Trials.

Abstract:

BACKGROUND:Noninferiority trials are increasingly common, though they have less standardized designs and their interpretation is less familiar to clinicians than superiority trials. OBJECTIVE:To empirically evaluate a cohort of noninferiority trials to determine 1) their interpretation as recommended by CONSORT, 2) choice of alpha threshold and its sidedness, and 3) differences between methods of analysis such as intention-to-treat and per-protocol. DESIGN:We searched MEDLINE for parallel-group randomized controlled noninferiority trials published in the five highest-impact general medical journals between 2011 and 2016. MAIN MEASURES:Data abstracted included trial design parameters, results, and interpretation of results based on CONSORT recommendations. KEY RESULTS:One hundred sixty-three trials and 182 noninferiority comparisons were included in our analysis. Based on CONSORT-recommended interpretation, 79% of experimental therapies met criteria for noninferiority, 13% met criteria for superiority, 20% were declared inconclusive, and 2% met criteria for inferiority. However, for 12% of trials, the experimental therapy was statistically significantly worse than the active control, but CONSORT recommended an interpretation of inconclusive or noninferior. A two-sided alpha equivalent of greater than 0.05 was used in 34% of the trials, and in five of these trials, the use of a standard two-sided alpha of 0.05 led to changes in the interpretation of results that disfavored the experimental therapy. In four of the five comparisons where different methods of analysis (e.g., intention-to-treat and per-protocol) yielded different results, the intention-to-treat analysis was the more conservative. In 11% of trials, a secondary advantage of the new therapy was neither reported nor could it be inferred by reviewers. CONCLUSIONS:In this cohort, the design and interpretation of noninferiority trials led to significant and systematic bias in favor of the experimental therapy. Clinicians should exercise caution when interpreting these trials. Future trials may be more reliable if design parameters are standardized.

journal_name

J Gen Intern Med

authors

Aberegg SK,Hersh AM,Samore MH

doi

10.1007/s11606-017-4161-4

subject

Has Abstract

pub_date

2018-01-01 00:00:00

pages

88-96

issue

1

eissn

0884-8734

issn

1525-1497

pii

10.1007/s11606-017-4161-4

journal_volume

33

pub_type

杂志文章,评审
  • The effectiveness of beta-blockers in women with congestive heart failure.

    abstract:BACKGROUND:Beta-blockers have been shown to improve survival in patients with congestive heart failure (CHF). However, few studies have looked at the effects of these medications specifically in women. OBJECTIVE:To determine the effectiveness of beta-blockers in women with CHF. PATIENTS:We conducted a retrospective c...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-007-0197-1

    authors: Keyhan G,Chen SF,Pilote L

    更新日期:2007-07-01 00:00:00

  • Training primary care clinicians in maintenance care for moderated alcohol use.

    abstract:OBJECTIVE:To evaluate whether training primary care clinicians in maintenance care for patients who have changed their drinking influences practice behavior. DESIGN:We randomized 15 physician and 3 mid-level clinicians in 2 primary care offices in a 2:1 design. The 12 intervention clinicians received a total of 2 (1/4...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/j.1525-1497.2006.00611.x

    authors: Friedmann PD,Rose J,Hayaki J,Ramsey S,Charuvastra A,Dubé C,Herman D,Stein MD

    更新日期:2006-12-01 00:00:00

  • Formal art observation training improves medical students' visual diagnostic skills.

    abstract:BACKGROUND:Despite evidence of inadequate physical examination skills among medical students, teaching these skills has declined. One method of enhancing inspection skills is teaching "visual literacy," the ability to reason physiology and pathophysiology from careful and unbiased observation. OBJECTIVE:To improve stu...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1007/s11606-008-0667-0

    authors: Naghshineh S,Hafler JP,Miller AR,Blanco MA,Lipsitz SR,Dubroff RP,Khoshbin S,Katz JT

    更新日期:2008-07-01 00:00:00

  • Valdecoxib for treatment of primary dysmenorrhea. A randomized, double-blind comparison with placebo and naproxen.

    abstract:OBJECTIVE:To compare the analgesic efficacy of valdecoxib with placebo and naproxen sodium for relieving menstrual cramping and pain due to primary dysmenorrhea. DESIGN:Single-center, double-blind study with a 4-period, 4-sequence crossover design. Patients assessed pain intensity and pain relief at regular intervals ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/j.1525-1497.2004.30052.x

    authors: Daniels SE,Torri S,Desjardins PJ

    更新日期:2005-01-01 00:00:00

  • A Coaching by Telephone Intervention on Engaging Patients to Address Modifiable Cardiovascular Risk Factors: a Randomized Controlled Trial.

    abstract:BACKGROUND:A large proportion of deaths and chronic illnesses can be attributed to three modifiable risk factors: tobacco use, overweight/obesity, and physical inactivity. OBJECTIVE:To test whether telephone-based health coaching after completion of a comprehensive health risk assessment (HRA) increases patient activa...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1007/s11606-018-4398-6

    authors: Oddone EZ,Gierisch JM,Sanders LL,Fagerlin A,Sparks J,McCant F,May C,Olsen MK,Damschroder LJ

    更新日期:2018-09-01 00:00:00

  • Older patients' aversion to antidepressants. A qualitative study.

    abstract:BACKGROUND:Depression is common among older patients yet is often inadequately treated. Patient beliefs about antidepressants are known to affect treatment initiation and adherence, but are often not expressed in clinical settings. OBJECTIVE:To explore attitudes toward antidepressants in a sample of depressed, communi...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2005.00296.x

    authors: Givens JL,Datto CJ,Ruckdeschel K,Knott K,Zubritsky C,Oslin DW,Nyshadham S,Vanguri P,Barg FK

    更新日期:2006-02-01 00:00:00

  • Using Health Systems Engineering Approaches to Prepare for Tailoring of Implementation Interventions.

    abstract:BACKGROUND:Implementation of evidence-based practices often requires tailoring implementation strategies to local contextual factors, including available resources, expertise, and cultural norms. Using an exemplar case, we describe how health systems engineering methods can be used to understand system-level variation ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-020-06121-5

    authors: Barnes GD,Acosta J,Kurlander JE,Sales AE

    更新日期:2020-08-31 00:00:00

  • Testing the exportability of a tool for detecting operational problems in VA teaching clinics.

    abstract:BACKGROUND:Recurrent operational problems in teaching clinics may be caused by the different medical preferences of patients, residents, faculty, and administrators. These preference differences can be identified by cultural consensus analysis (CCA), a standard anthropologic tool. OBJECTIVE:This study tests the export...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1525-1497.2006.00313.x

    authors: Smith CS,Morris M,Hill W,Francovich C,McMullin J,Christiano J,Chavez L,Roth C,Vo A,Wheeler S,Milne C

    更新日期:2006-02-01 00:00:00

  • Buprenorphine retention in primary care.

    abstract:BACKGROUND:This study assesses the rate and predictors of treatment retention for primary care patients with opioid dependence-prescribed buprenorphine, a long-acting partial opioid agonist. METHODS:Observational cohort study of patients prescribed buprenorphine/naloxone and followed for 6 months in the period after t...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2005.0228.x

    authors: Stein MD,Cioe P,Friedmann PD

    更新日期:2005-11-01 00:00:00

  • Medication reconciliation accuracy and patient understanding of intended medication changes on hospital discharge.

    abstract:BACKGROUND:Adverse drug events after hospital discharge are common and often serious. These events may result from provider errors or patient misunderstanding. OBJECTIVE:To determine the prevalence of medication reconciliation errors and patient misunderstanding of discharge medications. DESIGN:Prospective cohort stu...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-012-2168-4

    authors: Ziaeian B,Araujo KL,Van Ness PH,Horwitz LI

    更新日期:2012-11-01 00:00:00

  • Validation of a method for assessing resident physicians' quality improvement proposals.

    abstract:BACKGROUND:Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. OBJECTIVE:We developed an instrument for assessing resident QI proposals--the Quality Im...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-007-0260-y

    authors: Leenstra JL,Beckman TJ,Reed DA,Mundell WC,Thomas KG,Krajicek BJ,Cha SS,Kolars JC,McDonald FS

    更新日期:2007-09-01 00:00:00

  • Effect of part-time practice on patient outcomes.

    abstract:BACKGROUND:Primary care physicians are spending fewer hours in direct patient care, yet it is not known whether reduced hours are associated with differences in patient outcomes. OBJECTIVE:To determine whether patient outcomes vary with physicians' clinic hours. DESIGN:Cross-sectional retrospective design assessing p...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1046/j.1525-1497.2003.20401.x

    authors: Parkerton PH,Wagner EH,Smith DG,Straley HL

    更新日期:2003-09-01 00:00:00

  • Gambling: an addictive behavior with health and primary care implications.

    abstract::Over the past several decades, and particularly during the last 10 to 15 years, there has been a rapid increase in the accessibility of legalized gambling in the United States and other parts of the world. Few studies have systematically explored the relationships between patterns of gambling and health status. Existi...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,评审

    doi:10.1046/j.1525-1497.2002.10812.x

    authors: Potenza MN,Fiellin DA,Heninger GR,Rounsaville BJ,Mazure CM

    更新日期:2002-09-01 00:00:00

  • A regional evaluation of variation in low-severity hospital admissions.

    abstract:OBJECTIVE:Determine patient and hospital-level variation in proportions of low-severity admissions. DESIGN:Retrospective cohort study. SETTING:Thirty hospitals in a large metropolitan region. PATIENTS:A total of 43,209 consecutive eligible patients discharged in 1991 through 1993 with congestive heart failure (n = 2...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1046/j.1525-1497.1997.00073.x

    authors: Rosenthal GE,Harper DL,Shah A,Covinsky KE

    更新日期:1997-07-01 00:00:00

  • Evaluation of a women's safe shelter experience to teach internal medicine residents about intimate partner violence. A randomized controlled trial.

    abstract::Although intimate partner violence (IPV) remains a major public health problem, physicians often fail to screen female patients. Reported IPV training approaches suffer from weak study designs and limited outcome assessments. We hypothesized that an educational experience for residents at a women's safe shelter would ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/j.1525-1497.2005.0100.x

    authors: Brienza RS,Whitman L,Ladouceur L,Green ML

    更新日期:2005-06-01 00:00:00

  • Identifying key components for an effective case report poster: an observational study.

    abstract:BACKGROUND:Residents demonstrate scholarly activity by presenting posters at academic meetings. Although recommendations from national organizations are available, evidence identifying which components are most important is not. OBJECTIVE:To develop and test an evaluation tool to measure the quality of case report pos...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-008-0860-1

    authors: Willett LL,Paranjape A,Estrada C

    更新日期:2009-03-01 00:00:00

  • A patient-based system for describing ambulatory medicine practices using diagnosis clusters.

    abstract:OBJECTIVE:To develop a patient-based classification system to describe the clinical content of ambulatory medicine practices. DESIGN:A system of 100 diagnosis clusters was developed based on retrospective review of computerized problem lists of patients from a university practice, and then applied to the problem lists...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/BF02599394

    authors: Williams BC,Philbrick JT,Becker DM,McDermott A,Davis RC,Buncher PC

    更新日期:1991-01-01 00:00:00

  • Using Active Choice Within the Electronic Health Record to Increase Influenza Vaccination Rates.

    abstract:BACKGROUND:Despite the benefits of influenza vaccination, each year more than half of adults in the United States do not receive it. OBJECTIVE:To evaluate the association between an active choice intervention in the electronic health record (EHR) and changes in influenza vaccination rates. DESIGN:Observational study....

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1007/s11606-017-4046-6

    authors: Patel MS,Volpp KG,Small DS,Wynne C,Zhu J,Yang L,Honeywell S Jr,Day SC

    更新日期:2017-07-01 00:00:00

  • Community volunteerism of US physicians.

    abstract:BACKGROUND:Many physicians and professional leaders agree that community participation is an important professional role for physicians. Volunteerism has also received increasing attention in the national agenda for social change. Yet little is known about physicians' community volunteer activities. OBJECTIVE:To measu...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-008-0811-x

    authors: Grande D,Armstrong K

    更新日期:2008-12-01 00:00:00

  • Psychosocial risk factors for adverse outcomes in patients with nonvalvular atrial fibrillation receiving warfarin.

    abstract:OBJECTIVE:Our goal was to establish whether psychosocial risk factors for nonadherence, previously identified as negative predictors of warfarin prescribing, are predictors of adverse events for patients with nonvalvular atrial fibrillation receiving warfarin. DESIGN:Retrospective cohort analysis. SETTING:Ohio Medica...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2005.0242.x

    authors: Schauer DP,Moomaw CJ,Wess M,Webb T,Eckman MH

    更新日期:2005-12-01 00:00:00

  • Randomized Controlled Trial of Brief Mindfulness Training and Hypnotic Suggestion for Acute Pain Relief in the Hospital Setting.

    abstract:BACKGROUND:Medical management of acute pain among hospital inpatients may be enhanced by mind-body interventions. OBJECTIVE:We hypothesized that a single, scripted session of mindfulness training focused on acceptance of pain or hypnotic suggestion focused on changing pain sensations through imagery would significantl...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1007/s11606-017-4116-9

    authors: Garland EL,Baker AK,Larsen P,Riquino MR,Priddy SE,Thomas E,Hanley AW,Galbraith P,Wanner N,Nakamura Y

    更新日期:2017-10-01 00:00:00

  • Race, disadvantage and faculty experiences in academic medicine.

    abstract:BACKGROUND:Despite compelling reasons to draw on the contributions of under-represented minority (URM) faculty members, US medical schools lack these faculty, particularly in leadership and senior roles. OBJECTIVE:The study's purpose was to document URM faculty perceptions and experience of the culture of academic med...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-010-1478-7

    authors: Pololi L,Cooper LA,Carr P

    更新日期:2010-12-01 00:00:00

  • Prevention in medical education: an uncertain future.

    abstract::There is reason for pessimism about the incorporation of prevention into medical education. In addition to what might be called the standard reasons for resistance to prevention, there are at least three other structural barriers: the destabilization of the health care system, the loss of interest in careers in primar...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/BF02600854

    authors: Fried RA

    更新日期:1990-09-01 00:00:00

  • Do physicians spend more time with non-English-speaking patients?

    abstract:OBJECTIVE:To determine whether physicians at a general internal medicine clinic spend more time with non-English-speaking patients. DESIGN:A time-motion study comparing physician time spent with non-English-speaking patients and time spent with English-speaking patients during 5 months of observation. We also tested p...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1046/j.1525-1497.1999.00338.x

    authors: Tocher TM,Larson EB

    更新日期:1999-05-01 00:00:00

  • Abdominal aortitis due to Streptococcus pneumoniae and Enterobacter aerogenes: a case report and review.

    abstract::Endovascular infections are 1 cause of fever of unknown origin. We describe a diagnostically challenging case of cryptogenic abdominal aortitis from Streptococcus pneumoniae and Enterobacter aerogenes. A 72-year-old male presented with epigastric pain, fevers, and chills. A computed tomography scan demonstrated enlarg...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2006.00455.x

    authors: Rondina MT,Raphael K,Pendleton R,Sande MA

    更新日期:2006-07-01 00:00:00

  • Predicting emergency readmissions for patients discharged from the medical service of a teaching hospital.

    abstract::Emergency readmissions among patients discharged from the medical service of an acute-care teaching hospital were analyzed. Using the multivariate technique of recursive partitioning, the authors developed and validated a model to predict readmission based on diagnoses and other clinical factors. Of the 4,769 patients...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/BF02596366

    authors: Phillips RS,Safran C,Cleary PD,Delbanco TL

    更新日期:1987-11-01 00:00:00

  • Persistent Severe Fixed Airways Obstruction in a High-Dosing E-cigarette User.

    abstract::Electronic Nicotine Delivery Systems (ENDS), commonly referred to as "e-cigs," were first introduced in the United States in 2007. Since then, their use has grown substantially, with the largest market among adolescents and young adults. ENDS are often perceived by the public as safe alternatives to traditional cigare...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-019-05462-0

    authors: Macedonia TV,Krefft SD,Rose CS

    更新日期:2020-01-01 00:00:00

  • Determining whether a patient is feeling better: pitfalls from the science of human perception.

    abstract::Human perception is fallible and may lead patients to be inaccurate when judging whether their symptoms are improving with treatment. This article provides a narrative review of studies in psychology that describe misconceptions related to a patient's comprehension, recall, evaluation and expression. The specific misc...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,评审

    doi:10.1007/s11606-011-1655-3

    authors: Redelmeier DA,Dickinson VM

    更新日期:2011-08-01 00:00:00

  • Patient safety and telephone medicine : some lessons from closed claim case review.

    abstract:OBJECTIVES:The telephone can facilitate medical care but also result in adverse outcomes leading to telephone-related malpractice suits. Analyzing claims might identify errors amenable to prevention. The objective of the study was to describe medical errors involving the telephone in patient-clinician encounters that s...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-007-0491-y

    authors: Katz HP,Kaltsounis D,Halloran L,Mondor M

    更新日期:2008-05-01 00:00:00

  • Variation in primary care physicians' colorectal cancer screening recommendations by patient age and comorbidity.

    abstract:BACKGROUND:Screening patterns among primary care physicians (PCPs) may be influenced by patient age and comorbidity. Colorectal cancer (CRC) screening has little benefit among patients with limited life expectancy. OBJECTIVE:To characterize the extent to which PCPs modify their recommendations for CRC screening based ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-012-2093-6

    authors: Haggstrom DA,Klabunde CN,Smith JL,Yuan G

    更新日期:2013-01-01 00:00:00