Using decision thresholds for ranking treatments in network meta-analysis results in more informative rankings.

Abstract:

OBJECTIVES:To evaluate how the rank probabilities obtained from network meta-analysis (NMA) change with the use of increasingly stringent criteria for the relative effect comparing two treatments which ranks one treatment better than the other. STUDY DESIGN AND SETTING:Systematic survey and reanalysis of published data. We included all systematic reviews (SRs) with NMA from the field of cardiovascular medicine that had trial-level data available, published in Medline up to February 2015. We reran all the NMAs and determined the probabilities of each treatment being the best. For the best treatment, we examined the effect on these probabilities of varying, what we call the decision threshold, the relative effect required to declare two treatments different. RESULTS:We included 14 SRs, having a median of 20 randomized trials and 9 treatments. The best treatments had probabilities of being best that ranged from 38% to 85.3%. The effect of changing the decision thresholds on the probability of a treatment being best varied substantially across reviews, with relatively little decrease (∼20 percentage points) in some settings but a decline to near 0% in others. CONCLUSION:Rank probabilities can be fragile to increases in the decision threshold used to claim that one treatment is more effective than another. Including these thresholds into the calculation of rankings may aid their interpretation and use in clinical practice.

journal_name

J Clin Epidemiol

authors

Brignardello-Petersen R,Johnston BC,Jadad AR,Tomlinson G

doi

10.1016/j.jclinepi.2018.02.008

subject

Has Abstract

pub_date

2018-06-01 00:00:00

pages

62-69

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(17)30228-7

journal_volume

98

pub_type

杂志文章
  • The Kaiser Permanente inpatient risk adjustment methodology was valid in an external patient population.

    abstract:OBJECTIVES:Accurately predicting hospital mortality is necessary to measure and compare patient care. External validation of predictive models is required to truly prove their utility. This study assessed the Kaiser Permanente inpatient risk adjustment methodology for hospital mortality in a patient population distinct...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2009.08.020

    authors: van Walraven C,Escobar GJ,Greene JD,Forster AJ

    更新日期:2010-07-01 00:00:00

  • Comorbidity was associated with neurologic and psychiatric diseases: a general practice-based controlled study.

    abstract:BACKGROUND AND OBJECTIVE:To comprehensively examine comorbidity in unselected cohorts of patients with depression, stroke, multiple sclerosis (MS), Parkinson's disease/parkinsonism (PD/PKM), dementia, migraine, and epilepsy. METHODS:This cross-sectional study used morbidity data recorded by Dutch general practitioners...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.01.005

    authors: Nuyen J,Schellevis FG,Satariano WA,Spreeuwenberg PM,Birkner MD,van den Bos GA,Groenewegen PP

    更新日期:2006-12-01 00:00:00

  • Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

    abstract:BACKGROUND AND OBJECTIVES:The determinants of guideline panels' recommendations remain uncertain. The objective of this study was to investigate factors considered by members of 8 panels convened by the American Society of Hematology (ASH) to develop guidelines using Grading of Recommendations Assessment, Development, ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2019.02.009

    authors: Djulbegovic B,Reljic T,Elqayam S,Cuker A,Hozo I,Zhou Q,Li SA,Alexander P,Nieuwlaat R,Wiercioch W,Schünemann H,Guyatt G

    更新日期:2019-06-01 00:00:00

  • Systematic review reveals heterogeneity in definition of a clinically relevant difference in pain.

    abstract:OBJECTIVE:To describe the pain decrease considered as clinically relevant when designing a trial and reporting its results. METHODS:A systematic review of the literature in MEDLINE was conducted to select randomized controlled trials (RCTs) with pain as a primary outcome. Data extracted included the definition (terms ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.06.008

    authors: Ruyssen-Witrand A,Tubach F,Ravaud P

    更新日期:2011-05-01 00:00:00

  • Estimating age incidence from survey data with adjustments for recall errors.

    abstract::In this paper we propose a method and discuss the type of data required to estimate age incidence rates from population survey data. While surveys are typically designed to estimate the prevalence of a disease or medical condition, they can also be used to estimate incidence rates. A limitation of survey data, however...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90100-5

    authors: Stewart W,Brookmyer R,Van Natta M

    更新日期:1989-01-01 00:00:00

  • A nested case-control study of influenza vaccination was a cost-effective alternative to a full cohort analysis.

    abstract:OBJECTIVE:In the absence of trial results that are applicable to the target population, nested case-control studies might be an alternative to full-cohort analysis. We compared relative and absolute estimates of associations in an influenza vaccine study using both designs. STUDY DESIGN AND SETTING:Data from elderly p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.01.019

    authors: Hak E,Wei F,Grobbee DE,Nichol KL

    更新日期:2004-09-01 00:00:00

  • The comprehensive diagnostic study is suggested as a design to model the diagnostic process.

    abstract:OBJECTIVES:The classical diagnostic cross-sectional study has a focus on one disease only. Generalist clinicians, however, are confronted with a wide range of diagnoses. We propose the "comprehensive diagnostic study design" to evaluate diagnostic tests regarding more than one disease outcome. STUDY DESIGN AND SETTING...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.05.019

    authors: Donner-Banzhoff N,Haasenritter J,Hüllermeier E,Viniol A,Bösner S,Becker A

    更新日期:2014-02-01 00:00:00

  • Using the numerical method in 1836, James Jackson bridged French therapeutic epistemology and American medical pragmatism.

    abstract:OBJECTIVES:To review James Jackson's analysis of bloodletting among pneumonitis patients at the newly founded Massachusetts General Hospital, in which he implemented the numerical method advocated by Pierre-Charles-Alexandre Louis. STUDY DESIGN AND SETTING:The study sample included 34 cases of clinically diagnosed pne...

    journal_title:Journal of clinical epidemiology

    pub_type: 传,历史文章,杂志文章

    doi:10.1016/j.jclinepi.2014.10.013

    authors: Kahn LG,Morabia A

    更新日期:2015-04-01 00:00:00

  • Beyond Mendelian randomization: how to interpret evidence of shared genetic predictors.

    abstract:OBJECTIVE:Mendelian randomization is a popular technique for assessing and estimating the causal effects of risk factors. If genetic variants which are instrumental variables for a risk factor are shown to be additionally associated with a disease outcome, then the risk factor is a cause of the disease. However, in man...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.08.001

    authors: Burgess S,Butterworth AS,Thompson JR

    更新日期:2016-01-01 00:00:00

  • Incremental cost-effectiveness analysis: the optimal strategy depends on the strategy set.

    abstract::Evaluating the incremental cost-effectiveness of a technology is critical to understanding the impact of its adoption. The purpose of this study was to evaluate, using a particular example, how the specific alternatives selected for a cost-effectiveness analysis may influence the results of the analysis. In this examp...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00021-9

    authors: Cantor SB,Ganiats TG

    更新日期:1999-06-01 00:00:00

  • Three ways to quantify uncertainty in individually applied "minimally important change" values.

    abstract:OBJECTIVE:Determining "minimally important change" (MIC) facilitates the interpretation of change scores on multi-item instruments. This article focuses on how MIC values should be interpreted when applied to individual patients. STUDY DESIGN AND SETTING:The MIC value of a hypothetical questionnaire "Q" was determined...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.03.011

    authors: de Vet HC,Terluin B,Knol DL,Roorda LD,Mokkink LB,Ostelo RW,Hendriks EJ,Bouter LM,Terwee CB

    更新日期:2010-01-01 00:00:00

  • Fracture risk following bilateral oophorectomy.

    abstract::To assess fracture risk following bilateral oophorectomy, we conducted a population-based retrospective cohort study among the 463 Rochester, Minnesota women who underwent bilateral oophorectomy for benign ovarian conditions in 1950-1979. During 7220 person-years of observation, there appeared to be a modest increase ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(96)00211-9

    authors: Melton LJ 3rd,Crowson CS,Malkasian GD,O'Fallon WM

    更新日期:1996-10-01 00:00:00

  • Application of competing risks analysis improved prognostic assessment of patients with decompensated chronic heart failure and reduced left ventricular ejection fraction.

    abstract:OBJECTIVE:The Kaplan-Meier method may overestimate absolute mortality risk (AMR) in the presence of competing risks. Urgent heart transplantation (UHT) and ventricular assist device implantation (VADi) are important competing events in heart failure. We sought to quantify the extent of bias of the Kaplan-Meier method i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.07.006

    authors: Scrutinio D,Guida P,Passantino A,Ammirati E,Oliva F,Lagioia R,Frigerio M

    更新日期:2018-11-01 00:00:00

  • Assessment of generalized lymphadenopathy in AIDS research: the degree of clinical agreement.

    abstract::The degree of clinical agreement amongst different physicians on the presence or absence of generalized lymphadenopathy was assessed in 32 randomly selected participants from a prospective study of male sexual contacts of men with AIDS or an AIDS-related condition (ARC). Three physicians completed the same standard ex...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90131-x

    authors: Coates RA,Fanning MM,Johnson JK,Calzavara L

    更新日期:1988-01-01 00:00:00

  • Sample size considerations for studies comparing survival curves using historical controls.

    abstract::Formulas are derived for determination of the number of patients needed in a prospective comparison of survival curves, when the control group patients have already been followed for some period. Although an explicit formula for the required sample size is not available, the computing is straightforward, and tables of...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章

    doi:10.1016/0895-4356(88)90025-x

    authors: Dixon DO,Simon R

    更新日期:1988-01-01 00:00:00

  • Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses.

    abstract:OBJECTIVES:To evaluate meta-analyses with trial sequential analysis (TSA). TSA adjusts for random error risk and provides the required number of participants (information size) in a meta-analysis. Meta-analyses not reaching information size are analyzed with trial sequential monitoring boundaries analogous to interim m...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2007.10.007

    authors: Brok J,Thorlund K,Gluud C,Wetterslev J

    更新日期:2008-08-01 00:00:00

  • "Precision" and "accuracy": two terms that are neither.

    abstract:OBJECTIVE:In some publications, the terms "precision" and "accuracy" are used as if they were synonyms for "reliability" and "validity." METHODS AND RESULTS:This article shows that these terms are neither precise nor accurate when used in this way. Scales can demonstrate high test-retest or interrater reliability (i.e...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2005.09.005

    authors: Streiner DL,Norman GR

    更新日期:2006-04-01 00:00:00

  • Reproducibility and relative validity of a self-administered semiquantitative food frequency questionnaire applied to younger women.

    abstract::We have evaluated the reproducibility and relative validity of a semiquantitative food frequency questionnaire (FFQ) used in a prospective study of risk factors for cervical neoplasia. The questionnaire is a modified version of one developed and evaluated in a middle-aged Danish population. In the present study, 122 w...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00379-4

    authors: Friis S,Kruger Kjaer S,Stripp C,Overvad K

    更新日期:1997-03-01 00:00:00

  • The importance of severity of illness adjustment in predicting adverse outcomes in the Medicare population.

    abstract::The importance of using risk-adjusted mortality rates to measure quality of care is well-established. However, mortality rates may be an insensitive measure of quality for surgical patients since death is a relatively rare outcome. This study used Medicare files to identify, through chart abstraction, clinical postope...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00165-m

    authors: Rosen AK,Ash AS,McNiff KJ,Moskowitz MA

    更新日期:1995-05-01 00:00:00

  • Causality assessment of adverse reactions to drugs--I. A novel method based on the conclusions of international consensus meetings: application to drug-induced liver injuries.

    abstract::Despite the great number of methods proposed, assessing the causal role of a drug in the occurrence of an adverse medical event remains one of the most controversial issues. Qualifying terms for criteria, such as "compatible", "suggestive" of "inconclusive", have never been strictly defined, leading to low reproducibi...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90101-6

    authors: Danan G,Benichou C

    更新日期:1993-11-01 00:00:00

  • Using ordinal logistic regression to estimate the likelihood of colorectal neoplasia.

    abstract::The utility of ordinal logistic regression in the prediction of colorectal neoplasia was demonstrated in a group of 461 consecutive patients undergoing colonoscopy in a community practice. One hundred twenty-nine patients had adenomatous polyps and 34 had colorectal adenocarcinoma. An ordinal logistic regression model...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90159-7

    authors: Brazer SR,Pancotto FS,Long TT 3rd,Harrell FE Jr,Lee KL,Tyor MP,Pryor DB

    更新日期:1991-01-01 00:00:00

  • Characteristics of stroke victims associated with early cardiovascular mortality in their children.

    abstract::We assessed the relationship between characteristics of stroke victims and the risk of early death from coronary or cerebrovascular disease (CCVD) among their children. For each of 55 stroke patients selected from a registry which enrolled patients between 1969 and 1973, an index of their progeny's survival was calcul...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90055-t

    authors: Howard G,Evans GW,Toole JF,Tell G,Rose LA,Espeland M,Truscott BL

    更新日期:1990-01-01 00:00:00

  • External validation of prognostic models for critically ill patients required substantial sample sizes.

    abstract:OBJECTIVE:To investigate the behavior of predictive performance measures that are commonly used in external validation of prognostic models for outcome at intensive care units (ICUs). STUDY DESIGN AND SETTING:Four prognostic models (Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluati...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.08.011

    authors: Peek N,Arts DG,Bosman RJ,van der Voort PH,de Keizer NF

    更新日期:2007-05-01 00:00:00

  • Proxy respondents reliably assessed the quality of life of elective cardiac surgery patients.

    abstract:BACKGROUND AND OBJECTIVE:The level of agreement between index and proxy respondents on assessment of health status of clinical cohorts is variable. There is limited information regarding agreement between cardiac surgery patients and their proxies, and levels of agreement examined across repeated measures. This study e...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.06.010

    authors: Elliott D,Lazarus R,Leeder SR

    更新日期:2006-02-01 00:00:00

  • Single pivotal trials with few corroborating characteristics were used for FDA approval of cancer therapies.

    abstract:BACKGROUND AND OBJECTIVE:Novel cancer therapies are often approved with evidence from a single pivotal trial alone. There are concerns about the credibility of this evidence. Higher validity may be indicated by five methodological and statistical characteristics of pivotal trial evidence that were described by the U.S....

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.05.033

    authors: Ladanie A,Speich B,Briel M,Sclafani F,Bucher HC,Agarwal A,Ioannidis JPA,Pereira TV,Kasenda B,Hemkens LG

    更新日期:2019-10-01 00:00:00

  • Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement.

    abstract:OBJECTIVE:In the course of performing systematic reviews on the prevalence of low back and neck pain, we required a tool to assess the risk of study bias. Our objectives were to (1) modify an existing checklist and (2) test the final tool for interrater agreement. STUDY DESIGN AND SETTING:The final tool consists of 10...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.11.014

    authors: Hoy D,Brooks P,Woolf A,Blyth F,March L,Bain C,Baker P,Smith E,Buchbinder R

    更新日期:2012-09-01 00:00:00

  • Diagnostic interval and mortality in colorectal cancer: U-shaped association demonstrated for three different datasets.

    abstract:OBJECTIVE:To test the theory of a U-shaped association between time from the first presentation of symptoms in primary care to the diagnosis (the diagnostic interval) and mortality after diagnosis of colorectal cancer (CRC). STUDY DESIGN AND SETTING:Three population-based studies in Denmark and the United Kingdom usin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.12.006

    authors: Tørring ML,Frydenberg M,Hamilton W,Hansen RP,Lautrup MD,Vedsted P

    更新日期:2012-06-01 00:00:00

  • A method is presented to plan the required sample size when estimating regression-based reference limits.

    abstract:BACKGROUND AND OBJECTIVE:Reference limits are widely used in anthropometry, the behavioral sciences, medicine, and clinical chemistry. They describe the distribution of a quantitative variable in a healthy population, and are often a smooth function of age or another determinant. Thus, instead of estimating reference l...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.09.004

    authors: Bellera CA,Hanley JA

    更新日期:2007-06-01 00:00:00

  • Social class and mortality in older women.

    abstract::In middle-aged people, social class is one of the strongest predictors of mortality. However, to date, research prospectively evaluating the relationship between social class and mortality in the older persons has produced conflicting results. This may be due to the lack of clinical covariates in many analyses. The ob...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00464-x

    authors: Long JA,Ickovics JR,Gill TM,Horwitz RI

    更新日期:2002-10-01 00:00:00

  • Systematic review identifies number of strategies important for retaining study participants.

    abstract:OBJECTIVE:Loss to follow-up threatens internal and external validity yet little research has examined ways to limit participant attrition. We conducted a systematic review of studies with a primary focus on strategies to retain participants in health care research. STUDY DESIGN AND SETTINGS:We completed searches of Pu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2006.11.023

    authors: Robinson KA,Dennison CR,Wayman DM,Pronovost PJ,Needham DM

    更新日期:2007-08-01 00:00:00