Multiple performance measures are needed to evaluate triage systems in the emergency department.

Abstract:

OBJECTIVES:Emergency department triage systems can be considered prediction rules with an ordinal outcome, where different directions of misclassification have different clinical consequences. We evaluated strategies to compare the performance of triage systems and aimed to propose a set of performance measures that should be used in future studies. STUDY DESIGN AND SETTING:We identified performance measures based on literature review and expert knowledge. Their properties are illustrated in a case study evaluating two triage modifications in a cohort of 14,485 pediatric emergency department visits. Strengths and weaknesses of the performance measures were systematically appraised. RESULTS:Commonly reported performance measures are measures of statistical association (34/60 studies) and diagnostic accuracy (17/60 studies). The case study illustrates that none of the performance measures fulfills all criteria for triage evaluation. Decision curves are the performance measures with the most attractive features but require dichotomization. In addition, paired diagnostic accuracy measures can be recommended for dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R2 for ordinal analyses. Other performance measures provide limited additional information. CONCLUSION:When comparing modifications of triage systems, decision curves and diagnostic accuracy measures should be used in a dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R2 in an ordinal approach.

journal_name

J Clin Epidemiol

authors

Zachariasse JM,Nieboer D,Oostenbrink R,Moll HA,Steyerberg EW

doi

10.1016/j.jclinepi.2017.11.004

subject

Has Abstract

pub_date

2018-02-01 00:00:00

pages

27-34

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(17)30257-3

journal_volume

94

pub_type

杂志文章
  • Latent class growth analysis successfully identified subgroups of participants during a weight loss intervention trial.

    abstract:INTRODUCTION:Weight loss interventions often present small mean weight changes over time, despite the fact that a substantial proportion of the participants lost more weight. This effect is often leveled out by the substantial proportion of participants who gained weight during the trial. The aim of this study is to id...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2014.03.007

    authors: de Vos BC,Runhaar J,Verkleij SP,van Middelkoop M,Bierma-Zeinstra SM

    更新日期:2014-08-01 00:00:00

  • Clinical practice guidelines were adapted and implemented meeting country-specific requirements--the example of Kazakhstan.

    abstract:OBJECTIVES:In a twinning partnership between the Canadian Society for International Health and Kazakhstan's Ministry of Health, a project to build capacity and a process for the adaptation and implementation of international clinical practice guidelines (CPGs) was undertaken. STUDY DESIGN AND SETTING:A pragmatic CPG a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.05.001

    authors: McGowan J,Muratov S,Tsepke A,Issina A,Slawecki E,Lang ES

    更新日期:2016-01-01 00:00:00

  • Zinc supplementation reduced cost and duration of acute diarrhea in children.

    abstract:OBJECTIVE:To determine whether zinc with oral rehydration solution (ORS) is more cost effective than ORS alone in the treatment of acute diarrhea. STUDY DESIGN AND SETTING:Cost-effectiveness analysis among patients consulting the emergency room of a government institution. METHOD:Cost of treatment and outcome of part...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2006.08.004

    authors: Gregorio GV,Dans LF,Cordero CP,Panelo CA

    更新日期:2007-06-01 00:00:00

  • Result dissemination from clinical trials conducted at German university medical centers was delayed and incomplete.

    abstract:OBJECTIVES:Timely and comprehensive reporting of clinical trial results builds the backbone of evidence-based medicine and responsible research. The proportion of timely disseminated trial results can inform alternative national and international benchmarking of university medical centers (UMCs). STUDY DESIGN AND SETT...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.002

    authors: Wieschowski S,Riedel N,Wollmann K,Kahrass H,Müller-Ohlraun S,Schürmann C,Kelley S,Kszuk U,Siegerink B,Dirnagl U,Meerpohl J,Strech D

    更新日期:2019-11-01 00:00:00

  • Meta-analysis identifies Back Pain Questionnaire reliability influenced more by instrument than study design or population.

    abstract:OBJECTIVE:To assess if predefined variables in study design, instrument type, and patient characteristics account for variance in reported retest reliability for the Oswestry Disability Index (ODI) and Roland-Morris Questionnaire (RMQ). A second aim was a more precise estimate of instrument reliability. STUDY DESIGN A...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jclinepi.2012.06.024

    authors: Geere JH,Geere JA,Hunter PR

    更新日期:2013-03-01 00:00:00

  • Epidemiology of adulthood injuries: a quickly changing injury profile in Finland.

    abstract::Although developed societies have undergone many profound changes during recent decades, including urbanization, increased traffic and aging of the populations, epidemiologic information on secular trends in profiles of injuries is limited. We investigated such trends in Finland by selecting from the National Hospital...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00346-2

    authors: Kannus P,Niemi S,Parkkari J,Palvanen M

    更新日期:2001-06-01 00:00:00

  • Series: Pragmatic trials and real world evidence: Paper 6. Outcome measures in the real world.

    abstract::Results from pragmatic trials should reflect the comparative treatment effects encountered in patients in real-life clinical practice to guide treatment decisions. Therefore, pragmatic trials should focus on outcomes that are relevant to patients, clinical practice, and treatment choices. This sixth article in the ser...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.12.022

    authors: Welsing PM,Oude Rengerink K,Collier S,Eckert L,van Smeden M,Ciaglia A,Nachbaur G,Trelle S,Taylor AJ,Egger M,Goetz I,Work Package 3 of the GetReal Consortium.

    更新日期:2017-10-01 00:00:00

  • A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods.

    abstract:BACKGROUND:Chronic kidney disease (CKD) is a global health concern that is increasing mainly as the result of increasing incidences of diabetes and hypertension. Furthermore, if left untreated, individuals with CKD may progress to end-stage kidney failure. Identifying individuals with undiagnosed CKD or those who are a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.06.020

    authors: Collins GS,Omar O,Shanyinde M,Yu LM

    更新日期:2013-03-01 00:00:00

  • Statistically significant papers in psychiatry were cited more often than others.

    abstract:OBJECTIVE:Citations by other researchers are important in the dissemination of research findings. We aimed to investigate whether preferential citation of statistically significant articles exists in the psychiatric literature. STUDY DESIGN AND SETTINGS:We analyzed all original research papers published in 1996 in fou...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.11.014

    authors: Nieminen P,Rucker G,Miettunen J,Carpenter J,Schumacher M

    更新日期:2007-09-01 00:00:00

  • Time-dependent variability in repeated measurements of cholesterol levels: clinical implications for risk misclassification and intervention monitoring.

    abstract::Intraindividual variability (IIV) in total cholesterol levels based on measurements taken 1 week apart is compared with an estimate based on measurements taken 2 years apart. Single-subject 95% confidence intervals around the mean of two repeated measurements were Xi +/- 21 and +/- 28 mg/dl, respectively, and Xi +/- 3...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90115-h

    authors: Roeback JR,Cook JR,Guess HA,Heyse JF

    更新日期:1993-10-01 00:00:00

  • Quality of life and functional health of primary care patients.

    abstract::Quality of life and functional health were measured cross-sectionally for 314 adult ambulatory primary care patients in a rural clinic and found to be much better for patients with low severity of illness who required no confinement to home because of health problems, than for patients with high severity of illness wh...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90171-i

    authors: Parkerson GR Jr,Broadhead WE,Tse CK

    更新日期:1992-11-01 00:00:00

  • Analysis of nonresponse bias in a population-based case-control study on lung cancer.

    abstract::The objective of this study was to identify characteristics of nonrespondents and late respondents in a population-based case-control study on lung cancer conducted in the city of Turin (Italy). Information about demographic and socioeconomic variables of 634 cases and 859 controls who responded to an interview, as we...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00455-9

    authors: Richiardi L,Boffetta P,Merletti F

    更新日期:2002-10-01 00:00:00

  • Parents were accurate proxy reporters of urgent pediatric asthma health services: a retrospective agreement analysis.

    abstract:OBJECTIVE:To assess agreement between parents' proxy reports of children's respiratory-related health service use and administrative data. STUDY DESIGN AND SETTING:A retrospective analysis of statistical agreement between clinical and claims data for reports of physician visits, emergency department (ED) visits, and h...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2007.02.002

    authors: Ungar WJ,Davidson-Grimwood SR,Cousins M

    更新日期:2007-11-01 00:00:00

  • WHO/ISH total risk approach for primary prevention of cardiovascular disease shows greater decrease in costs for women but not the elderly in Jamaica.

    abstract:OBJECTIVES:To investigate cost savings from and implications of replacing the single risk with a total cardiovascular risk approach in primary prevention of cardiovascular disease (CVD). STUDY DESIGN AND SETTING:A cost analysis using data from the 2007-08 Jamaica Health and Lifestyle Survey of 1,432 persons aged 40 ye...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2014.11.027

    authors: Abdulkadri AO,Tulloch-Reid MK,Francis DK,Gordon-Strachan GM,Younger-Coleman NO,Rocke KD,McFarlane SR,Cunningham-Myrie CA,Ferguson TS,Wilks RJ,Anderson SG

    更新日期:2015-09-01 00:00:00

  • Systematic review reveals heterogeneity in definition of a clinically relevant difference in pain.

    abstract:OBJECTIVE:To describe the pain decrease considered as clinically relevant when designing a trial and reporting its results. METHODS:A systematic review of the literature in MEDLINE was conducted to select randomized controlled trials (RCTs) with pain as a primary outcome. Data extracted included the definition (terms ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.06.008

    authors: Ruyssen-Witrand A,Tubach F,Ravaud P

    更新日期:2011-05-01 00:00:00

  • Does physical activity lower blood pressure: a critical review of the clinical trials.

    abstract::This review critically appraises 22 recent articles of trials of physical activity, as a means of reducing blood pressure. The quality of the literature remains poor and of the 13 controlled trials of habitual activity only one did not have a major design fault. Overall, blood pressure was reduced by physical activity...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/0895-4356(92)90093-3

    authors: Arroll B,Beaglehole R

    更新日期:1992-05-01 00:00:00

  • Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects.

    abstract:OBJECTIVE:To assess whether nominally statistically significant effects in meta-analyses of clinical trials are true and whether their magnitude is inflated. STUDY DESIGN AND SETTING:Data from the Cochrane Database of Systematic Reviews 2005 (issue 4) and 2010 (issue 1) were used. We considered meta-analyses with bina...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.12.012

    authors: Pereira TV,Ioannidis JP

    更新日期:2011-10-01 00:00:00

  • Both clinical epidemiology and population health perspectives can define the role of health care in reducing health disparities.

    abstract:OBJECTIVE:To compare and contrast clinical epidemiology and population health perspectives on the role of health care in reducing socioeconomic disparities in health. STUDY DESIGN AND SETTING:A review of concepts outlined in selected articles on population health and clinical epidemiology and a systematic literature s...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2004.10.020

    authors: Anderson GM,Bronskill SE,Mustard CA,Culyer A,Alter DA,Manuel DG

    更新日期:2005-08-01 00:00:00

  • Frequent inappropriate use of unweighted summary statistics in systematic reviews of pathogen genotypes or genogroups.

    abstract:OBJECTIVES:Our study aimed to systematically assess and report the methodological quality used in epidemiological systematic reviews (SRs) and meta-analysis (MA) of pathogen genotypes/genogroups. STUDY DESIGN AND SETTING:Nine electronic databases and manual search of reference lists were used to identify relevant stud...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2019.11.009

    authors: Tran L,Nhu Y M,Le Ba Nghia T,Hendam A,Vuong NL,Alzalal E,Sayed AM,Hussain MM,Sharma A,Tieu T,Mathenge PG,Hirayama K,Alexander N,Huy NT

    更新日期:2020-03-01 00:00:00

  • Likelihood and clinical trials.

    abstract::The history of the application of statistical theory to the analysis of clinical trials is reviewed. The current orthodoxy is a somewhat illogical hybrid of the original theory of significance tests of Edgeworth, Karl Pearson, and Fisher, and the subsequent decision theory approach of Neyman, Egon Pearson, and Wald. T...

    journal_title:Journal of clinical epidemiology

    pub_type: 历史文章,杂志文章

    doi:10.1016/s0895-4356(99)00156-0

    authors: Hill G,Forbes W,Kozak J,MacNeill I

    更新日期:2000-03-01 00:00:00

  • The validity and ethics of giving placebo in a randomized nonpharmacologic trial was evaluated.

    abstract:OBJECTIVE:When studying the effects of a non-pharmacologic intervention, the choice of a control group is often difficult. In a study on the effectiveness of increased water intake on voiding dysfunction in elderly men we used an unusual design. This article addresses the internal validty and ethics of this design. ST...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.08.009

    authors: Spigt MG,Knipschild PG,van Schayck CP,Knottnerus JA

    更新日期:2005-04-01 00:00:00

  • A systematic review of core outcome set development studies demonstrates difficulties in defining unique outcomes.

    abstract:OBJECTIVES:Core outcome set (COS) development often begins with a systematic review to identify outcomes. Reviews frequently show heterogeneity in numbers of outcomes reported across trials. Contributing to this is a lack of a uniform definition for an outcome. This study proposes a first working definition for a uniqu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.016

    authors: Young AE,Brookes ST,Avery KNL,Davies A,Metcalfe C,Blazeby JM

    更新日期:2019-11-01 00:00:00

  • Describing reporting guidelines for health research: a systematic review.

    abstract:OBJECTIVE:To describe the process of development, content, and methods of implementation of reporting guidelines for health research. STUDY DESIGN AND SETTING:A systematic review of publications describing health research reporting guidelines developed using consensus. RESULTS:Eighty-one reporting guidelines for heal...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.09.013

    authors: Moher D,Weeks L,Ocampo M,Seely D,Sampson M,Altman DG,Schulz KF,Miller D,Simera I,Grimshaw J,Hoey J

    更新日期:2011-07-01 00:00:00

  • Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis.

    abstract::The objective of this study was to compare the relative responsiveness of a condition-specific spinal stenosis measure and two generic health status measures for outcome assessment of surgery for degenerative lumbar spinal stenosis, and to examine whether responsiveness statistics and measures of the ability to distin...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,多中心研究

    doi:10.1016/0895-4356(95)00054-2

    authors: Stucki G,Liang MH,Fossel AH,Katz JN

    更新日期:1995-11-01 00:00:00

  • International classification of diseases and current procedural terminology codes underestimated thrombolytic use for ischemic stroke.

    abstract:BACKGROUND AND OBJECTIVE:To determine the accuracy of recently introduced International Classification of Diseases Ninth Revision (ICD-9) procedure and Current Procedural Terminology (CPT) codes designed for injection or infusion of thrombolytic agents. MATERIALS AND METHODS:We determined the accuracy of ICD-9 procedu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.01.004

    authors: Qureshi AI,Harris-Lane P,Siddiqi F,Kirmani JF

    更新日期:2006-08-01 00:00:00

  • Risk adjustment for older hospitalized persons: a comparison of two methods of data collection for the Charlson index.

    abstract::To compare Charlson indices based on chart data and ICD-9 data for agreement overall and on rating specific comorbid conditions, and to compare mortality risks associated with these indices. Prospective cohort study. Six general medicine wards at Yale-New Haven Hospital. 524 consecutive patients who had no clinical ev...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00367-x

    authors: van Doorn C,Bogardus ST,Williams CS,Concato J,Towle VR,Inouye SK

    更新日期:2001-07-01 00:00:00

  • The Italian SF-36 Health Survey: translation, validation and norming.

    abstract::This article reports on the development and validation of the Italian SF-36 Health Survey using data from seven studies in which an Italian version of the SF-36 was administered to more than 7000 subjects between 1991 and 1995. Empirical findings from a wide array of studies and diseases indicate that the performance ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00094-8

    authors: Apolone G,Mosconi P

    更新日期:1998-11-01 00:00:00

  • Statistical analysis of failure times in total joint replacement.

    abstract::Time to revision is an important criterion describing the quality of implants in total joint surgery. Estimates of failure probabilities are required to inform a patient about the risk of suffering a reoperation. Also, regression models are used for comparing different prosthesis designs. Typically, patients dying bef...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00371-7

    authors: Schwarzer G,Schumacher M,Maurer TB,Ochsner PE

    更新日期:2001-10-01 00:00:00

  • The statistical significance of meta-analyses is frequently fragile: definition of a fragility index for meta-analyses.

    abstract:OBJECTIVES:Meta-analyses inform clinical practice by summarizing treatment effect estimates based on results from several trials. However, the statistical significance of a meta-analysis (i.e., whether the pooled treatment effect is statistically significant or not) may rely on the outcome of only a few patients from s...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.03.012

    authors: Atal I,Porcher R,Boutron I,Ravaud P

    更新日期:2019-07-01 00:00:00

  • Dependence of the minimal clinically important improvement on the baseline value is a consequence of floor and ceiling effects and not different expectations by patients.

    abstract:OBJECTIVE:Estimates of minimal clinically important improvements (MCIIs) are larger among patients with higher values at baseline, suggesting that these patients require larger changes to appreciate improvements. We examined if baseline dependency of MCIIs was associated with specific patients across three measures, or...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.10.025

    authors: Ward MM,Guthrie LC,Alba M

    更新日期:2014-06-01 00:00:00