ROC area discrimination (ROCAD) curve: a new method of evaluating the discriminating ability of ordinal scales.

Abstract:

OBJECTIVE:The area under the receiver operating characteristic (ROC) curve has been frequently used to assess the ability of diagnostic tests to discriminate between individuals with and without a disease. In this paper, we propose to use the ROC area to evaluate the discriminating power of ordinal measures, such as many subjective ratings or multioption questionnaire items. STUDY DESIGN AND SETTING:Applications of the method are illustrated with examples from a study designed to select multioption items for a quality-of-life questionnaire in persons with arthritis. RESULTS:DISCRIMINATION was defined as the ability to discriminate between subjects above and below a given threshold value for the attribute being measured. The ROC curve for an ordinal scale was obtained for each observed value of the attribute and the areas under the ROC curves were estimated and plotted on a graph. The resultant curve is referred to as the ROC Area Discrimination (ROCAD) curve. In contrast to standard measures of validity for ordinal scales, such as a correlation coefficient, the ROCAD curve describes the performance of the scale for each point along the spectrum of the measured attribute. CONCLUSION:ROCAD curves can be useful in evaluating the discriminating power of ordinal scales.

journal_name

J Clin Epidemiol

authors

Kopec JA,Sayre EC

doi

10.1016/j.jclinepi.2007.11.016

subject

Has Abstract

pub_date

2008-10-01 00:00:00

pages

997-1003.e1

issue

10

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(07)00448-9

journal_volume

61

pub_type

杂志文章
  • A myriad of methods: calculated sample size for two proportions was dependent on the choice of sample size formula and software.

    abstract:OBJECTIVES:Several methods exist to calculate sample size for the difference of proportions (risk difference). Researchers are often unaware that there are different formulae, different underlying assumptions, and what the impact of choice of formula is on the calculated sample size. The aim of this study was to discus...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.10.008

    authors: Bell ML,Teixeira-Pinto A,McKenzie JE,Olivier J

    更新日期:2014-05-01 00:00:00

  • Minimal important change (MIC) based on a predictive modeling approach was more precise than MIC based on ROC analysis.

    abstract:OBJECTIVES:To present a new method to estimate a "minimal important change" (MIC) of health-related quality of life (HRQOL) scales, based on predictive modeling, and to compare its performance with the MIC based on receiver operating characteristic (ROC) analysis. To illustrate how the new method deals with variables t...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.03.015

    authors: Terluin B,Eekhout I,Terwee CB,de Vet HC

    更新日期:2015-12-01 00:00:00

  • Analysis of nonresponse bias in a population-based case-control study on lung cancer.

    abstract::The objective of this study was to identify characteristics of nonrespondents and late respondents in a population-based case-control study on lung cancer conducted in the city of Turin (Italy). Information about demographic and socioeconomic variables of 634 cases and 859 controls who responded to an interview, as we...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00455-9

    authors: Richiardi L,Boffetta P,Merletti F

    更新日期:2002-10-01 00:00:00

  • Administrative database code accuracy did not vary notably with changes in disease prevalence.

    abstract:OBJECTIVES:Previous mathematical analyses of diagnostic tests based on the categorization of a continuous measure have found that test sensitivity and specificity varies significantly by disease prevalence. This study determined if the accuracy of diagnostic codes varied by disease prevalence. STUDY DESIGN AND SETTING...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.05.009

    authors: van Walraven C,English S,Austin PC

    更新日期:2016-11-01 00:00:00

  • Cardiovascular disease in Edinburgh and north Glasgow--a tale of two cities.

    abstract::Scotland has one of the highest mortality rates from coronary heart disease for both men and women. However within Scotland there are major geographical differences in the mortality rates, exemplified by the differences between the two largest Scottish cities. Glasgow on the west has a much higher mortality rate for c...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90033-l

    authors: Smith WC,Shewry MC,Tunstall-Pedoe H,Crombie IK,Tavendale R

    更新日期:1990-01-01 00:00:00

  • Correlation between serial tests made disease probability estimates erroneous.

    abstract:BACKGROUND:The probability of a disease, given the result of two diagnostic tests, can be calculated by multiplying the odds of disease after the first test by the likelihood ratio of the second test. OBJECTIVE:To illustrate the error that occurs when calculating disease probability by combining the results of tests t...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.04.010

    authors: van Walraven C,Austin PC,Jennings A,Forster AJ

    更新日期:2009-12-01 00:00:00

  • Headache classification based on questionnaire data: which symptoms are especially suitable?

    abstract::In replication of two recent studies, it was intended to show that headache symptoms obtained by means of questionnaires fit a categorial model, provided that appropriate methods of data analysis are used. In addition, the questions which are best posed to obtain a succinct classification should be determined. Configu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00182-p

    authors: Köhler T,Eisentraut R,Graeber E

    更新日期:1995-06-01 00:00:00

  • Prevalence of iron deficiency and iron overload in the adult Icelandic population.

    abstract::The aim of this cross-sectional study was to estimate the prevalence of iron deficiency and overload in the adult population in Iceland, a developed Scandinavian country. The study population consisted of 4240 individuals aged 25-74 years randomly selected from the national roster. Basic hematological, S-iron, S-total...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90090-v

    authors: Jonsson JJ,Johannesson GM,Sigfusson N,Magnusson B,Thjodleifsson B,Magnusson S

    更新日期:1991-01-01 00:00:00

  • One-hour postload plasma glucose and risks of fatal coronary heart disease and stroke among nondiabetic men and women: the Chicago Heart Association Detection Project in Industry (CHA) Study.

    abstract::Associations of baseline one-hour postload plasma glucose with 22-year coronary heart disease, stroke, cardiovascular diseases, and all cause mortality were assessed in five age-specific cohorts of nondiabetic men and women from the Chicago Heart Association Detection Project in Industry: 10,269 men ages 18-39 years; ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00201-1

    authors: Orencia AJ,Daviglus ML,Dyer AR,Walsh M,Greenland P,Stamler J

    更新日期:1997-12-01 00:00:00

  • The Burden of Stroke Scale (BOSS) provides valid and reliable score estimates of functioning and well-being in stroke survivors with and without communication disorders.

    abstract:BACKGROUND AND OBJECTIVE:This study describes the conceptual foundation and psychometric properties of the Burden of Stroke Scale (BOSS), a patient-reported health status assessment designed to quantify the physical, cognitive, and psychological burden of stroke. METHODS:Qualitative research methods were used to devel...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.11.016

    authors: Doyle PJ,McNeil MR,Mikolic JM,Prieto L,Hula WD,Lustig AP,Ross K,Wambaugh JL,Gonzalez-Rothi LJ,Elman RJ

    更新日期:2004-10-01 00:00:00

  • Most overviews of Cochrane reviews neglected potential biases from dual authorship.

    abstract:OBJECTIVE:Some authors of Cochrane overviews have also (co-)authored one or more of the underlying reviews. We examined the extent of dual (co-)authorship in Cochrane overviews, how it is dealt with, and whether the issue is raised in protocols. STUDY DESIGN:The Cochrane Library was searched for overviews and protocol...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.04.008

    authors: Büchter RB,Pieper D

    更新日期:2016-09-01 00:00:00

  • Measuring the impact of trauma care on survival: rates of preventable death, effectiveness, and efficacy.

    abstract::This paper focuses on the appropriateness of outcome measures to evaluate trauma care. The preventable death rate (PDR), based on the study of deceased patients only, has been the traditional measure of the impact of trauma care on improving the survival of patients with severe trauma. Another measure frequently used ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90125-9

    authors: Salmi LR,Williams JI,Waxweiler RJ

    更新日期:1990-01-01 00:00:00

  • Evaluation of the MOS SF-36 physical functioning scale (PF-10): I. Unidimensionality and reproducibility of the Rasch item scale.

    abstract::Indexes developed to measure physical functioning as an essential component of general health status are often based on sets of hierarchically-structured items intended to represent a broad underlying concept. Rasch Item Response Theory (IRT) provides a methodology to examine the hierarchical structure, unidimensional...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)90215-1

    authors: Haley SM,McHorney CA,Ware JE Jr

    更新日期:1994-06-01 00:00:00

  • Finding bile duct injuries using record linkage: a validated study of complications following cholecystectomy.

    abstract::Laparoscopic cholecystectomy was introduced to Western Australia in 1991 and has become the method of choice for this procedure, although there are concerns about complications, particularly bile duct injuries. Previous studies have investigated this problem but have not confirmed the accuracy of coded information. We...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/s0895-4356(99)00043-8

    authors: Valinsky LJ,Hockey RL,Hobbs MS,Fletcher DR,Pikora TJ,Parsons RW,Tan P

    更新日期:1999-09-01 00:00:00

  • Bias in estimates of confidence intervals for health outcome report cards.

    abstract::Health researchers commonly use logistic regression when profiling health providers. Data from the patients treated by the providers are used to construct models predicting the expected number of outcomes for providers and the ratio of observed to expected outcomes (O/E ratio) used as a risk-adjusted measure of provid...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00048-9

    authors: Faris PD,Ghali WA,Brant R

    更新日期:2003-06-01 00:00:00

  • The level of alcohol consumption at which all-cause mortality is least.

    abstract::Moderate consumers of alcohol have lower mortality than either nondrinkers or heavy drinkers. This systematic review aimed to quantify the level of alcohol consumption (termed the nadir) at which the lowest mortality occurs. Twenty cohort studies reported analyses of all-cause mortality for at least three categories o...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析

    doi:10.1016/s0895-4356(99)00076-1

    authors: White IR

    更新日期:1999-10-01 00:00:00

  • Unpublished data can be of value in systematic reviews of adverse effects: methodological overview.

    abstract:OBJECTIVE:To assess the impact of including unpublished data on adverse effects in systematic reviews. STUDY DESIGN AND SETTING:We carried out a systematic review of methodological evaluations that compared the quantitative reporting of adverse effects data between published and unpublished sources, in particular, the...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.02.009

    authors: Golder S,Loke YK,Bland M

    更新日期:2010-10-01 00:00:00

  • Reproductive risk factors of fetal asphyxia at delivery: a population based analysis.

    abstract::To investigate reproductive maternal risk factors of intrapartum fetal asphyxia, we analyzed 556 women with singleton pregnancies complicated by intrapartum fetal asphyxia who gave birth at Kuopio University Hospital from January 1990 to December 1998. The general obstetric population (N=21746) was selected as the ref...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00329-2

    authors: Heinonen S,Saarikoski S

    更新日期:2001-04-01 00:00:00

  • A minimal clinically important difference was derived for the Roland-Morris Disability Questionnaire for low back pain.

    abstract:OBJECTIVE:To compare methods commonly used to derive minimal important differences and recommend a rule for defining patients as clinically improved on the low back pain-specific Roland-Morris Disability Questionnaire (RMDQ). METHODS:447 primary care low back pain consulters completed a questionnaire at consultation a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.03.018

    authors: Jordan K,Dunn KM,Lewis M,Croft P

    更新日期:2006-01-01 00:00:00

  • Factors associated with serum HCV RNA positivity in anti-HCV antibody positive intravenous drug users.

    abstract::Serum hepatitis C virus (HCV) RNA, HCV genotypes and liver function tests were evaluated in a series of 189 unselected, consecutive anti-HCV positive intravenous drug users (IVDUs). Serum HCV RNA was detected in 106/189 patients. Abnormal liver function tests were associated with alcohol abuse, but not with the presen...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00305-3

    authors: Pirisi M,Toniutto P,Fabris C,Lombardelli T,Falleti E,Tisminetzky SG,Baralle F,Bartoli E

    更新日期:1998-05-01 00:00:00

  • Index event bias-a numerical example.

    abstract::Studies of determinants of recurrent disease often give unexpected results. In particular, well-established risk factors may seem not to have much influence on the recurrence risk. Recently, it has been argued that such paradoxical findings may be because of the bias caused by the selection of patients based on the oc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2012.06.023

    authors: Smits LJ,van Kuijk SM,Leffers P,Peeters LL,Prins MH,Sep SJ

    更新日期:2013-02-01 00:00:00

  • Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health.

    abstract:OBJECTIVES:To illustrate how multiple hypotheses testing can produce associations with no clinical plausibility. STUDY DESIGN AND SETTING:We conducted a study of all 10,674,945 residents of Ontario aged between 18 and 100 years in 2000. Residents were randomly assigned to equally sized derivation and validation cohort...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.01.012

    authors: Austin PC,Mamdani MM,Juurlink DN,Hux JE

    更新日期:2006-09-01 00:00:00

  • The practice of meta-analysis.

    abstract::Meta-analysis seems to have a potentially useful role in carefully selected situations where the primary literature is of good quality, heterogeneity in the response to treatment of the tested population is small and well-understood, interest centers on estimation of a specific, critical parameter of outcome, and the ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/0895-4356(94)00149-k

    authors: Bailar JC 3rd

    更新日期:1995-01-01 00:00:00

  • External validation of prognostic models for critically ill patients required substantial sample sizes.

    abstract:OBJECTIVE:To investigate the behavior of predictive performance measures that are commonly used in external validation of prognostic models for outcome at intensive care units (ICUs). STUDY DESIGN AND SETTING:Four prognostic models (Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluati...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.08.011

    authors: Peek N,Arts DG,Bosman RJ,van der Voort PH,de Keizer NF

    更新日期:2007-05-01 00:00:00

  • Testing the equivalence of translations of widely used response choice labels: results from the IQOLA Project. International Quality of Life Assessment.

    abstract::The similarity in meaning assigned to response choice labels from the SF-36 Health Survey (SF-36) was evaluated across countries. Convenience samples of judges (range, 10 to 117; median = 48) from 13 countries rated translations of response choice labels, using a variation of the Thurstone method of equal appearing in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00084-5

    authors: Keller SD,Ware JE Jr,Gandek B,Aaronson NK,Alonso J,Apolone G,Bjorner JB,Brazier J,Bullinger M,Fukuhara S,Kaasa S,Leplège A,Sanson-Fisher RW,Sullivan M,Wood-Dauphinee S

    更新日期:1998-11-01 00:00:00

  • Heritabilities and shared environmental effects were estimated from household clustering in national health survey data.

    abstract:OBJECTIVES:The relative contributions of genetic and environmental variables to within-household clustering of quantitative traits in household surveys are poorly characterized. We estimated shared genetic and shared environmental contributions to within-household correlation for anthropometric variables and cardiovasc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.02.015

    authors: Saunders CL,Gulliford MC

    更新日期:2006-11-01 00:00:00

  • Parity derived for pregnant women using historical administrative hospital data: accuracy varied among patient groups.

    abstract:OBJECTIVES:Understanding patterns of maternity care requires knowing which women have given birth previously, but this information is typically unavailable in administrative hospital data sets. We assessed how well parity can be derived using linked historical records. STUDY DESIGN AND SETTING:Using Hospital Episode S...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.10.011

    authors: Cromwell DA,Knight HE,Gurol-Urganci I

    更新日期:2014-05-01 00:00:00

  • Weighted 2 x 2 kappa coefficients: recommended indices of diagnostic accuracy for evidence-based practice.

    abstract:OBJECTIVES:The diagnostic accuracy of a clinical test is typically evaluated by comparing the classification of individuals by the test with their classification by some diagnostic gold standard. The most popular indices of diagnostic accuracy are sensitivity, specificity, and positive and negative predictive values. H...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.11.012

    authors: Gilchrist JM

    更新日期:2009-10-01 00:00:00

  • Prospective comparison of search strategies for systematic reviews: an objective approach yielded higher sensitivity than a conceptual one.

    abstract:BACKGROUND:In the development of search strategies for systematic reviews, "conceptual approaches" are generally recommended to identify appropriate search terms for those parts of the strategies for which no validated search filters exist. However, "objective approaches" based on search terms identified by text analys...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.05.002

    authors: Hausner E,Guddat C,Hermanns T,Lampert U,Waffenschmidt S

    更新日期:2016-09-01 00:00:00

  • Systematic reviews reveal unrepresentative evidence for the development of drug formularies for poor and nonwhite populations.

    abstract:OBJECTIVE:To explore implications of using systematic drug class reviews to develop U.S. Medicaid drug formularies. We assess racial/ethnic, gender, and socioeconomic status (SES) concordance between Medicaid populations and studies synthesized in Drug Effectiveness Review Project (DERP) systematic reviews. STUDY DESI...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2009.01.009

    authors: Odierna DH,Bero LA

    更新日期:2009-12-01 00:00:00