Weighted 2 x 2 kappa coefficients: recommended indices of diagnostic accuracy for evidence-based practice.

Abstract:

OBJECTIVES:The diagnostic accuracy of a clinical test is typically evaluated by comparing the classification of individuals by the test with their classification by some diagnostic gold standard. The most popular indices of diagnostic accuracy are sensitivity, specificity, and positive and negative predictive values. However, these measures are affected by the fact that some diagnostic decisions will be correct by chance, resulting in values that differ widely between indices, and clinicians may be confused as to whether results indicate that a test is good or poor. In keeping with the principle in evidence-based practice that decisions should be based on evidence not guesswork, we might expect that measures of diagnostic accuracy should therefore be chance corrected. The objective of this article was to advocate this and draw attention to indices that achieve this requirement. STUDY DESIGN AND SETTING:The principles underlying calculations of diagnostic accuracy are presented as a framework for understanding the problem and its solution. RESULTS:Disparities between different indices of diagnostic accuracy may be resolved by adjusting them to correct for chance effects. This produces a pair of weighted 2 x 2 "diagnostic" kappa coefficients offering a number of theoretical and practical advantages. CONCLUSION:Routine use of weighted 2 x 2 kappa coefficients as indices of diagnostic accuracy is recommended.

journal_name

J Clin Epidemiol

authors

Gilchrist JM

doi

10.1016/j.jclinepi.2008.11.012

subject

Has Abstract

pub_date

2009-10-01 00:00:00

pages

1045-53

issue

10

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(08)00329-6

journal_volume

62

pub_type

杂志文章
  • Outcomes in systematic reviews of complex interventions never reached "high" GRADE ratings when compared with those of simple interventions.

    abstract:OBJECTIVES:To investigate the application of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach and the quality of evidence ratings in systematic reviews of complex interventions. STUDY DESIGN AND SETTING:This study examined all 40 systematic reviews published in three Cochrane Rev...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2016.03.014

    authors: Movsisyan A,Melendez-Torres GJ,Montgomery P

    更新日期:2016-10-01 00:00:00

  • A 67-item stress resilience item bank showing high content validity was developed in a psychosomatic sample.

    abstract:OBJECTIVES:To develop the first item bank to measure stress resilience (SR) in clinical populations. STUDY DESIGN AND SETTING:Qualitative item development resulted in an initial pool of 131 items covering a broad theoretical SR concept. These items were tested in n = 521 patients at a psychosomatic outpatient clinic. ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.04.004

    authors: Obbarius N,Fischer F,Obbarius A,Nolte S,Liegl G,Rose M

    更新日期:2018-08-01 00:00:00

  • Multivariable adjustments counteract spectrum and test review bias in accuracy studies.

    abstract:OBJECTIVES:The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.02.007

    authors: Bachmann LM,ter Riet G,Weber WE,Kessels AG

    更新日期:2009-04-01 00:00:00

  • Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations.

    abstract:OBJECTIVES:Model specification-what adjusting variables are analytically modeled-may influence results of observational associations. We present a standardized approach to quantify the variability of results obtained with choices of adjustments called the "vibration of effects" (VoE). STUDY DESIGN AND SETTING:We estim...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.05.029

    authors: Patel CJ,Burford B,Ioannidis JP

    更新日期:2015-09-01 00:00:00

  • Decline in mortality from heart disease in Denmark: some methodological problems.

    abstract::Mortality rates in Denmark from ischemic heart diseases (IHD), other heart diseases and unknown causes are presented for the period 1968-92. In all age groups, mortality from IHD is higher at the beginning of the period than at the end. For other heart disease, the plot of the mortality rate is U-shaped for the age gr...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00158-m

    authors: Juel K,Sjøl A

    更新日期:1995-04-01 00:00:00

  • Relationships of site of infarction and history of previous infarction with short- and long-term prognosis after acute myocardial infarction in Japan.

    abstract::We studied the outcome in 308 patients with acute myocardial infarction (MI) admitted to the coronary care unit of Kobe General Hospital. Short-term outcome (within 28 days after MI) and long-term outcome (more than 28 days) were examined with survival curves to find any relationship with a history of previous MI and ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90186-q

    authors: Nishi N,Nakanishi N,Kuroda K,Koizumi K,Yoshikawa J,Tatara K

    更新日期:1992-01-01 00:00:00

  • Gender differences in the reliability of reporting symptoms of angina pectoris.

    abstract::Numerous studies have shown that the symptoms of angina pectoris are more prevalent in women than men, than other manifestations of coronary heart disease, with the greatest discrepancies at younger ages. Variation in symptom reliability between genders could be a potential explanation for these differences. The Lipid...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90009-x

    authors: Harris RB,Weissfeld LA

    更新日期:1991-01-01 00:00:00

  • Correspondence analysis is a useful tool to uncover the relationships among categorical variables.

    abstract:OBJECTIVE:Correspondence analysis (CA) is a multivariate graphical technique designed to explore the relationships among categorical variables. Epidemiologists frequently collect data on multiple categorical variables with the goal of examining associations among these variables. Nevertheless, CA appears to be an under...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.08.008

    authors: Sourial N,Wolfson C,Zhu B,Quail J,Fletcher J,Karunananthan S,Bandeen-Roche K,Béland F,Bergman H

    更新日期:2010-06-01 00:00:00

  • A likelihood-based approach to P-value interpretation provided a novel, plausible, and clinically useful research study metric.

    abstract:OBJECTIVES:Interpretation of clinical research findings using the paradigm of null hypothesis significance testing has a number of limitations. These include arbitrary dichotomization of results, lack of incorporation of study power and prior probability, and the confusing use of conditional probability. This study aim...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.08.016

    authors: Adams NG,O'Reilly G

    更新日期:2017-12-01 00:00:00

  • Improving private pharmacy practice: a multi-intervention experiment in Hanoi, Vietnam.

    abstract::The objective of this study was to assess the effects of a multicomponent intervention on private pharmacy practice. From 641 private pharmacies in Hanoi, 68 pharmacies were randomly selected and matched into 34 pairs. Each pair consisted of a control and an intervention pharmacy. Three interventions were applied sequ...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1016/s0895-4356(02)00458-4

    authors: Chuc NT,Larsson M,Do NT,Diwan VK,Tomson GB,Falkenberg T

    更新日期:2002-11-01 00:00:00

  • The increasing complexity of the core outcomes landscape.

    abstract::In this project, we set out to identify ways to increase the uptake of core outcome sets in clinical research. In doing so, we uncovered a growing recognition, across many different health care sectors, of the need for common, relevant outcomes to improve the quality of decision-making. This has led to a plethora of p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.05.016

    authors: Moloney RM,Messner DA,Tunis SR

    更新日期:2019-12-01 00:00:00

  • Evidence of survival benefit was often ambiguous in randomized trials of cancer treatments.

    abstract:OBJECTIVES:The objective of the study is to estimate the proportion of statistically significant survival improvements reported in randomized trials of cancer treatments that are also compatible with a clinically negligible benefit. STUDY DESIGN AND SETTING:This is a cross-sectional study of reports of randomized clin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.06.026

    authors: Perneger TV,Brindel P,Combescure C,Gayet-Ageron A

    更新日期:2020-11-01 00:00:00

  • Statistical power of clinical trials increased while effect size remained stable: an empirical analysis of 136,212 clinical trials between 1975 and 2014.

    abstract:OBJECTIVES:To study the statistical power of randomized clinical trials and examine developments over time. STUDY DESIGN AND SETTING:We analyzed the statistical power in 136,212 clinical trials between 1975 and 2014 extracted from meta-analyses from the Cochrane database of systematic reviews. We determined study powe...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.06.014

    authors: Lamberink HJ,Otte WM,Sinke MRT,Lakens D,Glasziou PP,Tijdink JK,Vinkers CH

    更新日期:2018-10-01 00:00:00

  • Clinical replicability of rehabilitation interventions in randomized controlled trials reported in main journals is inadequate.

    abstract:OBJECTIVE:The objective of this study was to study if randomized controlled trials (RCTs) in rehabilitation (a field where complex interventions prevail) published in main journals include all the details needed to replicate the intervention in clinical practice (clinical replicability). STUDY DESIGN AND SETTING:Forty...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.008

    authors: Negrini S,Arienti C,Pollet J,Engkasan JP,Francisco GE,Frontera WR,Galeri S,Gworys K,Kujawa J,Mazlan M,Rathore FA,Schillebeeckx F,Kiekens C,REREP study participants.

    更新日期:2019-10-01 00:00:00

  • Recall bias in case-control studies: an empirical analysis and theoretical framework.

    abstract::Previous work has suggested that recall bias in case-control studies may be more serious when the overall study quality is lower. This paper summarizes a systematic literature search to examine the question. All relevant studies published between 1966 and 1990 were included if they met the following criteria: (1) they...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00132-a

    authors: Chouinard E,Walter S

    更新日期:1995-02-01 00:00:00

  • Sieve analysis: methods for assessing from vaccine trial data how vaccine efficacy varies with genotypic and phenotypic pathogen variation.

    abstract::A key component in the evaluation of efficacy of a vaccine to protect against disease caused by an antigenically diverse infectious pathogen in a preventative vaccine trial is assessing how vaccine-induced protection depends on genotypic and phenotypic variations of the exposing pathogen. This assessment is made by co...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0895-4356(00)00258-4

    authors: Gilbert P,Self S,Rao M,Naficy A,Clemens J

    更新日期:2001-01-01 00:00:00

  • An observational study showed that explaining randomization using gambling-related metaphors and computer-agency descriptions impeded randomized clinical trial recruitment.

    abstract:OBJECTIVES:To explore how the concept of randomization is described by clinicians and understood by patients in randomized controlled trials (RCTs) and how it contributes to patient understanding and recruitment. STUDY DESIGN AND SETTING:Qualitative analysis of 73 audio recordings of recruitment consultations from fiv...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2018.02.018

    authors: Jepson M,Elliott D,Conefrey C,Wade J,Rooshenas L,Wilson C,Beard D,Blazeby JM,Birtle A,Halliday A,Stein R,Donovan JL,CSAW study group.,Chemorad study group.,POUT study group.,ACST-2 study group.,OPTIMA prelim study group.

    更新日期:2018-07-01 00:00:00

  • Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

    abstract:BACKGROUND AND OBJECTIVES:The determinants of guideline panels' recommendations remain uncertain. The objective of this study was to investigate factors considered by members of 8 panels convened by the American Society of Hematology (ASH) to develop guidelines using Grading of Recommendations Assessment, Development, ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2019.02.009

    authors: Djulbegovic B,Reljic T,Elqayam S,Cuker A,Hozo I,Zhou Q,Li SA,Alexander P,Nieuwlaat R,Wiercioch W,Schünemann H,Guyatt G

    更新日期:2019-06-01 00:00:00

  • Characteristics of the Modified Mini-Mental State Exam among elderly persons.

    abstract::This study assesses psychometric properties of the Modified Mini-Mental State Exam (3MS) and present population norms and demographic risk factors for low 3MS scores. The subjects were 885 persons aged 65 and older who took the 3MS as part of the Stirling County Study, a population-based longitudinal study of adult re...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00111-2

    authors: Bassuk SS,Murphy JM

    更新日期:2003-07-01 00:00:00

  • Medical record validation of maternally reported history of preeclampsia.

    abstract:OBJECTIVE:In this study, we assessed the validity of maternally self-reported history of preeclampsia. STUDY DESIGN AND SETTING:This study was embedded in the Generation R Study, a population-based prospective cohort study. Data were obtained from prenatal questionnaires and one questionnaire obtained 2 months postpar...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.10.010

    authors: Coolman M,de Groot CJ,Jaddoe VW,Hofman A,Raat H,Steegers EA

    更新日期:2010-08-01 00:00:00

  • Sun exposure and number of nevi in 5- to 6-year-old European children.

    abstract::The occurrence and number of melanocytic nevi are among the most important known risk factors for the development of malignant melanoma. Studying the causes of nevi should lead to successful strategies in the prevention of melanoma. Among 11,478 white German children of preschool age the association between benign mel...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00484-5

    authors: Dulon M,Weichenthal M,Blettner M,Breitbart M,Hetzer M,Greinert R,Baumgardt-Elms C,Breitbart EW

    更新日期:2002-11-01 00:00:00

  • Montreal Accord on Patient-Reported Outcomes (PROs) use series - Paper 5: patient-reported outcomes can be linked to epidemiologic measures to monitor populations and inform public health decisions.

    abstract:BACKGROUND:A comprehensive picture of population health status can be captured by the incorporation of patient-reported outcome measures into population health monitoring. OBJECTIVE:The aim of the study was to identify the current state, opportunities, and future research related to the utilization of patient-reported...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.04.018

    authors: Mamiya H,Lix LM,Gardner W,Bartlett SJ,Ahmed S,Buckeridge DL

    更新日期:2017-09-01 00:00:00

  • Bias in estimates of confidence intervals for health outcome report cards.

    abstract::Health researchers commonly use logistic regression when profiling health providers. Data from the patients treated by the providers are used to construct models predicting the expected number of outcomes for providers and the ratio of observed to expected outcomes (O/E ratio) used as a risk-adjusted measure of provid...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00048-9

    authors: Faris PD,Ghali WA,Brant R

    更新日期:2003-06-01 00:00:00

  • Weight and mortality in Finnish men.

    abstract::Mortality rates of 22,995 Finnish men aged 25 and over followed up for a median of 12 years were analyzed in relation to body mass index (BMI) at the initial examination. All-cause mortality followed a "U"-shaped distribution, being greatest for the thinnest and fattest men at all ages, or about 1.5-fold for those wit...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90076-0

    authors: Rissanen A,Heliövaara M,Knekt P,Aromaa A,Reunanen A,Maatela J

    更新日期:1989-01-01 00:00:00

  • Unpublished data can be of value in systematic reviews of adverse effects: methodological overview.

    abstract:OBJECTIVE:To assess the impact of including unpublished data on adverse effects in systematic reviews. STUDY DESIGN AND SETTING:We carried out a systematic review of methodological evaluations that compared the quantitative reporting of adverse effects data between published and unpublished sources, in particular, the...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.02.009

    authors: Golder S,Loke YK,Bland M

    更新日期:2010-10-01 00:00:00

  • Headache classification based on questionnaire data: which symptoms are especially suitable?

    abstract::In replication of two recent studies, it was intended to show that headache symptoms obtained by means of questionnaires fit a categorial model, provided that appropriate methods of data analysis are used. In addition, the questions which are best posed to obtain a succinct classification should be determined. Configu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00182-p

    authors: Köhler T,Eisentraut R,Graeber E

    更新日期:1995-06-01 00:00:00

  • Epidemiology of Dupuytren's disease: clinical, serological, and social assessment. The Reykjavik Study.

    abstract::Dupuytren's disease or palmar fibromatosis is a common disabling hand disorder, mainly confined to Caucasians of northwestern European origin. The prevalence of Dupuytren's disease and possible risk factors related to the disease were evaluated in a random sample of 1297 males and 868 females, aged 46 to 74 years. Blo...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00145-6

    authors: Gudmundsson KG,Arngrímsson R,Sigfússon N,Björnsson A,Jónsson T

    更新日期:2000-03-01 00:00:00

  • A prospective study of psychological and socioeconomic characteristics, health behavior and morbidity in cigarette smokers prior to quitting compared to persistent smokers and non-smokers.

    abstract::Psychosocial factors influencing smoking cessation were studied in current smokers prior to quitting. Two questionnaires were sent in 1975 and 1981 to adult members of the Finnish Twin Cohort. The 1975 response rate was 89%, and 89% of those eligible replied again in 1981. Analysis was done on data from one twin pair ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90088-1

    authors: Kaprio J,Koskenvuo M

    更新日期:1988-01-01 00:00:00

  • Toxic oil syndrome: survival in the whole cohort between 1981 and 1995.

    abstract:BACKGROUND AND OBJECTIVE:In 1981, toxic oil syndrome (TOS) appeared in Spain, affecting more than 20,000 persons and causing over 2500 deaths to date. Previous studies have addressed mortality only by gender and age. We analyzed possible prognostic factors in the survival of the cohort. METHODS:The study period was 1 ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00119-7

    authors: Sánchez-Porro Valadés P,Posada de la Paz M,de Andrés Copa P,Gimenez Ribota O,Abaitua Borda I

    更新日期:2003-07-01 00:00:00

  • Health care use by inner-city patients with asthma.

    abstract::The purpose of this study was to describe patterns of health care use by inner-city patients with asthma and to identify patients at risk for hospitalization. We performed a retrospective cohort study of 1788 patients with asthma aged 5 to 34 years from a large hospital-based multi-specialty practice in inner-city Ind...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00333-2

    authors: Murray MD,Stang P,Tierney WM

    更新日期:1997-02-01 00:00:00