Interrater reliability: the kappa statistic.

Abstract:

:The kappa statistic is frequently used to test interrater reliability. The importance of rater reliability lies in the fact that it represents the extent to which the data collected in the study are correct representations of the variables measured. Measurement of the extent to which data collectors (raters) assign the same score to the same variable is called interrater reliability. While there have been a variety of methods to measure interrater reliability, traditionally it was measured as percent agreement, calculated as the number of agreement scores divided by the total number of scores. In 1960, Jacob Cohen critiqued use of percent agreement due to its inability to account for chance agreement. He introduced the Cohen's kappa, developed to account for the possibility that raters actually guess on at least some variables due to uncertainty. Like most correlation statistics, the kappa can range from -1 to +1. While the kappa is one of the most commonly used statistics to test interrater reliability, it has limitations. Judgments about what level of kappa should be acceptable for health research are questioned. Cohen's suggested interpretation may be too lenient for health related studies because it implies that a score as low as 0.41 might be acceptable. Kappa and percent agreement are compared, and levels for both kappa and percent agreement that should be demanded in healthcare studies are suggested.

journal_name

Biochem Med (Zagreb)

journal_title

Biochemia medica

authors

McHugh ML

subject

Has Abstract

pub_date

2012-01-01 00:00:00

pages

276-82

issue

3

eissn

1330-0962

issn

1846-7482

journal_volume

22

pub_type

杂志文章
  • Inflammatory and angiogenic biomarkers in diabetic retinopathy.

    abstract::Diabetic retinopathy (DR) is one of the most common microvascular complications of diabetes mellitus (DM) and a leading cause of blindness in working-age adults in developed countries. Numerous investigations have recognised inflammation and angiogenesis as important factors in the development of this complication of ...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2020.030502

    authors: Kaštelan S,Orešković I,Bišćan F,Kaštelan H,Gverović Antunica A

    更新日期:2020-10-15 00:00:00

  • Education of medical biochemists in Bosnia and Herzegovina.

    abstract::In this paper we would like to briefly introduce readers to the situation in the field of laboratory medicine in Bosnia and Herzegovina, with a focus on training in the field of medical biochemistry. As in some of neighboring countries, term Medical biochemist is the usual name for the Clinical biochemist or Clinical ...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:

    authors: Winterhalter-Jadrić M,Causević A,Jadrić R,Corić J,Hasić S,Kiseljaković E

    更新日期:2011-01-01 00:00:00

  • The effective reduction of tourniquet application time after minor modification of the CLSI H03-A6 blood collection procedure.

    abstract:INTRODUCTION:The phlebotomists' procedures are a still source of laboratory variability. The aim of this study was to verify the efficacy of minor modification in procedure for collection of diagnostic blood specimens by venipuncture from CLSI H03-A6 document is able to reduce the tourniquet application time. MATERIAL...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/bm.2013.037

    authors: Lima-Oliveira G,Lippi G,Salvagno GL,Montagnana M,Picheth G,Guidi GC

    更新日期:2013-01-01 00:00:00

  • Diagnostic accuracy of urinary prostate protein glycosylation profiling in prostatitis diagnosis.

    abstract:INTRODUCTION:Although prostatitis is a common male urinary tract infection, clinical diagnosis of prostatitis is difficult. The developmental mechanism of prostatitis is not yet unraveled which led to the elaboration of various biomarkers. As changes in asparagine-linked-(N-)-glycosylation were observed between healthy...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2015.045

    authors: Vermassen T,Van Praet C,Poelaert F,Lumen N,Decaestecker K,Hoebeke P,Van Belle S,Rottey S,Delanghe J

    更新日期:2015-10-15 00:00:00

  • A review of urinary angiotensin converting enzyme 2 in diabetes and diabetic nephropathy.

    abstract::Urinary angiotensin converting enzyme 2 (ACE2) is significantly increased in diabetes and diabetic nephropathy. While studies on its clinical significance are still underway, its urinary expression, association with metabolic and renal parameters has been in the recent past considerably studied. The recent studies hav...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2019.010501

    authors: Gilbert A,Liu J,Cheng G,An C,Deo K,Gorret AM,Qin X

    更新日期:2019-02-15 00:00:00

  • Preanalytical phase--a continuous challenge for laboratory professionals.

    abstract::Preanalytical phase is the most vulnerable part of the total testing process and is considered to be among the greatest challenges to the laboratory professionals. However, preanalytical activities, management of unsuitable specimens and reporting policies are not fully standardized, nor harmonized worldwide. Several ...

    journal_title:Biochemia medica

    pub_type: 社论

    doi:10.11613/bm.2012.017

    authors: Simundic AM,Lippi G

    更新日期:2012-01-01 00:00:00

  • Understanding logistic regression analysis.

    abstract::Logistic regression is used to obtain odds ratio in the presence of more than one explanatory variable. The procedure is quite similar to multiple linear regression, with the exception that the response variable is binomial. The result is the impact of each variable on the odds ratio of the observed event of interest....

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2014.003

    authors: Sperandei S

    更新日期:2014-02-15 00:00:00

  • Determining biological variation of serum parathyroid hormone in healthy adults.

    abstract:Introduction:Measurement of parathyroid hormone (PTH) is essential in the investigation and management of calcium metabolism disorders. To assess the significance of any assay result when clinical decision making biological variation (BV) of the measurand must be taken into consideration. The aim of the present study i...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2019.030702

    authors: Ercan M,Akbulut ED,Avcı E,Yücel Ç,Oğuz EF,Turhan T,Serdar M

    更新日期:2019-10-15 00:00:00

  • The likelihood ratio and its graphical representation.

    abstract::Diagnostic tests are important clinical tools. Bayes' theorem and Bayesian approach are important methods for interpreting test results. The Bayesian factor, the so-called likelihood ratio, has not always been well-understood. In this article, we try to discuss the likelihood ratio and its value for a specific test re...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2019.020101

    authors: Habibzadeh F,Habibzadeh P

    更新日期:2019-06-15 00:00:00

  • Sigma metrics in laboratory medicine revisited: We are on the right road with the wrong map.

    abstract::Reliable procedures are needed to quantify the performance of instruments and methods in order to increase the quality in clinical laboratories. The Sigma metrics serves that purpose, and in the present study, the current methods for the calculation of the Sigma metrics are critically evaluated. Although the conventio...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2018.020503

    authors: Oosterhuis WP,Coskun A

    更新日期:2018-06-15 00:00:00

  • Reference intervals for six salivary cortisol measures based on the Croatian Late Adolescence Stress Study (CLASS).

    abstract:Introduction:The aim of this nested study is to provide the reference intervals for already published measurements of salivary cortisol from the Croatian Adolescence Stress Study (CLASS). Material and methods:A total of 969 individuals (372 males and 597 females) were included in the reference sample (age range: 18-21...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2018.010902

    authors: Šupe-Domić D,Milas G,Stanišić L,Drmić Hofman I,Martinović Klarić I

    更新日期:2018-02-15 00:00:00

  • Test validation, method comparison and reference range for the measurement of β-hydroxybutyrate in peripheral blood samples.

    abstract:Introduction:The measurement of β-hydroxybutyrate (βOHB) concentrations is a corner stone of the diagnosis of diabetic ketoacidosis and other ketonic states. The aim of this study was to perform a validation of a peripheral blood βOHB assay (Randox) on a Roche cobas c502 analyser and to establish a βOHB reference range...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2020.010707

    authors: Kraus FB,Kocijancic M,Kluttig A,Ludwig-Kraus B

    更新日期:2020-02-15 00:00:00

  • The chi-square test of independence.

    abstract::The Chi-square statistic is a non-parametric (distribution free) tool designed to analyze group differences when the dependent variable is measured at a nominal level. Like all non-parametric statistics, the Chi-square is robust with respect to the distribution of the data. Specifically, it does not require equality o...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/bm.2013.018

    authors: McHugh ML

    更新日期:2013-01-01 00:00:00

  • Redefinition of gestational diabetes mellitus: implications for laboratory practice in Croatia.

    abstract::An increasing prevalence of gestational diabetes has become a very challenging task in prenatal care worldwide. International Association of Diabetes and Pregnancy Study Groups (IADPSG) has recently issued recommendations on the diagnosis and classification of hyperglycaemia in pregnancy. These recommendations, the fi...

    journal_title:Biochemia medica

    pub_type: 社论

    doi:10.11613/bm.2013.002

    authors: Lovrencić MV,Honović L,Kralik S,Matica J,Prasek M,Pape-Medvidović E,Ivanisević M,Delmis J

    更新日期:2013-01-01 00:00:00

  • Eosinophil cationic protein--current concepts and controversies.

    abstract::Eosinophil cationic protein (ECP) is a heterogeneous molecule originating from activated eosinophil granulocytes. Biological activity and the cellular content of ECP are determined by genetic and posttranslational factors. Several single nucleotide polymorphisms (SNPs) in human ECP gene (RNASE3) have been described so...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/bm.2011.019

    authors: Topic RZ,Dodig S

    更新日期:2011-01-01 00:00:00

  • External Quality Assessment in Croatia: problems, challenges, and specific circumstances.

    abstract::In Croatian medical laboratories (ML), external quality assessment (EQA) has a long tradition of almost half of a century. At national level, EQA is provided by Croatian Centre for Quality Assessment in Laboratory Medicine (CROQALM) which is a part of Croatian Society of Medical Biochemistry and Laboratory Medicine.
T...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2017.011

    authors: Krleza JL,Celap I,Tanaskovic JV

    更新日期:2017-02-15 00:00:00

  • Laboratory diagnostics of chronic kidney disease in Croatia: state of the art.

    abstract:INTRODUCTION:Early identification and management of chronic kidney disease (CKD) is highly cost-effective and can reduce the risk of kidney failure progression and cardiovascular disease. In 2014, the Joint Croatian Working Group (JCWG) for laboratory diagnostic of CKD on the behalf of Croatian society of medical bioch...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2015.009

    authors: Biljak VR,Honović L,Matica J,Knežević B,Vojak SŠ

    更新日期:2015-01-01 00:00:00

  • Using clinical guidelines to assess the potential value of laboratory medicine in clinical decision-making.

    abstract:Introduction:It is often quoted that 70% of clinical decisions are based on laboratory results, but the evidence to substantiate this claim is lacking. Since clinical guidelines aim to document best-practice decision making for specific disease conditions, inclusion of any laboratory test means that the best available ...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2021.010703

    authors: Hicks AJ,Carwardine ZL,Hallworth MJ,Kilpatrick ES

    更新日期:2021-02-15 00:00:00

  • Scientific author names: errors, corrections, and identity profiles.

    abstract::Authorship problems are deep-rooted in the field of science communication. Some of these relate to lack of specific journal instructions. For decades, experts in journal editing and publishing have been exploring the authorship criteria and contributions deserving either co-authorship or acknowledgment. The issue of i...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2016.017

    authors: Gasparyan AY,Yessirkepov M,Gerasimov AN,Kostyukova EI,Kitas GD

    更新日期:2016-01-01 00:00:00

  • Classical pathway activity C3c, C4 and C1-inhibitor protein reference intervals determination in EDTA plasma.

    abstract:Introduction:Reference intervals (RIs) for complement assays in EDTA plasma samples have not previously been published. The objectives of the present study were to validate and/or determine RIs for classical pathway (CP50) activity and C3c, C4 and C1 inhibitor protein (C1INH) assays and to assess the need for age-speci...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2019.030707

    authors: Lopez B,Bertier N,Ledoult E,Joudinaud R,Maanaoui M,Majerus V,Moitrot E,Deleplancque AS,Rogeau S,Launay D,Lefèvre G,Labalette M,Dubucquoi S

    更新日期:2019-10-15 00:00:00

  • Detection of acute kidney injury in premature asphyxiated neonates by serum neutrophil gelatinase-associated lipocalin (sNGAL)--sensitivity and specificity of a potential new biomarker.

    abstract:INTRODUCTION:Acute kidney injury (AKI) is common in neonatal intensive care units (NICU). In recent years, every effort is made for early detection of AKI. Our hypothesis was that serum neutrophil gelatinase-associated lipocalin (sNGAL) may be a reliable screening test for early diagnosis of AKI in premature neonates a...

    journal_title:Biochemia medica

    pub_type: 临床试验,杂志文章

    doi:10.11613/BM.2015.046

    authors: Pejović B,Erić-Marinković J,Pejović M,Kotur-Stevuljević J,Peco-Antić A

    更新日期:2015-10-15 00:00:00

  • Evaluating analytical quality in clinical biochemistry laboratory using Six Sigma.

    abstract:Introduction:In recent years, Six Sigma metrics has became the hotspot in all trades and professions, which contributes a general procedure to explain the performance on sigma scale. Nowadays, many large companies, such as General Healthcare, Siemens, etc., have applied Six Sigma to clinical medicine and achieved satis...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2018.020904

    authors: Mao X,Shao J,Zhang B,Wang Y

    更新日期:2018-06-15 00:00:00

  • Indications for laboratory tests in primary care: assessment of the most frequent indications and requests with blank clinical information.

    abstract:INTRODUCTION:The aim of this work is twofold. Firstly, to study the temporal evolution in the number of laboratory requests from primary care without clinical indication, and to analyse the number of such requests before and after the implementation of an automated requesting procedure. Secondly, to investigate what ar...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2016.045

    authors: Salinas M,López-Garrigós M,Flores E,Leiva-Salinas M,Esteban P,Ahumada M,Leiva-Salinas C

    更新日期:2016-10-15 00:00:00

  • Oxidative status parameters in children with urinary tract infection.

    abstract:INTRODUCTION:Urinary tract infection (UTI) is one of the most common bacterial infectious diseases in children. The aim of this study was to determine the total prooxidant and antioxidant capacity of children with UTI, as well as changes of oxidative status parameters according to acute inflammation persistence and acu...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2014.029

    authors: Petrovic S,Bogavac-Stanojevic N,Kotur-Stevuljevic J,Peco-Antic A,Ivanisevic I,Ivanisevic J,Paripovic D,Jelic-Ivanovic Z

    更新日期:2014-01-01 00:00:00

  • Effectiveness of citrate buffer-fluoride mixture in Terumo tubes as an inhibitor of in vitro glycolysis.

    abstract:INTRODUCTION:Glycolysis affects glucose determination in vitro. The placement of sample tubes in ice-water slurry with plasma separation within 30 minutes is recommended, or alternatively the use of a glycolysis inhibitor. The aim of our two-steps study was to evaluate which Terumo tube is best for glucose determinatio...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2016.006

    authors: Bonetti G,Carta M,Montagnana M,Lo Cascio C,Bonfigli AR,Mosca A,Testa R,Italian joint SIBioC-SIPMeL Study Group on Diabetes Mellitus.

    更新日期:2016-01-01 00:00:00

  • How to conduct External Quality Assessment Schemes for the pre-analytical phase?

    abstract::In laboratory medicine, several studies have described the most frequent errors in the different phases of the total testing process, and a large proportion of these errors occur in the pre-analytical phase. Schemes for registration of errors and subsequent feedback to the participants have been conducted for decades ...

    journal_title:Biochemia medica

    pub_type: 杂志文章,评审

    doi:10.11613/BM.2014.013

    authors: Kristensen GB,Aakre KM,Kristoffersen AH,Sandberg S

    更新日期:2014-02-15 00:00:00

  • Additional technician tasks and turnaround time in the clinical Stat laboratory.

    abstract:INTRODUCTION:Many additional tasks in the Stat laboratory (SL) increase the workload. It is necessary to control them because they can affect the service provided by the laboratory. Our aim is to calculate these tasks, study their evolution over a 10 year period, and compare turnaround times (TAT) in summer period to t...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2016.027

    authors: Salinas M,López-Garrigós M,Flores E,Leiva-Salinas M,Lillo R,Leiva-Salinas C

    更新日期:2016-01-01 00:00:00

  • Utility of routine laboratory preoperative tests based on previous results: Time to give up.

    abstract:INTRODUCTION:The usefulness and cost-effectiveness of routine laboratory preoperative tests (POTs) have been challenged recently. In fact, the American Society of Anesthesiologists (ASA) Task Force has stated that test results obtained from the medical record within 6 months of surgery generally are mostly acceptable. ...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2017.030902

    authors: Rodríguez-Borja E,Corchon-Peyrallo A,Aguilar-Aguilar G,Carratala-Calvo A

    更新日期:2017-10-15 00:00:00

  • A paradigmatic case of haemolysis and pseudohyperkalemia in blood gas analysis.

    abstract::A 51-year old male patient was admitted to the hospital with acute dyspnea and history of chronic asthma. Venous blood was drawn into a 3.0 mL heparinized syringe and delivered to the laboratory for blood gas analysis (GEM Premier 4000, Instrumentation Laboratory), which revealed high potassium value (5.2 mmol/L; refe...

    journal_title:Biochemia medica

    pub_type:

    doi:10.11613/BM.2019.011003

    authors: Salvagno GL,Demonte D,Lippi G

    更新日期:2019-02-15 00:00:00

  • Optimizing laboratory defined macroprolactin algorithm.

    abstract:Introduction:Macroprolactinaemia is a well-known analytical problem in diagnostics of hyperprolactinaemia usually detected with polyethylene glycol (PEG) precipitation method. Since there is no harmonization in macroprolactin detection and reporting results, this study proposes and evaluates the usefulness of in-house ...

    journal_title:Biochemia medica

    pub_type: 杂志文章

    doi:10.11613/BM.2019.020706

    authors: Šostarić M,Bokulić A,Marijančević D,Zec I

    更新日期:2019-06-15 00:00:00