Assessing the reliability of ordered categorical scales using kappa-type statistics.

Abstract:

:Methods for the analysis of reliability of ordered categorical scales are discussed, focussing on the limitation of the single summary-weighted kappa coefficients. A symmetric matrix of kappa-type coefficients is suggested as an alternative. The method is proposed as being suitable for ordinal scale where there is no underlying continuum. Their application is illustrated using two data sets from reliability studies. If, instead, distances between categories can be specified, a weighted mean of the matrix terms can be used as a summary measure. This is equal to a weighted kappa coefficient with squared weights, provided distances between adjacent categories are equal. When a study design corresponds to a one-way random effects model, estimates of precision of kappa-type coefficient, including the coefficients described here, can be obtained using the delta-method, bootstrap resampling by subjects or jack-knifing by subjects. In the case of interobserver reliability studies, where there may be systematic differences between observers, the investigator may wish to generalise to a population of observers and subjects. In this case, jack-knifing by observer and subject is suggested. Empirical comparisons are made between standard error estimates based on the delta-method, on jack-knifing by subjects and a two-way jack-knife by subjects and observers. The results suggest that standard errors based on the delta-method or jack-knifing by subject alone may be overly precise.

journal_name

Stat Methods Med Res

authors

Roberts C,McNamee R

doi

10.1191/0962280205sm413oa

subject

Has Abstract

pub_date

2005-10-01 00:00:00

pages

493-514

issue

5

eissn

0962-2802

issn

1477-0334

journal_volume

14

pub_type

杂志文章
  • Parametric models for incomplete continuous and categorical longitudinal data.

    abstract::This paper reviews models for incomplete continuous and categorical longitudinal data. In terms of Rubin's classification of missing value processes we are specifically concerned with the problem of nonrandom missingness. A distinction is drawn between the classes of selection and pattern-mixture models and, using sev...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章,评审

    doi:10.1177/096228029900800105

    authors: Kenward MG,Molenberghs G

    更新日期:1999-03-01 00:00:00

  • Joint latent class models for longitudinal and time-to-event data: a review.

    abstract::Most statistical developments in the joint modelling area have focused on the shared random-effect models that include characteristics of the longitudinal marker as predictors in the model for the time-to-event. A less well-known approach is the joint latent class model which consists in assuming that a latent class s...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章,评审

    doi:10.1177/0962280212445839

    authors: Proust-Lima C,Séne M,Taylor JM,Jacqmin-Gadda H

    更新日期:2014-02-01 00:00:00

  • Long-term frailty modeling using a non-proportional hazards model: Application with a melanoma dataset.

    abstract::The semiparametric Cox regression model is often fitted in the modeling of survival data. One of its main advantages is the ease of interpretation, as long as the hazards rates for two individuals do not vary over time. In practice the proportionality assumption of the hazards may not be true in some situations. In ad...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280219883905

    authors: Calsavara VF,Milani EA,Bertolli E,Tomazella V

    更新日期:2020-08-01 00:00:00

  • Expected p-values in light of an ROC curve analysis applied to optimal multiple testing procedures.

    abstract::Many statistical studies report p-values for inferential purposes. In several scenarios, the stochastic aspect of p-values is neglected, which may contribute to drawing wrong conclusions in real data experiments. The stochastic nature of p-values makes their use to examine the performance of given testing procedures o...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217704451

    authors: Vexler A,Yu J,Zhao Y,Hutson AD,Gurevich G

    更新日期:2018-12-01 00:00:00

  • Bayesian spatially dependent variable selection for small area health modeling.

    abstract::Statistical methods for spatial health data to identify the significant covariates associated with the health outcomes are of critical importance. Most studies have developed variable selection approaches in which the covariates included appear within the spatial domain and their effects are fixed across space. Howeve...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280215627184

    authors: Choi J,Lawson AB

    更新日期:2018-01-01 00:00:00

  • Change-point detection for infinite horizon dynamic treatment regimes.

    abstract::A dynamic treatment regime is a set of decision rules for how to treat a patient at multiple time points. At each time point, a treatment decision is made depending on the patient's medical history up to that point. We consider the infinite-horizon setting in which the number of decision points is very large. Specific...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217708655

    authors: Goldberg Y,Pollak M,Mitelpunkt A,Orlovsky M,Weiss-Meilik A,Gorfine M

    更新日期:2017-08-01 00:00:00

  • Letter to the editor: Fitting truncated normal distributions.

    abstract::I comment here on a recent paper in this journal, on the fitting of truncated normal distributions by the EM algorithm. I show that the fitting of such distributions by direct numerical maximization of likelihood (rather than EM) is straightforward, contrary to an assertion made by the authors of that paper. ...

    journal_title:Statistical methods in medical research

    pub_type: 评论,信件

    doi:10.1177/0962280217712089

    authors: MacDonald IL

    更新日期:2018-12-01 00:00:00

  • Unconditional tests for comparing two ordered multinomials.

    abstract::We consider two exact unconditional procedures to test the difference between two multinomials with ordered categorical data. Exact unconditional procedures are compared to other approaches based on the Wilcoxon mid-rank test and the proportional odds model. We use a real example from an arthritis pain study to illust...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280212450957

    authors: Shan G,Ma C

    更新日期:2016-02-01 00:00:00

  • A mixed-effects, spatially varying coefficients model with application to multi-resolution functional magnetic resonance imaging data.

    abstract::Spatial resolution plays an important role in functional magnetic resonance imaging studies as the signal-to-noise ratio increases linearly with voxel volume. In scientific studies, where functional magnetic resonance imaging is widely used, the standard spatial resolution typically used is relatively low which ensure...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217752378

    authors: Liu Z,Bartsch AJ,Berrocal VJ,Johnson TD

    更新日期:2019-04-01 00:00:00

  • A multiphase non-linear mixed effects model: An application to spirometry after lung transplantation.

    abstract::In medical sciences, we often encounter longitudinal temporal relationships that are non-linear in nature. The influence of risk factors may also change across longitudinal follow-up. A system of multiphase non-linear mixed effects model is presented to model temporal patterns of longitudinal continuous measurements, ...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280214537255

    authors: Rajeswaran J,Blackstone EH

    更新日期:2017-02-01 00:00:00

  • Designs in partially controlled studies: messages from a review.

    abstract::The ability to evaluate effects of factors on outcomes is increasingly important for studies that control some but not all of the factors. Although important advances have been made in methods of analysis for such partially controlled studies, work on designs has been limited. To help understand why, we review the mai...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1191/0962280205sm405oa

    authors: Li F,Frangakis CE

    更新日期:2005-08-01 00:00:00

  • Analysis of phase II methodologies for single-arm clinical trials with multiple endpoints in rare cancers: An example in Ewing's sarcoma.

    abstract::Trials run in either rare diseases, such as rare cancers, or rare sub-populations of common diseases are challenging in terms of identifying, recruiting and treating sufficient patients in a sensible period. Treatments for rare diseases are often designed for other disease areas and then later proposed as possible tre...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280216662070

    authors: Dutton P,Love SB,Billingham L,Hassan AB

    更新日期:2018-05-01 00:00:00

  • Prospective analysis of infectious disease surveillance data using syndromic information.

    abstract::In this paper, we describe a Bayesian hierarchical Poisson model for the prospective analysis of data for infectious diseases. The proposed model consists of two components. The first component describes the behavior of disease during nonepidemic periods and the second component represents the increase in disease coun...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280214527385

    authors: Corberán-Vallet A,Lawson AB

    更新日期:2014-12-01 00:00:00

  • Causal mediation analysis with multiple causally non-ordered mediators.

    abstract::In many health studies, researchers are interested in estimating the treatment effects on the outcome around and through an intermediate variable. Such causal mediation analyses aim to understand the mechanisms that explain the treatment effect. Although multiple mediators are often involved in real studies, most of t...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280215615899

    authors: Taguri M,Featherstone J,Cheng J

    更新日期:2018-01-01 00:00:00

  • A Bayesian semiparametric approach with change points for spatial ordinal data.

    abstract::The change-point model has drawn much attention over the past few decades. It can accommodate the jump process, which allows for changes of the effects before and after the change point. Intellectual disability is a long-term disability that impacts performance in cognitive aspects of life and usually has its onset pr...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280212463415

    authors: Cai B,Lawson AB,McDermott S,Aelion CM

    更新日期:2016-04-01 00:00:00

  • Pseudo-observations in survival analysis.

    abstract::We review recent work on the application of pseudo-observations in survival and event history analysis. This includes regression models for parameters like the survival function in a single point, the restricted mean survival time and transition or state occupation probabilities in multi-state models, e.g. the competi...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章,评审

    doi:10.1177/0962280209105020

    authors: Andersen PK,Perme MP

    更新日期:2010-02-01 00:00:00

  • Correcting for non-participation bias in health surveys using record-linkage, synthetic observations and pattern mixture modelling.

    abstract::Surveys are key means of obtaining policy-relevant information not available from routine sources. Bias arising from non-participation is typically handled by applying weights derived from limited socio-demographic characteristics. This approach neither captures nor adjusts for differences in health and related behavi...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280219854482

    authors: Gray L,Gorman E,White IR,Katikireddi SV,McCartney G,Rutherford L,Leyland AH

    更新日期:2020-04-01 00:00:00

  • Everything all right in method comparison studies?

    abstract::Researchers and clinicians often need to know whether a new method of measurement is equivalent to an established one that is already in use. For this problem, the estimation of limits of agreement advocated by Bland and Altman is a widely used solution. However, this approach ignores two vital issues in method compar...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280210379365

    authors: Alanen E

    更新日期:2012-08-01 00:00:00

  • Semi-supervised identification of cancer subgroups using survival outcomes and overlapping grouping information.

    abstract::Identification of cancer patient subgroups using high throughput genomic data is of critical importance to clinicians and scientists because it can offer opportunities for more personalized treatment and overlapping treatments of cancers. In spite of tremendous efforts, this problem still remains challenging because o...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217752980

    authors: Wei W,Sun Z,da Silveira WA,Yu Z,Lawson A,Hardiman G,Kelemen LE,Chung D

    更新日期:2019-07-01 00:00:00

  • Testing hypotheses under adaptive randomization with continuous covariates in clinical trials.

    abstract::Covariate-adaptive designs are widely used to balance covariates and maintain randomization in clinical trials. Adaptive designs for discrete covariates and their asymptotic properties have been well studied in the literature. However, important continuous covariates are often involved in clinical studies. Simply disc...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280218770231

    authors: Li X,Zhou J,Hu F

    更新日期:2019-06-01 00:00:00

  • Hybrid test for publication bias in meta-analysis.

    abstract::Publication bias frequently appears in meta-analyses when the included studies' results (e.g., p-values) influence the studies' publication processes. Some unfavorable studies may be suppressed from publication, so the meta-analytic results may be biased toward an artificially favorable direction. Many statistical tes...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280220910172

    authors: Lin L

    更新日期:2020-10-01 00:00:00

  • A unified approach for assessing heterogeneity in age-period-cohort model parameters using random effects.

    abstract::Age-period-cohort models are a popular tool for studying population-level rates; for example, trends in cancer incidence and mortality. Age-period-cohort models decompose observed trends into age effects that correlate with natural history, period effects that reveal factors impacting all ages simultaneously (e.g. inn...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217713033

    authors: Chernyavskiy P,Little MP,Rosenberg PS

    更新日期:2019-01-01 00:00:00

  • Modelling of zero-inflation improves inference of metagenomic gene count data.

    abstract::Metagenomics enables the study of gene abundances in complex mixtures of microorganisms and has become a standard methodology for the analysis of the human microbiome. However, gene abundance data is inherently noisy and contains high levels of biological and technical variability as well as an excess of zeros due to ...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280218811354

    authors: Jonsson V,Österlund T,Nerman O,Kristiansson E

    更新日期:2019-12-01 00:00:00

  • Modeling fecundity in the presence of a sterile fraction using a semi-parametric transformation model for grouped survival data.

    abstract::The analysis of fecundity data is challenging and requires consideration of both highly timed and interrelated biologic processes in the context of essential behaviors such as sexual intercourse during the fertile window. Understanding human fecundity is further complicated by presence of a sterile population, i.e. co...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280212438646

    authors: McLain AC,Sundaram R,Buck Louis GM

    更新日期:2016-02-01 00:00:00

  • Stochastic models of sequence evolution including insertion-deletion events.

    abstract::Comparison of sequences that have descended from a common ancestor based on an explicit stochastic model of substitutions, insertions and deletions has risen to prominence in the last decade. Making statements about the positions of insertions-deletions (abbr. indels) is central in sequence and genome analysis and is ...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280208099500

    authors: Miklós I,Novák A,Satija R,Lyngsø R,Hein J

    更新日期:2009-10-01 00:00:00

  • Applications of temporal kernel canonical correlation analysis in adherence studies.

    abstract::Adherence to medication is often measured as a continuous outcome but analyzed as a dichotomous outcome due to lack of appropriate tools. In this paper, we illustrate the use of the temporal kernel canonical correlation analysis (tkCCA) as a method to analyze adherence measurements and symptom levels on a continuous s...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280215598805

    authors: John M,Lencz T,Ferbinteanu J,Gallego JA,Robinson DG

    更新日期:2017-10-01 00:00:00

  • Efficient two-stage sequential arrays of proof of concept studies for pharmaceutical portfolios.

    abstract::Previous work has shown that individual randomized "proof-of-concept" (PoC) studies may be designed to maximize cost-effectiveness, subject to an overall PoC budget constraint. Maximizing cost-effectiveness has also been considered for arrays of simultaneously executed PoC studies. Defining Type III error as the oppor...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280220958177

    authors: He L,Du L,Antonijevic Z,Posch M,Korostyshevskiy VR,Beckman RA

    更新日期:2020-09-21 00:00:00

  • An intuitive Bayesian spatial model for disease mapping that accounts for scaling.

    abstract::In recent years, disease mapping studies have become a routine application within geographical epidemiology and are typically analysed within a Bayesian hierarchical model formulation. A variety of model formulations for the latent level have been proposed but all come with inherent issues. In the classical BYM (Besag...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280216660421

    authors: Riebler A,Sørbye SH,Simpson D,Rue H

    更新日期:2016-08-01 00:00:00

  • Longitudinal prostate-specific antigen reference ranges: Choosing the underlying model of age-related changes.

    abstract::Serial measurements of prostate-specific antigen (PSA) are used as a biomarker for men diagnosed with prostate cancer following an active monitoring programme. Distinguishing pathological changes from natural age-related changes is not straightforward. Here, we compare four approaches to modelling age-related change i...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280213503928

    authors: Simpkin AJ,Metcalfe C,Martin RM,Lane JA,Donovan JL,Hamdy FC,Neal DE,Tilling K

    更新日期:2016-10-01 00:00:00

  • Interpretation of mixed models and marginal models with cohort attrition due to death and drop-out.

    abstract::Mixed models estimated by maximum likelihood and marginal models estimated by generalized estimating equations are the standard methods for the analysis of longitudinal data. However, their use is highly debated when attrition may be due to death. While some authors consider that mixed model estimates are interpretabl...

    journal_title:Statistical methods in medical research

    pub_type: 杂志文章

    doi:10.1177/0962280217723675

    authors: Rouanet A,Helmer C,Dartigues JF,Jacqmin-Gadda H

    更新日期:2019-02-01 00:00:00