Estimating diagnostic accuracy of raters without a gold standard by exploiting a group of experts.

Abstract:

:In diagnostic medicine, estimating the diagnostic accuracy of a group of raters or medical tests relative to the gold standard is often the primary goal. When a gold standard is absent, latent class models where the unknown gold standard test is treated as a latent variable are often used. However, these models have been criticized in the literature from both a conceptual and a robustness perspective. As an alternative, we propose an approach where we exploit an imperfect reference standard with unknown diagnostic accuracy and conduct sensitivity analysis by varying this accuracy over scientifically reasonable ranges. In this article, a latent class model with crossed random effects is proposed for estimating the diagnostic accuracy of regional obstetrics and gynaecological (OB/GYN) physicians in diagnosing endometriosis. To avoid the pitfalls of models without a gold standard, we exploit the diagnostic results of a group of OB/GYN physicians with an international reputation for the diagnosis of endometriosis. We construct an ordinal reference standard based on the discordance among these international experts and propose a mechanism for conducting sensitivity analysis relative to the unknown diagnostic accuracy among them. A Monte Carlo EM algorithm is proposed for parameter estimation and a BIC-type model selection procedure is presented. Through simulations and data analysis we show that this new approach provides a useful alternative to traditional latent class modeling approaches used in this setting.

journal_name

Biometrics

journal_title

Biometrics

authors

Zhang B,Chen Z,Albert PS

doi

10.1111/j.1541-0420.2012.01789.x

subject

Has Abstract

pub_date

2012-12-01 00:00:00

pages

1294-302

issue

4

eissn

0006-341X

issn

1541-0420

journal_volume

68

pub_type

杂志文章
  • Assessing reproducibility by the within-subject coefficient of variation with random effects models.

    abstract::In this paper we consider the use of within-subject coefficient of variation (WCV) for assessing the reproducibility or reliability of a measurement. Application to assessing reproducibility of biochemical markers for measuring bone turnover is described and the comparison with intraclass correlation is discussed. Bot...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Quan H,Shih WJ

    更新日期:1996-12-01 00:00:00

  • Operating characteristics of a rank correlation test for publication bias.

    abstract::An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Begg CB,Mazumdar M

    更新日期:1994-12-01 00:00:00

  • On symmetric semiparametric two-sample problem.

    abstract::We consider a two-sample problem where data come from symmetric distributions. Usual two-sample data with only magnitudes recorded, arising from case-control studies or logistic discriminant analyses, may constitute a symmetric two-sample problem. We propose a semiparametric model such that, in addition to symmetry, t...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/biom.13233

    authors: Li M,Diao G,Qin J

    更新日期:2020-12-01 00:00:00

  • Objective Bayesian search of Gaussian directed acyclic graphical models for ordered variables with non-local priors.

    abstract::Directed acyclic graphical (DAG) models are increasingly employed in the study of physical and biological systems to model direct influences between variables. Identifying the graph from data is a challenging endeavor, which can be more reasonably tackled if the variables are assumed to satisfy a given ordering; in th...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/biom.12018

    authors: Altomare D,Consonni G,La Rocca L

    更新日期:2013-06-01 00:00:00

  • Nonparametric analysis of covariance by matching.

    abstract::The basic problem under consideration is the comparison of treatments with respect to a response Y when a covariable X is taken into account. Various methods involving matching may be regarded as compromises between the standard analysis of covariance and the standard analysis of independent matched pairs. First, ther...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Quade D

    更新日期:1982-09-01 00:00:00

  • Prediction of random effects in linear and generalized linear models under model misspecification.

    abstract::Statistical models that include random effects are commonly used to analyze longitudinal and correlated data, often with the assumption that the random effects follow a Gaussian distribution. Via theoretical and numerical calculations and simulation, we investigate the impact of misspecification of this distribution o...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2010.01435.x

    authors: McCulloch CE,Neuhaus JM

    更新日期:2011-03-01 00:00:00

  • On assessing interrater agreement for multiple attribute responses.

    abstract::New methods are developed for assessing the extent of interrater agreement when each unit to be rated is characterized by a (possibly empty) subset of a specified set of distinct nominal attributes. For such multiple attribute response data, a two-rater concordance statistic is derived, and associated statistical infe...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Kupper LL,Hafner KB

    更新日期:1989-09-01 00:00:00

  • False discovery rate estimation for frequentist pharmacovigilance signal detection methods.

    abstract::Pharmacovigilance systems aim at early detection of adverse effects of marketed drugs. They maintain large spontaneous reporting databases for which several automatic signaling methods have been developed. One limit of those methods is that the decision rules for the signal generation are based on arbitrary thresholds...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2009.01262.x

    authors: Ahmed I,Dalmasso C,Haramburu F,Thiessard F,Broët P,Tubert-Bitter P

    更新日期:2010-03-01 00:00:00

  • Two-stage method of estimation for general linear growth curve models.

    abstract::We extend the linear random-effects growth curve model (REGCM) (Laird and Ware, 1982, Biometrics 38, 963-974) to study the effects of population covariates on one or more characteristics of the growth curve when the characteristics are expressed as linear combinations of the growth curve parameters. This definition in...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Stukel TA,Demidenko E

    更新日期:1997-06-01 00:00:00

  • A strategy for dose-finding and safety monitoring based on efficacy and adverse outcomes in phase I/II clinical trials.

    abstract::We propose a design strategy for single-arm clinical trials in which the goals are to find a dose of an experimental treatment satisfying both safety and efficacy requirements, treat a sufficiently large number of patients to estimate the rates of these events at the selected dose with a given reliability, and stop th...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Thall PF,Russell KE

    更新日期:1998-03-01 00:00:00

  • Case-control studies of gene-environment interaction: Bayesian design and analysis.

    abstract::With increasing frequency, epidemiologic studies are addressing hypotheses regarding gene-environment interaction. In many well-studied candidate genes and for standard dietary and behavioral epidemiologic exposures, there is often substantial prior information available that may be used to analyze current data as wel...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2009.01357.x

    authors: Mukherjee B,Ahn J,Gruber SB,Ghosh M,Chatterjee N

    更新日期:2010-09-01 00:00:00

  • Regression dilution in the proportional hazards model.

    abstract::The problem of regression dilution arising from covariate measurement error is investigated for survival data using the proportional hazards model. The naive approach to parameter estimation is considered whereby observed covariate values are used, inappropriately, in the usual analysis instead of the underlying covar...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Hughes MD

    更新日期:1993-12-01 00:00:00

  • Asymptotic confidence bands for generalized nonlinear regression models.

    abstract::Asymptotic confidence bands for generalized nonlinear regression models are developed. These are based on a combination of the S method of Scheffe, together with the delta method which is used to approximate the mean function by a linear combination of the parameters. The approach can be used in any situation where la...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Cox C,Ma G

    更新日期:1995-03-01 00:00:00

  • A group sequential procedure for all-pairwise comparisons of k treatments based on the range statistic.

    abstract::In this paper, a group sequential procedure for all-private comparisons of the means of k independent normal populations with a common known variance is proposed. A repeated range test is defined and its critical points are tabulated. The power function is studied and minimum group size needed to achieve a desirable p...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Liu W

    更新日期:1995-09-01 00:00:00

  • Large scale maximum average power multiple inference on time-course count data with application to RNA-seq analysis.

    abstract::Experiments that longitudinally collect RNA sequencing (RNA-seq) data can provide transformative insights in biology research by revealing the dynamic patterns of genes. Such experiments create a great demand for new analytic approaches to identify differentially expressed (DE) genes based on large-scale time-course c...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/biom.13144

    authors: Cao M,Zhou W,Breidt FJ,Peers G

    更新日期:2020-03-01 00:00:00

  • Sequential construction of multiple-objective optimal designs.

    abstract::We propose a sequential approach for constructing multiple-objective locally optimal designs for nonlinear models. The technique used here is a general one and we demonstrate the added benefits of using a multiple-objective design over a single-objective design with examples from biomedical studies. ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Huang YC,Wong WK

    更新日期:1998-12-01 00:00:00

  • Assessing the goodness-of-fit of hidden Markov models.

    abstract::In this article, we propose a graphical technique for assessing the goodness-of-fit of a stationary hidden Markov model (HMM). We show that plots of the estimated distribution against the empirical distribution detect lack of fit with high probability for large sample sizes. By considering plots of the univariate and ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.0006-341X.2004.00189.x

    authors: MacKay Altman R

    更新日期:2004-06-01 00:00:00

  • A score regression approach to assess calibration of continuous probabilistic predictions.

    abstract::Calibration, the statistical consistency of forecast distributions and the observations, is a central requirement for probabilistic predictions. Calibration of continuous forecasts is typically assessed using the probability integral transform histogram. In this article, we propose significance tests based on scoring ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2010.01406.x

    authors: Held L,Rufibach K,Balabdaoui F

    更新日期:2010-12-01 00:00:00

  • Regression analysis of multivariate grouped survival data.

    abstract::Multivariate failure time data arise when each study subject may experience several types of event or when there are clusterings of observational units such that failure times within the same cluster are correlated. The failure times are often subject to interval grouping or have truly discrete measurements. In this p...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Guo SW,Lin DY

    更新日期:1994-09-01 00:00:00

  • Permutation tests for random effects in linear mixed models.

    abstract::Inference regarding the inclusion or exclusion of random effects in linear mixed models is challenging because the variance components are located on the boundary of their parameter space under the usual null hypothesis. As a result, the asymptotic null distribution of the Wald, score, and likelihood ratio tests will ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2011.01675.x

    authors: Lee OE,Braun TM

    更新日期:2012-06-01 00:00:00

  • Likelihood-ratio tests for hidden Markov models.

    abstract::We consider hidden Markov models as a versatile class of models for weakly dependent random phenomena. The topic of the present paper is likelihood-ratio testing for hidden Markov models, and we show that, under appropriate conditions, the standard asymptotic theory of likelihood-ratio tests is valid. Such tests are c...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.0006-341x.2000.00742.x

    authors: Giudici P,Rydén T,Vandekerkhove P

    更新日期:2000-09-01 00:00:00

  • Fair regression for health care spending.

    abstract::The distribution of health care payments to insurance plans has substantial consequences for social policy. Risk adjustment formulas predict spending in health insurance markets in order to provide fair benefits and health care coverage for all enrollees, regardless of their health status. Unfortunately, current risk ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/biom.13206

    authors: Zink A,Rose S

    更新日期:2020-09-01 00:00:00

  • Propensity score matching and subclassification in observational studies with multi-level treatments.

    abstract::In this article, we develop new methods for estimating average treatment effects in observational studies, in settings with more than two treatment levels, assuming unconfoundedness given pretreatment variables. We emphasize propensity score subclassification and matching methods which have been among the most popular...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/biom.12505

    authors: Yang S,Imbens GW,Cui Z,Faries DE,Kadziola Z

    更新日期:2016-12-01 00:00:00

  • Combined maximum likelihood estimates for the equicorrelation coefficient.

    abstract::Combined maximum likelihood estimates for equicorrelation covariance matrices are considered. The case of a common equicorrelation rho and possibly different standard deviations sigma 1, ..., sigma k among k experimental groups is examined first, and the estimation of (rho, sigma 1, ..., sigma k) is discussed. Second,...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Viana MA

    更新日期:1994-09-01 00:00:00

  • Testing for cubic smoothing splines under dependent data.

    abstract::In most research on smoothing splines the focus has been on estimation, while inference, especially hypothesis testing, has received less attention. By defining design matrices for fixed and random effects and the structure of the covariance matrices of random errors in an appropriate way, the cubic smoothing spline a...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2010.01537.x

    authors: Nummi T,Pan J,Siren T,Liu K

    更新日期:2011-09-01 00:00:00

  • Incorporating correlation for multivariate failure time data when cluster size is large.

    abstract::We propose a new estimation method for multivariate failure time data using the quadratic inference function (QIF) approach. The proposed method efficiently incorporates within-cluster correlations. Therefore, it is more efficient than those that ignore within-cluster correlation. Furthermore, the proposed method is e...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.1541-0420.2009.01307.x

    authors: Xue L,Wang L,Qu A

    更新日期:2010-06-01 00:00:00

  • A disequilibrium coefficient approach to Hardy-Weinberg testing.

    abstract::A comparison was made of various tests for Hardy-Weinberg equilibrium, with emphasis on methods for multiple alleles. For an overall test of deviations from equilibrium, the classical chi-square goodness-of-fit test generally performs well, with continuity corrections needed for extreme gene frequencies or extreme dep...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Hernández JL,Weir BS

    更新日期:1989-03-01 00:00:00

  • Use of historical marker data for assessing treatment effects in phase I/II trials when subject selection is determined by baseline marker level.

    abstract::Although the primary focus of Phase I clinical trials is to assess clinical pharmacology and possible toxicities, any information on the potential effect of treatment would be useful in helping to determine priorities between treatments for further study. We consider the scenario where data are routinely collected on ...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Lin HM,Hughes MD

    更新日期:1995-09-01 00:00:00

  • A marginal mixed baseline hazards model for multivariate failure time data.

    abstract::In multivariate failure time data analysis, a marginal regression modeling approach is often preferred to avoid assumptions on the dependence structure among correlated failure times. In this paper, a marginal mixed baseline hazards model is introduced. Estimating equations are proposed for the estimation of the margi...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:10.1111/j.0006-341x.1999.00805.x

    authors: Clegg LX,Cai J,Sen PK

    更新日期:1999-09-01 00:00:00

  • Regression estimator in ranked set sampling.

    abstract::Ranked set sampling (RSS) utilizes inexpensive auxiliary information about the ranking of the units in a sample to provide a more precise estimator of the population mean of the variable of interest Y, which is either difficult or expensive to measure. However, the ranking may not be perfect in most situations. In thi...

    journal_title:Biometrics

    pub_type: 杂志文章

    doi:

    authors: Yu PL,Lam K

    更新日期:1997-09-01 00:00:00