A probabilistic model for the MRMC method, part 1: theoretical development.

Abstract:

RATIONALE AND OBJECTIVES:Current approaches to receiver operating characteristic (ROC) analysis use the MRMC (multiple-reader, multiple-case) paradigm in which several readers read each case and their ratings (or scores) are used to construct an estimate of the area under the ROC curve or some other ROC-related parameter. Standard practice is to decompose the parameter of interest according to a linear model into terms that depend in various ways on the readers, cases, and modalities. Though the methodologic aspects of MRMC analysis have been studied in detail, the literature on the probabilistic basis of the individual terms is sparse. In particular, few articles state what probability law applies to each term and what underlying assumptions are needed for the assumed independence. When probability distributions are specified for these terms, these distributions are assumed to be Gaussians. MATERIALS AND METHODS:This article approaches the MRMC problem from a mechanistic perspective. For a single modality, three sources of randomness are included: the images, the reader skill, and the reader uncertainty. The probability law on the reader scores is written in terms of three nested conditional probabilities, and random variables associated with this probability are referred to as triply stochastic. RESULTS:In this article, we present the probabilistic MRMC model and apply this model to the Wilcoxon statistic. The result is a seven-term expansion for the variance of the figure of merit. CONCLUSION:We relate the terms in this expansion to those in the standard, linear MRMC model. Finally, we use the probabilistic model to derive constraints on the coefficients in the seven-term expansion.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Clarkson E,Kupinski MA,Barrett HH

doi

10.1016/j.acra.2006.07.016

subject

Has Abstract

pub_date

2006-11-01 00:00:00

pages

1410-21

issue

11

eissn

1076-6332

issn

1878-4046

pii

S1076-6332(06)00413-2

journal_volume

13

pub_type

杂志文章
  • Subtraction CT angiography of the lower extremities: single volume subtraction versus multi-segmented volume subtraction.

    abstract:RATIONALE AND OBJECTIVES:To validate the hypothesis that a multisegmented approach during subtraction computed tomography (CT) angiography of the lower extremities can improve bone removal efficiency by suppressing regional motion. MATERIALS AND METHODS:The institutional review board of our hospital approved this retr...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.01.024

    authors: Lee IJ,Chung JW,Hong H,Yin YH,Kim S,Park EA,Lee W

    更新日期:2011-07-01 00:00:00

  • Optimal timing and diagnostic adequacy of hepatocyte phase imaging with gadoxetate-enhanced liver MRI.

    abstract:RATIONALE AND OBJECTIVES:To evaluate clinical and imaging features associated with adequacy of the hepatocyte phase (HP) in gadoxetate disodium-enhanced liver magnetic resonance imaging (MRI) in patients without chronic liver disease (CLD). MATERIALS AND METHODS:This was a retrospective institutional review board-appr...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.02.005

    authors: Bashir MR,Breault SR,Braun R,Do RK,Nelson RC,Reeder SB

    更新日期:2014-06-01 00:00:00

  • Diffusion-weighted magnetic resonance imaging of focal hepatic nodules in an experimental hepatocellular carcinoma rat model.

    abstract:RATIONALE AND OBJECTIVES:We sought to investigate the value of diffusion-weighted MR imaging in evaluating focal hepatic nodules in an experimental hepatocellular carcinoma (HCC) rat model. MATERIALS AND METHODS:Forty rats with chemically induced primary hepatic nodules ranging pathologically from regenerative nodules...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2006.12.005

    authors: Xu H,Li X,Xie JX,Yang ZH,Wang B

    更新日期:2007-03-01 00:00:00

  • Validation of the international labour office digitized standard images for recognition and classification of radiographs of pneumoconiosis.

    abstract:RATIONALE AND OBJECTIVES:Chest radiographs are recommended for prevention and detection of pneumoconiosis. In 2011, the International Labour Office (ILO) released a revision of the International Classification of Radiographs of Pneumoconioses that included a digitized standard images set. The present study compared res...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.11.019

    authors: Halldin CN,Petsonk EL,Laney AS

    更新日期:2014-03-01 00:00:00

  • Monitoring breast cancer response to neoadjuvant systemic chemotherapy using parametric contrast-enhanced MRI: a pilot study.

    abstract:RATIONALE AND OBJECTIVES:Neoadjuvant systemic therapy (NST) is the standard treatment for locally advanced breast cancer and a common option for primary operable disease. It is important to develop standardized imaging techniques that can monitor and quantify response to NST enabling treatment tailored to each individu...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.02.005

    authors: Chou CP,Wu MT,Chang HT,Lo YS,Pan HB,Degani H,Furman-Haran E

    更新日期:2007-05-01 00:00:00

  • Bronchial arterial response to contrast medium.

    abstract:RATIONALE AND OBJECTIVES:Contrast agents have been shown to produce vasodilatory responses in several vascular beds. To our knowledge, however, their effect on the bronchial vasculature has not been examined. Clinically, contrast-induced bronchial vasodilation could potentially exacerbate life-threatening pulmonary hem...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80700-7

    authors: Baile EM,Mayo JR,Sasaki F,Bai TR,Paré PD

    更新日期:1995-11-01 00:00:00

  • Seventy-Peak Kilovoltage High-Pitch Thoracic Aortic CT Angiography without ECG Gating: Evaluation of Image Quality and Radiation Dose.

    abstract:RATIONALE AND OBJECTIVES:To assess the feasibility of 70-kVp high-pitch non-ECG-gated thoracic aortic computed tomography angiography (CTA) with 40-mL contrast agent compared to 100-kVp standard-pitch CTA with 60-mL contrast agent. MATERIALS AND METHODS:Sixty-seven patients (51 men and 16 women; mean age, 55 ± 14 year...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2015.03.007

    authors: Zhang LJ,Zhao YE,Schoepf UJ,Mangold S,Felmly LM,Li X,Tang CX,Zhou CS,Qi L,Lu GM

    更新日期:2015-07-01 00:00:00

  • Theory-based signal calibration with single-point T1 measurements for first-pass quantitative perfusion MRI studies.

    abstract:RATIONALE AND OBJECTIVES:The aim of the study is to develop a theory-based signal calibration approach to be used for the conversion of signal-time curves to absolute contrast concentration-time curves for first-pass contrast-enhanced quantitative myocardial perfusion studies. MATERIALS AND METHODS:A normalization pro...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2006.02.040

    authors: Cernicanu A,Axel L

    更新日期:2006-06-01 00:00:00

  • Grand rounds and a visiting professorship program in a department of radiology: how we do it.

    abstract::We discuss the benefits of maintaining an active, rigorous, and highly structured grand rounds (GR) program in an academic radiology department. These benefits include education for faculty (continuing medical education), fellows, and residents and a venue for building collaboration and camaraderie within the departme...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.08.003

    authors: Tridandapani S,Mullins ME,Meltzer CC

    更新日期:2012-11-01 00:00:00

  • Intraarterial biocompatibility of polyethylene terephthalate self-expandable stents implanted in porcine peripheral arteries.

    abstract:RATIONALE AND OBJECTIVES:We tested deployment feasibility and intraarterial biocompatibility of polyethylene terephthalate (PET) self-expandable vascular stents in a porcine peripheral artery model. METHODS:To assess the thrombogenicity and neointimal response to oversized PET self-expandable stents, we implanted 10 s...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/S1076-6332(05)80151-5

    authors: De Scheerder IK,Wilczek KV,Verbeken EV,Barios L,Piessens J,De Geest H

    更新日期:1995-02-01 00:00:00

  • Mesoscopic fluorescence tomography of a photosensitizer (HPPH) 3D biodistribution in skin cancer.

    abstract:RATIONALE AND OBJECTIVES:Photodynamic therapy (PDT) is a promising strategy for treating cancer. PDT involves three components: a photosensitizer (PS) drug, a specific wavelength of drug-activating light, and oxygen. A challenge in PDT is the unknown biodistribution of the PS in the target tissue. In this preliminary s...

    journal_title:Academic radiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.acra.2013.11.009

    authors: Ozturk MS,Rohrbach D,Sunar U,Intes X

    更新日期:2014-02-01 00:00:00

  • Establishing a gold standard for test sets: variation in interpretive agreement of expert mammographers.

    abstract:RATIONALE AND OBJECTIVES:Test sets for assessing and improving radiologic image interpretation have been used for decades and typically evaluate performance relative to gold standard interpretations by experts. To assess test sets for screening mammography, a gold standard for whether a woman should be recalled for add...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.01.012

    authors: Onega T,Anderson ML,Miglioretti DL,Buist DS,Geller B,Bogart A,Smith RA,Sickles EA,Monsees B,Bassett L,Carney PA,Kerlikowske K,Yankaskas BC

    更新日期:2013-06-01 00:00:00

  • Image artifacts on prostate diffusion-weighted magnetic resonance imaging: trade-offs at 1.5 Tesla and 3.0 Tesla.

    abstract:RATIONALE AND OBJECTIVES:To identify the presence and extent of artifacts in prostate diffusion-weighted magnetic resonance imaging (DW-MRI) and discuss tradeoffs between imaging at 1.5 T (1.5 T) and 3.0 T (3.0 T). In addition, we aim to provide quantitative estimates of signal-to-noise ratios (SNRs) at both field stre...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.04.005

    authors: Mazaheri Y,Vargas HA,Nyman G,Akin O,Hricak H

    更新日期:2013-08-01 00:00:00

  • Minimized Radiation and Contrast Agent Exposure for Coronary Computed Tomography Angiography: First Clinical Experience on a Latest Generation 256-slice Scanner.

    abstract:RATIONALE AND OBJECTIVES:The aim of the study was to evaluate the impact of the latest coronary computed tomography angiography (CCTA) techniques allowing a radiation- and contrast-sparing protocol on image quality in unselected patients referred for exclusion of suspected coronary artery disease (CAD). MATERIALS AND ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.03.015

    authors: Benz DC,Gräni C,Hirt Moch B,Mikulicic F,Vontobel J,Fuchs TA,Stehli J,Clerc OF,Possner M,Pazhenkottil AP,Gaemperli O,Buechel RR,Kaufmann PA

    更新日期:2016-08-01 00:00:00

  • Corona Virus International Public Health Emergencies: Implications for Radiology Management.

    abstract::The outbreak of 2019 novel coronavirus (2019-nCoV) pneumonia was reported in Wuhan, Hubei Province, China in December 2019 and has spread internationally. This article discusses how radiology departments can most effectively respond to this public health emergency. ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.02.003

    authors: Zhang HW,Yu J,Xu HJ,Lei Y,Pu ZH,Dai WC,Lin F,Wang YL,Wu XL,Liu LH,Li M,Mo YQ,Zhang H,Luo SP,Chen H,Lyu GW,Zhou ZG,Liu WM,Liu XL,Song HY,Chen FZ,Zeng L,Zhong H,Guo TT,Hu YQ,Yang XX,Liu PN,Li DF

    更新日期:2020-04-01 00:00:00

  • Radiology faculty evaluation: bi-institutional implementation of an experimental appraisal instrument.

    abstract:RATIONALE AND OBJECTIVES:The authors evaluated the reliability and validity of an experimental radiology faculty appraisal instrument. MATERIALS AND METHODS:Residents from the University of Wisconsin (UW) and Indiana University (IU) were asked to use a previously developed behaviorally based, 53-item experimental facu...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(98)80266-3

    authors: Collins J,Albanese MA,Scanlan KA,Propeck PA,Jackson VP

    更新日期:1998-11-01 00:00:00

  • Iodixanol and ioxaglate in adult aortography and peripheral arteriography: a phase III clinical trial.

    abstract:RATIONALE AND OBJECTIVES:This study compared the safety and efficacy of iodixanol with those of ioxaglate in adult patients undergoing aortography or peripheral arteriography. METHODS:Forty-six patients were enrolled in this controlled, randomized, double-blind, two-center study. The patients were monitored for advers...

    journal_title:Academic radiology

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1016/s1076-6332(05)80368-x

    authors: Rosenblum JD,Siegel EL,Leef J,Eckard DA,Lu CT

    更新日期:1996-09-01 00:00:00

  • Correlation Between Screening Mammography Interpretive Performance on a Test Set and Performance in Clinical Practice.

    abstract:RATIONALE AND OBJECTIVES:Evidence is inconsistent about whether radiologists' interpretive performance on a screening mammography test set reflects their performance in clinical practice. This study aimed to estimate the correlation between test set and clinical performance and determine if the correlation is influence...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2017.03.016

    authors: Miglioretti DL,Ichikawa L,Smith RA,Buist DSM,Carney PA,Geller B,Monsees B,Onega T,Rosenberg R,Sickles EA,Yankaskas BC,Kerlikowske K

    更新日期:2017-10-01 00:00:00

  • Area beam equalization: optimization and performance of an automated prototype system for chest radiography.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the feasibility and performance of an x-ray beam equalization system for chest radiography using anthropomorphic phantoms. MATERIALS AND METHODS:Area beam equalization involves the process of the initial unequalized image acquisition, attenuator thickness calculation, mask generati...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)00730-x

    authors: Xu T,Shikhaliev PM,Berenji GR,Tehranzadeh J,Saremi F,Molloi S

    更新日期:2004-04-01 00:00:00

  • Optimal contrast agents for vascular imaging on computed tomography: iodixanol versus iohexol.

    abstract:RATIONALE AND OBJECTIVES:Dimeric nonionic iodinated contrast has a lower osmolality than monomeric nonionic iodinated contrast but is available at lower iodine concentrations. Less dilution of intravascular fluid by influx from the extravascular space is proposed to occur with decreasing osmolality. The purpose of this...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2005.01.015

    authors: Pannu HK,Thompson RE,Phelps J,Magee CA,Fishman EK

    更新日期:2005-05-01 00:00:00

  • Evaluation of clinical outcomes of antiangiogenic-targeted therapy in patients with pulmonary metastatic renal cell carcinoma using non-contrast-enhanced computed tomography.

    abstract:RATIONALE AND OBJECTIVES:The objective of this study was to assess whether changes to radiographic parameters before and after treatment with antiangiogenic drugs would improve performance in predicting tumor response with non-contrast-enhanced computed tomography (NCECT) compared to Response Evaluation Criteria in Sol...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.06.007

    authors: Wu GY,Suo ST,Kong W,Jin D,Zhang J,Xu JR

    更新日期:2014-11-01 00:00:00

  • Diffraction enhanced imaging of a rat model of gastric acid aspiration pneumonitis.

    abstract:RATIONALE AND OBJECTIVES:Diffraction-enhanced imaging (DEI) is a type of phase contrast x-ray imaging that has improved image contrast at a lower dose than conventional radiography for many imaging applications, but no studies have been done to determine if DEI might be useful for diagnosing lung injury. The goals of t...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.08.005

    authors: Connor DM,Zhong Z,Foda HD,Wiebe S,Parham CA,Dilmanian FA,Cole EB,Pisano ED

    更新日期:2011-12-01 00:00:00

  • Magnetic resonance imaging using hyperpolarized 3He-Gas.

    abstract:RATIONALE AND OBJECTIVES:Current imaging procedures of the lung concentrate on visualization of morphology. Computed tomography is the imaging method of choice for the majority of pulmonary diseases. Functional data are commonly obtained from arterial blood gas analysis, spirometry, and body plethysmography, which all ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)00335-0

    authors: Gast KK,Eberle B,Schmiedeskamp J,Kauczor HU

    更新日期:2003-10-01 00:00:00

  • Computed radiography X-ray exposure trends.

    abstract:RATIONALE AND OBJECTIVES:Computed radiography provides correct optical density on film, independent of the incident radiation exposure, but it can result in under- or overexposure of the imaging plate. In the current study, we evaluated the radiation exposure trends of computed radiography over a 2-year period for port...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(96)80247-9

    authors: Seibert JA,Shelton DK,Moore EH

    更新日期:1996-04-01 00:00:00

  • Magnetic resonance lymphography in rats: effects of muscular activity and hyperthermia on the lymph node uptake of intravenously injected superparamagnetic iron oxide particles.

    abstract:RATIONALE AND OBJECTIVES:We investigated the influence of muscular activity and regional body temperature changes on the accumulation of intravenously (i.v.) administered, dextran-coated superparamagnetic iron oxide (SPIO) particles in the lymph nodes of rats. METHODS:Four groups of rats (N = 21) were used. Five rats ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(96)80193-0

    authors: Elste V,Wagner S,Taupitz M,Pfefferer D,Kresse M,Hamm B,Berg R,Wolf KJ,Semmler W

    更新日期:1996-08-01 00:00:00

  • Computer-aided detection of clustered microcalcifications in digitized mammograms.

    abstract:RATIONALE AND OBJECTIVES:We investigated a computer-aided detection (CAD) scheme for clustered microcalcifications in digitized mammograms. METHODS:A multistage CAD scheme was developed and tested. To increase sensitivity, the scheme uses a Gaussian band-pass filter and nonlinear threshold. A multistage local minimum ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80431-3

    authors: Zheng B,Chang YH,Staiger M,Good W,Gur D

    更新日期:1995-08-01 00:00:00

  • A preliminary report on the role of spatial frequency analysis in the perception of breast cancers missed at mammography screening.

    abstract:RATIONALE AND OBJECTIVES:Because several factors are involved in cancer detection, a malignant lesion that is visible on a mammogram will not necessarily be reported by the radiologist reading the case. Indeed, a significant fraction of screening-detected cancers are visible in retrospect, and were perceived by the rad...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2004.04.015

    authors: Mello-Thoms C,Chapman B

    更新日期:2004-08-01 00:00:00

  • Radiology residency eCurriculum developed in-house: evaluation of benefits and weaknesses.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to evaluate residents' use of a radiology curriculum CD-ROM designed to provide ready access to the department's curricula, study materials, and Internet resources. MATERIALS AND METHODS:A survey questionnaire eliciting feedback about the usability and value of th...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)80085-5

    authors: Bartlett ES,Maley JE,Fajardo LL

    更新日期:2003-06-01 00:00:00

  • Detection of ductal carcinoma in situ with mammography, breast specific gamma imaging, and magnetic resonance imaging: a comparative study.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the sensitivity of high-resolution breast-specific gamma imaging (BSGI) for the detection of ductal carcinoma in situ (DCIS) based on histopathology and to compare the sensitivity of BSGI with mammography and magnetic resonance imaging (MRI) for the detection of DCIS. MATERIALS AND...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.04.004

    authors: Brem RF,Fishman M,Rapelyea JA

    更新日期:2007-08-01 00:00:00

  • Rates of disagreement in imaging interpretation in a group of community hospitals.

    abstract:RATIONALE AND OBJECTIVES:Prospective studies of radiologists' interpretations of selected radiographs reported 20-40 years ago indicated error rates of 30% and higher. The authors retrospectively evaluated the interpretations of groups of radiologists and determined a range of rates of disagreement in interpretation. Q...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(98)80277-8

    authors: Siegle RL,Baram EM,Reuter SR,Clarke EA,Lancaster JL,McMahan CA

    更新日期:1998-03-01 00:00:00