A permutation test for comparing ROC curves in multireader studies a multi-reader ROC, permutation test.

Abstract:

RATIONALE AND OBJECTIVES:The aim of the study is to develop a permutation test to compare receiver operating characteristic (ROC) curves of two diagnostic modalities in a multireader paired design. MATERIALS AND METHODS:A statistical test for comparing two diagnostic modalities is developed based on all possible exchanges of the set of reader-ratings between the two modalities. An exact permutation test is formed by determining the frequency of the most extreme values of the statistic estimating the average difference in the areas under the ROC curves (AUCs). An asymptotic version of the test is constructed by obtaining the exact permutation variance and appealing to the asymptotic normality of the nonparametric estimator of the average difference in areas. Computer simulations were conducted to validate the type I error for small sample sizes. RESULTS:The new test provides a permutation approach for comparing ROC curves in a multireader paired-design setting in which effects of the readers are considered to be fixed. The type I error of the asymptotic test is close to the true value, even for samples as small as 20 normal and 20 abnormal cases. The test is designed to be sensitive to alternatives in which the AUCs of the two diagnostic modalities differ. CONCLUSIONS:The proposed test provides a powerful method for comparing two diagnostic modalities in a multireader paired-study design when the primary interest is to detect difference in average AUCs.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Bandos AI,Rockette HE,Gur D

doi

10.1016/j.acra.2005.12.012

keywords:

subject

Has Abstract

pub_date

2006-04-01 00:00:00

pages

414-20

issue

4

eissn

1076-6332

issn

1878-4046

pii

S1076-6332(05)01044-5

journal_volume

13

pub_type

杂志文章
  • Performance of T2 Maps in the Detection of Prostate Cancer.

    abstract:RATIONALE AND OBJECTIVES:This study compares the performance of T2 maps in the detection of prostate cancer (PCa) in comparison to T2-weighted (T2W) magnetic resonance images. MATERIALS AND METHODS:The prospective study was institutional review board approved. Consenting patients (n = 45) with histologic confirmed PCa...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.04.005

    authors: Chatterjee A,Devaraj A,Mathew M,Szasz T,Antic T,Karczmar GS,Oto A

    更新日期:2019-01-01 00:00:00

  • Use of 3D Printed Models to Create Molds for Shaping Implants for Surgical Repair of Orbital Fractures.

    abstract:RATIONALE AND OBJECTIVES:Surgical repair of an isolated orbital fracture requires anatomically accurate implant shape and placement. We describe a three-dimensional (3D) printing technique to customize the shape of commercially available absorbable implants. MATERIALS AND METHODS:We reviewed our early experience with ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.06.023

    authors: Weadock WJ,Heisel CJ,Kahana A,Kim J

    更新日期:2020-04-01 00:00:00

  • Recognition of Neonatal Lymphatic Flow Disorder: Fetal MR Findings and Postnatal MR Lymphangiogram Correlation.

    abstract:RATIONALE AND OBJECTIVES:This study aimed to describe prenatal and postnatal imaging features and outcomes of neonates with neonatal lymphatic disorders (NLDs). MATERIALS AND METHODS:An institutional review board-approved search of the radiology database for patients with NLD identified five patients. Inclusion criter...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.02.020

    authors: Biko DM,Johnstone JA,Dori Y,Victoria T,Oliver ER,Itkin M

    更新日期:2018-11-01 00:00:00

  • Combining Washout and Noncontrast Data From Adrenal Protocol CT: Improving Diagnostic Performance.

    abstract:RATIONALE AND OBJECTIVES:To determine if combination of washout and noncontrast data from delayed adrenal computed tomography (CT) improves diagnostic performance, and demonstration of an optimizing analytical framework. MATERIALS AND METHODS:This retrospective study consisted of 97 adrenal lesions, in 96 patients, wi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2017.12.005

    authors: Ng CS,Altinmakas E,Wei W,Ghosh P,Li X,Grubbs EG,Perrier NA,Prieto VG,Lee JE,Hobbs BP

    更新日期:2018-07-01 00:00:00

  • Perfusion CT estimates photosensitizer uptake and biodistribution in a rabbit orthotopic pancreatic cancer model: a pilot study.

    abstract:RATIONALE AND OBJECTIVES:It was hypothesized that perfusion computed tomography (CT), blood flow (BF), blood volume (BV), and vascular permeability surface area (PS) product parameters would be predictive of therapeutic anticancer agent uptake in pancreatic cancer, facilitating image-guided interpretation of human trea...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.12.014

    authors: Elliott JT,Samkoe KS,Gunn JR,Stewart EE,Gardner TB,Tichauer KM,Lee TY,Hoopes PJ,Pereira SP,Hasan T,Pogue BW

    更新日期:2015-05-01 00:00:00

  • Pitfalls in RECIST Data Extraction for Clinical Trials: Beyond the Basics.

    abstract::Response Evaluation Criteria in Solid Tumors (RECIST) is a standardized methodology for determining therapeutic response to anticancer therapy using changes in lesion appearance on imaging studies. Many radiologists are now using RECIST in their routine clinical workflow, as part of consultative arrangements, or withi...

    journal_title:Academic radiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.acra.2015.01.015

    authors: Abramson RG,McGhee CR,Lakomkin N,Arteaga CL

    更新日期:2015-06-01 00:00:00

  • Ultrasound biomicroscopy for the detection of early osteoarthritis in an animal model.

    abstract:RATIONALE AND OBJECTIVES:Osteoarthritis (OA) is a common disease, and early diagnosis is essential for preventing further cartilage destruction and decreasing severe complications. Ultrasound biomicroscopy (UBM) is sensitive for detecting minute lesions in tissue because of its higher resolution, but its B-mode charact...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.09.011

    authors: Wang Y,Guo Y,Zhang L,Niu H,Xu M,Zhao B,Wan W

    更新日期:2011-02-01 00:00:00

  • Learning radiology a survey investigating radiology resident use of textbooks, journals, and the internet.

    abstract:RATIONALE AND OBJECTIVES:We surveyed radiology residents to understand which information sources residents use to learn radiology. MATERIALS AND METHODS:A 15-question survey on learning resources was given to radiology residents at one institution. The survey queried residents about their preferences for sources when ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.06.002

    authors: Kitchin DR,Applegate KE

    更新日期:2007-09-01 00:00:00

  • NCI image archive management workshop: a preliminary report.

    abstract::The National Cancer Institute organized a workshop entitled "Image Archive Management" that was presented on August 28 and 29, 2000, at the Natcher Conference Center on the National Institutes of Health (NIH) campus. The purpose of this workshop was to solicit expert input for the planned development of an archival sy...

    journal_title:Academic radiology

    pub_type:

    doi:10.1016/S1076-6332(03)80699-2

    authors: Staab E,Clarke LP,Baker H,Sullivan D

    更新日期:2001-07-01 00:00:00

  • Inflammatory breast carcinoma in magnetic resonance imaging: a comparison with locally advanced breast cancer.

    abstract:RATIONALE AND OBJECTIVES:Although inflammatory breast carcinoma (IBC) accounts for 1%-4% of all breast cancer cases, the appearance of this highly malignant tumor in magnetic resonance imaging (MRI) is still not well characterized. The aim of this study was to identify typical imaging features of IBC in comparison with...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.09.011

    authors: Renz DM,Baltzer PA,Böttcher J,Thaher F,Gajda M,Camara O,Runnebaum IB,Kaiser WA

    更新日期:2008-02-01 00:00:00

  • Data analysis for detection and localization of multiple abnormalities with application to mammography.

    abstract:RATIONALE AND OBJECTIVES:In assessing diagnostic accuracy it is often essential to determine the reader's ability both to detect and to correctly locate multiple abnormalities per patient. The authors developed a new approach for the detection and localization of multiple abnormalities and compared it with other approa...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(00)80324-4

    authors: Obuchowski NA,Lieber ML,Powell KA

    更新日期:2000-07-01 00:00:00

  • Multidisciplinary gastrointestinal cancer clinic: abdominal radiologist as active participant.

    abstract:RATIONALE AND OBJECTIVES:Abdominal radiologists actively participated and provided subspecialty radiologic expertise in a multidisciplinary gastrointestinal cancer clinic that served a tertiary referral center. The purpose of this study was to evaluate the feasibility and nonradiologists' opinions of this new approach ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(98)80564-3

    authors: Silverman SG,Khorasani R,Adams DF,Phillips MD,Sica GT,Mayer RJ

    更新日期:1998-10-01 00:00:00

  • Ex Vivo Study of Artifacts Caused by Breast Tissue Markers with Different 1.5 Tesla and 3 Tesla MRI Scanners - A Bicentric Study.

    abstract:RATIONALE AND OBJECTIVES:The purpose of our study was to evaluate magnetic resonance (MR) artifacts related to breast tissue markers in breast imaging procedures. MATERIALS AND METHODS:In this bicentric prospective ex vivo study 10 different commercially available markers were measured in self-made breast phantoms. Br...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.12.006

    authors: Puesken M,Unterberg-Buchwald C,Rhiem K,Große Hokamp N,Maintz D,Lotz J,Wienbeck S

    更新日期:2021-01-01 00:00:00

  • Management of Splenic Trauma in Contemporary Clinical Practice: A National Trauma Data Bank Study.

    abstract:BACKGROUND:To evaluate the utilization and efficacy of various treatments for management of adult patients with splenic trauma, highlighting the evolving role of splenic artery embolization. MATERIALS AND METHODS:The National Trauma Data Bank (NTDB) was queried for patients who sustained splenic trauma between 2007 an...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.11.010

    authors: Chahine AH,Gilyard S,Hanna TN,Fan S,Risk B,Johnson JO,Duszak R Jr,Newsome J,Xing M,Kokabi N

    更新日期:2020-12-04 00:00:00

  • Correlation Between Radiology ACGME Case Logs Values and ABR Core Exam Pass Rate.

    abstract:RATIONALE AND OBJECTIVES:There is discordance between the American Board of Radiology (ABR) and many radiology trainees with respect to the most appropriate means to prepare for the ABR Core Examination. Whereas the ABR suggests that participation in routine clinical examination interpretation best prepares a trainee f...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.10.004

    authors: Nickerson JP,Koski C,Anderson JC,Beckett B,Jackson VP

    更新日期:2020-02-01 00:00:00

  • The "Look Ahead" Technique: A Novel Way to Engage Medical Students in the Radiology Reading Room.

    abstract:RATIONALE AND OBJECTIVES:Engaging medical students during a radiology course can be challenging. We sought a way to actively engage students with live cases, allow them to interact with the picture archiving and communication system workstation, and experience what it is like to be a radiologist. MATERIALS AND METHODS...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.12.021

    authors: Huang J,Bingham B,Jordanov M

    更新日期:2021-02-01 00:00:00

  • Three-dimensional human airway segmentation methods for clinical virtual bronchoscopy.

    abstract:RATIONALE AND OBJECTIVES:The segmentation of airways from CT images is a critical first step for numerous virtual bronchoscopic (VB) applications. Automatic or semiautomatic methods are necessary, since manual segmentation is prohibitively time consuming. The methods must be robust and operate within a reasonable time ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)80517-2

    authors: Kiraly AP,Higgins WE,McLennan G,Hoffman EA,Reinhardt JM

    更新日期:2002-10-01 00:00:00

  • Increased epicardial, pericardial, and subcutaneous adipose tissue is associated with the presence and severity of coronary artery calcium.

    abstract:RATIONALE AND OBJECTIVES:Epicardial adipose tissue (EAT), pericardial adipose tissue (PAT), and subcutaneous adipose tissue (SAT) are mediators of metabolic risk and may be involved in the pathogenesis of coronary artery disease. The aim of this study was to investigate the association of visceral and subcutaneous fat ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.08.017

    authors: Ahmadi N,Nabavi V,Yang E,Hajsadeghi F,Lakis M,Flores F,Zeb I,Bevinal M,Ebrahimi R,Budoff M

    更新日期:2010-12-01 00:00:00

  • Coregistration of Preoperative MRI with Ex Vivo Mesorectal Pathology Specimens to Spatially Map Post-treatment Changes in Rectal Cancer Onto In Vivo Imaging: Preliminary Findings.

    abstract:RATIONALE AND OBJECTIVES:The objective of this study was to develop and quantitatively evaluate a radiology-pathology fusion method for spatially mapping tissue regions corresponding to different chemoradiation therapy-related effects from surgically excised whole-mount rectal cancer histopathology onto preoperative ma...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2017.12.006

    authors: Antunes J,Viswanath S,Brady JT,Crawshaw B,Ros P,Steele S,Delaney CP,Paspulati R,Willis J,Madabhushi A

    更新日期:2018-07-01 00:00:00

  • Three-dimensional isotropic wavelets for post-acquisitional extraction of latent images of atherosclerotic plaque components from micro-computed tomography of human coronary arteries.

    abstract:RATIONALE AND OBJECTIVES:The capability of wavelet transforms to separate signals into frequency bands is the basis for its use in image compression and storage, data management and transmission, and, recently, extraction of latent images of tissue components from noisy medical images. Analysis of temporal variations o...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.06.018

    authors: Gertz SD,Bodmann BG,Vela D,Papadakis M,Aboshady I,Cherukuri P,Alexander S,Kouri DJ,Baid S,Gittens AA,Gladish GW,Conyers JL,Cody DD,Gavish L,Mazraeshahi RM,Wilner WT,Frazier L,Madjid M,Zarrabi A,Lukovenkov S,Ahmed

    更新日期:2007-12-01 00:00:00

  • Computer-aided detection of clustered microcalcifications in digitized mammograms.

    abstract:RATIONALE AND OBJECTIVES:We investigated a computer-aided detection (CAD) scheme for clustered microcalcifications in digitized mammograms. METHODS:A multistage CAD scheme was developed and tested. To increase sensitivity, the scheme uses a Gaussian band-pass filter and nonlinear threshold. A multistage local minimum ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80431-3

    authors: Zheng B,Chang YH,Staiger M,Good W,Gur D

    更新日期:1995-08-01 00:00:00

  • MR imaging findings in colloid cysts of the sellar region: comparison with colloid cysts of the third ventricle and Rathke's cleft cysts.

    abstract:RATIONALE AND OBJECTIVES:To identify magnetic resonance (MR) imaging characteristics allowing specific preoperative discrimination between colloid cysts (CCs) of the sellar region and third ventricle (CC3rdv) versus Rathke's cleft cysts (RCCs). MATERIALS AND METHODS:MR imaging data of 38 patients with histologically p...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.08.014

    authors: Bender B,Honegger JB,Beschorner R,Ernemann U,Horger M

    更新日期:2013-11-01 00:00:00

  • Academic Remediation: Why Early Identification and Intervention Matters.

    abstract::At our institution, we have developed a remediation team of strong, focused experts who help us with struggling learners in making the diagnosis and then coaching on their milestone deficits. It is key for all program directors to recognize struggling residents because early recognition and intervention gives the resi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.12.022

    authors: Rumack CM,Guerrasio J,Christensen A,Aagaard EM

    更新日期:2017-06-01 00:00:00

  • Performance of Diffusion Kurtosis Imaging Versus Diffusion Tensor Imaging in Discriminating Between Benign Tissue, Low and High Gleason Grade Prostate Cancer.

    abstract:RATIONALE AND OBJECTIVES:To investigate the performance of diffusion kurtosis imaging (DKI) and diffusion tensor imaging (DTI) in discriminating benign tissue, low- and high-grade prostate adenocarcinoma (PCa). MATERIALS AND METHODS:Forty-eight patients with biopsy-proven PCa of different Gleason grade (GG), who provi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.11.015

    authors: Di Trani MG,Nezzo M,Caporale AS,De Feo R,Miano R,Mauriello A,Bove P,Manenti G,Capuani S

    更新日期:2019-10-01 00:00:00

  • Computer-aided diagnosis of soft-tissue tumors using sonographic morphologic and texture features.

    abstract:RATIONALE AND OBJECTIVES:The aim of this study was to develop a computer-aided diagnosis (CAD) system in assessing the sonographic morphologic and texture features of soft-tissue tumors. MATERIALS AND METHODS:The retrospective study involved 114 pathology proven cases including 73 benign and 41 malignant soft-tissue t...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2009.07.024

    authors: Chen CY,Chiou HJ,Chou SY,Chiou SY,Wang HK,Chou YH,Chiang HK

    更新日期:2009-12-01 00:00:00

  • Evaluation of clinical outcomes of antiangiogenic-targeted therapy in patients with pulmonary metastatic renal cell carcinoma using non-contrast-enhanced computed tomography.

    abstract:RATIONALE AND OBJECTIVES:The objective of this study was to assess whether changes to radiographic parameters before and after treatment with antiangiogenic drugs would improve performance in predicting tumor response with non-contrast-enhanced computed tomography (NCECT) compared to Response Evaluation Criteria in Sol...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.06.007

    authors: Wu GY,Suo ST,Kong W,Jin D,Zhang J,Xu JR

    更新日期:2014-11-01 00:00:00

  • Multimodality computer-aided breast cancer diagnosis with FFDM and DCE-MRI.

    abstract:RATIONALE AND OBJECTIVES:To investigate a multimodality computer-aided diagnosis (CAD) scheme that combines image information from full-field digital mammography (FFDM) and dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) for computerized breast cancer classification. MATERIALS AND METHODS:From a retrosp...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.04.015

    authors: Yuan Y,Giger ML,Li H,Bhooshan N,Sennett CA

    更新日期:2010-09-01 00:00:00

  • Effects of oral 5-fluorouracil drugs on hepatic fat content in patients with colon cancer.

    abstract:RATIONALE AND OBJECTIVES:The association between hepatic steatosis and oral 5-fluorouracil (5-FU) agents is clinically recognized but has not been systematically studied. The aim of this study was to determine the effects of 5-FU on hepatic fat content in patients undergoing oral 5-FU therapy and to compare the effects...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2005.02.010

    authors: Miyake K,Hayakawa K,Nishino M,Morimoto T,Mukaihara S

    更新日期:2005-06-01 00:00:00

  • Prognostic vascular imaging biomarkers in high-grade gliomas: tumor permeability as an adjunct to blood volume estimates.

    abstract:RATIONALE AND OBJECTIVES:Despite recent advances in the treatment of high-grade gliomas, overall survival (OS) remains poor, which underlines the importance of searching for and determining prognostic imaging biomarkers. The purpose of our retrospective study was to correlate patient survival with relative cerebral blo...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.11.011

    authors: Jain R,Narang J,Griffith B,Bagher-Ebadian H,Scarpace L,Mikkelsen T,Littenberg B,Schultz LR

    更新日期:2013-04-01 00:00:00

  • Diagnosis of inguinal lymph node metastases using contrast enhanced high resolution MR lymphangiography.

    abstract:RATIONALE AND OBJECTIVES:Inguinal lymph nodes can be the first or the only clinical signs of tumor metastases. The aim of the study was to evaluate the role of contrast-enhanced high-resolution magnetic resonance (MR) lymphangiography in diagnosis of inguinal lymph node metastases. MATERIALS AND METHODS:The study enro...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.09.014

    authors: Liu N,Yan Z,Lu Q,Wang C

    更新日期:2013-02-01 00:00:00