Comparison of three methods for estimating the standard error of the area under the curve in ROC analysis of quantitative data.

Abstract:

RATIONALE AND OBJECTIVES:Several methods have been proposed for estimating the standard error (SE) of the area under the curve (AUC) in receiver operating characteristic analysis. The authors examined the validity of three methods--the LABROC procedure, exponential approximation, and the method of DeLong et al (purely nonparametric)--for estimating the SE of the AUC in receiver operating characteristic analysis of quantitative diagnostic data. MATERIALS AND METHODS:The authors conducted a broad numerical investigation to assess how to estimate the SE of AUC in various configurations of binormal and nonbinormal pairs of distributions, in which one or both pair members were mixtures of Gaussian distributions (the samples included 100 in the diseased group and 100 in the nondiseased group). RESULTS:The authors found that exponential approximation of the SE of AUC slightly underestimates the observed SE of a nonparametric estimate of the AUC when the ratio of the standard deviation of distributions for diseased to nondiseased populations was greater than 2. With binormal data the observed SE tended to be smaller with the LABROC procedure (semiparametric) than with the method of DeLong et al, but the LABROC procedure yields more conservative estimates of SE with nonbinormal data. In particular, with bimodal data it often produces a more conservative (ie, larger) estimate of the actual (observed) fluctuation. CONCLUSION:Overall, the LABROC procedure and the method of DeLong et al yielded very close estimates of the SE of AUC, even with data generated from a nonbinormal model. The choice between these two methods can be based on users' preferences and practicality.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Hajian-Tilaki KO,Hanley JA

doi

10.1016/s1076-6332(03)80561-5

keywords:

subject

Has Abstract

pub_date

2002-11-01 00:00:00

pages

1278-85

issue

11

eissn

1076-6332

issn

1878-4046

journal_volume

9

pub_type

杂志文章
  • Detection of age-dependent changes in healthy adult lungs with diffusion-weighted 3He MRI.

    abstract:RATIONALE AND OBJECTIVES:To investigate changes in lung microstructure in healthy adult subjects with no smoking history using diffusion-weighted 3He MRI. MATERIALS AND METHODS:Diffusion magnetic resonance imaging using hyperpolarized helium 3 (3He) was applied to healthy volunteers to explore the dependence of lung m...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2005.08.005

    authors: Fain SB,Altes TA,Panth SR,Evans MD,Waters B,Mugler JP 3rd,Korosec FR,Grist TM,Silverman M,Salerno M,Owers-Bradley J

    更新日期:2005-11-01 00:00:00

  • Variability of CT Airways Measurements in COPD Patients Between Morning and Afternoon: Comparisons to Variability of Spirometric Measurements.

    abstract:RATIONALE AND OBJECTIVES:Computed tomography (CT) airways measurements can be used as surrogates to spirometric measurements for assessing bronchodilation in a particular patient with chronic obstructive pulmonary disease. Although spirometric measurements show variations within the opening hours of a hospital departme...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.02.024

    authors: Hackx M,Gyssels E,Severo Garcia T,De Meulder I,Bruyneel M,Van Muylem A,Ninane V,Gevenois PA

    更新日期:2018-12-01 00:00:00

  • Indications for Plain Radiographs in Uncomplicated Lower Extremity Cellulitis.

    abstract:RATIONALE AND OBJECTIVES:Cellulitis is a common cause for emergency department (ED) presentation and subsequent hospital admission. Underlying fracture, osteomyelitis, or foreign body is often considered in the clinical evaluation of these patients. Accordingly, plain radiographs (XRs) of the affected extremity are oft...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2015.08.002

    authors: Stranix JT,Lee ZH,Bellamy J,Rifkind K,Thanik V

    更新日期:2015-11-01 00:00:00

  • Estimation of volumes of distribution and intratumoral ethanol concentrations by computed tomography scanning after percutaneous ethanol injection.

    abstract:RATIONALE AND OBJECTIVES:We developed a technique for estimating the volumes of distribution and intratumoral ethanol concentrations using computed tomography (CT) scanning in patients undergoing percutaneous ethanol injection (PEI) treatment of malignant hepatic tumors. METHODS:A phantom containing anhydrous ethanol ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/S1076-6332(96)80333-3

    authors: Alexander DG,Unger EC,Seeger SJ,Karmann S,Krupinski EA

    更新日期:1996-01-01 00:00:00

  • Lung deformation estimation and four-dimensional CT lung reconstruction.

    abstract:RATIONALE AND OBJECTIVES:Four-dimensional (4D) computed tomography (CT) can be used in radiation treatment planning to account for respiratory motion. Current 4D CT techniques have limitations in either spatial or temporal resolution. In addition, most of these techniques rely on auxiliary surrogates to relate the time...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2006.05.004

    authors: Xu S,Taylor RH,Fichtinger G,Cleary K

    更新日期:2006-09-01 00:00:00

  • Optimal timing and diagnostic adequacy of hepatocyte phase imaging with gadoxetate-enhanced liver MRI.

    abstract:RATIONALE AND OBJECTIVES:To evaluate clinical and imaging features associated with adequacy of the hepatocyte phase (HP) in gadoxetate disodium-enhanced liver magnetic resonance imaging (MRI) in patients without chronic liver disease (CLD). MATERIALS AND METHODS:This was a retrospective institutional review board-appr...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.02.005

    authors: Bashir MR,Breault SR,Braun R,Do RK,Nelson RC,Reeder SB

    更新日期:2014-06-01 00:00:00

  • MRI of right atrial function after catheter ablation of atrial flutter.

    abstract:RATIONALE AND OBJECTIVES:Catheter ablation of the cavotricuspid isthmus (CTI) is an effective treatment of right atrial flutter. The objective of this study was to evaluate the changes in CTI length and right atrial (RA) function after radiofrequency ablation of isthmus-dependent atrial flutter (isthmus ablation). MAT...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.03.015

    authors: Ozgun M,Kirchhof P,Bunck AC,Heindel W,Eckardt L,Maintz D

    更新日期:2010-07-01 00:00:00

  • Image Quality of Virtual Monochromatic Reconstructions of Noncontrast CT on a Dual-Source CT Scanner in Adult Patients.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the image quality of virtual monochromatic images (VMI) reconstructed from dual-energy dual-source noncontrast head CT with different reconstruction kernels. MATERIALS AND METHODS:Twenty-five consecutive adult patients underwent noncontrast dual-energy CT. VMI were retrospectively ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.05.038

    authors: van Ommen F,Kauw F,Bennink E,Heit JJ,Wolman DN,Dankbaar JW,de Jong HWAM,Wintermark M

    更新日期:2020-06-30 00:00:00

  • MR imaging of the temporomandibular joint: a validation experiment in vitro.

    abstract:RATIONALE AND OBJECTIVES:The authors compared magnetic resonance (MR) image quality obtained from 3- and 1-mm-thick sections in the depiction of the temporomandibular joint (TMJ) and its adjacent structures. MATERIALS AND METHODS:Eight TMJ specimens from four adult cadaver heads were depicted with MR imaging. Both 3- ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/S1076-6332(99)80116-0

    authors: Cavalcanti MG,Lew D,Ishimaru T,Ruprecht A

    更新日期:1999-11-01 00:00:00

  • Evaluation of the quality of radiology requisitions for intensive care unit patients.

    abstract:RATIONALE AND OBJECTIVES:The study aim is to evaluate the quality of radiology requisitions for plain film radiographs on intensive care unit (ICU) patients. MATERIALS AND METHODS:Radiology requisitions for 58 patients in ICU units at our children's hospital and the corresponding original orders for the study, written...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2005.10.017

    authors: Cohen MD,Curtin S,Lee R

    更新日期:2006-02-01 00:00:00

  • Optimal ECG trigger point in electron-beam CT studies: three methods for minimizing motion artifacts.

    abstract:RATIONALE AND OBJECTIVES:The authors hypothesized that electrocardiographic triggering near end systole could minimize motion artifacts in electron-beam computed tomography (CT) of the coronary artery. MATERIALS AND METHODS:The study included 2,660 patients who underwent coronary artery calcium scanning with electron-...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/S1076-6332(03)80722-5

    authors: Mao S,Budoff MJ,Bin L,Liu SC

    更新日期:2001-11-01 00:00:00

  • Using a human visual system model to optimize soft-copy mammography display: influence of veiling glare.

    abstract:RATIONALE AND OBJECTIVES:This project evaluated human observer performance and that of a human visual system model (JNDmetrix) to assess whether the veiling glare of a digital display influences observer performance during soft-copy interpretation of mammographic images for the detection of masses. MATERIALS AND METHO...

    journal_title:Academic radiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.acra.2005.11.006

    authors: Krupinski EA,Lubin J,Roehrig H,Johnson J,Nafziger J

    更新日期:2006-03-01 00:00:00

  • Impact of COVID-19 Workflow Changes on Patient Throughput at Outpatient Imaging Centers.

    abstract:RATIONALE AND OBJECTIVES:To determine the impact of COVID-19 workflow changes on patient throughput at the outpatient imaging facilities of a large healthcare system in New York City. MATERIALS AND METHODS:COVID-19 workflow changes to permit social distancing and patient and staff safety included screening at the time...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.12.016

    authors: Chang G,Doshi A,Chandarana H,Recht M

    更新日期:2021-01-04 00:00:00

  • System for robotically assisted prostate biopsy and therapy with intraoperative CT guidance.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to assess the work-in-progress prototype of an image-guided, robotic system for accurate and consistent placement of transperineal needles into the prostate with intraoperative image guidance inside the gantry of a computed tomographic (CT) scanner. MATERIALS AND ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)80297-0

    authors: Fichtinger G,DeWeese TL,Patriciu A,Tanacs A,Mazilu D,Anderson JH,Masamune K,Taylor RH,Stoianovici D

    更新日期:2002-01-01 00:00:00

  • A Breast Radiology Department-operated, Proactive Same-day Program Identifies Pathogenic Breast Cancer Mutations in Unaffected Women.

    abstract:RATIONALE AND OBJECTIVES:Pathogenic mutations in some genes elevate women's breast cancer risk, necessitating risk-reduction strategies. Unfortunately, women are underscreened for cancer risk, and when identified as potentially high risk, women seldom pursue genetic counseling or testing. To improve cancer risk managem...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.12.005

    authors: Loving VA,Luiten RC,Siettmann JM,Mina LA

    更新日期:2020-12-15 00:00:00

  • Teaching medical management and operations engineering for systems-based practice to radiology residents.

    abstract:RATIONALE AND OBJECTIVES:To better prepare radiology residents for providing care within the context of the larger health care system, this study evaluated the feasibility and impact of a curriculum to enhance radiology residents' understanding and ability to apply concepts from medical management and industrial and op...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.09.025

    authors: Brandon CJ,Mullan PB

    更新日期:2013-03-01 00:00:00

  • Thin-section CT evidence of bronchial thickening in children with stable asthma: bronchoconstriction or airway remodeling?

    abstract:RATIONALE AND OBJECTIVES:The authors performed this study to determine if bronchial wall thickening is present in children with moderate to severe asthma during periods free from clinical bronchoconstriction. MATERIALS AND METHODS:The authors obtained low (radiation) dose thin-section computed tomographic (CT) scans i...

    journal_title:Academic radiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/S1076-6332(03)80535-4

    authors: Ketai L,Coutsias C,Williamson S,Coutsias V

    更新日期:2001-03-01 00:00:00

  • Usefulness of additional coronary calcium scoring in low-dose CT coronary angiography with prospective ECG-triggering impact on total effective radiation dose and diagnostic accuracy.

    abstract:RATIONALE AND OBJECTIVES:To determine the impact of additional coronary calcium scoring on total effective radiation dose and diagnostic accuracy of low-dose computed tomography coronary angiography (CTCA) with prospective electrocardiogram (ECG) triggering. MATERIALS AND METHODS:Sixty-one consecutive patients underwe...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2009.09.007

    authors: Husmann L,Herzog BA,Burger IA,Buechel RR,Pazhenkottil AP,von Schulthess P,Wyss CA,Gaemperli O,Landmesser U,Kaufmann PA

    更新日期:2010-02-01 00:00:00

  • MR imaging findings in colloid cysts of the sellar region: comparison with colloid cysts of the third ventricle and Rathke's cleft cysts.

    abstract:RATIONALE AND OBJECTIVES:To identify magnetic resonance (MR) imaging characteristics allowing specific preoperative discrimination between colloid cysts (CCs) of the sellar region and third ventricle (CC3rdv) versus Rathke's cleft cysts (RCCs). MATERIALS AND METHODS:MR imaging data of 38 patients with histologically p...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.08.014

    authors: Bender B,Honegger JB,Beschorner R,Ernemann U,Horger M

    更新日期:2013-11-01 00:00:00

  • Quantification of hepatic steatosis: a comparison of computed tomography and magnetic resonance indices in candidates for living liver donation.

    abstract:RATIONALE AND OBJECTIVES:To evaluate, in a group of candidates for liver donation, the role of unenhanced computed tomography (CT) and magnetic resonance (MR) as noninvasive means to measure hepatic steatosis (HS). MATERIALS AND METHODS:Sixty-one consecutive candidates underwent CT and MR evaluation for liver donation...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.01.007

    authors: Maruzzelli L,Parr AJ,Miraglia R,Tuzzolino F,Luca A

    更新日期:2014-04-01 00:00:00

  • Low-grade bone lesions in survivors of childhood medulloblastoma/primitive neuroectodermal tumor.

    abstract:OBJECTIVES AND RATIONALE:Medulloblastoma/primitive neuroectodermal tumor (MB/PNET) is the most common malignant tumor of the central nervous system (CNS) in children. MB/PNET survivors are at an increased risk for developing second malignancies. Little has been reported on development of low-grade lesions of the calvar...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.08.018

    authors: Koral K,Roy D,Timmons CF,Gargan L,Bowers DC

    更新日期:2012-01-01 00:00:00

  • Disorders of lymph flow.

    abstract::Disturbances in blood capillary exchange of fluid, macromolecules, and cells across intact and abnormal microvessels and deranged lymphatic transport are integral, interacting components in disorders of tissue swelling. Lymphedema or low-output failure of the lymph circulation is often indolent for many years before l...

    journal_title:Academic radiology

    pub_type: 杂志文章,评审

    doi:10.1016/s1076-6332(05)80193-x

    authors: Witte CL,Witte MH

    更新日期:1995-04-01 00:00:00

  • Cone beam CT in assessment of tibial bone defect healing: an animal study.

    abstract:RATIONALE AND OBJECTIVES:To evaluate cone beam computed tomography (CBCT) for monitoring of tibial bone defect healing in comparison to histopathological findings. MATERIALS AND METHODS:Circumscribed tibial bone defects were created in 16 mini-pigs and imaging of the tibia was performed on day 42 using a modern CBCT s...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.10.022

    authors: Kröpil P,Hakimi AR,Jungbluth P,Riegger C,Rubbert C,Miese F,Lanzman RS,Wild M,Schek A,Scherer A,Windolf J,Antoch G,Becker J,Hakimi M

    更新日期:2012-03-01 00:00:00

  • Diagnostic Accuracy of Ultrasound, Contrast-enhanced CT, and Conventional MRI for Differentiating Leiomyoma From Leiomyosarcoma.

    abstract:RATIONALE AND OBJECTIVES:This study aimed to determine whether uterine leiomyoma can be distinguished from uterine leiomyosarcoma on ultrasound (US), computed tomography (CT), and/or magnetic resonance imaging (MRI) without diffusion-weighted imaging. MATERIALS AND METHODS:Institutional review board approval was obtai...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.06.004

    authors: Gaetke-Udager K,McLean K,Sciallis AP,Alves T,Maturen KE,Mervak BM,Moore AG,Wasnik AP,Erba J,Davenport MS

    更新日期:2016-10-01 00:00:00

  • When and why might a computer-aided detection (CAD) system interfere with visual search? An eye-tracking study.

    abstract:RATIONAL AND OBJECTIVES:Computer-aided detection (CAD) systems are intended to improve performance. This study investigates how CAD might actually interfere with a visual search task. This is a laboratory study with implications for clinical use of CAD. METHODS:Forty-seven naive observers in two studies were asked to ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.05.013

    authors: Drew T,Cunningham C,Wolfe JM

    更新日期:2012-10-01 00:00:00

  • Variability in Individual Radiologist BI-RADS 3 Usage at a Large Academic Center: What's the Cause and What Should We Do About It?

    abstract:RATIONALE AND OBJECTIVES:Although the breast imaging reporting and data system (BI-RADS) lists specific criteria for designating a lesion as BI-RADS category 3 (probably benign), there are no target benchmarks for BI-RADS 3 usage rates. This study investigates the variability of BI-RADS 3 rates among a group of academi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.09.002

    authors: Ambinder EB,Mullen LA,Falomo E,Myers K,Hung J,Lee B,Harvey SC

    更新日期:2019-07-01 00:00:00

  • Evaluation of Intracranial Vascular Status in Patients with Acute Ischemic Stroke by Time Maximum Intensity Projection CT Angiography: A Preliminary Study.

    abstract:RATIONALE AND OBJECTIVES:To describe the application of time maximum intensity projection CTA (t-MIP CTA) in acute ischemic stroke and compare t-MIP CTA and single-phase CTA (sCTA) in assessing collateral circulation and predicting prognosis. MATERIALS AND METHODS:Twenty-nine acute ischemic stroke patients who underwe...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.06.013

    authors: Cao R,Jiang Y,Lu J,Wu G,Zhang L,Chen J

    更新日期:2020-05-01 00:00:00

  • Quality of communication: different patterns of reporting the location of the tip of a nasogastric tube.

    abstract:PURPOSE:This investigation is part of a prospective National Institutes of Health-funded study evaluating three different methods for estimating the optimal length for placement of a new nasogastric (NG) tube. Abdomen radiographs were required to determine the location of the tube tip. Our objective was to analyze diff...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.02.007

    authors: Cohen MD,Ellett M

    更新日期:2012-06-01 00:00:00

  • Augmented Radiologist Workflow Improves Report Value and Saves Time: A Potential Model for Implementation of Artificial Intelligence.

    abstract:RATIONALE AND OBJECTIVES:Our primary aim was to improve radiology reports by increasing concordance of target lesion measurements with oncology records using radiology preprocessors (RP). Faster notification of incidental actionable findings to referring clinicians and clinical radiologist exam interpretation time savi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.09.014

    authors: Do HM,Spear LG,Nikpanah M,Mirmomen SM,Machado LB,Toscano AP,Turkbey B,Bagheri MH,Gulley JL,Folio LR

    更新日期:2020-01-01 00:00:00

  • DICOM router: an open source toolbox for communication and correction of DICOM objects.

    abstract:RATIONALE AND OBJECTIVE:Today, the exchange of medical images and clinical information is well defined by the digital imaging and communications in medicine (DICOM) and Health Level Seven (ie, HL7) standards. The interoperability among information systems is specified by the integration profiles of IHE (Integrating the...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2004.11.015

    authors: Hackländer T,Kleber K,Martin J,Mertens H

    更新日期:2005-03-01 00:00:00