Some practical issues of experimental design and data analysis in radiological ROC studies.

Abstract:

:Receiver operating characteristic (ROC) analysis has been used in a broad variety of medical imaging studies during the past 15 years, and its advantages over more traditional measures of diagnostic performance are now clearly established. But despite the essential simplicity of the approach, workers in the field often find--sometimes only after an ROC study is under way--that a number of subtle issues related to experimental design and data analysis must be confronted in practice. Many of these issues have not been discussed in the literature in detail, and most are not well known. The purposes of this paper are to make users of ROC methodology in medical imaging aware of potential problems that should be confronted before an ROC study is begun and to indicate, at least broadly, how those problems may be dealt with, given the present state of the art. Some of the issues raised here can be addressed adequately by easily prescribed techniques, whereas others remain difficult and will be resolved fully only by new methodologic developments.

journal_name

Invest Radiol

journal_title

Investigative radiology

authors

Metz CE

doi

10.1097/00004424-198903000-00012

subject

Has Abstract

pub_date

1989-03-01 00:00:00

pages

234-45

issue

3

eissn

0020-9996

issn

1536-0210

journal_volume

24

pub_type

杂志文章
  • The use of a thrombus-specific ultrasound contrast agent to detect thrombus in arteriovenous fistulae.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the use of a new thrombus-specific ultrasound contrast agent, MRX-408, in the ultrasonic detection of thrombus in arteriovenous (AV) fistulae. METHODS:Six purpose-bred mongrels with two AV fistulae each were imaged with gray-scale ultrasound 7 weeks after graft implantation before ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-200001000-00010

    authors: Unger E,Metzger P 3rd,Krupinski E,Baker M,Hulett R,Gabaeff D,Mills J,Ihnat D,McCreery T

    更新日期:2000-01-01 00:00:00

  • Low-dose spiral computed tomography of the thorax: comparison with the standard-dose technique.

    abstract:RATIONALE AND OBJECTIVES:This study was conducted to determine whether significant reduction in radiation dose (250 mAs-->50 mAs), in chest computed tomography (CT) using volume acquisition affects image quality or the detectability of pathologic findings in the lung and mediastinum. METHODS:Phantom studies were condu...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199802000-00002

    authors: Takahashi M,Maguire WM,Ashtari M,Khan A,Papp Z,Alberico R,Campbell W,Eacobacci T,Herman PG

    更新日期:1998-02-01 00:00:00

  • Digital radiography versus conventional radiography for the detection of a skull fracture under varying exposure parameters.

    abstract:RATIONALE AND OBJECTIVES:The effect of varying exposure parameters on the detectability of a fracture with digital and conventional radiography were examined. METHODS:A macerated fractured skull was imaged by film-screen radiography (FSR) and digital storage phosphor radiography (DR) with various exposure values. Five...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199303000-00010

    authors: Langen HJ,Klein HM,Wein B,Schiwy-Bochat KH,Stargardt A,Günther RW

    更新日期:1993-03-01 00:00:00

  • The clotting issue: etiologic factors in thromboembolism. II. Clinical considerations.

    abstract:RATIONALE AND OBJECTIVES:The authors analyze the origins of the "clotting issue," the controversy that began in the 1980s when contrast media, once perceived as good flushing agents for catheters because of their assumed anticoagulant properties, came under attack for allegedly causing thromboembolism. Laboratory studi...

    journal_title:Investigative radiology

    pub_type: 杂志文章,评审

    doi:

    authors: Dawson P,Cousins C,Bradshaw A

    更新日期:1993-11-01 00:00:00

  • Evaluation of iron content in human cerebral cavernous malformation using quantitative susceptibility mapping.

    abstract:OBJECTIVES:The aims of this study were to investigate and validate quantitative susceptibility mapping (QSM) for lesional iron quantification in cerebral cavernous malformations (CCMs). MATERIALS AND METHODS:Magnetic resonance imaging studies were performed in phantoms and 16 patients on a 3-T scanner. Susceptibility ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000043

    authors: Tan H,Liu T,Wu Y,Thacker J,Shenkar R,Mikati AG,Shi C,Dykstra C,Wang Y,Prasad PV,Edelman RR,Awad IA

    更新日期:2014-07-01 00:00:00

  • Preliminary evaluation of Hexabrix for temporomandibular joint arthrography.

    abstract::A double-blind randomized study of ten patients compared Hexabrix 32% to Renografin-60 in TMJ arthrography. Equivalent volumes of contrast material were injected under fluoroscopic observation, with film quality and patient subjective response graded independently by three radiologists. In immediate arthrogram quality...

    journal_title:Investigative radiology

    pub_type: 临床试验,杂志文章

    doi:10.1097/00004424-198411001-00032

    authors: Katzberg RW

    更新日期:1984-11-01 00:00:00

  • Characterization of radial forces in Z stents.

    abstract:RATIONAL AND OBJECTIVES:The purpose of this study was to evaluate the effects of variation in design parameters on the resultant radial force. We evaluated the influence of wire gauge, leg length, and number of bends on the radial force produced by z stents and compared these with radial forces produced by commercial s...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-200109000-00004

    authors: Snowhill PB,Nosher JL,Siegel RL,Silver FH

    更新日期:2001-09-01 00:00:00

  • Comparison of the Relaxivities of Macrocyclic Gadolinium-Based Contrast Agents in Human Plasma at 1.5, 3, and 7 T, and Blood at 3 T.

    abstract:PURPOSE:The relaxivities of 3 macrocyclic gadolinium-based contrast agents (GBCAs) were determined in human plasma and blood under standardized and clinically relevant laboratory conditions. METHODS:The T1 relaxivity, r1, was determined in human plasma at 1.5, 3, and 7 T, and in human blood at 3 T at 37°C in phantoms ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000577

    authors: Szomolanyi P,Rohrer M,Frenzel T,Noebauer-Huhmann IM,Jost G,Endrikat J,Trattnig S,Pietsch H

    更新日期:2019-09-01 00:00:00

  • Comparison of Routine Brain Imaging at 3 T and 7 T.

    abstract:OBJECTIVE:The aim of this study was to compare quantitative and semiquantitative parameters (signal-to-noise ratio [SNR], contrast-to-noise ratio [CNR], image quality, diagnostic confidence) from a standard brain magnetic resonance imaging examination encompassing common neurological disorders such as demyelinating dis...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000256

    authors: Springer E,Dymerska B,Cardoso PL,Robinson SD,Weisstanner C,Wiest R,Schmitt B,Trattnig S

    更新日期:2016-08-01 00:00:00

  • Contrast media for CT. An analysis of the early pharmacokinetics.

    abstract::Iohexol and meglumine-sodium diatrizoate were injected intravenously into 18 pigs as either a 99:1 or 1:99 mixture. Blood samples were taken for 30 minutes and the concentration of each of the two contrast media was measured by means of a double labeling technique with 125I and 131I. Relative concentrations of iohexol...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198511000-00016

    authors: Jensen LI,Dean PB,Nyman U,Golman K

    更新日期:1985-11-01 00:00:00

  • Diminished cerebrospinal fluid beta-endorphin concentration in monkeys with arachnoiditis.

    abstract::Altered concentrations of brain beta endorphin and spinal cord encephalin have been reported in mice with iatrogenic arachnoiditis. We measured beta-endorphin concentration in cerebrospinal fluid (CSF) in normal monkeys and in monkeys with various degrees of arachnoiditis resulting from myelography and spinal surgery ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198803000-00006

    authors: Lipman BT,Haughton VM

    更新日期:1988-03-01 00:00:00

  • MRI dosimetry: a fast quantitative MRI method to determine 3D absorbed dose distributions.

    abstract:RATIONALE AND OBJECTIVES:Magnetic resonance imaging (MRI) techniques seem to be very promising for 3D dosimetry studies, but long imaging acquisition time limits their use. A new fast T1 mapping protocol, easy to implement on a conventional MR imager, has been used to determine dose distributions on Fricke gels. METHO...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199903000-00014

    authors: Calmet C,Vincensini D,Bonnet J,Bertino C,Catala A,Martinez M,Joffre F

    更新日期:1999-03-01 00:00:00

  • A method for evaluating the bronchial circulation. Preliminary observations.

    abstract::Due to the small size of the bronchial arteries, the bronchial circulation is difficult to study and remains poorly understood. We have utilized single photon emission computed tomography (SPECT) as a noninvasive means of studying the bronchial circulation. Imaging studies were performed in sheep before and after the ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199001000-00014

    authors: Chiles C,Newman GE,Blinder RA

    更新日期:1990-01-01 00:00:00

  • Intrapulmonary 3He gas distribution depending on bolus size and temporal bolus placement.

    abstract:OBJECTIVE:Dynamic ventilation (3)He-MRI is a new method to assess pulmonary gas inflow. As differing airway diameters throughout the ventilatory cycle can influence gas inflow this study intends to investigate the influence of volume and timing of a He gas bolus with respect to the beginning of the tidal volume on insp...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e3181690111

    authors: Gast KK,Hawig K,Windirsch M,Markstaller K,Schreiber WG,Schmiedeskamp J,Düber C,Kauczor HU,Heussel CP

    更新日期:2008-06-01 00:00:00

  • Mechanism of hepatic parenchyma-specific contrast of microbubble-based contrast agent for ultrasonography: microscopic studies in rat liver.

    abstract:OBJECTIVE:The objective of this study was to elucidate the mechanism of hepatic parenchyma-specific contrast of Sonazoid (microbubble contrast agent) using microscopic techniques. MATERIALS AND METHODS:Sonazoid was intravenously injected into rats to investigate the microbubble dynamics and distribution within hepatic...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e31805f2682

    authors: Watanabe R,Matsumura M,Munemasa T,Fujimaki M,Suematsu M

    更新日期:2007-09-01 00:00:00

  • Ultrasound-guided, percutaneous cryotherapy of small (< or = 15 mm) breast cancers.

    abstract:RATIONALE AND OBJECTIVE:The purpose of this study was to investigate the feasibility, efficacy, and safety of ultrasound-guided percutaneous cryotherapy of stage T1 breast cancers. MATERIALS AND METHODS:Thirty patients with biopsy-confirmed breast cancers with tumor diameters of 15 mm or smaller (range, 5-15 mm; media...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000166935.56971.ff

    authors: Pfleiderer SO,Marx C,Camara O,Gajda M,Kaiser WA

    更新日期:2005-07-01 00:00:00

  • Evaluation of CT time-density curves of lower-limb veins.

    abstract:UNLABELLED:Szapiro D, Ghaye B, Willems V, et al. Evaluation of CT time-density curves of lower-limb veins. Invest Radiol 2001;36:164-169. RATIONALE AND OBJECTIVES:To evaluate time-density curves of the lower-limb veins for optimization of CT venography. METHODS:Fifty patients referred for chest CT were randomized int...

    journal_title:Investigative radiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00004424-200103000-00005

    authors: Szapiro D,Ghaye B,Willems V,Zhang L,Albert A,Dondelinger RF

    更新日期:2001-03-01 00:00:00

  • Time continuous tracking and segmentation of cardiovascular magnetic resonance images using multidimensional dynamic programming.

    abstract::In this article, we propose a semiautomatic method for time-continuous contour detection in all phases of the cardiac cycle in magnetic resonance sequences. The method is based on multidimensional dynamic programming. After shape parameterization, cost hypercubes are filled with image-feature derived cost function val...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000194070.88432.24

    authors: Uzümcü M,van der Geest RJ,Swingen C,Reiber JH,Lelieveldt BP

    更新日期:2006-01-01 00:00:00

  • Curved reconstructions versus three-dimensional surface rendering in the demonstration of cortical lesions in patients with extratemporal epilepsy.

    abstract:RATIONALE AND OBJECTIVES:To compare the visibility and localization of extratemporal cortical lesions in extratemporal epilepsy by using curved reconstruction (CR) and three-dimensional surface rendering (3D SR) of 3D-acquired MR images and to study the degree of confidence with which localizations are made, particular...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-200104000-00005

    authors: Meiners LC,Scheffers JM,De Kort GA,Burger H,Van Huffelen AC,Van Rijen PC,Van Veelen CW

    更新日期:2001-04-01 00:00:00

  • Model-based iterative reconstruction technique for ultralow-dose computed tomography of the lung: a pilot study.

    abstract:OBJECTIVES:The aim of this study was to assess the effectiveness of a model-based iterative reconstruction (MBIR) in improving image quality and diagnostic performance of ultralow-dose computed tomography (ULDCT) of the lung. MATERIALS AND METHODS:The institutional review board approved this study, and all patients pr...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e3182562a89

    authors: Yamada Y,Jinzaki M,Tanami Y,Shiomi E,Sugiura H,Abe T,Kuribayashi S

    更新日期:2012-08-01 00:00:00

  • Analysis of edge-tracking errors inherent in fluoroscopic images of the beating heart.

    abstract:RATIONALE AND OBJECTIVES:Because of the complex relationships between the dynamic three-dimensional cardiac surface shape and its projected image, errors arise with the use of two-dimensional silhouettes to measure displacements of the heart. The character and frequency of such errors are examined. METHODS:A high-prec...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199403000-00004

    authors: McInerney JJ,Weldner PW,Herr MD,Copenhaver GL

    更新日期:1994-03-01 00:00:00

  • Changes in complement and coagulation factors in a patient suffering a severe anaphylactoid reaction to injected contrast material: some considerations of pathogenesis.

    abstract::A patient, suffering a severe anaphylactoid reaction to contrast material injected for an intravenous pyelogram, developed a consumption coagulopathy and evidence of complement activation. Precontrast complement values suggested that the patient had been processing complement via the classical pathway, perhaps as a co...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198011001-00004

    authors: Lasser EC,Lang JH,Lyon SG,Hamblin AE

    更新日期:1980-11-01 00:00:00

  • Stability of MRI paramagnetic contrast media: a proton relaxometric protocol for transmetallation assessment.

    abstract:RATIONALE AND OBJECTIVES:The suitability of paramagnetic complexes as magnetic resonance contrast agents depends on various factors such as their relaxivity, stability, selectivity, and the inertness toward transmetallation by endogenous ions. The transmetallation of a series of 18 gadolinium complexes by the Zn2+ ion ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-200102000-00008

    authors: Laurent S,Elst LV,Copoix F,Muller RN

    更新日期:2001-02-01 00:00:00

  • Specific enhancement of intra-abdominal abscesses with perfluoroctylbromide for CT imaging.

    abstract::Perfluoroctylbromide (PFOB), a radiopaque reticuloendothelial system contrast media for computed tomography, has been shown to accumulate in macrophages. In the current study PFOB was tested in rabbits as an abscess imaging agent. Two abscesses were induced in each of 24 rabbits, one in the liver and the other in the ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198409000-00017

    authors: Mattrey RF,Andrè M,Campbell J,Mitten R,Multer F,Hackney D,Long DM,Higgins CB

    更新日期:1984-09-01 00:00:00

  • AUR Memorial Award 1993. A drug system (PDH) for interventional radiology. Synthesis, properties, and efficacy.

    abstract:RATIONALE AND OBJECTIVES:The authors synthesized and tested a novel hydrogel system proposed for use in extra- and intravascular radiologic interventions, such as chemoembolizations and embolizations, and as a vehicle for sustained drug release. MATERIALS:The material was specifically designed to meet the prerequisite...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199312000-00001

    authors: Weissleder R,Bogdanov A,Frank H,Nossiff N,Bogdanova A,Schaffer BK,Brady T,Wittenberg J

    更新日期:1993-12-01 00:00:00

  • Gelatin encapsulated nitrogen microbubbles as ultrasonic contrast agents.

    abstract::Gelatin encapsulated nitrogen microbubbles were effective ultrasonic contrast agents in in vitro phantom and in vivo rabbit V2 carcinoma studies. Intra-arterial injection of 80-micrometer gelatin encapsulated nitrogen microbubbles appeared to improve tumor visualization by rim enhancement, which persisted for several ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198005000-00013

    authors: Carroll BA,Turner RJ,Tickner EG,Boyle DB,Young SW

    更新日期:1980-05-01 00:00:00

  • The use of continuous and discrete confidence judgments in receiver operating characteristic studies of diagnostic imaging techniques.

    abstract::Virtually all receiver operating characteristic (ROC) studies of medical imaging methods have involved data collected on a discrete confidence-rating scale, though in principle ROC studies can be conducted with either discrete or continuous scales. Continuous scales provide potential advantages in medical applications...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199202000-00016

    authors: Rockette HE,Gur D,Metz CE

    更新日期:1992-02-01 00:00:00

  • High-resolution magnetic resonance imaging at 2 Tesla: potential for atherosclerotic lesions exploration in the apolipoprotein E knockout mouse.

    abstract:INTRODUCTION:The aim of the present study was to evaluate the potential of high-resolution MRI at 2 Tesla (T) for direct noninvasive imaging of the aortic wall in a mouse model of atherosclerosis. MATERIAL AND METHODS:A specific mouse antenna was developed and sequence parameters were adjusted. T(1)- and T2-weighted i...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000067491.31978.1c

    authors: Chaabane L,Soulas EC,Contard F,Salah A,Guerrier D,Briguet A,Douek P

    更新日期:2003-08-01 00:00:00

  • 18F-Fluorodeoxyglucose Positron Emission Tomography/Magnetic Resonance in Lymphoma: Comparison With 18F-Fluorodeoxyglucose Positron Emission Tomography/Computed Tomography and With the Addition of Magnetic Resonance Diffusion-Weighted Imaging.

    abstract:OBJECTIVES:The aim of this study was to compare F-fluorodeoxyglucose (FDG) positron emission tomography (PET)/magnetic resonance (MR) (with and without diffusion-weighted imaging [DWI]) to F-FDG PET/computed tomography (CT), with regard to the assessment of nodal and extranodal involvement, in patients with Hodgkin lym...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000218

    authors: Giraudo C,Raderer M,Karanikas G,Weber M,Kiesewetter B,Dolak W,Simonitsch-Klupp I,Mayerhoefer ME

    更新日期:2016-03-01 00:00:00

  • Detection of emphysema with computed tomography. Correlation with pulmonary function tests and chest radiography.

    abstract::We studied 60 male patients who had concurrent chest films (CXR), computed tomography scans (CT) and pulmonary function tests (PFT) to assess the sensitivity of CT and conventional films in detecting emphysema compared with PFT. We also sought to determine whether emphysema could be diagnosed by CT in patients with no...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198804000-00004

    authors: Sanders C,Nath PH,Bailey WC

    更新日期:1988-04-01 00:00:00