Evaluation of radiologist interpretive performance using blinded reads by multiple external readers.

Abstract:

OBJECTIVE:To demonstrate a method of assessing radiologic diagnostic agreement utilizing multiple blinded external readers. METHODS:Six body CT studies interpreted by one reader (primary reader) at the host institution were compiled with patient identifiers removed. Brief clinical histories that were available to the primary reader were provided. Radiologists at 22 centers participated and the interpretations were analyzed in aggregate with the consensus majority that served as the surrogate gold standard for each case. RESULTS:A total of 31 radiologists formed the group of secondary readers with two-thirds in academic practice averaging 8 years of experience (range: 1-25 years). The average findings per reader for cases A to F include: 1.9 (range: 1-5), 6.3 (range: 2-10), 10.4 (range: 7-14), 5.7 (range: 3-10), 4.2 (range: 2-8), and 3.8 (range: 1-7), respectively. There was agreement of the primary interpretation and the surrogate gold standard for each case. CONCLUSIONS:The results of our study demonstrate a wide range of interpretation, with wider ranges observed in more complex cases and with vague clinical complaints. Comparison to the primary reader required the use of aggregate analysis and an agreement percentage cutoff to minimize bias and the limitations of this type of study. An intensive evaluation of radiologist performance such as this could be considered in various settings such as a quality assurance program, intense scrutiny of an individual radiologist whether competency is in question, or for medicolegal purpose to ascertain standard of care.

journal_name

Invest Radiol

journal_title

Investigative radiology

authors

Ryan AF,Semelka RC,Molina PL,Yonkers S,Vaidean G

doi

10.1097/RLI.0b013e3181d2ee97

subject

Has Abstract

pub_date

2010-04-01 00:00:00

pages

211-6

issue

4

eissn

0020-9996

issn

1536-0210

journal_volume

45

pub_type

杂志文章
  • Inhibition of restenosis in stented porcine coronary arteries: uptake of Paclitaxel from angiographic contrast media.

    abstract:RATIONALE AND OBJECTIVES:Paclitaxel added to angiographic contrast medium (CM) has been shown to inhibit restenosis in the porcine coronary overstretch model. This study determined early local tissue concentrations after the administration of different paclitaxel doses and preparations. MATERIALS AND METHODS:Fifteen p...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000116125.96544.64

    authors: Speck U,Scheller B,Abramjuk C,Grossmann S,Mahnkopf D,Simon O

    更新日期:2004-03-01 00:00:00

  • CT Dosimetry: What Has Been Achieved and What Remains to Be Done.

    abstract::Radiation dose in computed tomography (CT) has become a hot topic due to an upward trend in the number of CT procedures worldwide and the relatively high doses associated with these procedures. The main aim of this review article is to provide an overview of the most frequently used metrics for CT radiation dose chara...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000727

    authors: Damilakis J

    更新日期:2021-01-01 00:00:00

  • Extravascular extravasation of radiographic contrast media. Effects of conventional and low-osmolar agents in the rat thigh.

    abstract::We compared the damage resulting from intradermal injection of four commonly used radiographic contrast media in laboratory rats. Sixty percent meglumine diatrizoate (Reno M 60) and ioxaglate (Hexabrix) produced significantly more ulceration and crusting on gross inspection and more necrosis, edema, and hemorrhage on ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199005000-00006

    authors: Cohan RH,Leder RA,Bolick D,Herzberg AJ,Hedlund LW,Wheeler CT,Helms MJ,Dunnick NR

    更新日期:1990-05-01 00:00:00

  • Interventional atrioseptostomy by application of monopolar high-frequency alternating current. In vitro evaluation of a new device.

    abstract:RATIONALE AND OBJECTIVES:The authors evaluate the use of a new device for interventional creation of atrial septal defects (ASD) working with high-frequency alternating current in an in vitro study with porcine atria. METHODS:The device consists of a symmetrical cage of six superelastic monofile wires, including a mic...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199702000-00003

    authors: Grabitz RG,Handt S,Vanopbroeke HJ,Seghaye MC,Franke A,Osypka P,von Bernuth G

    更新日期:1997-02-01 00:00:00

  • Normal renal blood flow measurement using phase-contrast cine magnetic resonance imaging.

    abstract:RATIONALE AND OBJECTIVES:This study assesses the ability of a cardiac-gated phase-contrast magnetic resonance imaging (MRI) technique to measure renal blood flow (RBF) noninvasively in humans. METHODS:In nine normal volunteers, total RBF in the renal arteries and in the left renal vein was estimated by MRI and correla...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199206000-00012

    authors: Sommer G,Noorbehesht B,Pelc N,Jamison R,Pinevich AJ,Newton L,Myers B

    更新日期:1992-06-01 00:00:00

  • MR cholangiopancreatography at 3.0 T: intraindividual comparative study with MR cholangiopancreatography at 1.5 T for clinical patients.

    abstract:OBJECTIVES:To prospectively evaluate the image quality and diagnostic accuracy of magnetic resonance cholangiopancreatography (MRCP) at 3.0 T compared with that at 1.5 T used for patients. MATERIALS AND METHODS:This study was approved by our institutional review board, and informed consent was obtained from all patien...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e3181b4c0ae

    authors: Onishi H,Kim T,Hori M,Murakami T,Tatsumi M,Nakaya Y,Nakamoto A,Osuga K,Tomoda K,Nakamura H

    更新日期:2009-09-01 00:00:00

  • Magnetization Transfer Imaging Predicts Porcine Kidney Recovery After Revascularization of Renal Artery Stenosis.

    abstract:MATERIALS AND METHODS:Stenotic kidney (STK) and contralateral kidney magnetization transfer ratios (MTRs; Mt/M0) were measured at 3.0-T magnetic resonance imaging, at offset frequencies of 600 and 1000 Hz, before and 1 month post-PTRA in 7 RVD pigs. Stenotic kidney MTR was correlated to renal perfusion, renal blood flo...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000711

    authors: Afarideh M,Jiang K,Ferguson CM,Woollard JR,Glockner JF,Lerman LO

    更新日期:2021-02-01 00:00:00

  • Radiolabeled leukocytes and platelets.

    abstract::Radiolabeled blood cells are widely used for both clinical and research studies. In vitro and in vivo studies have shown the tagging process does not significantly affect function. The labeling techniques and clinical uses of labeled leukocytes and platelets are reviewed. ...

    journal_title:Investigative radiology

    pub_type: 杂志文章,评审

    doi:10.1097/00004424-198603000-00001

    authors: Datz FL

    更新日期:1986-03-01 00:00:00

  • Pathophysiology of radiocontrast nephropathy: a role for medullary hypoxia.

    abstract::Recent experimental data underlies the role of hypoxic tubular injury in the pathophysiology of radiocontrast nephropathy. Although systemic transient hypoxemia, increased blood viscosity, and a leftward shift of the oxygen-hemoglobin dissociation curve may all contribute to intrarenal hypoxia, imbalance between oxyge...

    journal_title:Investigative radiology

    pub_type: 杂志文章,评审

    doi:10.1097/00004424-199911000-00004

    authors: Heyman SN,Reichman J,Brezis M

    更新日期:1999-11-01 00:00:00

  • Diagnostic performance of dark-blood T2-weighted CMR for evaluation of acute myocardial injury.

    abstract:OBJECTIVES:We compared the image quality and diagnostic performance of 2 fat-suppression methods for black-blood T2-weighted fast spin-echo (FSE), which are as follows: (a) short T1 inversion recovery (STIR; FSE-STIR) and (b) spectral adiabatic inversion recovery (SPAIR; FSE-SPAIR), for detection of acute myocardial in...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e3182718672

    authors: Srichai MB,Lim RP,Lath N,Babb J,Axel L,Kim D

    更新日期:2013-01-01 00:00:00

  • Hepatic kinetics and magnetic resonance imaging of gadolinium-EOB-DTPA in dogs.

    abstract:RATIONALE AND OBJECTIVES:To measure the hepatic uptake and biliary elimination kinetics of gadolinium (Gd)-EOB-DTPA in dogs. METHOD:Two groups of four beagles each were anesthetized and given an intravenous bolus of 25 mumol/kg or 250 mumol/kg of Gd-EOB-DTPA. Blood, hepatic bile, and urine were collected over 140 minu...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199604000-00005

    authors: Benness G,Khangure M,Morris I,Warwick A,Burrows P,Vogler H,Weinmann HJ

    更新日期:1996-04-01 00:00:00

  • Activities of the Conjoint Committee. Enhancement of diagnostic radiologic research and education.

    abstract::Even though we have made much progress over the last decade, much still needs to be done. I am personally very pleased with the excellent management and authority of my coauthor, Joe Frank, in assuming the Acting Directorship of our DRRP. You will be hearing more from him in the immediate future about this research pr...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199304001-00014

    authors: Putman CE,Frank JA

    更新日期:1993-04-01 00:00:00

  • AcidoCEST-UTE MRI for the Assessment of Extracellular pH of Joint Tissues at 3 T.

    abstract:OBJECTIVES:The goal of this study was to demonstrate feasibility of measuring extracellular pH in cartilage and meniscus using acidoCEST technique with a 3-dimensional ultrashort echo time readout (acidoCEST-UTE) magnetic resonance imaging (MRI). MATERIALS AND METHODS:Magnetization transfer ratio asymmetry, radiofrequ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0000000000000576

    authors: Ma YJ,High RA,Tang Q,Wan L,Jerban S,Du J,Chang EY

    更新日期:2019-09-01 00:00:00

  • Detection of low-contrast signals. A comparison of observers with and without radiology training.

    abstract::Sixteen observers averaging 7.4 years experience in interpreting radiology images and 16 observers without radiology training were tested for their ability to detect low-contrast signals in structured noise backgrounds using a digital display system. No significant difference in true positives, false positives, time t...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198704000-00006

    authors: Rackow PL,Spitzer VM,Hendee WR

    更新日期:1987-04-01 00:00:00

  • Some practical issues of experimental design and data analysis in radiological ROC studies.

    abstract::Receiver operating characteristic (ROC) analysis has been used in a broad variety of medical imaging studies during the past 15 years, and its advantages over more traditional measures of diagnostic performance are now clearly established. But despite the essential simplicity of the approach, workers in the field ofte...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198903000-00012

    authors: Metz CE

    更新日期:1989-03-01 00:00:00

  • CTA contrast enhancement of the aorta and pulmonary artery: the effect of saline chase injected at two different rates in a canine experimental model.

    abstract:OBJECTIVE:To investigate the effect of saline chase injected at 2 different rates on computed tomography (CT) angiography. MATERIALS AND METHODS:This study was approved by our institutional animal study committee. Three injection protocols were used; contrast injection (24 mL, 0.8 mL/s) without saline chase (protocol ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e318032a9fe

    authors: Lee CH,Goo JM,Bae KT,Lee HJ,Kim KG,Chun EJ,Park CM,Im JG

    更新日期:2007-07-01 00:00:00

  • High-resolution magnetic resonance imaging at 2 Tesla: potential for atherosclerotic lesions exploration in the apolipoprotein E knockout mouse.

    abstract:INTRODUCTION:The aim of the present study was to evaluate the potential of high-resolution MRI at 2 Tesla (T) for direct noninvasive imaging of the aortic wall in a mouse model of atherosclerosis. MATERIAL AND METHODS:A specific mouse antenna was developed and sequence parameters were adjusted. T(1)- and T2-weighted i...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000067491.31978.1c

    authors: Chaabane L,Soulas EC,Contard F,Salah A,Guerrier D,Briguet A,Douek P

    更新日期:2003-08-01 00:00:00

  • Cerebral computed tomography angiography using a low tube voltage (80 kVp) and a moderate concentration of iodine contrast material: a quantitative and qualitative comparison with conventional computed tomography angiography.

    abstract:OBJECTIVE:To investigate the feasibility of an 80-kVp protocol using a moderate concentration contrast material (MC-CM) for cerebral computed tomography angiography by comparison with a conventional 120-kVp protocol using a high concentration contrast material (HC-CM). MATERIALS AND METHODS:Attenuation values and sign...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e31823076a4

    authors: Cho ES,Chung TS,Oh DK,Choi HS,Suh SH,Lee HK,Lee KH

    更新日期:2012-02-01 00:00:00

  • Radiologic-pathologic-clinical correlation in mechanisms of disease course.

    abstract::The interdisciplinary approach to medical education has often been deficient in medical school curricula. Because of the nonintegrated approach to medical education, problem solving capabilities are not fostered. The clinical presentation of a patient, the imaging modalities used to investigate the patient, and the ul...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198604000-00015

    authors: Oldham SA,Jacobson F

    更新日期:1986-04-01 00:00:00

  • Pyelovenous and pyelolymphatic backflow during retrograde pyelography in renal vein thrombosis.

    abstract::Pyelovenous and pyelolymphatic backflow have been observed during retrograde pyelography in three patients with renal vein thrombosis. The radiographic patterns of backflow following experimental unilateral renal vein occlusion in rabbits were analyzed and correlated with the clinical findings. Capsular, perihilar, pe...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198101000-00003

    authors: Bidgood WD Jr,Cuttino JT Jr,Clark RL,Volberg FM

    更新日期:1981-01-01 00:00:00

  • Influence of soft tissue (fat and fat-free mass) on ultrasound bone velocity: an in vivo study.

    abstract:RATIONALE AND OBJECTIVES:The authors determine the relative effect of soft-tissue compartments, body fat (percent [%Bfat] and weight [Bfat kg]) and fat-free mass (FFM kg), on measurements of ultrasound bone velocity (UBV m/second). METHODS:The authors measured UBV in proximal phalanxes and body fat and fat-free mass b...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199710000-00005

    authors: Gómez M,Aguado F,Manuel J,Menéndez JM,Revilla M,Villa LF,Cortés J,Rico H

    更新日期:1997-10-01 00:00:00

  • Evaluation of intrarenal oxygenation at 3.0 T using 3-dimensional multiple gradient-recalled echo sequence.

    abstract:OBJECTIVE:The objective of this study was to validate quantitation of R2* and DeltaR2* measurements obtained with a 3-dimensional (3-D) multiple gradient-recalled echo (mGRE) sequence for evaluating intrarenal oxygenation in humans. MATERIALS AND METHODS:Validation was accomplished (1) by comparing R2* values with pre...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/01.rli.0000187166.43871.fb

    authors: Tumkur S,Vu A,Li L,Prasad PV

    更新日期:2006-02-01 00:00:00

  • A large animal model (swine) to study the diagnosis and treatment of cholelithiasis.

    abstract::Human gallstones were surgically placed into the gallbladders of 200 swine. Eight of these swine were used as a prospective series to verify that the placement and presence of human gallstones in their gallbladders caused no significant pathologic changes in the gallbladder and that the gallstones were not spontaneous...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-198902000-00005

    authors: Griffith SL,Burney BT,Fry FJ,Franklin TD Jr

    更新日期:1989-02-01 00:00:00

  • 3 T contrast-enhanced magnetic resonance angiography for evaluation of the intracranial arteries: comparison with time-of-flight magnetic resonance angiography and multislice computed tomography angiography.

    abstract:PURPOSE:We sought to prospectively evaluate the image quality and visualization of the intracranial arteries using high spatial resolution contrast-enhanced magnetic resonance angiography (CE-MRA) at 3 T and to perform intraindividual comparison with time-of-flight (TOF) MRA and multislice CT angiography (CTA). MATERI...

    journal_title:Investigative radiology

    pub_type: 临床试验,杂志文章

    doi:10.1097/01.rli.0000242835.00032.f5

    authors: Villablanca JP,Nael K,Habibi R,Nael A,Laub G,Finn JP

    更新日期:2006-11-01 00:00:00

  • The current status of total joint replacement.

    abstract::The last two decades have witnessed tremendous strides in the evolution of acceptable and successful methods of prosthetic replacement for the arthritic joint. By and large, these techniques are predictable and durable, though not always to the complete satisfaction of the patient and surgeon. Despite the recent empha...

    journal_title:Investigative radiology

    pub_type: 杂志文章,评审

    doi:10.1097/00004424-199001000-00022

    authors: Volz RG,Benjamin JB

    更新日期:1990-01-01 00:00:00

  • An overview of neck node sonography.

    abstract:RATIONALE AND OBJECTIVES:Gray scale and power Doppler sonography are commonly used to evaluate cervical lymph nodes. This study was undertaken to identify which of the features used in ultrasound of cervical lymph nodes is readily applicable in routine clinical practice. METHODS:Two hundred and eight-six patients diag...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-200206000-00005

    authors: Ahuja A,Ying M

    更新日期:2002-06-01 00:00:00

  • Experimental arterial stent placement. Comparison of a new Nitinol stent and Wallstent.

    abstract:RATIONALE AND OBJECTIVES:To compare technical aspects and neointima formation of a new Nitinol stent and a Wallstent. METHODS:A Nitinol sten and a Wallstent were placed into the iliac arteries of 14 sheep (total of 28 stents) and followed angiographically. Seven sheep were killed after 1 month and 7 after 4.5 months. ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199507000-00004

    authors: Schürmann K,Vorwerk D,Kulisch A,Stroehmer-Kulisch E,Biesterfeld S,Stopinski T,Günther RW

    更新日期:1995-07-01 00:00:00

  • Contrast media-induced renal tubular vacuolization. A light and electron microscopic study on rat kidneys.

    abstract::The morphologic changes in healthy rat kidneys (n = 102) were studied 2 or 48 hours after intravenous injection of 1 or 3 g iodine (I)/kg of high-osmolality diatrizoate, low-osmolality iopromide and iohexol, or iso-osmolality iotrolan, as well as after 0.2 or 0.6 g/kg of the high-osmolality magnetic resonance contrast...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/00004424-199110000-00009

    authors: Tervahartiala P,Kivisaari L,Kivisaari R,Virtanen I,Standertskjöld-Nordenstam CG

    更新日期:1991-10-01 00:00:00

  • Multishot targeted PROPELLER magnetic resonance imaging: description of the technique and initial applications.

    abstract:OBJECTIVES:To test the feasibility of combining inner-volume imaging (IVI) techniques with conventional multishot periodically rotated overlapping parallel lines with enhanced reconstruction (PROPELLER) techniques for targeted-PROPELLER magnetic resonance imaging. MATERIALS AND METHODS:Perpendicular section-selective ...

    journal_title:Investigative radiology

    pub_type: 杂志文章

    doi:10.1097/RLI.0b013e3181a8b015

    authors: Deng J,Larson AC

    更新日期:2009-08-01 00:00:00

  • The effects of ioxaglate 320, iohexol 350, and iopamidol 370 on erythrocyte aggregation.

    abstract::The authors report a randomized, double-blind prospective trial comparing the effects of nonionic with ionic low-osmolar contrast media on erythrocyte aggregation. The study group comprised 40 consecutive patients with pathology necessitating selective angiography. Patients were examined using either ioxaglate 320, io...

    journal_title:Investigative radiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00004424-199108000-00009

    authors: Hayes R,Mahon T,Masterson J,Owens A

    更新日期:1991-08-01 00:00:00