Selection of subtle cases for observer-performance studies: the importance of knowing the true diagnosis.

Abstract:

RATIONALE AND OBJECTIVES:To assess the usefulness of classifying degree of difficulty in abnormality detection and to determine the effect of knowing the true diagnosis when selecting subtle images for observer-performance studies. MATERIALS AND METHODS:A total of 529 posteroanterior chest images that had been used in a multiabnormality, multireader observer-performance study were rated by three observers as to the difficulty of determining the presence or absence of each abnormality when the true diagnosis was known and when it was not known. Changes in image subtlety ratings were evaluated, and actual observer-performance results for the different groups of images grouped according to raters' classifications with and without availability of the true diagnosis were compared. RESULTS:The majority of negative cases (9,168 of 12,258, 74.8%) were rated as "easy" to determine. Substantial changes were made during the selection of the "subtle" case category when the truth was known compared with when the truth was not provided. These changes caused differences between typical and subtle cases in terms of observer performance. Combined ratings of case subtlety by agreement of multiple classifiers resulted in a well-ordered selection with decreasing observer performance as a function of subtlety ratings. CONCLUSION:Cases for observer-performance studies that stress the diagnostic system can be successfully selected in the multiple-disease setting by experienced readers and should be selected with the truth known to the raters. The degree of agreement by multiple raters can be used to refine subtlety ratings.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Rockette HE,King JL,Thaete FL,Fuhrman CR,Slifko RM,Gur D

doi

10.1016/s1076-6332(98)80127-x

subject

Has Abstract

pub_date

1998-02-01 00:00:00

pages

86-92

issue

2

eissn

1076-6332

issn

1878-4046

journal_volume

5

pub_type

杂志文章
  • Reproducibility of four-dimensional computed tomography-based lung ventilation imaging.

    abstract:RATIONALE AND OBJECTIVES:A novel ventilation imaging method based on four-dimensional (4D) computed tomography (CT) has been applied to the field of radiation oncology. Understanding its reproducibility is a prerequisite for clinical applications. The purpose of this study was to quantify the reproducibility of 4D CT v...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.07.006

    authors: Yamamoto T,Kabus S,von Berg J,Lorenz C,Chung MP,Hong JC,Loo BW Jr,Keall PJ

    更新日期:2012-12-01 00:00:00

  • Data analysis for detection and localization of multiple abnormalities with application to mammography.

    abstract:RATIONALE AND OBJECTIVES:In assessing diagnostic accuracy it is often essential to determine the reader's ability both to detect and to correctly locate multiple abnormalities per patient. The authors developed a new approach for the detection and localization of multiple abnormalities and compared it with other approa...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(00)80324-4

    authors: Obuchowski NA,Lieber ML,Powell KA

    更新日期:2000-07-01 00:00:00

  • Clinical evaluation of wavelet-compressed digitized screen-film mammography.

    abstract:RATIONALE AND OBJECTIVES:The authors compared diagnostic accuracy and callback rates with conventional screen-film mammograms and wavelet-compressed digitized images. MATERIALS AND METHODS:Sixty sets of mammograms (four views per case) were digitized at a spatial resolution of 100 microm. The images were wavelet compr...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(00)80004-5

    authors: Powell KA,Mallasch PG,Obuchowski NA,Kerczewski RJ,Ganobcik SN,Cardenosa G,Chilcote W

    更新日期:2000-05-01 00:00:00

  • Magnetic resonance lymphography in rats: effects of muscular activity and hyperthermia on the lymph node uptake of intravenously injected superparamagnetic iron oxide particles.

    abstract:RATIONALE AND OBJECTIVES:We investigated the influence of muscular activity and regional body temperature changes on the accumulation of intravenously (i.v.) administered, dextran-coated superparamagnetic iron oxide (SPIO) particles in the lymph nodes of rats. METHODS:Four groups of rats (N = 21) were used. Five rats ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(96)80193-0

    authors: Elste V,Wagner S,Taupitz M,Pfefferer D,Kresse M,Hamm B,Berg R,Wolf KJ,Semmler W

    更新日期:1996-08-01 00:00:00

  • Multimodality computer-aided breast cancer diagnosis with FFDM and DCE-MRI.

    abstract:RATIONALE AND OBJECTIVES:To investigate a multimodality computer-aided diagnosis (CAD) scheme that combines image information from full-field digital mammography (FFDM) and dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) for computerized breast cancer classification. MATERIALS AND METHODS:From a retrosp...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.04.015

    authors: Yuan Y,Giger ML,Li H,Bhooshan N,Sennett CA

    更新日期:2010-09-01 00:00:00

  • Should Radiologists Comment on Incidental Findings of Vascular Calcifications Found on Abdominal/Pelvic CT in Patients Less Than 50 Years of Age?

    abstract:RATIONALE AND OBJECTIVES:To evaluate if incidental abdominopelvic calcified atherosclerosis (ACA) in patients under 50 years of age correlates with cardiovascular disease (CVD) risk factors. Most studies evaluating calcific atherosclerosis and associated increased risk of CVD have concentrated on middle age and older p...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.10.013

    authors: Bernheim A,Grunhut J,Tang A,Gofur E,Thai J,Mehta V,Stern J,Jadidi N,Hodes A,Goldwasser B,Arneja A,Krausz D,Coords M,Peti S,Chacko J,Sarkany D

    更新日期:2020-08-01 00:00:00

  • Area beam equalization: optimization and performance of an automated prototype system for chest radiography.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the feasibility and performance of an x-ray beam equalization system for chest radiography using anthropomorphic phantoms. MATERIALS AND METHODS:Area beam equalization involves the process of the initial unequalized image acquisition, attenuator thickness calculation, mask generati...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)00730-x

    authors: Xu T,Shikhaliev PM,Berenji GR,Tehranzadeh J,Saremi F,Molloi S

    更新日期:2004-04-01 00:00:00

  • Preoperative and intraoperative sonographic visibility of collagen-based breast biopsy marker clips.

    abstract:RATIONALE AND OBJECTIVES:The aim of this study was to determine the sonographic visibility of implanted collagen-based breast biopsy marker clips in the clinic and operating room. MATERIALS AND METHODS:Female patients aged > or =18 years who presented for preoperative surgical evaluation within 4 weeks of ultrasound-g...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2009.10.017

    authors: Eby PR,Calhoun KE,Kurland BF,Demartini WB,Gutierrez RL,Peacock S,Anderson BO,Byrd DR,Mann GN,Lehman CD

    更新日期:2010-03-01 00:00:00

  • Sampling variability of nonparametric estimates of the areas under receiver operating characteristic curves: an update.

    abstract:RATIONALE AND OBJECTIVES:Several methods have been proposed for calculating the variances and covariances of nonparametric estimates of the area under receiver operating characteristic curves (AUC). The authors provide an explanation of the relationships between them and illustrate the factors that determine sampling v...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(97)80161-4

    authors: Hanley JA,Hajian-Tilaki KO

    更新日期:1997-01-01 00:00:00

  • A comparison of internally water-perfused and cryogenically cooled monopolar and bipolar radiofrequency applicators in ex vivo liver samples.

    abstract:RATIONALE AND OBJECTIVES:To evaluate the ex vivo ablation zones created in hepatic tissue using monopolar and bipolar gas- and water-cooled radiofrequency (RF) applicators. MATERIALS AND METHODS:RF ablations were performed on ex vivo bovine liver tissue using closed circuit water-cooled and closed circuit cryogenicall...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.02.004

    authors: Rempp H,Mezger D,Voigtlaender M,Scharpf M,Hoffmann R,Pereira PL,Enderle MD,Claussen CD,Clasen S

    更新日期:2014-05-01 00:00:00

  • Automated diffusion tensor tractography: implementation and comparison to user-driven tractography.

    abstract:RATIONALE AND OBJECTIVES:Diffusion tensor tractography offers a unique perspective of white matter anatomy, but proper delineation of white matter tracts of interest generally requires the active involvement of an expert neuroanatomist. The investigators describe the implementation of an automated tractographic method ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.01.002

    authors: Nucifora PG,Wu X,Melhem ER,Gur RE,Gur RC,Verma R

    更新日期:2012-05-01 00:00:00

  • Teaching and Assessing Professionalism in Radiology: Resources and Scholarly Opportunities to Contribute to Required Expectations.

    abstract::Teaching and assessing trainees' professionalism now represents an explicit expectation for Accreditation Council Graduate Medical Education-accredited radiology programs. Challenges to meeting this expectation include variability in defining the construct of professionalism; limits of traditional teaching and assessm...

    journal_title:Academic radiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.acra.2018.01.008

    authors: Kelly AM,Mullan PB

    更新日期:2018-05-01 00:00:00

  • Evaluation of meniscal tears: fast spin-echo versus conventional spin-echo magnetic resonance imaging.

    abstract:RATIONALE AND OBJECTIVES:We compared the performance of fast spin-echo (FSE) with conventional spin-echo (CSE) magnetic resonance (MR) imaging sequences in the detection of meniscal tears. METHODS:Seventy-three patients underwent MR examination of the knee for suspected internal derangement. Each patient was scanned w...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80166-7

    authors: Anderson MW,Raghavan N,Seidenwurm DJ,Greenspan A,Drake C

    更新日期:1995-03-01 00:00:00

  • Inflammatory breast carcinoma in magnetic resonance imaging: a comparison with locally advanced breast cancer.

    abstract:RATIONALE AND OBJECTIVES:Although inflammatory breast carcinoma (IBC) accounts for 1%-4% of all breast cancer cases, the appearance of this highly malignant tumor in magnetic resonance imaging (MRI) is still not well characterized. The aim of this study was to identify typical imaging features of IBC in comparison with...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.09.011

    authors: Renz DM,Baltzer PA,Böttcher J,Thaher F,Gajda M,Camara O,Runnebaum IB,Kaiser WA

    更新日期:2008-02-01 00:00:00

  • Perfusion CT estimates photosensitizer uptake and biodistribution in a rabbit orthotopic pancreatic cancer model: a pilot study.

    abstract:RATIONALE AND OBJECTIVES:It was hypothesized that perfusion computed tomography (CT), blood flow (BF), blood volume (BV), and vascular permeability surface area (PS) product parameters would be predictive of therapeutic anticancer agent uptake in pancreatic cancer, facilitating image-guided interpretation of human trea...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2014.12.014

    authors: Elliott JT,Samkoe KS,Gunn JR,Stewart EE,Gardner TB,Tichauer KM,Lee TY,Hoopes PJ,Pereira SP,Hasan T,Pogue BW

    更新日期:2015-05-01 00:00:00

  • Parkinson's disease: interhemispheric textural differences in MR images.

    abstract:RATIONALE AND OBJECTIVES:Early-stage diagnosis of Parkinson's disease (PD) is essential in making decisions related to treatment and prognosis. However, there is no specific diagnostic test for the diagnosis of PD. The aim of this study was to evaluate the role of texture analysis (TA) of magnetic resonance images in d...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.06.007

    authors: Sikiö M,Holli KK,Harrison LC,Ruottinen H,Rossi M,Helminen MT,Ryymin P,Paalavuo R,Soimakallio S,Eskola HJ,Elovaara I,Dastidar P

    更新日期:2011-10-01 00:00:00

  • Emotional Wellness of Current Musculoskeletal Radiology Fellows.

    abstract:RATIONALE AND OBJECTIVES:Burnout is a psychological syndrome composed of emotional exhaustion, depersonalization, and sense of lack of personal accomplishment, as a result of prolonged occupational stress. The purpose of our study was to determine the prevalence of burnout among current musculoskeletal radiology fellow...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.12.024

    authors: Porrino J,Mulcahy MJ,Mulcahy H,Relyea-Chew A,Chew FS

    更新日期:2017-06-01 00:00:00

  • Cone beam CT in assessment of tibial bone defect healing: an animal study.

    abstract:RATIONALE AND OBJECTIVES:To evaluate cone beam computed tomography (CBCT) for monitoring of tibial bone defect healing in comparison to histopathological findings. MATERIALS AND METHODS:Circumscribed tibial bone defects were created in 16 mini-pigs and imaging of the tibia was performed on day 42 using a modern CBCT s...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.10.022

    authors: Kröpil P,Hakimi AR,Jungbluth P,Riegger C,Rubbert C,Miese F,Lanzman RS,Wild M,Schek A,Scherer A,Windolf J,Antoch G,Becker J,Hakimi M

    更新日期:2012-03-01 00:00:00

  • Proteoglycan depletion-induced changes in transverse relaxation maps of cartilage: comparison of T2 and T1rho.

    abstract:RATIONALE AND OBJECTIVES:The authors performed this study to (a) measure changes in T2 relaxation rates, signal-to-noise ratio (SNR), and contrast with sequential depletion of proteoglycan in cartilage; (b) determine whether there is a relationship between the T2 relaxation rate and proteoglycan in cartilage; and (c) c...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)80666-9

    authors: Regatte RR,Akella SV,Borthakur A,Kneeland JB,Reddy R

    更新日期:2002-12-01 00:00:00

  • 68Ga-PSMA PET/CT in Patients with Rising Prostatic-Specific Antigen After Definitive Treatment of Prostate Cancer: Detection Efficacy and Diagnostic accuracy.

    abstract:RATIONALE AND OBJECTIVES:68Ga-prostate-specific membrane antigen-11 (68Ga-PSMA-11) is a recently developed positron emission tomography (PET) tracer that can detect prostate cancer (PC) relapses and metastases with high contrast resolution. The aim of this study was to assess the detection efficacy and diagnostic accur...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.05.020

    authors: Hamed MAG,Basha MAA,Ahmed H,Obaya AA,Afifi AHM,Abdelbary EH

    更新日期:2019-04-01 00:00:00

  • Continuous arterial spin-labeling perfusion magnetic resonance imaging of the human testis.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to determine if continuous arterial spin-labeling perfusion magnetic resonance imaging could be used to detect testicular perfusion in human subjects. MATERIALS AND METHODS:Continuous arterial spin-labeling magnetic resonance perfusion imaging was performed in sev...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(03)00576-2

    authors: Pretorius ES,Roberts DA

    更新日期:2004-01-01 00:00:00

  • Diffraction enhanced imaging of a rat model of gastric acid aspiration pneumonitis.

    abstract:RATIONALE AND OBJECTIVES:Diffraction-enhanced imaging (DEI) is a type of phase contrast x-ray imaging that has improved image contrast at a lower dose than conventional radiography for many imaging applications, but no studies have been done to determine if DEI might be useful for diagnosing lung injury. The goals of t...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.08.005

    authors: Connor DM,Zhong Z,Foda HD,Wiebe S,Parham CA,Dilmanian FA,Cole EB,Pisano ED

    更新日期:2011-12-01 00:00:00

  • Determining optimal acquisition parameters for computed tomography coronary angiography: evaluation of a software-assisted, breathhold exam simulation.

    abstract:RATIONALE AND OBJECTIVES:Scanning parameters used in multislice computed tomographic (MSCT) coronary angiography should be adapted to patients' heart rates. The aim of this study was to evaluate the rate of success of a software-assisted scan simulation to determine optimal gantry rotation time prior to MSCT coronary a...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2008.08.016

    authors: Engelken FJ,Lembcke A,Hamm B,Dewey M

    更新日期:2009-02-01 00:00:00

  • A Review of Supplemental Screening Ultrasound for Breast Cancer: Certain Populations of Women with Dense Breast Tissue May Benefit.

    abstract::Breast density has been shown to be a strong, independent risk factor for breast cancer. Unfortunately, mammography is less accurate on dense breast tissue compared to fattier breast tissue. Multiple studies suggest a solution to this by demonstrating the ability of supplemental screening ultrasound to detect addition...

    journal_title:Academic radiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.acra.2016.05.017

    authors: Burkett BJ,Hanemann CW

    更新日期:2016-12-01 00:00:00

  • Deep Learning in the Prediction of Ischaemic Stroke Thrombolysis Functional Outcomes: A Pilot Study.

    abstract:RATIONALE AND OBJECTIVES:Intravenous thrombolysis decision-making and obtaining of consent would be assisted by an individualized risk-benefit ratio. Deep learning (DL) models may be able to assist with this patient selection. MATERIALS AND METHODS:Clinical data regarding consecutive patients who received intravenous ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.03.015

    authors: Bacchi S,Zerner T,Oakden-Rayner L,Kleinig T,Patel S,Jannes J

    更新日期:2020-02-01 00:00:00

  • How to successfully implement E-learning for both students and teachers.

    abstract:RATIONALE AND OBJECTIVES:Electronic learning (e-learning) may provide a means to enhance learning efficacy. However, introduction of e-learning often fails. We describe a strategy of how an e-learning curriculum was successfully implemented. MATERIALS AND METHODS:The curriculum was designed based on published evidence...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2005.12.006

    authors: Gotthardt M,Siegert MJ,Schlieck A,Schneider S,Kohnert A,Gross MW,Schäfer C,Wagner R,Hörmann S,Behr TM,Engenhart-Cabillic R,Klose KJ,Jungclas H,Glowalla U

    更新日期:2006-03-01 00:00:00

  • CT Quantification and Machine-learning Models for Assessment of Disease Severity and Prognosis of COVID-19 Patients.

    abstract:OBJECTIVE:This study was to investigate the CT quantification of COVID-19 pneumonia and its impacts on the assessment of disease severity and the prediction of clinical outcomes in the management of COVID-19 patients. MATERIALS METHODS:Ninety-nine COVID-19 patients who were confirmed by positive nucleic acid test (NAT...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.09.004

    authors: Cai W,Liu T,Xue X,Luo G,Wang X,Shen Y,Fang Q,Sheng J,Chen F,Liang T

    更新日期:2020-12-01 00:00:00

  • Computed radiography and film digitizer inputs to an intensive care unit teleradiology system: an image quality comparison.

    abstract:RATIONALE AND OBJECTIVES:We compared computed radiography (CR) with a film digitizer as an image input device for transmitting radiographs to intensive care unit (ICU) displays. METHODS:Limiting spatial resolution and low-contrast detectability performance were determined for a 600-speed screen-film combination and CR...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80375-7

    authors: Huda W,Honeyman JC,Palmer CK,Frost MM,Staab EV

    更新日期:1996-02-01 00:00:00

  • Three-dimensional isotropic wavelets for post-acquisitional extraction of latent images of atherosclerotic plaque components from micro-computed tomography of human coronary arteries.

    abstract:RATIONALE AND OBJECTIVES:The capability of wavelet transforms to separate signals into frequency bands is the basis for its use in image compression and storage, data management and transmission, and, recently, extraction of latent images of tissue components from noisy medical images. Analysis of temporal variations o...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.06.018

    authors: Gertz SD,Bodmann BG,Vela D,Papadakis M,Aboshady I,Cherukuri P,Alexander S,Kouri DJ,Baid S,Gittens AA,Gladish GW,Conyers JL,Cody DD,Gavish L,Mazraeshahi RM,Wilner WT,Frazier L,Madjid M,Zarrabi A,Lukovenkov S,Ahmed

    更新日期:2007-12-01 00:00:00

  • Detection of pulmonary embolism comparison between dual energy CT and MR angiography in a rabbit model.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to compare the efficacy of dual-energy computed tomography (DECT), time-resolved magnetic resonance (MR) imaging (MRI) perfusion measurements, and high-resolution MR angiography (MRA) for the detection of pulmonary embolism (PE) in a rabbit model. MATERIALS AND ME...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2010.09.004

    authors: Zhang LJ,Lu L,Bi J,Jin LX,Chai X,Zhao YE,Chen B,Lu GM

    更新日期:2010-12-01 00:00:00