Correlation Between Screening Mammography Interpretive Performance on a Test Set and Performance in Clinical Practice.

Abstract:

RATIONALE AND OBJECTIVES:Evidence is inconsistent about whether radiologists' interpretive performance on a screening mammography test set reflects their performance in clinical practice. This study aimed to estimate the correlation between test set and clinical performance and determine if the correlation is influenced by cancer prevalence or lesion difficulty in the test set. MATERIALS AND METHODS:This institutional review board-approved study randomized 83 radiologists from six Breast Cancer Surveillance Consortium registries to assess one of four test sets of 109 screening mammograms each; 48 radiologists completed a fifth test set of 110 mammograms 2 years later. Test sets differed in number of cancer cases and difficulty of lesion detection. Test set sensitivity and specificity were estimated using woman-level and breast-level recall with cancer status and expert opinion as gold standards. Clinical performance was estimated using women-level recall with cancer status as the gold standard. Spearman rank correlations between test set and clinical performance with 95% confidence intervals (CI) were estimated. RESULTS:For test sets with fewer cancers (N = 15) that were more difficult to detect, correlations were weak to moderate for sensitivity (woman level = 0.46, 95% CI = 0.16, 0.69; breast level = 0.35, 95% CI = 0.03, 0.61) and weak for specificity (0.24, 95% CI = 0.01, 0.45) relative to expert recall. Correlations for test sets with more cancers (N = 30) were close to 0 and not statistically significant. CONCLUSIONS:Correlations between screening performance on a test set and performance in clinical practice are not strong. Test set performance more accurately reflects performance in clinical practice if cancer prevalence is low and lesions are challenging to detect.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Miglioretti DL,Ichikawa L,Smith RA,Buist DSM,Carney PA,Geller B,Monsees B,Onega T,Rosenberg R,Sickles EA,Yankaskas BC,Kerlikowske K

doi

10.1016/j.acra.2017.03.016

subject

Has Abstract

pub_date

2017-10-01 00:00:00

pages

1256-1264

issue

10

eissn

1076-6332

issn

1878-4046

pii

S1076-6332(17)30187-3

journal_volume

24

pub_type

杂志文章
  • High-resolution computed tomography of airway changes after induced bronchoconstriction and bronchodilation in asthmatic volunteers.

    abstract:RATIONALE AND OBJECTIVES:We examined whether high-resolution computed tomography (HRCT) would detect and quantify induced airway changes in asthmatic volunteers. METHODS:We performed pulmonary function tests and HRCT on eight asthmatic adults and two nonasthmatic control adults under three conditions: baseline, after ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80671-3

    authors: Kee ST,Fahy JV,Chen DR,Gamsu G

    更新日期:1996-05-01 00:00:00

  • CT Pulmonary Angiography Using Automatic Tube Current Modulation Combination with Different Noise Index with Iterative Reconstruction Algorithm in Different Body Mass Index: Image Quality and Radiation Dose.

    abstract:RATIONALE AND OBJECTIVES:This study aimed to determine the appropriate body mass index (BMI)-dependent noise index (NI) setting in computed tomography pulmonary angiography (CTPA) with automatic tube current modulation with adaptive statistical iterative reconstruction (ASiR). MATERIALS AND METHODS:A total of 480 pati...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.07.018

    authors: Zhao YX,Zuo ZW,Suo HN,Wang JN,Chang J

    更新日期:2016-12-01 00:00:00

  • Implementation of an Innovative Tablet-based Curriculum for Radiology Resident Education.

    abstract:RATIONALE AND OBJECTIVES:The aim of this study was to prospectively examine the impact of a tablet-based curriculum on the radiology resident educational experience. MATERIALS AND METHODS:A comprehensive tablet-based curriculum was developed by creating subspecialty modules with appropriate content level for each requ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2018.05.018

    authors: Makary MS,Shah SH,Miller RJ,Doukides SP,King MA

    更新日期:2018-12-01 00:00:00

  • Conspicuity of Screen-Detected Malignancies on Full Field Digital Mammography vs. Synthetic Mammography.

    abstract:RATIONALE AND OBJECTIVES:To evaluate conspicuity of screen-detected cancers on two-dimensional synthetic mammography (SM) reconstructed from digital breast tomosynthesis (DBT) compared to two-dimensional full field digital mammography (FFDM). MATERIALS AND METHODS:IRB-approved retrospective review of consecutive scree...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.06.008

    authors: Chikarmane SA,Yeh ED,Wang A,Ratanaprasatporn L,Giess CS

    更新日期:2020-06-01 00:00:00

  • Lower limb vascular disease in diabetic patients: a study with calf compression contrast-enhanced magnetic resonance angiography at 3.0 Tesla.

    abstract:RATIONALE AND OBJECTIVES:To retrospectively analyze the significance of 3.0-T contrast-enhanced (CE) magnetic resonance angiography (MRA) with calf compression in the lower limbs of diabetic patients with peripheral vascular disease. MATERIALS AND METHODS:Sixty-one type 2 diabetes patients underwent both MRA and digit...

    journal_title:Academic radiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.acra.2011.01.013

    authors: Li J,Zhao JG,Li MH

    更新日期:2011-06-01 00:00:00

  • MRI-based delta-radiomics are predictive of pathological complete response after neoadjuvant chemoradiotherapy in locally advanced rectal cancer.

    abstract:RATIONALE AND OBJECTIVES:To investigate the capability of delta-radiomics to predict pathological complete response (pCR) after neoadjuvant chemoradiotherapy (nCRT) in patients with locally advanced rectal cancer (LARC). MATERIALS AND METHODS:This retrospective study enrolled 165 consecutive patients with LARC (traini...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2020.10.026

    authors: Wan L,Peng W,Zou S,Ye F,Geng Y,Ouyang H,Zhao X,Zhang H

    更新日期:2020-11-11 00:00:00

  • Effect of team training on patients' ability to complete MRI examinations.

    abstract:RATIONALE AND OBJECTIVES:Assess whether staff training in advanced rapport skills and self-hypnotic relaxation techniques reduces noncompletion rates during magnetic resonance imaging (MRI). METHODS AND MATERIALS:All staff of a free-standing MRI facility was invited to 3 hours of preparatory communication lectures. Ha...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2009.07.002

    authors: Lang EV,Ward C,Laser E

    更新日期:2010-01-01 00:00:00

  • Reliability of MR Quantification of Rotator Cuff Muscle Fatty Degeneration Using a 2-point Dixon Technique in Comparison with the Goutallier Classification: Validation Study by Multiple Readers.

    abstract:RATIONALE AND OBJECTIVES:Presurgical assessment of fatty degeneration is important in the management of patients with rotator cuff tears. The Goutallier classification is widely accepted as a qualitative scoring system, although it is highly observer-dependent and has poor reproducibility. The objective of this study w...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2017.03.026

    authors: Horiuchi S,Nozaki T,Tasaki A,Yamakawa A,Kaneko Y,Hara T,Yoshioka H

    更新日期:2017-11-01 00:00:00

  • Diagnosis of inguinal lymph node metastases using contrast enhanced high resolution MR lymphangiography.

    abstract:RATIONALE AND OBJECTIVES:Inguinal lymph nodes can be the first or the only clinical signs of tumor metastases. The aim of the study was to evaluate the role of contrast-enhanced high-resolution magnetic resonance (MR) lymphangiography in diagnosis of inguinal lymph node metastases. MATERIALS AND METHODS:The study enro...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.09.014

    authors: Liu N,Yan Z,Lu Q,Wang C

    更新日期:2013-02-01 00:00:00

  • T1-weighted MRI imaging features of pathologically proven non-pedal osteomyelitis.

    abstract:RATIONALE AND OBJECTIVES:The objective of our study was to determine if the T1-weighted magnetic resonance imaging (MRI) features associated with diabetic pedal osteomyelitis are present in histopathologically proven cases of non-pedal osteomyelitis. MATERIALS AND METHODS:Seventy-five patients with a histopathological...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.07.015

    authors: Howe BM,Wenger DE,Mandrekar J,Collins MS

    更新日期:2013-01-01 00:00:00

  • Assessing patient utilities for varying degrees of low back pain.

    abstract:RATIONALE AND OBJECTIVES:We sought to quantify patient preferences for mild, moderate, and severe low back pain via time-tradeoff analysis and utility measurement. MATERIALS AND METHODS:Forty-one patients being treated for low back pain in a tertiary care teaching hospital participated in the study. Patients were aske...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2004.11.031

    authors: Lai KC,Provenzale JM,Delong D,Mukundan S Jr

    更新日期:2005-04-01 00:00:00

  • MR imaging findings in colloid cysts of the sellar region: comparison with colloid cysts of the third ventricle and Rathke's cleft cysts.

    abstract:RATIONALE AND OBJECTIVES:To identify magnetic resonance (MR) imaging characteristics allowing specific preoperative discrimination between colloid cysts (CCs) of the sellar region and third ventricle (CC3rdv) versus Rathke's cleft cysts (RCCs). MATERIALS AND METHODS:MR imaging data of 38 patients with histologically p...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.08.014

    authors: Bender B,Honegger JB,Beschorner R,Ernemann U,Horger M

    更新日期:2013-11-01 00:00:00

  • Tumor angiography using high-resolution, three-dimensional magnetic resonance imaging: comparison of gadopentetate dimeglumine and a macromolecular blood-pool contrast agent.

    abstract:RATIONALE AND OBJECTIVES:We compared the peritumoral vascular definition in rats using either a paramagnetic extracellular or a macromolecular contrast medium in combination with high-resolution magnetic resonance (MR) imaging. METHODS:High-resolution, three-dimensional spoiled gradient-refocused acquisition in a stea...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80059-5

    authors: Schwickert HC,Stiskal M,van Dijke CF,Roberts TP,Mann JS,Demsar F,Brasch RC

    更新日期:1995-10-01 00:00:00

  • When and why might a computer-aided detection (CAD) system interfere with visual search? An eye-tracking study.

    abstract:RATIONAL AND OBJECTIVES:Computer-aided detection (CAD) systems are intended to improve performance. This study investigates how CAD might actually interfere with a visual search task. This is a laboratory study with implications for clinical use of CAD. METHODS:Forty-seven naive observers in two studies were asked to ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2012.05.013

    authors: Drew T,Cunningham C,Wolfe JM

    更新日期:2012-10-01 00:00:00

  • Emotional Wellness of Current Musculoskeletal Radiology Fellows.

    abstract:RATIONALE AND OBJECTIVES:Burnout is a psychological syndrome composed of emotional exhaustion, depersonalization, and sense of lack of personal accomplishment, as a result of prolonged occupational stress. The purpose of our study was to determine the prevalence of burnout among current musculoskeletal radiology fellow...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.12.024

    authors: Porrino J,Mulcahy MJ,Mulcahy H,Relyea-Chew A,Chew FS

    更新日期:2017-06-01 00:00:00

  • The use of flat panel volumetric computed tomography (fpVCT) in osteoporosis research.

    abstract:RATIONALE AND OBJECTIVES:Improvements in imaging technology have led to the increased use of computed tomography (CT). For example, micro-CT and quantitative CT (QCT) are now often used in osteoporosis research, in which micro-CT is able to analyze small bones or bone samples with high spatial resolution. In contrast, ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2008.09.017

    authors: Sehmisch S,Dullin C,Zaroban A,Tezval M,Rack T,Schmelz U,Seidlova-Wuttke D,Dunkelberg H,Wuttke W,Marten K,Stuermer KM,Stuermer EK

    更新日期:2009-04-01 00:00:00

  • A theoretical model using mechanical principles to quantify the physical principles of balloon dilatation.

    abstract:RATIONALE AND OBJECTIVES:Balloon dilatation is a mechanical form of controlled injury used to alleviate vascular stenoses. Several factors influence successful angioplasty. Few mechanical models exist to illustrate the physical principles of balloon dilatation. METHODS:We used mechanical analysis of membrane stresses,...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(05)80340-x

    authors: Kinney TB,Lee MJ,Mueller PR,Waltman AC

    更新日期:1995-05-01 00:00:00

  • Independent predictors of acute appendicitis on CT with pathologic correlation.

    abstract:RATIONALE AND OBJECTIVES:To assess computed tomographic (CT) signs that have been described in published studies for the diagnosis of appendicitis to identify independent findings that predict appendicitis. METHODS AND MATERIALS:A retrospective database search identified 67 patients with a CT scan of the abdomen/pelvi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2008.02.009

    authors: Ives EP,Sung S,McCue P,Durrani H,Halpern EJ

    更新日期:2008-08-01 00:00:00

  • Attenuation of contrast material-induced renal artery vasoconstriction by nitric oxide donors.

    abstract:RATIONALE AND OBJECTIVES:The authors studied the role of the endothelium and associated endothelial pathways in contrast material-induced renal vasoconstriction. MATERIALS AND METHODS:Isometric contractions in human and rabbit renal artery rings with intact and denuded endothelium were stimulated with phenylephrine an...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/s1076-6332(97)80254-1

    authors: Drescher P,Madsen PO

    更新日期:1997-12-01 00:00:00

  • Correction of helical CT attenuation values with wide beam collimation: in vitro test with urinary calculi.

    abstract:RATIONALE AND OBJECTIVES:Urinary calculi are now commonly detected with helical computed tomography (CT), and it has been proposed that stone composition can be determined from CT attenuation values. However, typical scans are made with a beam collimation of 5 mm or more, resulting in volume averaging and reduction in ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/S1076-6332(03)80619-0

    authors: Williams JC Jr,Saw KC,Monga AG,Chua GT,Lingeman JE,McAteer JA

    更新日期:2001-06-01 00:00:00

  • Should Radiologists Comment on Incidental Findings of Vascular Calcifications Found on Abdominal/Pelvic CT in Patients Less Than 50 Years of Age?

    abstract:RATIONALE AND OBJECTIVES:To evaluate if incidental abdominopelvic calcified atherosclerosis (ACA) in patients under 50 years of age correlates with cardiovascular disease (CVD) risk factors. Most studies evaluating calcific atherosclerosis and associated increased risk of CVD have concentrated on middle age and older p...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2019.10.013

    authors: Bernheim A,Grunhut J,Tang A,Gofur E,Thai J,Mehta V,Stern J,Jadidi N,Hodes A,Goldwasser B,Arneja A,Krausz D,Coords M,Peti S,Chacko J,Sarkany D

    更新日期:2020-08-01 00:00:00

  • Less Is More: Efficacy of Rapid 3D-T2 SPACE in ED Patients with Acute Atypical Low Back Pain.

    abstract:RATIONALE AND OBJECTIVES:Emergency department (ED) patients with acute low back pain (LBP) may present with ambiguous clinical findings that pose diagnostic challenges to exclude cauda equina syndrome (CES). As a proof of concept, we aimed to determine the efficacy of a rapid lumbar spine (LS) magnetic resonance imagin...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2017.02.011

    authors: Koontz NA,Wiggins RH 3rd,Mills MK,McLaughlin MS,Pigman EC,Anzai Y,Shah LM

    更新日期:2017-08-01 00:00:00

  • Diagnostic Accuracy of Ultrasound, Contrast-enhanced CT, and Conventional MRI for Differentiating Leiomyoma From Leiomyosarcoma.

    abstract:RATIONALE AND OBJECTIVES:This study aimed to determine whether uterine leiomyoma can be distinguished from uterine leiomyosarcoma on ultrasound (US), computed tomography (CT), and/or magnetic resonance imaging (MRI) without diffusion-weighted imaging. MATERIALS AND METHODS:Institutional review board approval was obtai...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2016.06.004

    authors: Gaetke-Udager K,McLean K,Sciallis AP,Alves T,Maturen KE,Mervak BM,Moore AG,Wasnik AP,Erba J,Davenport MS

    更新日期:2016-10-01 00:00:00

  • Chest radiology case exchange program: a paradigm for resident teaching and independent resident learning.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to test the effectiveness of resident-prepared, independent learning cases in teaching residents chest radiology. MATERIALS AND METHODS:Three 2nd-year residents (one each from the University of Wisconsin, the Oregon Health Sciences University, and the University o...

    journal_title:Academic radiology

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1016/s1076-6332(99)80059-2

    authors: Collins J,Blankenbaker DG,Albanese MA,Stack SP,Heiserman KK,Primack SL,Kazerooni EA

    更新日期:1999-01-01 00:00:00

  • Automated segmentation of the liver from 3D CT images using probabilistic atlas and multilevel statistical shape model.

    abstract:RATIONALE AND OBJECTIVES:An atlas-based automated liver segmentation method from three-dimensional computed tomographic (3D CT) images has been developed. The method uses two types of atlases, a probabilistic atlas (PA) and a statistical shape model (SSM). MATERIALS AND METHODS:Voxel-based segmentation with a PA is fi...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2008.07.008

    authors: Okada T,Shimada R,Hori M,Nakamoto M,Chen YW,Nakamura H,Sato Y

    更新日期:2008-11-01 00:00:00

  • Acoustic noise transfer function in clinical MRI a multicenter analysis.

    abstract:RATIONALE AND OBJECTIVES:Acoustic noise both in terms of its magnitude and frequency during magnetic resonance imaging (MRI) scan is influenced by imaging parameters and pulse sequences. It varies because of many different factors such as structure, materials, and magnetic field strength. The purpose of our study is to...

    journal_title:Academic radiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.acra.2010.09.009

    authors: Hamaguchi T,Miyati T,Ohno N,Hirano M,Hayashi N,Gabata T,Matsui O,Matsushita T,Yamamoto T,Fujiwara Y,Kimura H,Takeda H,Takehara Y

    更新日期:2011-01-01 00:00:00

  • Iodixanol and ioxaglate in adult aortography and peripheral arteriography: a phase III clinical trial.

    abstract:RATIONALE AND OBJECTIVES:This study compared the safety and efficacy of iodixanol with those of ioxaglate in adult patients undergoing aortography or peripheral arteriography. METHODS:Forty-six patients were enrolled in this controlled, randomized, double-blind, two-center study. The patients were monitored for advers...

    journal_title:Academic radiology

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1016/s1076-6332(05)80368-x

    authors: Rosenblum JD,Siegel EL,Leef J,Eckard DA,Lu CT

    更新日期:1996-09-01 00:00:00

  • Characterization of texture features of bladder carcinoma and the bladder wall on MRI: initial experience.

    abstract:RATIONALE AND OBJECTIVES:The purpose of this study was to determine textural features that show a significant difference between carcinomatous tissue and the bladder wall on magnetic resonance imaging (MRI) and explore the feasibility of using them to differentiate malignancy from the normal bladder wall as an initial ...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2013.03.011

    authors: Shi Z,Yang Z,Zhang G,Cui G,Xiong X,Liang Z,Lu H

    更新日期:2013-08-01 00:00:00

  • Cone beam CT in assessment of tibial bone defect healing: an animal study.

    abstract:RATIONALE AND OBJECTIVES:To evaluate cone beam computed tomography (CBCT) for monitoring of tibial bone defect healing in comparison to histopathological findings. MATERIALS AND METHODS:Circumscribed tibial bone defects were created in 16 mini-pigs and imaging of the tibia was performed on day 42 using a modern CBCT s...

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2011.10.022

    authors: Kröpil P,Hakimi AR,Jungbluth P,Riegger C,Rubbert C,Miese F,Lanzman RS,Wild M,Schek A,Scherer A,Windolf J,Antoch G,Becker J,Hakimi M

    更新日期:2012-03-01 00:00:00

  • Registering histologic and MR images of prostate for image-based cancer detection.

    abstract:RATIONALE AND OBJECTIVES:Needle biopsy is currently the only way to confirm prostate cancer. To increase prostate cancer diagnostic rate, needles are expected to be deployed at suspicious cancer locations. High-contrast magnetic resonance (MR) imaging provides a powerful tool for detecting suspicious cancerous tissues....

    journal_title:Academic radiology

    pub_type: 杂志文章

    doi:10.1016/j.acra.2007.07.018

    authors: Zhan Y,Ou Y,Feldman M,Tomaszeweski J,Davatzikos C,Shen D

    更新日期:2007-11-01 00:00:00