当前位置： SCI文献检索 > ACADEMIC RADIOLOGY期刊下所有文献 > Establishing a gold standard for test sets: variation in interpretive agreement of expert mammographers.

Establishing a gold standard for test sets: variation in interpretive agreement of expert mammographers.

Abstract：

RATIONALE AND OBJECTIVES:Test sets for assessing and improving radiologic image interpretation have been used for decades and typically evaluate performance relative to gold standard interpretations by experts. To assess test sets for screening mammography, a gold standard for whether a woman should be recalled for additional workup is needed, given that interval cancers may be occult on mammography and some findings ultimately determined to be benign require additional imaging to determine if biopsy is warranted. Using experts to set a gold standard assumes little variation occurs in their interpretations, but this has not been explicitly studied in mammography. MATERIALS AND METHODS:Using digitized films from 314 screening mammography exams (n = 143 cancer cases) performed in the Breast Cancer Surveillance Consortium, we evaluated interpretive agreement among three expert radiologists who independently assessed whether each examination should be recalled, and the lesion location, finding type (mass, calcification, asymmetric density, or architectural distortion), and interpretive difficulty in the recalled images. RESULTS:Agreement among the three expert pairs for recall/no recall was higher for cancer cases (mean 74.3 ± 6.5) than for noncancers (mean 62.6 ± 7.1). Complete agreement on recall, lesion location, finding type and difficulty ranged from 36.4% to 42.0% for cancer cases and from 43.9% to 65.6% for noncancer cases. Two of three experts agreed on recall and lesion location for 95.1% of cancer cases and 91.8% of noncancer cases, but all three experts agreed on only 55.2% of cancer cases and 42.1% of noncancer cases. CONCLUSION:Variability in expert interpretive is notable. A minimum of three independent experts combined with a consensus should be used for establishing any gold standard interpretation for test sets, especially for noncancer cases.

journal_name

Acad Radiol

journal_title

Academic radiology

authors

Onega T,Anderson ML,Miglioretti DL,Buist DS,Geller B,Bogart A,Smith RA,Sickles EA,Monsees B,Bassett L,Carney PA,Kerlikowske K,Yankaskas BC

doi

10.1016/j.acra.2013.01.012

subject

Has Abstract

pub_date

2013-06-01 00:00:00

pages

731-9

issue

eissn

1076-6332

issn

1878-4046

pii

S1076-6332(13)00034-2

journal_volume

pub_type

杂志文章

在线工具

Establishing a gold standard for test sets: variation in interpretive agreement of expert mammographers.