当前位置： SCI文献检索 > RADIOLOGY期刊下所有文献 > Identifying minimally acceptable interpretive performance criteria for screening mammography.

Identifying minimally acceptable interpretive performance criteria for screening mammography.

Abstract：

PURPOSE:To develop criteria to identify thresholds for minimally acceptable physician performance in interpreting screening mammography studies and to profile the impact that implementing these criteria may have on the practice of radiology in the United States. MATERIALS AND METHODS:In an institutional review board-approved, HIPAA-compliant study, an Angoff approach was used in two phases to set criteria for identifying minimally acceptable interpretive performance at screening mammography as measured by sensitivity, specificity, recall rate, positive predictive value (PPV) of recall (PPV(1)) and of biopsy recommendation (PPV(2)), and cancer detection rate. Performance measures were considered separately. In phase I, a group of 10 expert radiologists considered a hypothetical pool of 100 interpreting physicians and conveyed their cut points of minimally acceptable performance. The experts were informed that a physician's performance falling outside the cut points would result in a recommendation to consider additional training. During each round of scoring, all expert radiologists' cut points were summarized into a mean, median, mode, and range; these were presented back to the group. In phase II, normative data on performance were shown to illustrate the potential impact cut points would have on radiology practice. Rescoring was done until consensus among experts was achieved. Simulation methods were used to estimate the potential impact of performance that improved to acceptable levels if effective additional training was provided. RESULTS:Final cut points to identify low performance were as follows: sensitivity less than 75%, specificity less than 88% or greater than 95%, recall rate less than 5% or greater than 12%, PPV(1) less than 3% or greater than 8%, PPV(2) less than 20% or greater than 40%, and cancer detection rate less than 2.5 per 1000 interpretations. The selected cut points for performance measures would likely result in 18%-28% of interpreting physicians being considered for additional training on the basis of sensitivity and cancer detection rate, while the cut points for specificity, recall, and PPV(1) and PPV(2) would likely affect 34%-49% of practicing interpreters. If underperforming physicians moved into the acceptable range, detection of an additional 14 cancers per 100000 women screened and a reduction in the number of false-positive examinations by 880 per 100000 women screened would be expected. CONCLUSION:This study identified minimally acceptable performance levels for interpreters of screening mammography studies. Interpreting physicians whose performance falls outside the identified cut points should be reviewed in the context of their specific practice settings and be considered for additional training.

journal_name

Radiology

journal_title

Radiology

authors

Carney PA,Sickles EA,Monsees BS,Bassett LW,Brenner RJ,Feig SA,Smith RA,Rosenberg RD,Bogart TA,Browning S,Barry JW,Kelly MM,Tran KA,Miglioretti DL

doi

10.1148/radiol.10091636

subject

Has Abstract

pub_date

2010-05-01 00:00:00

pages

354-61

issue

eissn

0033-8419

issn

1527-1315

pii

255/2/354

journal_volume

255

pub_type

杂志文章

在线工具

Identifying minimally acceptable interpretive performance criteria for screening mammography.