当前位置： SCI文献检索 > Journal of Surgical Education期刊下所有文献 > Initial performance of a modified milestones global evaluation tool for semiannual evaluation of residents by faculty.

Initial performance of a modified milestones global evaluation tool for semiannual evaluation of residents by faculty.

Abstract：

OBJECTIVES:To determine whether faculty could successfully evaluate residents using a competency-based modified Milestones global evaluation tool. DESIGN:A program's leadership team modified a draft Surgery Milestones Working Group summative global assessment instrument into a modified Milestones tool (MMT) for local use during faculty meetings devoted to semiannual resident review. Residents were scored on 15 items spanning all competencies using an 8-point graphic response scale; unstructured comments also were solicited. Arithmetic means were computed at the resident and postgraduate year cohort levels for items and competency item sets. Score ranges (highest minus lowest score) were calculated; variability was termed "low" (range <2.0 points), "moderate" (range = 2.0), or "high" (range >2.0). A subset of "low" was designated "small" (1.0-1.9). Trends were sought among item, competency, and total Milestones scores. MMT correlations with examination scores and multisource (360°) assessments were explored. The success of implementing MMT was judged using published criteria for educational assessment methods. SETTING:Fully accredited, independently sponsored residency. PARTICIPANTS:Program leaders and 22 faculty members (71% voluntary, mean 12y of experience). RESULTS:Twenty-six residents were assessed, yielding 7 to 13 evaluations for MMT per categorical resident and 3 to 6 per preliminary trainee. Scores spanned the entire response scale. All MMT evaluations included narrative comments. Individual resident score variability was low (96% within competencies and 92% across competencies). Subset analysis showed that small variations were common (35% within competencies and 54% across competencies). Postgraduate year cohort variability was higher (61% moderate or high within competencies and 50% across competencies). Cohort scores at the item, competency, and total score levels exhibited rising trajectories, suggesting MMT construct validity. MMT scores did not demonstrate concurrent validity, correlating poorly with other metrics. The MMT met multiple criteria for good assessment. CONCLUSIONS:A modified Milestones global evaluation tool can be successfully adopted for semiannual assessments of resident performance by volunteer faculty members.

journal_name

J Surg Educ

journal_title

Journal of surgical education

authors

Borman KR,Augustine R,Leibrandt T,Pezzi CM,Kukora JS

doi

10.1016/j.jsurg.2013.08.004

subject

Has Abstract

pub_date

2013-11-01 00:00:00

pages

739-49

issue

eissn

1931-7204

issn

1878-7452

pii

S1931-7204(13)00212-2

journal_volume

pub_type

杂志文章,评审

在线工具

Initial performance of a modified milestones global evaluation tool for semiannual evaluation of residents by faculty.