当前位置： SCI文献检索 > MEDICAL EDUCATION期刊下所有文献 > Translating outcome frameworks to assessment programmes: Implications for validity.

Translating outcome frameworks to assessment programmes: Implications for validity.

Abstract：

OBJECTIVES:Competency-based medical education (CBME) requires that educators structure assessment of clinical competence using outcome frameworks. Although these frameworks may serve some outcomes well (e.g. represent eventual practice), translating these into workplace-based assessment plans may undermine validity and, therefore, trustworthiness of assessment decisions due to a number of competing factors that may not always be visible or their impact knowable. Explored here is the translation process from outcome framework to formative and summative assessment plans in postgraduate medical education (PGME) in three Canadian universities. METHODS:We conducted a qualitative study involving in-depth semi-structured interviews with leaders of PGME programmes involved in assessment and/or CBME implementation, with a focus on their assessment-based translational activities and evaluation strategies. Interviews were informed by Callon's theory of translation. Our analytical strategy involved directed content analysis, allowing us to be guided by Kane's validity framework, whilst still participating in open coding and analytical memo taking. We then engaged in axial coding to systematically explore themes across the dataset, various situations and our conceptual framework. RESULTS:Twenty-four interviews were conducted involving 15 specialties across three universities. Our results suggest: (i) using outcomes frameworks for assessment is necessary for good assessment but are also viewed as incomplete constructs; (ii) there are a number of social and practical negotiations with competing factors that displace validity as a core influencer in assessment planning, including implementation, accreditation and technology; and (iii) validity exists as threatened, uncertain and assumed due to a number of unchecked assumptions and reliance on surrogates. CONCLUSIONS:Translational processes in CBME involve negotiating with numerous influencing actors and institutions that, from an assessment perspective, provide challenges for assessment scientists, institutions and educators to contend with. These processes are challenging validity as a core element of assessment designs. Educators must reconcile these influences when preparing for or structuring validity arguments.

journal_name

Med Educ

journal_title

Medical education

authors

Tavares W,Rowland P,Dagnone D,McEwen LA,Billett S,Sibbald M

doi

10.1111/medu.14287

subject

Has Abstract

pub_date

2020-10-01 00:00:00

pages

932-942

issue

eissn

0308-0110

issn

1365-2923

journal_volume

pub_type

杂志文章

在线工具

Translating outcome frameworks to assessment programmes: Implications for validity.