当前位置： SCI文献检索 > Pediatric Rheumatology期刊下所有文献 > The pediatric rheumatology objective structured clinical examination: progressing from a homegrown effort toward a reliable and valid national formative assessment.

The pediatric rheumatology objective structured clinical examination: progressing from a homegrown effort toward a reliable and valid national formative assessment.

Abstract：

BACKGROUND:Of 37 pediatric rheumatology fellowship training programs in the United States, many have three or fewer fellows at a given time, making large-scale assessment of fellow performance difficult. An objective structured clinical examination (OSCE) is a scenario-based simulation method that assesses individual performance, thus indirectly measuring training program effectiveness. This study describes the development and implementation of two national pediatric rheumatology OSCEs and methods used for programmatic improvement. METHODS:OSCEs for pediatric rheumatology fellows were held in 2009 and 2011 during national rheumatology meetings using scenarios and assessment forms originally developed by a fellowship program director. The seven scenarios tested medical knowledge, physical exam and interpersonal skills. Pediatric rheumatologist evaluators assessed fellows' performance using checklists and gave immediate feedback. Program directors were sent summaries of their fellows' performances. Fellows evaluated the OSCE, providing organizational and scenario improvement suggestions. Programmatic changes to the 2011 OSCE were based on 2009 performance data and program evaluation feedback. RESULTS:Twenty-two fellows participated in 2009 and 19 in 2011. Performance scores in similar scenarios did not change considerably over the two iterations. In 2009, 85.7% of participants reported desire to change clinical behavior. Assessors' 2009 program evaluation data prompted changes in rating scales and removal of invalid or unreliable assessments. Negative evaluation data about individual stations decreased from 60% in 2009 to 15.4% in 2011. Fellows' ratings of the experience's overall value were similar in 2009 and 2011. The average experience ratings were lower among fellows who proposed scenario-specific improvements and higher among those who recommended organizational improvements. CONCLUSIONS:The 2011 examination exhibited programmatic improvement via reduction in fellows' scenario-specific negative feedback. Fellows' overall satisfaction did not change. Further work in scenario selection, assessment validation and inter-rater reliability will improve future pediatric rheumatology OSCEs.

journal_name

Pediatr Rheumatol Online J

journal_title

Pediatric rheumatology online journal

authors

Curran ML,Martin EE,Thomas EC,Singh R,Armana S,Kauser A,Zaheer EA,Sherry DD

doi

10.1186/s12969-019-0308-7

subject

Has Abstract

pub_date

2019-02-08 00:00:00

pages

issue

issn

1546-0096

pii

10.1186/s12969-019-0308-7

journal_volume

pub_type

杂志文章

在线工具

The pediatric rheumatology objective structured clinical examination: progressing from a homegrown effort toward a reliable and valid national formative assessment.