当前位置： SCI文献检索 > ACTA OPHTHALMOLOGICA期刊下所有文献 > Evaluation of adding item-response theory analysis for evaluation of the European Board of Ophthalmology Diploma examination.

Evaluation of adding item-response theory analysis for evaluation of the European Board of Ophthalmology Diploma examination.

Abstract：

PURPOSE:To investigate whether introduction of item-response theory (IRT) analysis, in parallel to the 'traditional' statistical analysis methods available for performance evaluation of multiple T/F items as used in the European Board of Ophthalmology Diploma (EBOD) examination, has proved beneficial, and secondly, to study whether the overall assessment performance of the current written part of EBOD is sufficiently high (KR-20≥ 0.90) to be kept as examination format in future EBOD editions. METHODS:'Traditional' analysis methods for individual MCQ item performance comprise P-statistics, Rit-statistics and item discrimination, while overall reliability is evaluated through KR-20 for multiple T/F items. The additional set of statistical analysis methods for the evaluation of EBOD comprises mainly IRT analysis. These analysis techniques are used to monitor whether the introduction of negative marking for incorrect answers (since EBOD 2010) has a positive influence on the statistical performance of EBOD as a whole and its individual test items in particular. RESULTS:Item-response theory analysis demonstrated that item performance parameters should not be evaluated individually, but should be related to one another. Before the introduction of negative marking, the overall EBOD reliability (KR-20) was good though with room for improvement (EBOD 2008: 0.81; EBOD 2009: 0.78). After the introduction of negative marking, the overall reliability of EBOD improved significantly (EBOD 2010: 0.92; EBOD 2011:0.91; EBOD 2012: 0.91). CONCLUSION:Although many statistical performance parameters are available to evaluate individual items, our study demonstrates that the overall reliability assessment remains the only crucial parameter to be evaluated allowing comparison. While individual item performance analysis is worthwhile to undertake as secondary analysis, drawing final conclusions seems to be more difficult. Performance parameters need to be related, as shown by IRT analysis. Therefore, IRT analysis has proved beneficial for the statistical analysis of EBOD. Introduction of negative marking has led to a significant increase in the reliability (KR-20 > 0.90), indicating that the current examination format can be kept for future EBOD examinations.

journal_name

Acta Ophthalmol

journal_title

Acta ophthalmologica

authors

Mathysen DG,Aclimandos W,Roelant E,Wouters K,Creuzot-Garcher C,Ringens PJ,Hawlina M,Tassignon MJ

doi

10.1111/aos.12135

subject

Has Abstract

pub_date

2013-11-01 00:00:00

pages

e573-7

issue

eissn

1755-375X

issn

1755-3768

journal_volume

pub_type

杂志文章

在线工具

Evaluation of adding item-response theory analysis for evaluation of the European Board of Ophthalmology Diploma examination.