Do OSCE progress test scores predict performance in a national high-stakes examination?

Abstract:

CONTEXT:Progress tests, in which learners are repeatedly assessed on equivalent content at different times in their training and provided with feedback, would seem to lend themselves well to a competency-based framework, which requires more frequent formative assessments. The objective structured clinical examination (OSCE) progress test is a relatively new form of assessment that is used to assess the progression of clinical skills. The purpose of this study was to establish further evidence for the use of an OSCE progress test by demonstrating an association between scores from this assessment method and those from a national high-stakes examination. METHODS:The results of 8 years' of data from an Internal Medicine Residency OSCE (IM-OSCE) progress test were compared with scores on the Royal College of Physicians and Surgeons of Canada Comprehensive Objective Examination in Internal Medicine (RCPSC IM examination), which is comprised of both a written and performance-based component (n = 180). Correlations between scores in the two examinations were calculated. Logistic regression analyses were performed comparing IM-OSCE progress test scores with an 'elevated risk of failure' on either component of the RCPSC IM examination. RESULTS:Correlations between scores from the IM-OSCE (for PGY-1 residents to PGY-4 residents) and those from the RCPSC IM examination ranged from 0.316 (p = 0.001) to 0.554 (<.001) for the performance-based component and 0.305 (p = 0.002) to 0.516 (p < 0.001) for the written component. Logistic regression models demonstrated that PGY-2 and PGY-4 scores from the IM-OSCE were predictive of an 'elevated risk of failure' on both components of the RCPSC IM examination. CONCLUSIONS:This study provides further evidence for the use of OSCE progress testing by demonstrating a correlation between scores from an OSCE progress test and a national high-stakes examination. Furthermore, there is evidence that OSCE progress test scores are predictive of future performance on a national high-stakes examination.

journal_name

Med Educ

journal_title

Medical education

authors

Pugh D,Bhanji F,Cole G,Dupre J,Hatala R,Humphrey-Murto S,Touchie C,Wood TJ

doi

10.1111/medu.12942

subject

Has Abstract

pub_date

2016-03-01 00:00:00

pages

351-8

issue

3

eissn

0308-0110

issn

1365-2923

journal_volume

50

pub_type

杂志文章
  • Assessment tools in pre-licensure interprofessional education: A systematic review, quality appraisal and narrative synthesis.

    abstract:OBJECTIVES:Interprofessional education (IPE) aims to provide students with the opportunity to develop and demonstrate the team working behaviors and skills that will lead to positive patient outcomes. This systematic review aims to identify and critically appraise the assessment tools used after a pre-licensure IPE int...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.14453

    authors: Almoghirah H,Nazar H,Illing J

    更新日期:2021-01-13 00:00:00

  • Activating prior knowledge using multiple-choice question distractors.

    abstract:CONTEXT:A student's academic success in graduate and professional school may depend on prior knowledge. However, these students may not see important and necessary material for extended periods of time between their pre-requisites and their new course work. As such, they are more prone to being unable to access availab...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14162

    authors: Schimmelfing LC,Persky AM

    更新日期:2020-10-01 00:00:00

  • The attitudes of medical students towards homeless people: does medical school make a difference?

    abstract:BACKGROUND:Homeless people have greater health care needs than those who are housed, yet often experience difficulty in accessing health care. Evidence suggests that the attitudes of doctors can create significant barriers to health care for homeless people. METHODS:A validated structured questionnaire, the Attitudes ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01625.x

    authors: Masson N,Lester H

    更新日期:2003-10-01 00:00:00

  • Evidence-based education: development of an instrument to critically appraise reports of educational interventions.

    abstract:OBJECTIVES:Educational interventions may ultimately impact on patient care as well as affecting individuals' learning. Critical evaluation of educational literature by those involved in designing and developing educational interventions is therefore important. A checklist instrument for critically appraising reports of...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00479.x

    authors: Morrison JM,Sullivan F,Murray E,Jolly B

    更新日期:1999-12-01 00:00:00

  • Interactive video in medical education: a program on jugular venous pressure and the cardiac cycle.

    abstract::Interactive video is a new teaching medium that has much potential in medical education. Hitherto, the realization of this potential has been restrained by lack of awareness among medical teachers of the advantageous features provided and how to implement them, while computer specialists lack the required medical know...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00044.x

    authors: Jamison JP,Brannigan P

    更新日期:1991-03-01 00:00:00

  • Training psychiatrists and family doctors in evaluating interpersonal skills.

    abstract::Ten psychiatrists and 15 family doctors were asked to score videotapes of patient-doctor encounters before and after each of two training periods. One period focused on the theory of assessment of doctors' interpersonal skills, while the other was purely practical. Results indicate that after one training session in e...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1990.tb02454.x

    authors: Des Marchais JE,Jean P,Castonguay LG

    更新日期:1990-07-01 00:00:00

  • Medical students as standardized patients to assess interviewing skills for pain evaluation.

    abstract:PURPOSE:The use of medical students as standardized patients in a performance assessment of pain evaluation was studied. METHODS:Fifty-two pairs of second-year medical students participated. One student portrayed a patient presenting with cancer pain and was interviewed by the other medical student. The student-patien...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01070.x

    authors: Mavis BE,Ogle KS,Lovell KL,Madden LM

    更新日期:2002-02-01 00:00:00

  • Changes in performance: a 5-year longitudinal study of participants in a multi-source feedback programme.

    abstract:OBJECTIVES:Multi-source feedback (MSF) enables performance data to be provided to doctors from patients, co-workers and medical colleagues. This study examined the evidence for the validity of MSF instruments for general practice, investigated changes in performance for doctors who participated twice, 5 years apart, an...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2008.03127.x

    authors: Violato C,Lockyer JM,Fidler H

    更新日期:2008-10-01 00:00:00

  • Performance evaluation of graduates from a community-based curriculum: the housemanship period at Gezira.

    abstract::The housemanship performance of the first two classes of the University of Gezira Medical School was assessed on 107 occasions by using a questionnaire administered to the senior doctors (consultants) in the units in which they worked and the data, which covered 32% of all housemanship rotations taken by these graduat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1992.tb00159.x

    authors: Abdel Rahim IM,Mustafa AE,Ahmed BO

    更新日期:1992-05-01 00:00:00

  • Are we at risk of groupthink in our approach to teamwork interventions in health care?

    abstract:CONTEXT:The incidence of medical error, adverse clinical events and poor quality health care is unacceptably high and there are data to suggest that poor coordination of care, or teamwork, contributes to adverse outcomes. So, can we assume that increased collaboration in multidisciplinary teams improves performance and...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12943

    authors: Kaba A,Wishart I,Fraser K,Coderre S,McLaughlin K

    更新日期:2016-04-01 00:00:00

  • The effectiveness of arts-based interventions in medical education: a literature review.

    abstract:CONTEXT:arts-based interventions, which aim to foster understanding of the patient's perspective and to enhance communication skills, have been part of the medical curriculum for several years. This review aims to evaluate the available evidence base for their effectiveness and to suggest the nature of future work. ME...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2010.03848.x

    authors: Perry M,Maffulli N,Willson S,Morrissey D

    更新日期:2011-02-01 00:00:00

  • Illuminating an address: a guide for speakers at medical meetings.

    abstract::Most people who attend professional meetings would appreciate the use by speakers of more illustrative material with their lectures. This may be presented on a writing surface such as a black- or whiteboard, as projected pictures or by sound recordings. Suitable equipment is available in most halls and suggestions are...

    journal_title:Medical education

    pub_type:

    doi:10.1111/j.1365-2923.1980.tb02605.x

    authors: Essex-Lopresti M

    更新日期:1980-01-01 00:00:00

  • Associations between emotional intelligence and doctor burnout, job satisfaction and patient satisfaction.

    abstract:CONTEXT:The occupational health literature has long been dominated by stress-related topics. A more contemporary perspective suggests using a positive approach in the form of a health model focused on what is right with people, such as feelings of well-being and satisfaction. OBJECTIVES:Using a positive perspective an...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.03985.x

    authors: Weng HC,Hung CM,Liu YT,Cheng YJ,Yen CY,Chang CC,Huang CK

    更新日期:2011-08-01 00:00:00

  • Hand-scoring of multiple choice questions.

    abstract::Although computer marking of MCQ papers is common practice and is popular because of its accuracy, speed and the fact that detailed statistical analysis can be carried out painlessly, there is still a major role for hand-scoring. A computer and computer time are not always immediately available and some form of data c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1983.tb01111.x

    authors: Anderson J

    更新日期:1983-03-01 00:00:00

  • Reliability of global rating scales in the assessment of clinical competence of medical students.

    abstract::Undergraduate medical students of the Ben Gurion University were evaluated upon completion of their fourth- and sixth-year medical clerkships by a 17-item rating scale, a multiple choice question (MCQ) test and a patient-oriented oral examination by two academic staff members. Pearson's correlation coefficient between...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1987.tb01406.x

    authors: Keynan A,Friedman M,Benbassat J

    更新日期:1987-11-01 00:00:00

  • Beyond summative decision making: Illuminating the broader roles of competence committees.

    abstract:CONTEXT:Although competence committees (CCs) are most often conceptualised as group decision-making bodies, policy documents forward a more ambitious vision and outline several additional roles for CCs that support the continuous quality improvement of education programmes and promote formative feedback. However, wheth...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14072

    authors: Pack R,Lingard L,Watling C,Cristancho S

    更新日期:2020-06-01 00:00:00

  • Attitudes of medical students to old people: a cross-national comparative study.

    abstract::Medical students' attitudes to the elderly were compared at the start and finish of a 5-week clinical attachment in health care of the elderly at the Christchurch School of Medicine. The study investigated students in their first clinical year (fourth year of their medical course) over five terms using a questionnaire...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1992.tb00171.x

    authors: Sainsbury R,Wilkinson TJ,Smith CW

    更新日期:1992-07-01 00:00:00

  • The consequences of authentic early experience for medical students: creation of mētis.

    abstract:CONTEXT:Authentic early experience (AEE) describes experiences provided to new medical students to undertake 'human contact' to enhance learning. Although the concept of AEE is not new, and was commonplace prior to the Flexner Report of 1910, little is known about how or why meaning and knowledge are constructed throug...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04287.x

    authors: Yardley S,Brosnan C,Richardson J

    更新日期:2013-01-01 00:00:00

  • Workplace-based assessments in postgraduate medical education: A hermeneutic review.

    abstract:OBJECTIVES:Since their introduction, workplace-based assessments (WBAs) have proliferated throughout postgraduate medical education. Previous reviews have identified mixed findings regarding WBAs' effectiveness, but have not considered the importance of user-tool-context interactions. The present review was conducted t...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.14221

    authors: Prentice S,Benson J,Kirkpatrick E,Schuwirth L

    更新日期:2020-11-01 00:00:00

  • Assessing suitability for a problem-based learning curriculum: evaluating a new student selection instrument.

    abstract:CONTEXT:A new student selection instrument has been designed to assess candidate suitability for a problem-based learning, small group curriculum. OBJECTIVE:To evaluate the performance of the new teamwork selection instrument in terms of its discriminatory power, fairness, validity, reliability and acceptability among...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02086.x

    authors: Chamberlain SE,Searle J

    更新日期:2005-03-01 00:00:00

  • Computer-aided learning in the real world of medical education: does the quality of interaction with the computer affect student learning?

    abstract:BACKGROUND:Computerised learning clearly offers exciting potential for improving student learning, either as an aid to or as a replacement for traditional formats, or for the development of innovative approaches. However, rigorous evaluation of the utility of computer-aided learning (CAL) in enhancing student learning ...

    journal_title:Medical education

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1111/j.1365-2929.2004.01892.x

    authors: Hudson JN

    更新日期:2004-08-01 00:00:00

  • Student assessment in undergraduate medical education in the United Kingdom, 1998.

    abstract::This report describes the results of the project 'Assessment of Undergraduate Medical Education: Re-inventing the Wheel?' funded by the Nuffield Trust. The project was initiated in order to obtain information on current assessment practices in medical schools across the UK, to determine the extent of change as a conse...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.0340s1001.x

    authors: Fowell SL,Maudsley G,Maguire P,Leinster SJ,Bligh J

    更新日期:2000-09-01 00:00:00

  • Profile of doctors who participate in continuing medical education in Malaysia.

    abstract::A random survey of 400 doctors was carried out over a period of 3 months to determine the factors that would facilitate or inhibit the participation of doctors in continuing medical education (CME) in Malaysia. Regular participation in CME was defined as participation in any activity (self-directed reading or attendin...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00091.x

    authors: Shahabudin SH,Edariah AB

    更新日期:1991-09-01 00:00:00

  • Teaching of medical ethics.

    abstract::Teaching medical ethics in Manchester within the introductory course of obstetrics and gynaecology is a joint activity with the Centre for Social Ethics and Policy. This interdisciplinary teaching has evolved through lecture sessions with small-group discussions dealing with topics of interest in human reproduction. T...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1990.tb02670.x

    authors: Elstein M,Harris J

    更新日期:1990-11-01 00:00:00

  • Applying the science of learning to medical education.

    abstract::OBJECTIVE The goal of this paper is to examine how to apply the science of learning to medical education. SCIENCE OF LEARNING The science of learning is the scientific study of how people learn. Multimedia learning - learning from words and pictures - is particularly relevant to medical education. The cognitive theory...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03624.x

    authors: Mayer RE

    更新日期:2010-06-01 00:00:00

  • A critical narrative review of transfer of basic science knowledge in health professions education.

    abstract:CONTEXT:'Transfer' is the application of a previously learned concept to solve a new problem in another context. Transfer is essential for basic science education because, to be valuable, basic science knowledge must be transferred to clinical problem solving. Therefore, better understanding of interventions that enhan...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.13519

    authors: Castillo JM,Park YS,Harris I,Cheung JJH,Sood L,Clark MD,Kulasegaram K,Brydges R,Norman G,Woods N

    更新日期:2018-06-01 00:00:00

  • The place of primary health care in medical education in the United Kingdom: a survey.

    abstract::Primary health care has been held to be the foundation of any rational health system. The principle was fully endorsed by the Alma-Ata Conference in 1978, and has become the main policy of the World Health Organization. Important implications are involved for the education and training of doctors and other health care...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1983.tb00653.x

    authors: Walton HJ

    更新日期:1983-05-01 00:00:00

  • Independent learning: a self-instructional videotape approach in psychiatry.

    abstract::In response to the increased need to train well-rounded general practitioners within a limited time schedule, the teaching staff developed a self-instructional videotape programme devoted to suicide assessment. This tape, if successful, was to serve as a pilot for a full series of 18 tapes devoted to the assessment an...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1980.tb02609.x

    authors: Golden K,Furst E,Sundermann R,Delk J,McGill S

    更新日期:1980-01-01 00:00:00

  • Medical students' note-taking in a medical biochemistry course: an initial exploration.

    abstract::Beginning medical students spend numerous hours every week attending basic science lectures and taking notes. Medical faculty often wonder whether they should give students pre-printed instructors' notes before lectures. Proponents of this strategy argue that provided notes enhance learning by facilitating the accurat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01167.x

    authors: Morrison EH,McLaughlin C,Rucker L

    更新日期:2002-04-01 00:00:00

  • Anxiety and stress reduction in medical education: an intervention.

    abstract:OBJECTIVES:To assess the effectiveness of a stress reduction elective on Year 2 medical students and to assess the sustainability of any noted improvement. METHODS:A new elective entitled 'Mind-Body Medicine: an Experiential Elective' was offered to Year 2 medical students. It was based on a course developed by the Ce...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2007.02685.x

    authors: Finkelstein C,Brownstein A,Scott C,Lan YL

    更新日期:2007-03-01 00:00:00