Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score.

Abstract:

BACKGROUND:Objective structured clinical examination (OSCE) standard-setting procedures are not well developed and are often time-consuming and complex. We report an evaluation of a simple 'contrasting groups' method, applied to an OSCE conducted simultaneously in three separate schools. SUBJECTS:Medical students undertaking an end-of-fifth year multidisciplinary OSCE. METHODS:Using structured marking sheets, pairs of examiners independently scored student performance at each OSCE station. Examiners also provided a global rating of overall performance. The actual scores of any borderline candidates at each station were averaged to provide a passing score for each station. The passing scores for all stations were combined to become the passing score for the whole exam. Validity was determined by making comparisons with performance on other fifth-year assessments. Reliability measures comprised interschool agreement, interexaminer agreement and interstation variability. RESULTS:The approach was simple and had face validity. There was a stronger association between the performance of borderline candidates on the OSCE and their in-course assessments than with their performance on the written exam, giving a weak measure of construct validity in the absence of a better 'gold standard'. There was good agreement between examiners in identifying borderline candidates. There were significant differences between schools in the borderline score for some stations, which disappeared when more than three stations were aggregated. CONCLUSION:This practical method provided a valid and reliable competence-based pass mark. Combining marks from all stations before determining the pass mark was more reliable than making decisions based on individual stations.

journal_name

Med Educ

journal_title

Medical education

authors

Wilkinson TJ,Newble DI,Frampton CM

doi

10.1046/j.1365-2923.2001.01041.x

keywords:

subject

Has Abstract

pub_date

2001-11-01 00:00:00

pages

1043-9

issue

11

eissn

0308-0110

issn

1365-2923

pii

1041

journal_volume

35

pub_type

杂志文章
  • Teaching communication skills to pre-clinical medical students: a general practice based approach.

    abstract::This paper describes a method of teaching communication skills to pre-clinical medical students in the setting of general practice. By focusing on the nature of the patient's problem this teaching tries to place interviewing and diagnostic procedures in their proper context in the doctor-patient relationship. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb00926.x

    authors: Armstrong D,Hicks BH,Higgins PM,Weinman JA

    更新日期:1979-03-01 00:00:00

  • The development of medical teachers: an enquiry into the learning histories of 10 experienced medical teachers.

    abstract:AIM:The aim of the study was to explore the different ways in which doctors have learned to teach and train. INTRODUCTION:There is no coherent theory of medical teacher development. Doctors are experts in what they teach; most have had little or no training in how they teach. Research has mostly concentrated on the ac...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02335.x

    authors: MacDougall J,Drummond MJ

    更新日期:2005-12-01 00:00:00

  • Training the ideal hospital doctor: the specialist registrars' perspective.

    abstract:BACKGROUND:When training for junior doctors is being planned, little discussion is focused on what outcomes hospitals are trying to achieve with regard to education/training, i.e. on what makes the ideal hospital doctor. Instead, the primary focus is on the requirements of the syllabi of the Royal Colleges (credentiali...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:

    authors: Khera N,Stroobant J,Primhak RA,Gupta R,Davies H

    更新日期:2001-10-01 00:00:00

  • Portfolio-based learning: continuing medical education for general practitioners--a mid-point evaluation.

    abstract::In October 1994 a project was initiated by the General Practice Continuing Medical Education Tutors in the Department of General Practice at Sheffield University. The project sought to evaluate the efficiency (effort expended) and effectiveness (distance travelled) of a model of continuing professional development for...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1997.tb00038.x

    authors: Challis M,Mathers NJ,Howe AC,Field NJ

    更新日期:1997-01-01 00:00:00

  • Pre-registration house officers' views on studying under a reformed medical curriculum in the UK.

    abstract::In 1996 the University of Liverpool introduced a new curriculum based on the recommendations published in Tomorrow's Doctors. This work examines how graduates of that course view their undergraduate curriculum and whether they consider it prepared them well for the pre-registration year. Five focus groups were arrange...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2929.2006.02545.x

    authors: Watmough S,Garden A,Taylor D

    更新日期:2006-09-01 00:00:00

  • Reliability of global rating scales in the assessment of clinical competence of medical students.

    abstract::Undergraduate medical students of the Ben Gurion University were evaluated upon completion of their fourth- and sixth-year medical clerkships by a 17-item rating scale, a multiple choice question (MCQ) test and a patient-oriented oral examination by two academic staff members. Pearson's correlation coefficient between...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1987.tb01406.x

    authors: Keynan A,Friedman M,Benbassat J

    更新日期:1987-11-01 00:00:00

  • Professional behaviour of medical school graduates: an analysis.

    abstract::Recent graduates (1989-1990) of a traditional school of Chinese medicine were assessed by observers using a 10-item scale for professional behaviour in the non-cognitive realm. Overall, 10.7% of the graduates had low ratings on this scale. Of those who scored in the top two quartiles on this scale, 71.4% reported that...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1994.tb02715.x

    authors: Lu YH,Meng XY,Liu X

    更新日期:1994-07-01 00:00:00

  • How clinical supervisors develop trust in their trainees: a qualitative study.

    abstract:CONTEXT:Clinical supervisors oversee trainees' performance while granting them increasing opportunities to work independently. Although the factors contributing to supervisors' trust in their trainees to conduct clinical work have been identified, how the development of trust is shaped by these factors remains less cle...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12745

    authors: Hauer KE,Oza SK,Kogan JR,Stankiewicz CA,Stenfors-Hayes T,Cate OT,Batt J,O'Sullivan PS

    更新日期:2015-08-01 00:00:00

  • Resuscitating paediatric induction: an action research approach.

    abstract:OBJECTIVES:To establish teaching objectives, methods and assessment for a paediatric induction programme. DESIGN:Action research over a 2-year period. PARTICIPANTS:88 doctors from three hospitals. MAIN OUTCOME MEASURES:These were end-of-course evaluations, using Likert scales, and free comments; independent evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2001.00982.x

    authors: Melville C,Wall D,Samuels M

    更新日期:2001-08-01 00:00:00

  • Observational analysis of near-peer and faculty tutoring in problem-based learning groups.

    abstract:CONTEXT:Near-peer and faculty staff tutors may facilitate problem-based learning (PBL) through different means. Near-peer tutors are thought to compensate for their lack of subject matter expertise with greater adeptness at group facilitation and a better understanding of their learners. However, theoretical explanatio...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12969

    authors: Cianciolo AT,Kidd B,Murray S

    更新日期:2016-07-01 00:00:00

  • A course on collaboration between social workers and general practitioners during their vocational training.

    abstract::The educational programme reported was an experiment in the vocational training scheme of the department of General Practice, Erasmus University, Rotterdam, Holland, and is now part of the course. The programme focused on the training in team function (co-operation) given to trainee GPs and social workers. It became c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb00916.x

    authors: Schenk F

    更新日期:1979-01-01 00:00:00

  • The impact of learning environment disruption on medical student performance.

    abstract:OBJECTIVES:This study aimed to quantify the effects of two distinct and separate disruptions caused by earthquakes to a medical school learning environment on two separate cohorts of Year 5 medical students. METHODS:The first disruption was caused by an earthquake of magnitude 7.1 that occurred near the end of the aca...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12065

    authors: Wilkinson TJ,Ali AN,Bell CJ,Carter FA,Frampton CM,McKenzie JM

    更新日期:2013-02-01 00:00:00

  • The anxieties of new clinical students.

    abstract::The specific anxieties of 74 medical students beginning their clinical training were assessed by means of a questionnaire at the start of the clinical introductory course at St Mary's Hospital Medical School, London. Situations differed in the amount of anxiety that they engendered, and students also differed in the n...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1992.tb00116.x

    authors: Moss F,McManus IC

    更新日期:1992-01-01 00:00:00

  • An electronic learning portfolio for reflective continuing professional development.

    abstract:OBJECTIVES:These were to measure the uptake and use of an electronic learning portfolio to support reflective continuing professional development, and to characterize attitudes towards its use and obstacles to its adoption. DESIGN:Uncontrolled, longitudinal intervention study with quantitative and qualitative evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01278.x

    authors: Dornan T,Carroll C,Parboosingh J

    更新日期:2002-08-01 00:00:00

  • Script concordance testing: a review of published validity evidence.

    abstract:CONTEXT:Script concordance test (SCT) scores are intended to reflect respondents' competence in interpreting clinical data under conditions of uncertainty. The validity of inferences based on SCT scores has not been rigorously established. OBJECTIVES:This study was conducted in order to develop a structured validity a...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2010.03863.x

    authors: Lubarsky S,Charlin B,Cook DA,Chalk C,van der Vleuten CP

    更新日期:2011-04-01 00:00:00

  • Maturational differences in undergraduate medical students' perceptions about feedback.

    abstract:CONTEXT:Although medical students receive varied feedback throughout their training programmes, research demonstrates that they frequently perceive it as insufficient. However, supervisors tend to perceive that it is adequate. Students' responses to, and use of, feedback are not clearly understood. The purposes of this...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04291.x

    authors: Murdoch-Eaton D,Sargeant J

    更新日期:2012-07-01 00:00:00

  • General practitioners, revalidation and appraisal: a cross sectional survey of attitudes, beliefs and concerns in Lincolnshire.

    abstract:BACKGROUND:All general practitioners (GPs) are expected to have an appraisal from 2002 and the first cohort will experience revalidation in 2005. Although there is a link between appraisal and revalidation, this has yet to be clarified. OBJECTIVE:To investigate the knowledge, attitudes and beliefs of GPs towards reval...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01469.x

    authors: Middlemass J,Siriwardena AN

    更新日期:2003-09-01 00:00:00

  • Illuminating an address: a guide for speakers at medical meetings.

    abstract::Most people who attend professional meetings would appreciate the use by speakers of more illustrative material with their lectures. This may be presented on a writing surface such as a black- or whiteboard, as projected pictures or by sound recordings. Suitable equipment is available in most halls and suggestions are...

    journal_title:Medical education

    pub_type:

    doi:10.1111/j.1365-2923.1980.tb02605.x

    authors: Essex-Lopresti M

    更新日期:1980-01-01 00:00:00

  • Inquiry: the pedagogical importance of a skill central to clinical practice.

    abstract::The skill of inquiry is central to the task of the doctor confronted with a patient problem. Despite its importance this skill is not given appropriate emphasis in the education of medical students or in research concerning the clinical reasoning skills of doctors. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1990.tb02428.x

    authors: Barrows HS

    更新日期:1990-01-01 00:00:00

  • Well-being in an academic environment.

    abstract:PURPOSE:Due to the high volume and acuity of mental health issues presented by graduate and professional students nationwide, this study explored specific mental health needs in students in order to identify credible areas for intervention. METHODS:An assessment tool was created for this project, which identified sati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2929.2004.01812.x

    authors: Stecker T

    更新日期:2004-05-01 00:00:00

  • Teaching medical students about family planning: experiences from a primary health care course in Lagos, Nigeria.

    abstract::In 1979, the College of Medicine, Lagos, Nigeria embarked on a new curriculum, which places more emphasis on primary health care in line with the needs of the country. This paper discusses one aspect of the primary health care course, family planning, which involves teaching a practical subject to a large number of st...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1986.tb01040.x

    authors: Olukoya AA,Oyediran MA

    更新日期:1986-01-01 00:00:00

  • The short-term stability of student ratings of instruction in medical school.

    abstract::The purpose of this study was to assess the degree of consistency in student ratings of teacher effectiveness during the first year of medical school. Student ratings of teaching effectiveness represent a commonly used source of information that enters into the academic decision-making process. In medical school, stud...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1988.tb00419.x

    authors: West RF

    更新日期:1988-03-01 00:00:00

  • Validity of the visual analogue scale as an instrument to measure self-efficacy in resuscitation skills.

    abstract:CONTEXT:Self-efficacy is an important factor in many areas of medical education, including self-assessment and self-directed learning, but has been little studied in resuscitation training, possibly because of the lack of a simple measurement instrument. OBJECTIVE:We aimed to assess the validity of a visual analogue s...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2923.2007.02950.x

    authors: Turner NM,van de Leemput AJ,Draaisma JM,Oosterveld P,ten Cate OT

    更新日期:2008-05-01 00:00:00

  • Changing the attitudes of 'tomorrow's doctors' towards mental illness and psychiatry: a comparison of two teaching methods.

    abstract::The General Medical Council's document 'Tomorrow's Doctors' (1993, GMC, London) recommended major changes in the undergraduate curricula of UK medical schools. In Nottingham, the fourth-year psychiatric attachment became shorter in duration, and interactive, problem-oriented, workshop-based learning replaced lectures....

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00162.x

    authors: Singh SP,Baxter H,Standen P,Duggan C

    更新日期:1998-03-01 00:00:00

  • Techniques for measuring clinical competence: objective structured clinical examinations.

    abstract::The traditional clinical examination has been shown to have serious limitations in terms of its validity and reliability. The OSCE provides some answers to these limitations and has become very popular. Many variants on the original OSCE format now exist and much research has been done on various aspects of their use....

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2004.01755.x

    authors: Newble D

    更新日期:2004-02-01 00:00:00

  • The superiority of three-dimensional physical models to two-dimensional computer presentations in anatomy learning.

    abstract:BACKGROUND:Although several studies (Anat Sci Educ, 8 [6], 525, 2015) have shown that computer-based anatomy programs (three-dimensional visualisation technology [3DVT]) are inferior to ordinary physical models (PMs), the mechanism is not clear. In this study, we explored three mechanisms: haptic feedback, transfer-app...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13683

    authors: Wainman B,Wolak L,Pukas G,Zheng E,Norman GR

    更新日期:2018-11-01 00:00:00

  • Students' moral reasoning, Machiavellianism and socially desirable responding: implications for teaching ethics and research integrity.

    abstract:OBJECTIVE:To investigate the relationship between psychological constructs related to professional and research integrity and moral reasoning among medical students. METHODS:Medical students, 2nd-year (n = 208, 85.6% of 243 enrolled students), answered the moral reasoning test-defining issues test 2 (DIT2) and the Mac...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02391.x

    authors: Hren D,Vujaklija A,Ivanisević R,Knezević J,Marusić M,Marusić A

    更新日期:2006-03-01 00:00:00

  • Teaching and learning in the clinical setting: a qualitative study of the perceptions of students and teachers.

    abstract:OBJECTIVE:To describe the perceptions of medical students and clinical teachers of teaching and learning in the clinical setting. DESIGN:Qualitative study of focus groups with undergraduate medical students and semistructured interviews with hospital consultant clinical teachers. SETTING:The School of Medicine, Unive...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01675.x

    authors: Stark P

    更新日期:2003-11-01 00:00:00

  • The first batch of graduates of a new medical curriculum in Asia: how their teachers see them.

    abstract:OBJECTIVE:To examine teachers' views of the first batch of graduates of a revised medical curriculum in Asia. METHODS:A cross-sectional study using a structured questionnaire was carried out to obtain the views of all the clinical teachers involved in teaching final year students of the old curriculum in 2000-01 and t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.01910.x

    authors: Lam TP,Khoo US,Chan YS,Cheng YH,Lam KF

    更新日期:2004-09-01 00:00:00

  • Monitoring the widening participation initiative for access to medical school: are present measures sufficient?

    abstract:CONTEXT:Widening access to higher education is a political priority. Social trends among medical school applicants are presently monitored using information on parental occupation. However, not all students now provide this information on their university application forms. OBJECTIVES:To compare the demographic charac...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02535.x

    authors: Do PC,Parry J,Mathers J,Richardson M

    更新日期:2006-08-01 00:00:00