Improving assessment practice through cross-institutional collaboration: An exercise on the use of OSCEs.

Abstract:

BACKGROUND:This study was undertaken to improve assessment practice on OSCEs through collaboration across geographically dispersed medical schools in Australia. METHODS:A total of eleven OSCE stations were co-developed by four medical schools and used in summative 2011 and 2012 examinations for the assessment of clinical performance in the early clinical and exit OSCEs in each school's medical course. Partial Credit Rasch Model was used to evaluate the psychometric properties of the shared OSCE data. Evaluation of the quality assurance reports was used to determine the beneficial impact of the collaborative benchmarking exercise on learning and teaching outcomes. RESULTS:The data for each examination demonstrated sufficient fit to the Rasch model with infit mean square values ranging from 0.88 to 0.99. Person separation (1.25-1.63) indices indicated good reliability. Evaluation of perceived benefits showed that the benchmarking process was successful as it highlighted common curriculum areas requiring specific focus and provided comparable data on the quality of teaching at the participating medical schools. CONCLUSION:This research demonstrates the validity of the psychometric data and benefits of evaluating clinical competence across medical schools without the enforcement of a prescriptive national curriculum or assessment.

journal_name

Med Teach

journal_title

Medical teacher

authors

Malau-Aduli BS,Teague PA,Turner R,Holman B,D'Souza K,Garne D,Heal C,Heggarty P,Hudson JN,Wilson IG,Van Der Vleuten C

doi

10.3109/0142159X.2015.1016487

subject

Has Abstract

pub_date

2016-01-01 00:00:00

pages

263-71

issue

3

eissn

0142-159X

issn

1466-187X

journal_volume

38

pub_type

杂志文章
  • Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study.

    abstract:CONTEXT:E-learning resources, such as virtual patients (VPs), can be more effective when they are integrated in the curriculum. To gain insights that can inform guidelines for the curricular integration of VPs, we explored students' perceptions of scenarios with integrated and non-integrated VPs aimed at promoting clin...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.826790

    authors: Huwendiek S,Duncker C,Reichert F,De Leng BA,Dolmans D,van der Vleuten CP,Haag M,Hoffmann GF,Tönshoff B

    更新日期:2013-11-01 00:00:00

  • The good student is more than a listener - The 12+1 roles of the medical student.

    abstract:BACKGROUND:The process of medical education, particularly in the fast evolving new era of medical metaschools, is a broad and complex issue. Harden & Crosby claimed that a good teacher is more than a lecturer, and identified 12 roles that certify a good and capable teacher. However, this is only half the truth: the goo...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.638006

    authors: Karakitsiou DE,Markou A,Kyriakou P,Pieri M,Abuaita M,Bourousis E,Hido T,Tsatsaragkou A,Boukali A,de Burbure C,Dimoliatis ID

    更新日期:2012-01-01 00:00:00

  • The role of observational research in improving faculty lecturing skills: A qualitative study in an Italian dental school.

    abstract:BACKGROUND:This pilot study is based on observational research of lecturing skills during the annual Oral Medicine course at the Milan Dentistry School. AIMS:Our goals were to explore how teachers exhibited desirable lecturing skills, to observe how their attitudes and lecturing skills affected students' attention and...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590902744860

    authors: Visioli S,Lodi G,Carrassi A,Zannini L

    更新日期:2009-08-01 00:00:00

  • Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

    abstract:BACKGROUND:Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. AIM:The purpose of t...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2011.575903

    authors: Penciner R,Langhan T,Lee R,McEwen J,Woods RA,Bandiera G

    更新日期:2011-01-01 00:00:00

  • The assessment and treatment of the acutely ill patient--the role of the patient simulator as a teaching tool in the undergraduate programme.

    abstract::The assessment and treatment of the acutely ill patient is an essential part of the role of the pre-registration house officer, and research has demonstrated that management of such patients in the ward setting is often sub-optimal. However, this is an area which is difficult to teach at an undergraduate level, partic...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600625130

    authors: MacDowall J

    更新日期:2006-06-01 00:00:00

  • The clinical learning environment.

    abstract::Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches t...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1566601

    authors: Nordquist J,Hall J,Caverzagie K,Snell L,Chan MK,Thoma B,Razack S,Philibert I

    更新日期:2019-04-01 00:00:00

  • Introducing competency-based postgraduate medical education in the Netherlands.

    abstract::Medical boards around the world face the challenge of creating competency-based postgraduate training programs. Recent legislation requires that all postgraduate medical training programmes in The Netherlands be reformed. In this article the Dutch Advisory Board for Postgraduate Curriculum Development shares some of t...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590801993022

    authors: Scheele F,Teunissen P,Van Luijk S,Heineman E,Fluit L,Mulder H,Meininger A,Wijnen-Meijer M,Glas G,Sluiter H,Hummel T

    更新日期:2008-01-01 00:00:00

  • Teaching problem solving and decision making in undergraduate medical education: an instructional strategy.

    abstract::Actual changes in the context of real care along with their impact on current practice modes prompted the authors to develop a new instructional strategy, which aims to improve the diagnostic reasoning competence of medical undergraduates. In this strategy the use of visual representations is promoted. A diagnostic pa...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159031000137490

    authors: Van Puymbroeck H,Remmen R,Denekens J,Scherpbier A,Bisoffi Z,Van Den Ende J

    更新日期:2003-09-01 00:00:00

  • LectureKeepr: A novel approach to studying in the adaptive curriculum.

    abstract::As medical students search for ways to squeeze more hours of learning into their day, many have turned to technology for quick and efficient ways to study. Most commonly this includes based apps for purchase that involve visual tasks, mental review and repetition. Tasks involve flashcard creation, answering multiple c...

    journal_title:Medical teacher

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/0142159X.2018.1484895

    authors: Brown A,Ajufo E,Cone C,Quirk M

    更新日期:2018-08-01 00:00:00

  • Twelve tips for making the best use of feedback.

    abstract:BACKGROUND:Feedback is generally regarded as crucial for learning. We focus on feedback provided through instruments developed to inform self-assessment and support learners to improve performance. These instruments are being used commonly in medical education, but they are ineffective if the feedback is not well recei...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.769676

    authors: van der Leeuw RM,Slootweg IA

    更新日期:2013-05-01 00:00:00

  • Personal view: medical education in sweden: urgently needed reforms.

    abstract::I have been licensed as a physician in Sweden for more than 50 years, working for most of this time at the Royal University of Lund, the Royal University of Gothenburg and the Royal University of Uppsala. My experience has been mostly as Professor of Medicine, but I have also had considerable experience in Anatomy, th...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909023831

    authors: Ask-Upmark E

    更新日期:1979-01-01 00:00:00

  • The need for longitudinal clinical reasoning teaching and assessment: Results of an international survey.

    abstract::Background: Clinical reasoning is a key ability essential for practising health professionals. However, little is known about the current global adoption of clinical reasoning teaching and assessment.Purpose: We aimed to provide insights into how clinical reasoning is deliberately taught and assessed in curricula worl...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1708293

    authors: Kononowicz AA,Hege I,Edelbring S,Sobocan M,Huwendiek S,Durning SJ

    更新日期:2020-04-01 00:00:00

  • Automatic scoring of medical students' clinical notes to monitor learning in the workplace.

    abstract:BACKGROUND:Educators need efficient and effective means to track students' clinical experiences to monitor their progress toward competency goals. AIM:To validate an electronic scoring system that rates medical students' clinical notes for relevance to priority topics of the medical school curriculum. METHOD:The Vand...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.849801

    authors: Spickard A 3rd,Ridinger H,Wrenn J,O'brien N,Shpigel A,Wolf M,Stein G,Denny J

    更新日期:2014-01-01 00:00:00

  • Twelve tips for addressing medical student and resident physician lapses in professionalism.

    abstract::Medical educators have gained significant ground in the practical and scholarly approach to professionalism. When a lapse occurs, thoughtful remediation to address the underlying issue can have a positive impact on medical students and resident physicians, while failure to address lapses, or to do so ineffectively, ca...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.1001730

    authors: Rougas S,Gentilesco B,Green E,Flores L

    更新日期:2015-01-01 00:00:00

  • How physicians teach in the clinical setting: The embedded roles of teaching and clinical care.

    abstract:BACKGROUND:Clinical teaching lies at the heart of medical education. However, few studies have explored the embedded nature of teaching and clinical care. The goal of this study was to examine the process of clinical teaching as it naturally, and spontaneously, unfolds in a broad range of authentic contexts with medica...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2017.1360473

    authors: Steinert Y,Basi M,Nugus P

    更新日期:2017-12-01 00:00:00

  • Awareness and usage of evidence-based learning strategies among health professions students and faculty.

    abstract::Introduction: Learning is essential and life-long for faculty and students. Often students and teachers use ineffective learning strategies and are not aware of evidence-based strategies.Methods: A multicenter, international, cross-sectional, online survey-based assessment of awareness of evidence-based learning strat...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1645950

    authors: Piza F,Kesselheim JC,Perzhinsky J,Drowos J,Gillis R,Moscovici K,Danciu TE,Kosowska A,Gooding H

    更新日期:2019-12-01 00:00:00

  • Preparedness of medical education in China: Lessons from the COVID-19 outbreak.

    abstract::The COVID-19 outbreak can be seen as a 'big test' for China; a summative assessment of its preparedness on multiple fronts, including medical education. Being intimately involved in the coordinated response, the First Affiliated Hospital of Sun Yat-sen University has been a first-hand witness to the strengths and weak...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1770713

    authors: Yang DY,Cheng SY,Wang SZ,Wang JS,Kuang M,Wang TH,Xiao HP

    更新日期:2020-07-01 00:00:00

  • Clinical supervisors' perceived needs for teaching communication skills in clinical practice.

    abstract:BACKGROUND:Lack of faculty training is often cited as the main obstacle to post-graduate teaching in communication skills. AIMS:To explore clinical supervisors' needs and perceptions regarding their role as communication skills trainers. METHODS:Four focus group discussions were conducted with clinical supervisors fr...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802650134

    authors: Perron NJ,Sommer J,Hudelson P,Demaurex F,Luthy C,Louis-Simonet M,Nendaz M,De Grave W,Dolmans D,van der Vleuten CP

    更新日期:2009-07-01 00:00:00

  • Establishing faculty needs and priorities for peer-mentoring groups using a nominal group technique.

    abstract::Peer-mentoring groups are purported to enhance faculty productivity and retention, but the literature about implementation is sparse. Nominal Group Sessions (n=5) with 66 faculty members in different tracks developed prioritized lists of unmet professional development needs and potential group activities. Common items...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.669084

    authors: Colón-Emeric CS,Bowlby L,Svetkey L

    更新日期:2012-01-01 00:00:00

  • Twelve tips to stimulate creative problem-solving with design thinking.

    abstract::Design thinking is increasingly applied in healthcare and health professions education to generate innovative solutions to difficult problems. The design thinking framework helps individuals approach problems with a user-centered focus; the emphasis is on understanding the user experience, their challenges, and possib...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1807483

    authors: Wolcott MD,McLaughlin JE,Hubbard DK,Rider TR,Umstead K

    更新日期:2020-08-26 00:00:00

  • Teaching residents through consultation.

    abstract::Some patients present problems which exceed a junior doctor's ability to analyse and synthesize information on which management decisions must be made. As a result, he or she often consults with an attending physician or consultant. In this article four types of consultation are identified and analysed, each of which ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598109064474

    authors: Williams WC

    更新日期:1981-01-01 00:00:00

  • Clinical teachers' tacit knowledge of basic pedagogic principles.

    abstract::Academic faculty members in medical schools rarely receive formal instruction in basic pedagogic principles; nevertheless many develop into competent teachers. Perhaps they acquire tacit knowledge of these principles with teaching experience. This study was designed to assess clinical teachers' tacit knowledge of basi...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590310001643154

    authors: McLeod PJ,Meagher T,Steinert Y,Schuwirth L,McLeod AH

    更新日期:2004-02-01 00:00:00

  • The Problem with POMR.

    abstract::In this article, Dr Michael Simpson argues the case against unquestioning acceptance of problem orientated medical records, in reply to the article which appeared in the last issue of Medicd Teacher (1979, 1, 147-1511. ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909012600

    authors: Simpson MA

    更新日期:1979-01-01 00:00:00

  • A comparison of medical students' written expressions of emotion and coping and standardized patients' ratings of student professionalism and communication skills.

    abstract:UNLABELLED:Little is known about the relationship between medical students' expression of emotion when confronted with a traumatic medical event and their perceived communication skills and professionalism. METHOD:Eighty-nine second year medical students participated in an objective structured clinical examination (OS...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590400016431

    authors: Shapiro J,Lie D

    更新日期:2004-12-01 00:00:00

  • Impact of national context and culture on curriculum change: a case study.

    abstract:BACKGROUND:Earlier studies suggested national culture to be a potential barrier to curriculum reform in medical schools. In particular, Hofstede's cultural dimension 'uncertainty avoidance' had a significant negative relationship with the implementation rate of integrated curricula. AIMS:However, some schools succeede...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.785629

    authors: Jippes M,Driessen EW,Majoor GD,Gijselaers WH,Muijtjens AM,van der Vleuten CP

    更新日期:2013-08-01 00:00:00

  • Evaluating the quality of teaching in medical education: are we using the evidence for both formative and summative purposes?

    abstract::Heightened focus on the quality of teaching in medical schools has led to increased use of student surveys as a means of evaluating teaching. In some institutions, however, the summative purpose is emphasized over the developmental or self-improvement objective. The aim of this study was to examine the utility of a st...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590220134169

    authors: Elzubeir M,Rizk D

    更新日期:2002-05-01 00:00:00

  • Community medicine.

    abstract::It has become increasingly apparent that traditional medical education serves badly the need of many developing countries to provide effective health care for widely dispersed and often poor communities. This article describes a training programme developed in Iraq to provide final-year medical students with stimulati...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598309146429

    authors: Alkafajei AM,Antony R,Joseph G

    更新日期:1983-01-01 00:00:00

  • Comparability of outcome frameworks in medical education: Implications for framework development.

    abstract:BACKGROUND:Given the increasing mobility of medical students and practitioners, there is a growing need for harmonization of medical education and qualifications. Although several initiatives have sought to compare national outcome frameworks, this task has proven a challenge. Drawing on an analysis of existing outcome...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.3109/0142159X.2015.1012490

    authors: Hautz SC,Hautz WE,Feufel MA,Spies CD

    更新日期:2015-01-01 00:00:00

  • Health inequities: the need for action by schools of medicine.

    abstract:BACKGROUND:It is well recognised that marked inequalities in mortality and morbidity exist between populations particularly those in lower socio-economic groups, including Indigenous and some ethnic minorities. Academic medicine has not yet articulated a clear stance on reducing health inequity within communities. AIM...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590801948042

    authors: Sanson-Fisher RW,Williams N,Outram S

    更新日期:2008-01-01 00:00:00

  • How we started an elective in emergency bedside ultrasound.

    abstract::The expanding use of bedside ultrasonography in the practice of emergency medicine and other specialties is accompanied by the need to train medical students in its applications and interpretation of its results. In this article, the authors describe their successful design, launch, and management of the ultrasound el...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.975194

    authors: Martinez JP,Sommerkamp SK,Euerle BD

    更新日期:2015-01-01 00:00:00