Workplace-based assessments in postgraduate medical education: A hermeneutic review.

Abstract:

OBJECTIVES:Since their introduction, workplace-based assessments (WBAs) have proliferated throughout postgraduate medical education. Previous reviews have identified mixed findings regarding WBAs' effectiveness, but have not considered the importance of user-tool-context interactions. The present review was conducted to address this gap by generating a thematic overview of factors important to the acceptability, effectiveness and utility of WBAs in postgraduate medical education. METHOD:This review utilised a hermeneutic cycle for analysis of the literature. Four databases were searched to identify articles pertaining to WBAs in postgraduate medical education from the United Kingdom, Canada, Australia, New Zealand, the Netherlands and Scandinavian countries. Over the course of three rounds, 30 published articles were thematically analysed in an iterative fashion to deeply engage with the literature in order to answer three scoping questions concerning acceptability, effectiveness and assessment training. As each round was coded, themes were refined and questions added until saturation was reached. RESULTS:Stakeholders value WBAs for permitting assessment of trainees' performance in an authentic context. Negative perceptions of WBAs stem from misuse due to low assessment literacy, disagreement with definitions and frameworks, and inadequate summative use of WBAs. Effectiveness is influenced by user (eg, engagement and assessment literacy) and tool attributes (eg, definitions and scales), but most fundamentally by user-tool-context interactions, particularly trainee-assessor relationships. Assessors' assessment literacy must be combined with cultural and administrative factors in organisations and the broader medical discipline. CONCLUSIONS:The pivotal determinants of WBAs' effectiveness and utility are the user-tool-context interactions. From the identified themes, we present 12 lessons learned regarding users, tools and contexts to maximise WBA utility, including the separation of formative and summative WBA assessors, use of maximally useful scales, and instituting measures to reduce competitive demands.

journal_name

Med Educ

journal_title

Medical education

authors

Prentice S,Benson J,Kirkpatrick E,Schuwirth L

doi

10.1111/medu.14221

subject

Has Abstract

pub_date

2020-11-01 00:00:00

pages

981-992

issue

11

eissn

0308-0110

issn

1365-2923

journal_volume

54

pub_type

杂志文章,评审
  • Responses to non-emergency questions in rural medicine: their usefulness to practice decisions.

    abstract::This study reports the nature of non-emergency, day-to-day practice-related questions which arose in rural practice and were phoned in to a medical information system (MIS). The usefulness of these questions, and their responses, to clinical decision-making is outlined. Sixty-seven practitioners from 10 rural communit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00057.x

    authors: Jennett PA,Kishinevsky M,Parboosingh IT,Lockyer JM,Maes WR

    更新日期:1991-05-01 00:00:00

  • Resourcing innovative teaching of audit--models, methods and MAAGs.

    abstract::Audit is an important part of clinical practice, and has been promoted as a core aspect of undergraduate and postgraduate medical education. Few examples of how audit is taught in the undergraduate curriculum exist. This article presents a model for student teaching using innovative methods, which include an extended ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00240.x

    authors: Howe AC,Purkiss V

    更新日期:1998-11-01 00:00:00

  • Application of continuous quality improvement to medical education.

    abstract:CONTEXT:The explicit, intentional and systematic application of continuous quality improvement (QI) in medical education practice and research can improve medical education and help it achieve its goals. Quality improvement and medical education share a foundation centred on learning-experiencing, reflecting, thinking ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14351

    authors: Wong BM,Headrick LA

    更新日期:2021-01-01 00:00:00

  • Training the ideal hospital doctor: the specialist registrars' perspective.

    abstract:BACKGROUND:When training for junior doctors is being planned, little discussion is focused on what outcomes hospitals are trying to achieve with regard to education/training, i.e. on what makes the ideal hospital doctor. Instead, the primary focus is on the requirements of the syllabi of the Royal Colleges (credentiali...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:

    authors: Khera N,Stroobant J,Primhak RA,Gupta R,Davies H

    更新日期:2001-10-01 00:00:00

  • Medical education: the discontinuers' view point.

    abstract::A postal questionnaire was distributed to all students who had discontinued, for any reason, their studies at Aberdeen Medical School. Opinions were sought about their experiences while there, as well as their reactions to the discontinuation therefrom. Claiming that learning to cope with stress was an essential aspe...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1980.tb02607.x

    authors: Alexander DA,Haldane JD

    更新日期:1980-01-01 00:00:00

  • Beyond the self: The role of co-regulation in medical students' self-regulated learning.

    abstract:CONTEXT:Medical students are expected to self-regulate their learning within complex and unpredictable clinical learning environments. Research increasingly focuses on the effects of social interactions on the development of self-regulation in workplace settings, a notion embodied within the concept of co-regulated lea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14018

    authors: Bransen D,Govaerts MJB,Sluijsmans DMA,Driessen EW

    更新日期:2020-03-01 00:00:00

  • Predicting medical students' intentions to take up rural practice after graduation.

    abstract:OBJECTIVES:Using a novel longitudinal tracking project, this study develops and evaluates the performance of a predictive model and index of rural medical practice intention based on the characteristics of incoming medical students. METHODS:Medical school entry survey data were obtained from the Medical Schools Outcom...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2009.03506.x

    authors: Jones M,Humphreys J,Prideaux D

    更新日期:2009-10-01 00:00:00

  • Misunderstandings: a qualitative study of primary care consultations in multilingual settings, and educational implications.

    abstract:BACKGROUND:Patients in inner-city areas come from increasingly diverse language and cultural backgrounds. Neither communications training modelled on local English speakers nor the provision of interpreters offer adequate solutions. AIM:To identify how patients with limited English and culturally different communicati...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2929.2005.02121.x

    authors: Roberts C,Moss B,Wass V,Sarangi S,Jones R

    更新日期:2005-05-01 00:00:00

  • The impact of an individual tutorial session on MEDLINE use among obstetrics and gynaecology residents in an academic training programme: a randomized trial.

    abstract::Over the past decade, on-line databases have become increasingly popular among health care professionals. As a group, these 'end-users' report utilizing databases to keep abreast of medical progress, to conduct research and to address specific patient care issues. Throughout the literature, medical professionals ('con...

    journal_title:Medical education

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1046/j.1365-2923.1998.00229.x

    authors: Erickson S,Warner ER

    更新日期:1998-05-01 00:00:00

  • Assessing suitability for a problem-based learning curriculum: evaluating a new student selection instrument.

    abstract:CONTEXT:A new student selection instrument has been designed to assess candidate suitability for a problem-based learning, small group curriculum. OBJECTIVE:To evaluate the performance of the new teamwork selection instrument in terms of its discriminatory power, fairness, validity, reliability and acceptability among...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02086.x

    authors: Chamberlain SE,Searle J

    更新日期:2005-03-01 00:00:00

  • A communication skills course for preclinical students: evaluation of general practice based teaching using group methods.

    abstract::Teaching preclinical medical students about doctor-patient communication gives them an opportunity to develop their interviewing skills prior to their having to elicit lists of symptoms in their clinical years. General practitioners should be among the more efficient interviewers in clinical medicine and therefore abl...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00259.x

    authors: Kendrick T,Freeling P

    更新日期:1993-05-01 00:00:00

  • An update on British medical students' lifestyles.

    abstract::Information about medical students' lifestyles was obtained from 785 second-year students from seven medical schools in Great Britain by a personally administered questionnaire. Fifteen per cent of the students were non-drinkers. Among those who drank, 48% of the men and 38% of the women exceeded sensible weekly limit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00204.x

    authors: Webb E,Ashton CH,Kelly P,Kamah F

    更新日期:1998-05-01 00:00:00

  • Waking up the next morning: surgeons' emotional reactions to adverse events.

    abstract:CONTEXT:The adverse patient event is an inherent component of surgical practice, but many surgeons are unprepared for the profound emotional responses these events can evoke. This study explored surgeons' reactions to adverse events and their impact on subsequent judgement and decision making. METHODS:Using a construc...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/medu.12058

    authors: Luu S,Patel P,St-Martin L,Leung AS,Regehr G,Murnaghan ML,Gallinger S,Moulton CA

    更新日期:2012-12-01 00:00:00

  • How medical residents perceive the quality of supervision provided by attending doctors in the clinical setting.

    abstract:INTRODUCTION:The supervision of medical residents is a key responsibility of attending doctors in the clinical setting. Most attending doctors, however, are unfamiliar with the principles of effective supervision. Although inconsistent, supervision has been shown to be both important and effective for the professional ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02190.x

    authors: Busari JO,Weggelaar NM,Knottnerus AC,Greidanus PM,Scherpbier AJ

    更新日期:2005-07-01 00:00:00

  • Brief problem-solving questions in medical school examinations: is it necessary for students to explain their answers?

    abstract:OBJECTIVE:To compare outcomes when answers to objective type problem-solving questions are marked with and without consideration of students' explanations of their answers. DESIGN:Students answered six multiple-part problem-solving questions on the final examination for a course in clinical biochemistry. Each part req...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00382.x

    authors: Schwartz PL,Loten EG

    更新日期:1999-11-01 00:00:00

  • Self-explanation in learning clinical reasoning: the added value of examples and prompts.

    abstract:CONTEXT:Recent studies suggest that self-explanation (SE) while diagnosing cases fosters the development of clinical reasoning in medical students; however, the conditions that optimise the impact of SE remain unknown. The example-based learning framework justifies an exploration of students' use of their own SEs combi...

    journal_title:Medical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/medu.12623

    authors: Chamberland M,Mamede S,St-Onge C,Setrakian J,Bergeron L,Schmidt H

    更新日期:2015-02-01 00:00:00

  • The impact of cueing on written examinations of clinical decision making: a case study.

    abstract:CONTEXT:Selected-response (SR) formats (e.g. multiple-choice questions) and constructed-response (CR) formats (e.g. short-answer questions) are commonly used to test the knowledge of examinees. Scores on SR formats are typically higher than scores on CR formats. This difference is often attributed to examinees being cu...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12296

    authors: Desjardins I,Touchie C,Pugh D,Wood TJ,Humphrey-Murto S

    更新日期:2014-03-01 00:00:00

  • 'Part of the team': professional identity and social exclusivity in medical students.

    abstract:OBJECTIVES:Medical students must develop not only their professional identity but also inclusive social attitudes for effective medical practice in the future. This study explores the elements that contribute to medical students' sense of professional identity and investigates the concept of social exclusivity and how ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.04046.x

    authors: Weaver R,Peters K,Koch J,Wilson I

    更新日期:2011-12-01 00:00:00

  • A course on collaboration between social workers and general practitioners during their vocational training.

    abstract::The educational programme reported was an experiment in the vocational training scheme of the department of General Practice, Erasmus University, Rotterdam, Holland, and is now part of the course. The programme focused on the training in team function (co-operation) given to trainee GPs and social workers. It became c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb00916.x

    authors: Schenk F

    更新日期:1979-01-01 00:00:00

  • Resuscitating paediatric induction: an action research approach.

    abstract:OBJECTIVES:To establish teaching objectives, methods and assessment for a paediatric induction programme. DESIGN:Action research over a 2-year period. PARTICIPANTS:88 doctors from three hospitals. MAIN OUTCOME MEASURES:These were end-of-course evaluations, using Likert scales, and free comments; independent evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2001.00982.x

    authors: Melville C,Wall D,Samuels M

    更新日期:2001-08-01 00:00:00

  • 'More shades of grey in my answers': an interview study revisiting attitude erosion during clerkships.

    abstract:CONTEXT:Small declines in patient-centred attitudes during medical education have caused great concern. Although some of the self-report scales applied have solid psychometric foundations, validity evidence for the interpretation of attitude erosion during clerkships remains weak. OBJECTIVES:We sought to address this ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12102

    authors: Bombeke K,Symons L,Mortelmans D,Debaene L,Schol S,Van Royen P,De Winter B

    更新日期:2013-05-01 00:00:00

  • Student views on the effective teaching of physical examination skills: a qualitative study.

    abstract:OBJECTIVES:The lack of published studies into effective skills teaching in clinical skills centres inspired this study of student views of the teaching behaviours of skills teachers. METHODS:We organised focus group discussions with students from Years 1-3 of a 6-year undergraduate medical curriculum. A total of 30 ra...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2008.03283.x

    authors: Martens MJ,Duvivier RJ,van Dalen J,Verwijnen GM,Scherpbier AJ,van der Vleuten CP

    更新日期:2009-02-01 00:00:00

  • Evidence-based education: development of an instrument to critically appraise reports of educational interventions.

    abstract:OBJECTIVES:Educational interventions may ultimately impact on patient care as well as affecting individuals' learning. Critical evaluation of educational literature by those involved in designing and developing educational interventions is therefore important. A checklist instrument for critically appraising reports of...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00479.x

    authors: Morrison JM,Sullivan F,Murray E,Jolly B

    更新日期:1999-12-01 00:00:00

  • Current status of teaching on spirituality in UK medical schools.

    abstract:OBJECTIVE:To investigate the current status of teaching on spirituality in medicine in UK medical schools and to establish if and how medical schools are preparing future doctors to identify patients' spiritual needs. METHODS:We carried out a national questionnaire survey using a 2-part questionnaire. Section A contai...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究,评审

    doi:10.1111/j.1365-2923.2007.02980.x

    authors: Neely D,Minford EJ

    更新日期:2008-02-01 00:00:00

  • Teaching problem-solving and clinical reasoning: 20 years experience with video-supported small-group learning.

    abstract::In the context of a curriculum reform the Faculty of Medicine of the University of Leuven, Belgium, introduced a new teaching project: video-supported small-group learning on problem-solving and clinical reasoning. The aim of this study is to reflect 20 years experience. The video-supported sessions for sixth-year med...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00219.x

    authors: Dequeker J,Jaspaert R

    更新日期:1998-07-01 00:00:00

  • Dental students as operators: emotional reactions.

    abstract::The importance of the personality of the dentist in the dental treatment of the anxious patient has been recognized for some time. However, there has been little research into the emotional reactions of dental students in similar stressful situations. This investigation, using specific psychological tests, examined th...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1985.tb01135.x

    authors: Freeman RE

    更新日期:1985-01-01 00:00:00

  • Analysing qualitative data: ethnography and the evaluation of medical education.

    abstract::Quantitative methods of evaluating the outcomes of medical education may not always deliver the information which course organizers and teachers most need in order to improve their courses. Qualitative methods of research could provide such information. However, the use of qualitative methods has been limited by the d...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1989.tb01575.x

    authors: Walker M

    更新日期:1989-11-01 00:00:00

  • Medical teaching of the cultural aspects of ethnic minorities: does it exist?

    abstract::The development of published material relating to the practice of medicine in multiracial and multicultural Britain is briefly reviewed. The utilization of such information in English medical schools is found to be absent or at a low level of priority. A more detailed study of one region demonstrates that junior hospi...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1986.tb01388.x

    authors: Poulton J,Rylance GW,Johnson MR

    更新日期:1986-11-01 00:00:00

  • Stakes in the eye of the beholder: an international study of learners' perceptions within programmatic assessment.

    abstract:OBJECTIVES:Within programmatic assessment, the ambition is to simultaneously optimise the feedback and the decision-making function of assessment. In this approach, individual assessments are intended to be low stakes. In practice, however, learners often perceive assessments designed to be low stakes as high stakes. I...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13532

    authors: Schut S,Driessen E,van Tartwijk J,van der Vleuten C,Heeneman S

    更新日期:2018-06-01 00:00:00

  • Can general internal medicine be taught in general practice? An evaluation of the University College London model.

    abstract::There is national and international interest in increasing the community-based component of undergraduate medical education, but more research is needed on its potential, practicability and effectiveness. The objective of the study was to examine the feasibility and efficacy of general practitioners teaching basic cli...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1997.00678.x

    authors: Murray E,Todd C,Modell M

    更新日期:1997-09-01 00:00:00