Using the 360 degrees multisource feedback model to evaluate teaching and professionalism.

Abstract:

BACKGROUND:Student ratings have dominated as the primary and, frequently, only measure of teaching performance at colleges and universities for the past 50 years. Recently, there has been a trend toward augmenting those ratings with other data sources to broaden and deepen the evidence base. The 360 degrees multisource feedback (MSF) model used in management and industry for half a century and in clinical medicine for the last decade seemed like a best fit to evaluate teaching performance and professionalism. AIM:To adapt the 360 degrees MSF model to the assessment of teaching performance and professionalism of medical school faculty. METHODS:The salient characteristics of the MSF models in industry and medicine were extracted from the literature. These characteristics along with 14 sources of evidence from eight possible raters, including students, self, peers, outside experts, mentors, alumni, employers, and administrators, based on the research in higher education were adapted to formative and summative decisions. RESULTS:Three 360 degrees MSF models were generated for three different decisions: (1) formative decisions and feedback about teaching improvement; (2) summative decisions and feedback for merit pay and contract renewal; and (3) formative decisions and feedback about professional behaviors in the academic setting. The characteristics of each model were listed. Finally, a top-10 list of the most persistent and, perhaps, intractable psychometric issues in executing these models was suggested to guide future research. CONCLUSIONS:The 360 degrees MSF model appears to be a useful framework for implementing a multisource evaluation of faculty teaching performance and professionalism in medical schools. This model can provide more accurate, reliable, fair, and equitable decisions than the one based on just a single source.

journal_name

Med Teach

journal_title

Medical teacher

authors

Berk RA

doi

10.3109/01421590802572775

subject

Has Abstract

pub_date

2009-12-01 00:00:00

pages

1073-80

issue

12

eissn

0142-159X

issn

1466-187X

journal_volume

31

pub_type

杂志文章
  • Going 'trans-E-3-ve': Educational principles for a new generation of medical students.

    abstract::Educating medical students represents a thrilling yet challenging task. In an era of research breakthroughs but also global health setbacks, there is a risk that scientists and educators focus on highly specialized areas of knowledge, neglecting interrelated systemic issues. Here, we argue that the education of medica...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1774529

    authors: Pericàs JM,Bosch X

    更新日期:2020-06-12 00:00:00

  • Primary care physicians in public and private sectors perceive different learning needs.

    abstract::We compared the perceived learning needs of primary care physicians from the public and private sectors who responded to a questionnaire before taking educational courses in Family Medicine. They rated their perceived learning needs on 71 items of clinical practices and practice management on a scale of 1-10. The rati...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/00034980120103504

    authors: Wun YT,Dickinson JA,Chan CS

    更新日期:2002-01-01 00:00:00

  • Performance of paediatric Senior House Officers following changes in recruitment.

    abstract:BACKGROUND:Recruitment to Paediatric Senior House Officer (SHO) posts has traditionally been undertaken by each individual hospital trust. AIMS:This study looks at whether shortlisting and interview scores from a Central Paediatric SHO recruitment process are a reliable predicator of performance. METHODS:A questionna...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701509670

    authors: Bindal T,Wall D,Goodyear HM

    更新日期:2007-06-01 00:00:00

  • Twelve tips for introducing simulation based assessment in the objective structured clinical examination.

    abstract::The use of simulation as a tool for assessment in medical examinations is expanding. We describe 12 practical tips for the implementation of simulation based critical evaluation for the Objective Structured Clinical Examination (OSCE). The material in this article is a combination of personal experience and the availa...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1789084

    authors: Brown C,Morse J,Nesvadba D,Meldrum A

    更新日期:2020-07-21 00:00:00

  • Utility of selection methods for specialist medical training: A BEME (best evidence medical education) systematic review: BEME guide no. 45.

    abstract:BACKGROUND:Selection into specialty training is a high-stakes and resource-intensive process. While substantial literature exists on selection into medical schools, and there are individual studies in postgraduate settings, there seems to be paucity of evidence concerning selection systems and the utility of selection ...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.1080/0142159X.2017.1367375

    authors: Roberts C,Khanna P,Rigby L,Bartle E,Llewellyn A,Gustavs J,Newton L,Newcombe JP,Davies M,Thistlethwaite J,Lynam J

    更新日期:2018-01-01 00:00:00

  • Putting theory into practice - a case study in one UK medical school of the nature and extent of unprofessional behaviour over a 6-year period.

    abstract:BACKGROUND:Producing a medical profession which is fit for the demands and expectations of society involves ensuring that practitioners learn what it means to behave in a 'professional' way. Codes of professional conduct have been developed for medical students in the UK, but the literature on how medical schools actua...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421591003698018

    authors: Howe A,Miles S,Wright S,Leinster S

    更新日期:2010-01-01 00:00:00

  • Pre-exchange training - Developing ethical and cultural competencies in medical students.

    abstract::Background: The International Federation of Medical Students' Associations (IFMSA) organizes over 15,000 international medical exchanges per year in over 100 countries. In the past, there was no standardized Pre-Departure Training (PDT) for participants. A PDT is important to protect patient safety and prepare student...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1641590

    authors: D'Ignazio T,Lavoie G,Pomerani T,Lachapelle A,Gaucher N

    更新日期:2019-12-01 00:00:00

  • How To…: Use Prepared TV Material and Films in Medical Education.

    abstract::The use of educational television requires special skills on the part of both teacher and student. The experience and research results of the Open University are used as a basis to describe some functions and associated pedagogical considerations of the use of television in medical education. Emphasis is placed on pre...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598009071283

    authors: Durbridge N,Gale J

    更新日期:1980-01-01 00:00:00

  • Edgar Dale's Pyramid of Learning in medical education: a literature review.

    abstract:BACKGROUND:Edgar Dale's Pyramid of Learning and percentages of retained learning are cited in educational literature in a range of disciplines. The sources of the Pyramid, however, are misleading. AIMS:To examine the evidence supporting the Pyramid and the extent to which it is cited in medical education literature. ...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.3109/0142159X.2013.800636

    authors: Masters K

    更新日期:2013-11-01 00:00:00

  • Descriptive analysis of junior doctor assessment in the first postgraduate year.

    abstract:INTRODUCTION:Preparing graduates for the role of the junior doctor is the aim of all medical schools. There has been limited published description of junior doctor performance in the workplace within Australia. METHODS:This cohort study describes junior doctors' performance in the first postgraduate year, the influenc...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.918255

    authors: Carr SE,Celenza T,Lake FR

    更新日期:2014-11-01 00:00:00

  • Accelerating expertise: Perceptual and adaptive learning technology in medical learning.

    abstract:RATIONALE:Recent advances in the learning sciences offer remarkable potential for improving medical learning and performance. Difficult to teach pattern recognition skills can be systematically accelerated using techniques of perceptual learning (PL). The effectiveness of PL interventions is amplified when they are com...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2018.1484897

    authors: Kellman PJ,Krasne S

    更新日期:2018-08-01 00:00:00

  • Learning in clinical practice: Stimulating and discouraging response to social comparison.

    abstract:BACKGROUND:Social comparison theory is relevant for learning in general. In a clinical context, we examined four hypotheses concerning: preferred other to compare with, preferred direction of comparison, response to social comparison and influence of personal social comparison orientation (SCO). AIM:To investigate the...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.497820

    authors: Raat J,Kuks J,Cohen-Schotanus J

    更新日期:2010-01-01 00:00:00

  • Views of doctors of varying disciplines on HPAT-Ireland as a selection tool for medicine.

    abstract:BACKGROUND:Selection tools for medicine must achieve political validity and enjoy stakeholder acceptability. This qualitative study aimed to establish the perspectives of doctors, from various clinical specialities, on HPAT-Ireland, a new selection tool for undergraduate medical students. METHODS:Fifteen doctors parti...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.909012

    authors: Kelly ME,Gallagher N,Dunne FP,Murphy AW

    更新日期:2014-09-01 00:00:00

  • Medical students' use of Facebook to support learning: insights from four case studies.

    abstract:BACKGROUND:Recent research indicates that university students are interested and active in supporting their learning by using Facebook, a popular social networking website. AIM:This study aimed to add to our understanding of how or how effectively students may be using Facebook for this purpose. METHOD:Researchers su...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.497826

    authors: Gray K,Annabell L,Kennedy G

    更新日期:2010-01-01 00:00:00

  • Psychological responses to the SARS outbreak in healthcare students in Hong Kong.

    abstract::This paper reports a cross-sectional questionnaire study that investigated perceived stress and psychological responses to the SARS outbreak in healthcare students at the height of the outbreak in Hong Kong in 2003. Non-healthcare university students served as controls. All the groups reported high levels of perceived...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590400006572

    authors: Wong JG,Cheung EP,Cheung V,Cheung C,Chan MT,Chua SE,McAlonan GM,Tsang KW,Ip MS

    更新日期:2004-11-01 00:00:00

  • Applying the Bookmark method to medical education: standard setting for an aseptic technique station.

    abstract:INTRODUCTION:The purpose was to evaluate the Bookmark standard-setting method for use on a performance-based assessment in medical education. METHODS:We compared cutscores for Aseptic performance assessment using the modified Angoff, Hofstee and modified Bookmark methods. RESULTS:The Angoff produced a cutscore of 62%...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.778395

    authors: Lypson ML,Downing SM,Gruppen LD,Yudkowsky R

    更新日期:2013-07-01 00:00:00

  • Training socially responsive health care graduates: is service learning an effective educational approach?

    abstract:BACKGROUND:Health care educators strive to train graduates who are socially responsive and can act as "change agents" for communities they serve. Service learning (SL) is increasingly being used to teach the social aspects of health care and develop students' social responsiveness. However, the effectiveness of SL as a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.873118

    authors: Mc Menamin R,Mc Grath M,Cantillon P,Mac Farlane A

    更新日期:2014-04-01 00:00:00

  • Promoting resiliency for interprofessional faculty and senior medical students: Outcomes of a workshop using mind-body medicine and interactive reflective writing.

    abstract:BACKGROUND:Health care professions faculty/practitioners/students are at risk for stress and burnout, impacting well-being, and optimal patient care. AIMS:We conducted a unique intervention: an interprofessional, experiential, skills-based workshop (IESW) combining two approaches: mind-body medicine skills and interac...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1150980

    authors: Wald HS,Haramati A,Bachner YG,Urkin J

    更新日期:2016-05-01 00:00:00

  • Mixed reality as a time-efficient alternative to cadaveric dissection.

    abstract::Objectives: The extent of medical knowledge increases yearly, but the time available for students to learn is limited, leading to administrative pressures to revise and reconfigure medical school curricula. The goal of the present study is to determine whether the mixed reality platform HoloAnatomy represents an effec...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1762032

    authors: Ruthberg JS,Tingle G,Tan L,Ulrey L,Simonson-Shick S,Enterline R,Eastman H,Mlakar J,Gotschall R,Henninger E,Griswold MA,Wish-Baratz S

    更新日期:2020-08-01 00:00:00

  • Basic psychological needs, more than mindfulness and resilience, relate to medical student stress: A case for shifting the focus of wellness curricula.

    abstract:PURPOSE:Medical student distress is an increasing concern in medical education. Addressing this issue requires a comprehensive understanding of what factors influence learners' stress in medical school. Grounded in Self-Determination Theory (SDT), this study explores the relative association between medical students' m...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1813876

    authors: Neufeld A,Mossière A,Malin G

    更新日期:2020-12-01 00:00:00

  • Looking 'back to the future': alumni perceptions of a UK undergraduate medical programme.

    abstract::The five year Bachelor of Medicine (BM5) programme of the University of Southampton commenced in 1971. In keeping with other medical schools, the Southampton BM5 programme has been involved in a number of incremental curriculum reforms over the years. Complementing the School's annual pre-registration house officer (P...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600627425

    authors: Lueddeke GR,Anderson FH,Carr NJ,Mitchell BS,Taylor ME

    更新日期:2006-11-01 00:00:00

  • Teaching by hospitalist physicians: a practical approach.

    abstract::This article discusses an approach to the teaching of residents and medical students by hospitalist physicians on a general pediatric unit. It focuses on three basic principles of teaching and describes how these can be operationalized in a practical way. If this approach is followed, hospitalist physicians can be mor...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590220145833

    authors: Bellet PS

    更新日期:2002-07-01 00:00:00

  • Twelve tips for effective short course design.

    abstract::Short courses are commonly used by physicians to stay up-to-date and acquire new skills for practice. Unfortunately, many short courses are not designed to maximize their impact on practice as they fail to acknowledge how people learn and change. Designers of effective short course planning should pay attention to wri...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590500086888

    authors: Lockyer J,Ward R,Toews J

    更新日期:2005-08-01 00:00:00

  • Death by PowerPoint - the need for a 'fidget index'.

    abstract::PowerPoint is an application designed to help the speaker or lecturer assemble professional looking slides to be used in oral presentations. The result sadly is often an unending stream of slides with bullet lists, animations that obscure rather than clarify the point and cartoons that distract from rather than convey...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802307743

    authors: Harden RM

    更新日期:2008-01-01 00:00:00

  • The transition to hospital consultant: Denmark and the Netherlands compared on preparedness for practice, perceived intensity and contextual factors.

    abstract:INTRODUCTION:Danish and Dutch new consultants' perceptions regarding the transition to consultant were compared to gain insight into this period, particularly the influence of contextual factors concerning the organisation of specialty training and health care therein. Preparation for medical and generic competencies, ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.774332

    authors: Westerman M,Teunissen PW,Jørgensen RL,Fokkema JP,Siegert CE,Van der Vleuten CP,Scherpbier AJ,Ringsted C,Scheele F

    更新日期:2013-06-01 00:00:00

  • Weighting checklist items and station components on a large-scale OSCE: is it worth the effort?

    abstract:BACKGROUND:Past research suggests that the use of externally-applied scoring weights may not appreciably impact measurement qualities such as reliability or validity. Nonetheless, some credentialing boards and academic institutions apply differential scoring weights based on expert opinion about the relative importance...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.899687

    authors: Sandilands DD,Gotzmann A,Roy M,Zumbo BD,De Champlain A

    更新日期:2014-07-01 00:00:00

  • Involving medical students in staff development activities.

    abstract::Staff development is seen as a key aspect of medical education and many teachers/tutors are now required to attend some formal development activity. However, most workshops do not involve the student. In Manchester, the philosophy is to actively involve students in all aspects of the undergraduate course including del...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159031000092616

    authors: Duffy KA,O'neill PA

    更新日期:2003-03-01 00:00:00

  • A reappraisal of the use of multiple choice questions.

    abstract::The terms Multiple True/False and Best Answer deserve wider applicability than at present when discussing multiple choice questions (MCQs). They describe the truthfulness of the choices and distinguish between the question types. The choice which matches the key in a MCQ is best called the correct answer. Multiple Tru...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:

    authors: Premadasa IG

    更新日期:1993-01-01 00:00:00

  • A cardiological web as an adjunct to medical teaching: prospective analysis.

    abstract::The aim of the study was to deliver and evaluate an educational web for medical students. A web of the complete cardiovascular course was prepared as an adjunct educational material for the classes. The use and utility of the web was assessed through a questionnaire (frequency of use, impact on in-class attendance and...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590310001653991

    authors: Gómez-Arbonés X,Ferreira A,Piqué M,Roca J,Tomás J,Frutos JL,Vinyas J,Prat J,Ballester M

    更新日期:2004-03-01 00:00:00

  • Is there a place for e-learning in clinical skills? A survey of undergraduate medical students' experiences and attitudes.

    abstract:BACKGROUND:e-learning is established in many medical schools. However the effectiveness of e-learning has been difficult to quantify and there have been concerns that such educational activities may be driven more by novelty, than pedagogical evidence. Where some domains may lend themselves well to e-learning, clinical...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802334317

    authors: Gormley GJ,Collins K,Boohan M,Bickle IC,Stevenson M

    更新日期:2009-01-01 00:00:00