An investigation into the use of multi-source feedback (MSF) as a work-based assessment tool.

Abstract:

INTRODUCTION:This study compared Specialist Trainees' (STs) hand-selected multi-source feedback (MSF) scores with those made by their clinical supervisors and explored perceptions of both those being assessed and those assessing. METHODS:Participating STs were asked to hand a mini-PAT questionnaire to a clinical colleague of their choice and also to their Clinical Supervisor. Statistical analysis was carried out on submitted paired assessments to determine any differences in responses between clinical supervisors and hand-chosen assessors. Semi-structured interviews were held with seven nurses, seven Consultants and six postgraduate doctors. RESULTS:Forty pairs of mini-PAT questionnaires were analysed. Hand-chosen assessors' ratings were significantly higher than those for clinical supervisors with respect to: "good clinical care" (p < 0.01), "good medical practice" (p < 0.05), "teaching and training" (p < 0.01), "relationship with patients" (p < 0.05) as well as for overall impression of the trainee (p < 0.05). Five themes were identified from interviews: validity of selecting assessors; anonymity of assessors; usefulness of feedback; the value of multi-professional assessors; and grading. DISCUSSIONS:There is a systematic difference in the assessment scores for trainees in MSF between clinical supervisors and hand-chosen assessors, the former scoring trainees more harshly. Grading was open to interpretation. This raised questions, especially from nurse interviewees regarding appropriate benchmarking.

journal_name

Med Teach

journal_title

Medical teacher

authors

Brown JM,Lowe K,Fillingham J,Murphy PN,Bamforth M,Shaw NJ

doi

10.3109/0142159X.2014.909920

subject

Has Abstract

pub_date

2014-11-01 00:00:00

pages

997-1004

issue

11

eissn

0142-159X

issn

1466-187X

journal_volume

36

pub_type

杂志文章
  • Peer assisted learning in surgical skills laboratory training: a pilot study.

    abstract:BACKGROUND:Peer assisted learning (PAL) has been rarely investigated in surgical skills training. AIMS:Describe feedback residents give peers on surgical skills with and without guidelines, determine the association between feedback and actual performance, evaluate resident satisfaction with PAL. METHOD:Participants ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.706340

    authors: Beard JH,O'sullivan P,Palmer BJ,Qiu M,Kim EH

    更新日期:2012-01-01 00:00:00

  • Curriculum Navigator: aspiring towards a comprehensive package for curriculum planning.

    abstract:BACKGROUND:Insightful frameworks for curriculum development were described in the literature. There is a need, however, to outline the approach we prefer, sometime unconsciously, in curriculum planning. AIMS:This article describes a novel conceptual framework called Curriculum Navigator, to explore our attitudes towar...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.689445

    authors: Al-Eraky MM

    更新日期:2012-01-01 00:00:00

  • Managing change in postgraduate medical education: still unfreezing?

    abstract:BACKGROUND:Modernizing Medical Careers (MMC) is an ambitious project to change the training of UK doctors. A key to its successful implementation is the ways that MMC is perceived and operationalized by senior doctors who act as local educational leaders and supervisors. AIMS:To analyse hospital consultants' perceptio...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590801929976

    authors: Agius SJ,Willis SC,McArdle PJ,O'Neill PA

    更新日期:2008-01-01 00:00:00

  • Dissatisfaction with residency: a discrepancy between preferences and expectations?

    abstract:BACKGROUND:Medical residents play two roles that enter into conflict during their educational period: trainees and workers. This dual role can lead to dissatisfaction among residents that can affect both the quality of the services they provide to citizens and the proper functioning of the health services model itself....

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.687485

    authors: Biedma-Velázquez L,Serrano-Del-Rosal R,García-De-Diego JM,Cerrillo-Vidal JA

    更新日期:2012-01-01 00:00:00

  • Learning professionalism during the third year of medical school in a 9-month-clinical rotation in rural Minnesota.

    abstract:BACKGROUND:Professionalism is now an explicit part of the medical school curricula. AIM:To examine the components that are part of developing professionalism during the Rural Physician Associate Program (RPAP) experience, a 9-month rotation in a rural community during the third year of medical school. METHODS:Two res...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421590802572759

    authors: Zink T,Halaas GW,Brooks KD

    更新日期:2009-11-01 00:00:00

  • Insights into endoscopy training: a qualitative study of learning experience.

    abstract::Endoscopy is an important diagnostic and therapeutic procedure that demands high levels of cognitive and technical skill to perform effectively. Surprisingly little is known about how endoscopy is best taught and training is often inadequate. The aims of this study were to explore the learning experiences of endoscopy...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600825417

    authors: Thuraisingam AI,MacDonald J,Shaw IS

    更新日期:2006-08-01 00:00:00

  • Twelve tips for increasing the defensibility of assessment decisions.

    abstract::In an era of increasing scrutiny of the performance of graduates in the workplace, there can be frustrations when decisions about learners with borderline or poor performance in formal assessments are over-turned in appeal processes. This article addresses the approach to reducing the uncertainty about assessment deci...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.943711

    authors: Hays RB,Hamlin G,Crane L

    更新日期:2015-05-01 00:00:00

  • How to…: Organize Effective Laboratory Teaching in Medicine. Part 2, Design.

    abstract::In this second article on laboratory teaching in medicine, the authors discuss the design of laboratory manuals and displays, the design of laboratory exercises to meet important goals of medical teaching, and the sequencing of curricula involving laboratory work. Readers are encouraged to consider laboratory classes ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909012610

    authors: Hegarty EH,Lee A

    更新日期:1979-01-01 00:00:00

  • Rethinking health professions' education leadership: Developing 'eco-ethical' leaders for a more sustainable world and future.

    abstract::In this commentary, we discuss health professions' education (HPE) leadership in relation to planetary health emergencies, suggesting that an 'eco-ethical leadership' approach is highly relevant. Building on both traditional and more contemporary leadership approaches and the need for HPE to be socially and environmen...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1748877

    authors: McKimm J,McLean M

    更新日期:2020-08-01 00:00:00

  • The CanMEDS initiative: implementing an outcomes-based framework of physician competencies.

    abstract:BACKGROUND:Outcomes-based education in the health professions has emerged as a priority for curriculum planners striving to align with societal needs. However, many struggle with effective methods of implementing such an approach. In this narrative, we describe the lessons learned from the implementation of a national,...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701746983

    authors: Frank JR,Danoff D

    更新日期:2007-09-01 00:00:00

  • Pre-admission criteria and pre-clinical achievement: Can they predict medical students performance in the clinical phase?

    abstract:RATIONAL:Various factors affect medical students' performance during clinical phase. Identifying these factors would help in mentoring weak students and help in selection process for residency programmes. OBJECTIVE:Our study objective is to evaluate the impact of pre-admission criteria, and pre-clinical grade point av...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1142511

    authors: Salem RO,Al-Mously N,AlFadil S,Baalash A

    更新日期:2016-01-01 00:00:00

  • Adaptive medical education research.

    abstract::This commentary reflects on what the four research articles in this issue of Medical Teacher tell us about adaptive learning and how adaptive medical education research can be conducted. Adaptive medical education researchers must think disruptively and embrace nontraditional collaborations, research methods, and mean...

    journal_title:Medical teacher

    pub_type:

    doi:10.1080/0142159X.2018.1490705

    authors: Tackett S,Wright SM,Quirk M

    更新日期:2018-08-01 00:00:00

  • Continuing medical education, quality improvement, and organizational change: implications of recent theories for twenty-first-century CME.

    abstract::Healthcare providers and systems are being asked to measure and improve the quality of care delivered to their patients. Additionally, the American Board of Medical Specialties now requires physicians to participate in systems-based practice and practice-based learning and improvement activities as part of maintenance...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590500046270

    authors: Price D

    更新日期:2005-05-01 00:00:00

  • Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice.

    abstract:BACKGROUND:Qualitative and quantitative evaluation of academic programs can enhance the development, effectiveness, and dissemination of comparative quality reports as well as quality improvement efforts. OBJECTIVES:To evaluate the five research methodology workshops through assessing participants' satisfaction, knowl...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.886012

    authors: Abdulghani HM,Shaik SA,Khamis N,Al-Drees AA,Irshad M,Khalil MS,Alhaqwi AI,Isnani A

    更新日期:2014-04-01 00:00:00

  • Global minimum essential requirements: a road towards competence-oriented medical education.

    abstract::With the growing globalization of medicine and the emerging concept of a 'global profession of physicians', the issue of the essential competences that all physicians must possess becomes sharply focused. If defined, these competences would help indicate what teachers are supposed to teach, what students are expected ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590220120740

    authors: Schwarz MR,Wojtczak A

    更新日期:2002-03-01 00:00:00

  • Teaching for clinical reasoning - helping students make the conceptual links.

    abstract:BACKGROUND:Dental educators complain that students struggle to apply what they have learnt theoretically in the clinical context. This paper is premised on the assumption that there is a relationship between conceptual thinking and clinical reasoning. AIMS:The paper provides a theoretical framework for understanding t...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.3109/01421591003695303

    authors: McMillan WJ

    更新日期:2010-01-01 00:00:00

  • Medical students' perception of professionalism: a qualitative study from Saudi Arabia.

    abstract:BACKGROUND:Professionalism has emerged as a core competency for the medical professionals globally. However, few studies have been reported from the Gulf region to assess the situation and take steps to promote professionalism. AIM:To elicit the views of final year medical students, interns, and residents to explore w...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.541535

    authors: Adkoli BV,Al-Umran KU,Al-Sheikh M,Deepak KK,Al-Rubaish AM

    更新日期:2011-01-01 00:00:00

  • Community-based education: The influence of role modeling on career choice and practice location.

    abstract:INTRODUCTION:Research findings in medical education support the importance of positive role models in enhancing learning and influencing the career path of medical students and graduates. The authors explored the characteristics of positive and negative role models during Community-Based Education and Service (COBES), ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2016.1246711

    authors: Amalba A,Abantanga FA,Scherpbier AJ,van Mook WN

    更新日期:2017-02-01 00:00:00

  • Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference.

    abstract::In this article, we outline criteria for good assessment that include: (1) validity or coherence, (2) reproducibility or consistency, (3) equivalence, (4) feasibility, (5) educational effect, (6) catalytic effect, and (7) acceptability. Many of the criteria have been described before and we continue to support their i...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2011.551559

    authors: Norcini J,Anderson B,Bollela V,Burch V,Costa MJ,Duvivier R,Galbraith R,Hays R,Kent A,Perrott V,Roberts T

    更新日期:2011-01-01 00:00:00

  • Physiology.

    abstract::This paper describes an innovative approach to teaching a traditional subject-physiology. There are no lectures, tutorials or practicals. All learning activities are undertaken in small groups, and the course is learner-centred and problem-orientated. Students are required to collect and record their own information a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909019395

    authors: Beaton G,Mitchell D

    更新日期:1979-01-01 00:00:00

  • The role of assessment in competency-based medical education.

    abstract::Competency-based medical education (CBME), by definition, necessitates a robust and multifaceted assessment system. Assessment and the judgments or evaluations that arise from it are important at the level of the trainee, the program, and the public. When designing an assessment system for CBME, medical education lead...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.500704

    authors: Holmboe ES,Sherbino J,Long DM,Swing SR,Frank JR

    更新日期:2010-01-01 00:00:00

  • Educational Commission for Foreign Medical Graduates: clinical skills assessment prototype.

    abstract::The Clinical Skills Assessment is an OSCE-based performance examination that is now the final test requirement for Educational Commission for Foreign Medical Graduates certification of graduates of foreign medical schools. Its design, test development and scoring methodologies are presented, as are the processes used ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421599979789

    authors: Whelan GP

    更新日期:1999-01-01 00:00:00

  • Stimulating medical education research in the Netherlands.

    abstract:BACKGROUND:Since the 1970s, the Dutch have been active innovators and researchers in the medical education domain. With regards to the quantity of publications in the medical education literature, the Netherlands rank second among countries in Europe and fourth worldwide over the past years, related to the journals wit...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.749344

    authors: Jaarsma D,Scherpbier A,Van Der Vleuten C,Ten Cate O

    更新日期:2013-04-01 00:00:00

  • Joints: if relevant. Do available textbooks contain adequate information about musculoskeletal examination skills for medical students?

    abstract::The objective was to determine whether routinely available textbooks describe the core musculoskeletal examination skills for medical students. Textbooks were evaluated for content against a list of 27 core examination skills as perceived by rheumatologists, orthopaedic surgeons and general practitioners. The study to...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/014215901200901032

    authors: Kay LJ,Coady DA,Walker DJ

    更新日期:2001-10-01 00:00:00

  • The clinical educator's guide to fostering learner motivation: AMEE Guide No. 137.

    abstract::Motivation theory and research remain underused by health professions educators. Some educators say it can seem too abstract. To address this, we applied health care language to learner motivation theories. Using a familiar metaphor, we examined the indications, mechanism of action, administration, and monitoring of l...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1837764

    authors: Lyons KM,Cain JJ,Haines ST,Gasevic D,Brock TP

    更新日期:2020-11-02 00:00:00

  • Introducing HIV/AIDS to South African health sciences students.

    abstract::Given the burden of HIV/AIDS in South Africa, there is a need to introduce students to the issues health professionals face about the disease. We developed an introductory peer-led workshop on HIV/AIDS for first year students covering a range of biomedical and social issues. To evaluate the workshops, volunteer studen...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590500312995

    authors: Kent A,Myer L,Flisher AJ,Mathews C,Lombard C

    更新日期:2005-11-01 00:00:00

  • Learning from a role model: A cascade or whirlpool effect?

    abstract:BACKGROUND:Continuing Professional Development (CPD) and Faculty Development (FD) courses have been designed in the expectation that a cascade effect will occur, consisting of a conveyance of information from the courses to clinical trainers to daily practice and/or to trainees by means of role modeling. PURPOSE:The a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.956061

    authors: Jochemsen-van der Leeuw HG,Buwalda N,Wieringa-De Waard M,Van Dijk N

    更新日期:2015-05-01 00:00:00

  • Transforming health professional education through social accountability: Canada's Northern Ontario School of Medicine.

    abstract:BACKGROUND:The Northern Ontario School of Medicine (NOSM) has a social accountability mandate to contribute to improving the health of the people and communities of Northern Ontario. NOSM recruits students from Northern Ontario or similar backgrounds and provides Distributed Community Engaged Learning in over 70 clinic...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.774334

    authors: Strasser R,Hogenbirk JC,Minore B,Marsh DC,Berry S,McCready WG,Graves L

    更新日期:2013-06-01 00:00:00

  • The way we teach otolaryngology in an integrated problem-based curriculum.

    abstract::The University Science Malaysia, Penang, the third medical school in Malaysia, is following an integrated curriculum. In this curriculum, the students are taught the subject of otolaryngology from the second year of their course unlike the traditional schools where they are taught in the fourth or fifth year. This pap...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421599109036758

    authors: Elango S,Arumainayagam GC,Palaniappan SP

    更新日期:1991-01-01 00:00:00

  • Do GP trainers use feedback in drawing up their Personal Development Plans (PDPs)? Results from a quantitative study.

    abstract:BACKGROUND:General practice (GP) trainers play a key role GP trainees' education. To stimulate development of trainer competencies a Personal Development Plan (PDP) can be helpful, especially when feedback is incorporated. AIMS:To investigate to what extent GP trainers use feedback in PDPs. METHODS:GP trainers were p...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.670327

    authors: van Es JM,Visser MR,Wieringa-de Waard M

    更新日期:2012-01-01 00:00:00