Assessing procedural skills in context: Exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI).

Abstract:

BACKGROUND:The assessment of clinical procedural skills has traditionally focused on technical elements alone. However, in real practice, clinicians are expected to be able to integrate technical with communication and other professional skills. We describe an integrated procedural performance instrument (IPPI), where clinicians are assessed on 12 clinical procedures in a simulated clinical setting which combines simulated patients (SPs) with inanimate models or items of medical equipment. Candidates are observed remotely by assessors whose data are fed back to the clinician within 24 hours of the assessment. This paper describes the feasibility of IPPI. RESULTS:A full-scale IPPI and 2 pilot studies with trainee and qualified health care professionals has yielded an extensive data set including 585 scenario evaluations from candidates, 60 from clinical assessors and 31 from simulated patients (SPs). Interview and questionnaire data showed that for the majority of candidates IPPI provided a powerful and valuable learning experience. Realism was rated highly. Remote and real-time assessment worked effectively, although for some procedures limited camera resolution affected observation of fine details. DISCUSSION:IPPI offers an innovative approach to assessing clinical procedural skills. Although resource-intensive, it has the potential to provide insight into individual's performance over a spectrum of clinical scenarios and at no risk to the safety of patients. Additional benefits of IPPI include assessment in real time from experts (allowing remote rating by external examiners) as well as provision of feedback from simulated patients.

journal_name

Med Educ

journal_title

Medical education

authors

Kneebone R,Nestel D,Yadollahi F,Brown R,Nolan C,Durack J,Brenton H,Moulton C,Archer J,Darzi A

doi

10.1111/j.1365-2929.2006.02612.x

subject

Has Abstract

pub_date

2006-11-01 00:00:00

pages

1105-14

issue

11

eissn

0308-0110

issn

1365-2923

pii

MED2612

journal_volume

40

pub_type

杂志文章
  • Teaching medical students alcohol intervention skills: results of a controlled trial.

    abstract:OBJECTIVE:To assess the relative effectiveness of videotape feedback and lecture methods for teaching alcohol brief intervention skills. DESIGN:In a controlled trial, two student blocks received a manual, lecture and demonstration about the principles and practice of brief alcohol intervention. In addition, experiment...

    journal_title:Medical education

    pub_type: 临床试验,杂志文章

    doi:10.1046/j.1365-2923.1999.00378.x

    authors: Walsh RA,Sanson-Fisher RW,Low A,Roche AM

    更新日期:1999-08-01 00:00:00

  • Medical education for a changing future: new concepts for revising texts.

    abstract::Recent psychological research suggests how to simplify texts and translate quantitative concepts into the language of clinical medicine. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1987.tb00371.x

    authors: Politser PE

    更新日期:1987-07-01 00:00:00

  • Flexible training opportunities in the European Union.

    abstract::This paper compares the opportunities for flexible (part-time) specialist training in the UK and elsewhere in the EU in the overall context of the rising numbers of women doctors across Europe. Few other EU countries appear to provide the same opportunities for flexible training as the UK, despite high percentages of ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00236.x

    authors: Maingay J,Goldberg I

    更新日期:1998-09-01 00:00:00

  • Trends in national licensing examinations in medicine.

    abstract:CONTEXT:As a contribution to this special issue commemorating the journal's 50th volume, this paper seeks to explore directions for national licensing examinations (NLEs) in medicine. Increases in the numbers of new medical schools and the mobility of doctors across national borders mean that NLEs are becoming even mor...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12810

    authors: Swanson DB,Roberts TE

    更新日期:2016-01-01 00:00:00

  • New consultants mastering the role of on-call supervisor: a longitudinal qualitative study.

    abstract:CONTEXT:The supervision of specialty registrars during on-call shifts is essential to ensure the quality of both health care and medical education, but has been identified as a major novelty and stressor for new consultants in the transition from specialty training. There is a paucity of research on how consultants dea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12129

    authors: Westerman M,Teunissen PW,Fokkema JP,Siegert CE,van der Vleuten CP,Scherpbier AJ,Scheele F

    更新日期:2013-04-01 00:00:00

  • The value of student-made models as learning aids in physiology.

    abstract::In a new educational scheme introduced in Malta in 1978, university students spend half of the academic year studying and the other half as workers in various departments. During their work phase, students designed and made working models as teaching aids for the study of physiology. The value of these models was asse...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1984.tb01277.x

    authors: Abu-Sitta SA,Shalaby MA,Hajek J

    更新日期:1984-09-01 00:00:00

  • Surgical skills training: simulation and multimedia combined.

    abstract:CONTEXT:Basic surgical skills are needed throughout the medical profession, but current training is haphazard and unpredictable. There is increasing pressure to provide transparency about training and performance standards. There is a clear need for inexperienced learners to build a framework of basic skills before car...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2001.00997.x

    authors: Kneebone R,ApSimon D

    更新日期:2001-09-01 00:00:00

  • Using multiple self-regulated learning measures to understand medical students' biomedical science learning.

    abstract:CONTEXT:Understanding self-regulated learning (SRL) is complicated due to the different measures used to identify the key SRL processes. There is a growing trend in applying event measures of SRL (microanalysis and trace) but aptitude measures (questionnaires) continue to be widely used in medical education. A major co...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14079

    authors: Gandomkar R,Yazdani K,Fata L,Mehrdad R,Mirzazadeh A,Jalili M,Sandars J

    更新日期:2020-08-01 00:00:00

  • Patient involvement in teaching and assessing intimate examination skills: a systematic review.

    abstract:OBJECTIVES:There are recognised difficulties in teaching and assessing intimate examination skills that relate to the sensitive nature of the various examinations and the anxiety faced by novice learners. This systematic review provides a summary of the evidence for the involvement of real patients (RPs) and simulated ...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2009.03608.x

    authors: Jha V,Setna Z,Al-Hity A,Quinton ND,Roberts TE

    更新日期:2010-04-01 00:00:00

  • An electronic learning portfolio for reflective continuing professional development.

    abstract:OBJECTIVES:These were to measure the uptake and use of an electronic learning portfolio to support reflective continuing professional development, and to characterize attitudes towards its use and obstacles to its adoption. DESIGN:Uncontrolled, longitudinal intervention study with quantitative and qualitative evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01278.x

    authors: Dornan T,Carroll C,Parboosingh J

    更新日期:2002-08-01 00:00:00

  • Characteristics of graduating medical students who were matched and unmatched to hospital training posts.

    abstract::The purpose of this paper is to examine similarities and differences between graduating medical students who do and do not match through the National Internship and Resident Matching Programme (NIRMP). Data from graduates of 3- and 4-year undergraduate curricula were examined separately. A two way analysis of variance...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb01530.x

    authors: Garrard J

    更新日期:1979-09-01 00:00:00

  • Communication skills assessment: the perceptions of medical students at the University of Nottingham.

    abstract:INTRODUCTION:Despite the wealth of literature surrounding communication curricula within medical education, there is a lack of in-depth research into medical students' perceptions of communication skills assessment. This study aims to address this gap in the research literature. METHODS:Five focus group discussions we...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01300.x

    authors: Rees C,Sheard C,McPherson A

    更新日期:2002-09-01 00:00:00

  • Development and integration of CAL: a case study in medicine.

    abstract:CONTEXT:The Faculty of Medicine and Medical Sciences at the University of Aberdeen viewed the use of Computer Assisted Leaning (CAL) and other IT based learning resources as a possible way of coping with an increase in student numbers whilst maintaining or increasing the quality of medical teaching. OBJECTIVES:Our pri...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00270.x

    authors: Hamilton NM,Furnace J,Duguid KP,Helms PJ,Simpson JG

    更新日期:1999-04-01 00:00:00

  • The consequences of authentic early experience for medical students: creation of mētis.

    abstract:CONTEXT:Authentic early experience (AEE) describes experiences provided to new medical students to undertake 'human contact' to enhance learning. Although the concept of AEE is not new, and was commonplace prior to the Flexner Report of 1910, little is known about how or why meaning and knowledge are constructed throug...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04287.x

    authors: Yardley S,Brosnan C,Richardson J

    更新日期:2013-01-01 00:00:00

  • A trial of multiple choice examination in pharmacology.

    abstract::An account is given of the introduction of MCQ in an Indian Medical institution in 1974/75. Preliminary results suggest that the reliability coefficient of MCQs rises with their difficulty, and that Pearson-type coefficient indicates a higher degree of correlation with essay marks than do Spearman coefficients. A 'stu...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1978.tb00352.x

    authors: Gandhi IS,Ghosh MN

    更新日期:1978-07-01 00:00:00

  • Resourcing innovative teaching of audit--models, methods and MAAGs.

    abstract::Audit is an important part of clinical practice, and has been promoted as a core aspect of undergraduate and postgraduate medical education. Few examples of how audit is taught in the undergraduate curriculum exist. This article presents a model for student teaching using innovative methods, which include an extended ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00240.x

    authors: Howe AC,Purkiss V

    更新日期:1998-11-01 00:00:00

  • The superiority of three-dimensional physical models to two-dimensional computer presentations in anatomy learning.

    abstract:BACKGROUND:Although several studies (Anat Sci Educ, 8 [6], 525, 2015) have shown that computer-based anatomy programs (three-dimensional visualisation technology [3DVT]) are inferior to ordinary physical models (PMs), the mechanism is not clear. In this study, we explored three mechanisms: haptic feedback, transfer-app...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13683

    authors: Wainman B,Wolak L,Pukas G,Zheng E,Norman GR

    更新日期:2018-11-01 00:00:00

  • The attitudes of medical students towards homeless people: does medical school make a difference?

    abstract:BACKGROUND:Homeless people have greater health care needs than those who are housed, yet often experience difficulty in accessing health care. Evidence suggests that the attitudes of doctors can create significant barriers to health care for homeless people. METHODS:A validated structured questionnaire, the Attitudes ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01625.x

    authors: Masson N,Lester H

    更新日期:2003-10-01 00:00:00

  • Online testable concept maps: benefits for learning about the pathogenesis of disease.

    abstract:CONTEXT:Concept maps have been used to promote meaningful learning and critical thinking. Although these are crucially important in all disciplines, evidence for the benefits of concept mapping for learning in medicine is limited. METHODS:We performed a randomised crossover study to assess the benefits of online testa...

    journal_title:Medical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/medu.12422

    authors: Ho V,Kumar RK,Velan G

    更新日期:2014-07-01 00:00:00

  • Development of a tool to support holistic generic assessment of clinical procedure skills.

    abstract:CONTEXT:The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. OBJECTIVES:This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. METHODS:We carried ...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2008.03023.x

    authors: McKinley RK,Strand J,Gray T,Schuwirth L,Alun-Jones T,Miller H

    更新日期:2008-06-01 00:00:00

  • Learning to value ethnic diversity--what, why and how?

    abstract:INTRODUCTION:Learning to value ethnic diversity is the appreciation of how variations in culture and background may affect health care. It involves acknowledging and responding to an individual's culture in its broadest sense. This requires learning the skills to negotiate effective communication, a heightened awarenes...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00474.x

    authors: Kai J,Spencer J,Wilkes M,Gill P

    更新日期:1999-08-01 00:00:00

  • Application of continuous quality improvement to medical education.

    abstract:CONTEXT:The explicit, intentional and systematic application of continuous quality improvement (QI) in medical education practice and research can improve medical education and help it achieve its goals. Quality improvement and medical education share a foundation centred on learning-experiencing, reflecting, thinking ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14351

    authors: Wong BM,Headrick LA

    更新日期:2021-01-01 00:00:00

  • Influence of new educational technology on problem-based learning at Harvard Medical School.

    abstract:PURPOSE:Computers with 50-inch, wall-mounted plasma screens and broadband Internet access were installed in all small group tutorial rooms at Harvard Medical School. This study examines how the introduction of this educational technology impacted on the problem-based learning tutorials. METHOD:A total of 37 tutorial g...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02105.x

    authors: Kerfoot BP,Masser BA,Hafler JP

    更新日期:2005-04-01 00:00:00

  • Supporting Pre-registration House Officers: the needs of educational supervisors of the first phase of postgraduate medical education.

    abstract::The GMC's publications The New Doctor (GMC 1997) outlines an approach for the education of Pre-registration House Officers using designated educational supervisors. In order to establish appropriate means of training consultants to undertake this role, the Centre for Postgraduate and Continuing Medical Education at th...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00209.x

    authors: Challis M,Williams J,Batstone G

    更新日期:1998-03-01 00:00:00

  • The impact of three years' ethics teaching, in an integrated medical curriculum, on students' proposed behaviour on meeting ethical dilemmas.

    abstract:OBJECTIVE:To evaluate the impact of 3 years' ethics teaching (30 hours mainly small group teaching in year 1, 14 hours mainly lecture-type teaching in years 2 and 3) on students' proposed behaviour on encountering ethical dilemmas. DESIGN:Cohort design. SETTING:University of Glasgow Medical School. SUBJECTS:A cohort...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01176.x

    authors: Goldie J,Schwartz L,McConnachie A,Morrison J

    更新日期:2002-05-01 00:00:00

  • Student population changes and progress in Belgian medical schools.

    abstract::The present study was designed to analyse the evolution of student populations--undergraduates and graduates--in the 11 Belgian medical schools from 1969 to 1982. During this period, an overall 44% drop in the number of entrants was observed, while the number of medical graduates continued to rise until 1977, when it ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1989.tb00810.x

    authors: Albert A,Firket H,Castermans A

    更新日期:1989-01-01 00:00:00

  • In search of educational efficiency: 30 years of Medical Education's top-cited articles.

    abstract:CONTEXT:Academic journals represent shared spaces wherein the significance of thematic areas, methodologies and paradigms are debated and shaped through collective engagement. By studying journals in their historical and cultural contexts, the academic community can gain insight into the ways in which authors and audie...

    journal_title:Medical education

    pub_type: 历史文章,杂志文章,评审

    doi:10.1111/medu.13349

    authors: Rangel JC,Cartmill C,Martimianakis MA,Kuper A,Whitehead CR

    更新日期:2017-09-01 00:00:00

  • Entry to medical school: an audit of traditional selection requirements.

    abstract::The major focus in the selection of entrants for medical school has traditionally been on academic achievement in school-leaving examinations in which certain science subjects are a requirement. A longitudinal study of 413 successful applicants was undertaken to determine the relationship of these admission criteria t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02795.x

    authors: Collins JP,White GR,Kennedy JA

    更新日期:1995-01-01 00:00:00

  • Elective modules in the behavioural sciences.

    abstract::An elective modules programme in the behavioural sciences was designed for the undergraduate medical curriculum at The Ohio State University College of Medicine. The programme provides a mechanism by which a broad range of behavioural science content can be introduced into the curriculum without increased allocation o...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1984.tb01469.x

    authors: Sachs LA,McPherson C,Knopp W

    更新日期:1984-01-01 00:00:00

  • An electronic study guide for problem-based learning.

    abstract::This paper describes the development and structure of an Electronic Study Guide for Oncology (LETSGO) for undergraduate medical students. LETSGO is aimed at clinical students learning about cancer. The subject of the guide is breast cancer and learning objectives cover structure and function, behavioural science, publ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02860.x

    authors: Mooney GA,Bligh JG,Leinster SF,Warenius HM

    更新日期:1995-11-01 00:00:00