Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100.

Abstract:

:Why use SJTs? Traditionally, selection into medical education professions has focused primarily upon academic ability alone. This approach has been questioned more recently, as although academic attainment predicts performance early in training, research shows it has less predictive power for demonstrating competence in postgraduate clinical practice. Such evidence, coupled with an increasing focus on individuals working in healthcare roles displaying the core values of compassionate care, benevolence and respect, illustrates that individuals should be selected on attributes other than academic ability alone. Moreover, there are mounting calls to widen access to medicine, to ensure that selection methods do not unfairly disadvantage individuals from specific groups (e.g. regarding ethnicity or socio-economic status), so that the future workforce adequately represents society as a whole. These drivers necessitate a method of assessment that allows individuals to be selected on important non-academic attributes that are desirable in healthcare professionals, in a fair, reliable and valid way. What are SJTs? Situational judgement tests (SJTs) are tests used to assess individuals' reactions to a number of hypothetical role-relevant scenarios, which reflect situations candidates are likely to encounter in the target role. These scenarios are based on a detailed analysis of the role and should be developed in collaboration with subject matter experts, in order to accurately assess the key attributes that are associated with competent performance. From a theoretical perspective, SJTs are believed to measure prosocial Implicit Trait Policies (ITPs), which are shaped by socialisation processes that teach the utility of expressing certain traits in different settings such as agreeable expressions (e.g. helping others in need), or disagreeable actions (e.g. advancing ones own interest at others, expense). Are SJTs reliable, valid and fair? Several studies, including good quality meta-analytic and longitudinal research, consistently show that SJTs used in many different occupational groups are reliable and valid. Although there is over 40 years of research evidence available on SJTs, it is only within the past 10 years that SJTs have been used for recruitment into medicine. Specifically, evidence consistently shows that SJTs used in medical selection have good reliability, and predict performance across a range of medical professions, including performance in general practice, in early years (foundation training as a junior doctor) and for medical school admissions. In addition, SJTs have been found to have significant added value (incremental validity) over and above other selection methods such as knowledge tests, measures of cognitive ability, personality tests and application forms. Regarding differential attainment, generally SJTs have been found to have lower adverse impact compared to other selection methods, such as cognitive ability tests. SJTs have the benefit of being appropriate both for use in selection where candidates are novices (i.e. have no prior role experience or knowledge such as in medical school admissions) as well as settings where candidates have substantial job knowledge and specific experience (as in postgraduate recruitment for more senior roles). An SJT specification (e.g. scenario content, response instructions and format) may differ depending on the level of job knowledge required. Research consistently shows that SJTs are usually found to be positively received by candidates compared to other selection tests such as cognitive ability and personality tests. Practically, SJTs are difficult to design effectively, and significant expertise is required to build a reliable and valid SJT. Once designed however, SJTs are cost efficient to administer to large numbers of candidates compared to other tests of non-academic attributes (e.g. personal statements, structured interviews), as they are standardised and can be computer-delivered and machine-marked.

journal_name

Med Teach

journal_title

Medical teacher

authors

Patterson F,Zibarras L,Ashworth V

doi

10.3109/0142159X.2015.1072619

subject

Has Abstract

pub_date

2016-01-01 00:00:00

pages

3-17

issue

1

eissn

0142-159X

issn

1466-187X

journal_volume

38

pub_type

杂志文章,评审
  • Helping students to improve their academic performance: a pilot study of a workbook with self-monitoring exercises.

    abstract:BACKGROUND:There is increasing interest in developing student self-regulated learning skills, especially self-monitoring, to improve academic performance. AIMS:A pilot study to investigate the impact of self-monitoring exercises on calibration accuracy and academic performance in undergraduate medical students on a Bi...

    journal_title:Medical teacher

    pub_type: 杂志文章,随机对照试验

    doi:10.3109/0142159X.2012.691188

    authors: Leggett H,Sandars J,Burns P

    更新日期:2012-01-01 00:00:00

  • Medical students' reflective writing about a task-based learning experience on public health communication.

    abstract:BACKGROUND:Medical educators constantly face the challenge of preparing students for public health practice. AIMS:This study aimed to analyze students' reflections to gain insight into their task-based experiences in the public health communication selective. We have also examined their self-reported learning outcomes...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.849329

    authors: Koh YH,Wong ML,Lee JJ

    更新日期:2014-02-01 00:00:00

  • Using a blog as an integrated eLearning tool and platform.

    abstract::Technology enhanced learning or eLearning allows educators to expand access to educational content, promotes engagement with students and makes it easier for students to access educational material at a time, place and pace which suits them. The challenge for educators beginning their eLearning journey is to decide wh...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2015.1105947

    authors: Goh PS

    更新日期:2016-06-01 00:00:00

  • How does medical education affect empathy and compassion in medical students? A meta-ethnography: BEME Guide No. 57.

    abstract::Background: Empathy and compassion are important in healthcare delivery, and are necessary qualities in medical students. Aims: To explore medical students', patients' and educators' perceptions of what affects empathy and the expression of compassion; and to address gaps in knowledge, attitudes and skills on how educ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1630731

    authors: Krishnasamy C,Ong SY,Loo ME,Thistlethwaite J

    更新日期:2019-11-01 00:00:00

  • Failure to fail: the institutional perspective.

    abstract:PURPOSE:To determine institutional barriers to placing failing students on probation, dismissing students. METHODS:An online survey study was distributed to Student Affairs Deans or the equivalent at allopathic (MD) and osteopathic (DO) medical schools, and physician assistant (PA) and nurse practitioner (NP) schools ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.910295

    authors: Guerrasio J,Furfari KA,Rosenthal LD,Nogar CL,Wray KW,Aagaard EM

    更新日期:2014-09-01 00:00:00

  • What factors in rural and remote extended clinical placements may contribute to preparedness for practice from the perspective of students and clinicians?

    abstract:BACKGROUND:Community-based rural education opportunities have expanded in Australia, attracting more medical students to placements in rural and remote settings. AIM:To identify the factors in an integrated, community-engaged rural placement that may contribute to preparedness for practice (P4P) from the perspective o...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.820274

    authors: Daly M,Perkins D,Kumar K,Roberts C,Moore M

    更新日期:2013-11-01 00:00:00

  • Personal view: medical education in sweden: urgently needed reforms.

    abstract::I have been licensed as a physician in Sweden for more than 50 years, working for most of this time at the Royal University of Lund, the Royal University of Gothenburg and the Royal University of Uppsala. My experience has been mostly as Professor of Medicine, but I have also had considerable experience in Anatomy, th...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909023831

    authors: Ask-Upmark E

    更新日期:1979-01-01 00:00:00

  • Twelve tips for the introduction of emotional intelligence in medical education.

    abstract::Emotional intelligence (EI) is the ability to recognize, understand, and manage emotions in yourself and in others. EI has long been recognized as a critical component for individual and organizational success within the business realm, and there is emerging evidence that enhancing EI is equally important in the medic...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2018.1481499

    authors: Roth CG,Eldin KW,Padmanabhan V,Friedman EM

    更新日期:2019-07-01 00:00:00

  • A collaborative model for developing and maintaining virtual patients for medical education.

    abstract::There is great interest in using computer-assisted instruction in medical education, but getting computer-assisted instruction materials used broadly is difficult to achieve. We describe a successful model for the development and maintenance of a specific type of computer-assisted instruction - virtual patients - in m...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2011.540268

    authors: Berman NB,Fall LH,Chessman AW,Dell MR,Lang VJ,Leong SL,Nixon LJ,Smith S

    更新日期:2011-01-01 00:00:00

  • A comparison of answer retrieval through four evidence-based textbooks (ACP PIER, Essential Evidence Plus, First Consult, and UpToDate): a randomized controlled trial.

    abstract:BACKGROUND:The efficacy of bedside information products has not been properly evaluated, particularly in developing countries. AIM:To compare four evidence-based textbooks by comparing efficacy of their use by clinical residents, as measured by the proportion of questions for which relevant answers could be obtained w...

    journal_title:Medical teacher

    pub_type: 杂志文章,随机对照试验

    doi:10.3109/0142159X.2010.531155

    authors: Ahmadi SF,Faghankhani M,Javanbakht A,Akbarshahi M,Mirghorbani M,Safarnejad B,Baradaran H

    更新日期:2011-01-01 00:00:00

  • Child health in the West Bank: Experiences from implementing a paediatric course for Palestinian doctors and nurses working in primary care.

    abstract::Child health issues are of high importance in the occupied Palestinian territories, where half of the population are children. The Royal College of Paediatrics and Child Health have developed a comprehensive paediatric training programme for primary healthcare providers with the aim of improving child health in the ar...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.509411

    authors: Morris A,Rudolf M,Halileh S,Odeh J,Bowyer J,Waterston T

    更新日期:2010-01-01 00:00:00

  • Assessing the head-to-toe physical examination skills of medical students.

    abstract::Second-year medical students performed a head-to-toe screening physical examination on trained patient instructors (PIs) as a high-stakes examination before beginning clinical clerkships. PIs completed a 138-item checklist and instructed the students in the proper performance of any incorrectly executed or omitted ite...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590410001696452

    authors: Yudkowsky R,Downing S,Klamen D,Valaski M,Eulenberg B,Popa M

    更新日期:2004-08-01 00:00:00

  • The development of a scale to measure personal reflection in medical practice and education.

    abstract:AIM:Personal reflection is important for acquiring, maintaining and enhancing balanced medical professionalism. A new scale, the Groningen Reflection Ability Scale (GRAS), was developed to measure the personal reflection ability of medical students. METHOD:Explorative literature study was conducted to gather an initia...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701299272

    authors: Aukes LC,Geertsma J,Cohen-Schotanus J,Zwierstra RP,Slaets JP

    更新日期:2007-03-01 00:00:00

  • The Problem with POMR.

    abstract::In this article, Dr Michael Simpson argues the case against unquestioning acceptance of problem orientated medical records, in reply to the article which appeared in the last issue of Medicd Teacher (1979, 1, 147-1511. ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909012600

    authors: Simpson MA

    更新日期:1979-01-01 00:00:00

  • A comprehensive checklist for reporting the use of OSCEs.

    abstract:BACKGROUND:The Objective Structured Clinical Examination (OSCE) has experienced an explosion of use which has rarely been accompanied by systematic investigations on its validity, reliability and feasibility. A systematic review of OSCE was undertaken as part of Best Evidence Medical Education at the Centre for Evidenc...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.1080/01421590802578277

    authors: Patricio M,Juliao M,Fareleira F,Young M,Norman G,Vaz Carneiro A

    更新日期:2009-02-01 00:00:00

  • Physiology.

    abstract::This paper describes an innovative approach to teaching a traditional subject-physiology. There are no lectures, tutorials or practicals. All learning activities are undertaken in small groups, and the course is learner-centred and problem-orientated. Students are required to collect and record their own information a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909019395

    authors: Beaton G,Mitchell D

    更新日期:1979-01-01 00:00:00

  • Tele-attending can emulate and even improve bedside teaching and learning.

    abstract::Telemedicine can be used for education as well as clinical care. Wearable platforms now allow a remote student to "tele-present" cases to "Tele-Attending" elsewhere in real time. Most of the features that medical students rate as important can be accommodated in this paradigm. Augmenting the bedside case presentation ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2017.1393507

    authors: Adams RJ

    更新日期:2018-10-01 00:00:00

  • The truth lies somewhere in the middle: Swinging between globalization and regionalization of medical education in Japan.

    abstract::Japan is well known as a super-aging society, with a low birth rate, and has been ranked as one of the countries having the highest quality of healthcare system. Japan's society is currently approaching a major turning point with regard to societal and healthcare reforms, which are influenced by international trends a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2017.1359407

    authors: Saiki T,Imafuku R,Suzuki Y,Ban N

    更新日期:2017-10-01 00:00:00

  • Teaching doctors to treat doctors: medical student peer counselling.

    abstract::Physicians' emotional problems need to be recognized and treated. Intervention and prevention in this problem area have been attempted at the Medical College of Wisconsin through a programme of peer counselling designed to teach student physicians how to recognize and treat emotional difficulties faced by their peers....

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598009072181

    authors: Spiro JH,Roenneburg M,Maly BJ

    更新日期:1980-01-01 00:00:00

  • The clinical learning environment.

    abstract::Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches t...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2019.1566601

    authors: Nordquist J,Hall J,Caverzagie K,Snell L,Chan MK,Thoma B,Razack S,Philibert I

    更新日期:2019-04-01 00:00:00

  • Improving teachers' skills in working with 'problem' residents: a workshop description and evaluation.

    abstract::Working with 'problem' residents is a common challenge in medical education. This article describes a workshop designed to improve teachers' skills in this area as well as the results of an evaluation conducted to assess its effectiveness. Workshop modules focused on defining the problem, confirming the diagnosis, des...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590120048139

    authors: Steinert Y,Nasmith L,Daigle N,Franco ED

    更新日期:2001-05-01 00:00:00

  • Self-perceived attitudes and skills of cultural competence: a comparison of family medicine and internal medicine residents.

    abstract::This study surveyed resident perceptions of competent cross-cultural doctor-patient communication as a step toward developing an integrative primary care cross-cultural curriculum. Respondents were 57 first-, second- and third-year residents in family medicine (FA) and internal medicine (IMA) who completed a questionn...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159031000100454

    authors: Shapiro J,Hollingshead J,Morrison E

    更新日期:2003-05-01 00:00:00

  • Using cost-analyses to inform health professions education - The economic cost of pre-clinical failure.

    abstract:BACKGROUND:Student failure creates additional economic costs. Knowing the cost of failure helps to frame its economic burden relative to other educational issues, providing an evidence-base to guide priority setting and allocation of resources. The Ingredients Method is a cost-analysis approach which has been previousl...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2017.1410123

    authors: Foo J,Ilic D,Rivers G,Evans DJR,Walsh K,Haines TP,Paynter S,Morgan P,Maloney S

    更新日期:2018-12-01 00:00:00

  • Fitting it all in: integration of 12 cross-cutting themes into a School of Medicine curriculum.

    abstract::Changing demographic, social, economic and technological trends have impacted the expectations of the Academic Health Center in preparing physicians to serve the needs of the American society, resulting in revisions to current curricula. In addition to the traditional basic sciences and clinical disciplines, accredite...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701288564

    authors: Kitzes JA,Savich RD,Kalishman S,Sander JC,Prasad A,Morris CR,Timm C

    更新日期:2007-06-01 00:00:00

  • The introduction of standardized clinical surgical teaching: students' and tutors' perceptions of new teaching and learning aids.

    abstract:BACKGROUND:Increased student numbers coupled with changes in healthcare delivery mean that medical students have limited access to surgical patients, so novel methods of teaching surgery need to be considered. AIMS:To design, implement and evaluate standardised clinical surgical teaching for 3rd year undergraduate med...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590801938852

    authors: Stewart F,Cleland J

    更新日期:2008-06-01 00:00:00

  • Reflective practice in physiotherapy curricula: a survey of UK university based professional practice coordinators.

    abstract::There has been recent increasing interest in reflective practice within physiotherapy education as a method for reducing the 'theory-practice gap' and as a means of articulating, exposing and developing knowledge embedded in practice. Several contrasting theories have been developed to explain the role, place, purpose...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600568512

    authors: Ward A,Gracey J

    更新日期:2006-02-01 00:00:00

  • How we started an elective in emergency bedside ultrasound.

    abstract::The expanding use of bedside ultrasonography in the practice of emergency medicine and other specialties is accompanied by the need to train medical students in its applications and interpretation of its results. In this article, the authors describe their successful design, launch, and management of the ultrasound el...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.975194

    authors: Martinez JP,Sommerkamp SK,Euerle BD

    更新日期:2015-01-01 00:00:00

  • Is there a superior simulator for human anatomy education? How virtual dissection can overcome the anatomic and pedagogic limitations of cadaveric dissection.

    abstract::Educators must select the best tools to teach anatomy to future physicians and traditionally, cadavers have always been considered the "gold standard" simulator for living anatomy. However, new advances in technology and radiology have created new teaching tools, such as virtual dissection, which provide students with...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2018.1451629

    authors: Darras KE,de Bruin ABH,Nicolaou S,Dahlström N,Persson A,van Merriënboer J,Forster BB

    更新日期:2018-07-01 00:00:00

  • The learning processes of international students through the eyes of foreign supervisors.

    abstract::Semi-structured interviews were conducted with external supervisors of international electives undertaken by Dutch undergraduate students, in order to gain insight into student learning processes during these electives. The interviews served to triangulate information on these learning processes that was obtained from...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600726904

    authors: Niemantsverdriet S,van der Vleuten CP,Majoor GD,Scherpbier AJ

    更新日期:2006-06-01 00:00:00

  • Medical education in India.

    abstract::Medical schools in India produce the largest number of doctors than anywhere else in the world (30,408 from 271 medical schools), corresponding to the rapid proliferation of medical colleges in the last two decades, especially within the private sector. The Medical Council of India (MCI), the regulatory body, is requi...

    journal_title:Medical teacher

    pub_type: 杂志文章,评审

    doi:10.1080/01421590802139823

    authors: Sood R

    更新日期:2008-01-01 00:00:00