Validity in work-based assessment: expanding our horizons.

Abstract:

CONTEXT:Although work-based assessments (WBA) may come closest to assessing habitual performance, their use for summative purposes is not undisputed. Most criticism of WBA stems from approaches to validity consistent with the quantitative psychometric framework. However, there is increasing research evidence that indicates that the assumptions underlying the predictive, deterministic framework of psychometrics may no longer hold. In this discussion paper we argue that meaningfulness and appropriateness of current validity evidence can be called into question and that we need alternative strategies to assessment and validity inquiry that build on current theories of learning and performance in complex and dynamic workplace settings. METHODS:Drawing from research in various professional fields we outline key issues within the mechanisms of learning, competence and performance in the context of complex social environments and illustrate their relevance to WBA. In reviewing recent socio-cultural learning theory and research on performance and performance interpretations in work settings, we demonstrate that learning, competence (as inferred from performance) as well as performance interpretations are to be seen as inherently contextualised, and can only be under-stood 'in situ'. Assessment in the context of work settings may, therefore, be more usefully viewed as a socially situated interpretive act. DISCUSSION:We propose constructivist-interpretivist approaches towards WBA in order to capture and understand contextualised learning and performance in work settings. Theoretical assumptions underlying interpretivist assessment approaches call for a validity theory that provides the theoretical framework and conceptual tools to guide the validation process in the qualitative assessment inquiry. Basic principles of rigour specific to qualitative research have been established, and they can and should be used to determine validity in interpretivist assessment approaches. If used properly, these strategies generate trustworthy evidence that is needed to develop the validity argument in WBA, allowing for in-depth and meaningful information about professional competence.

journal_name

Med Educ

journal_title

Medical education

authors

Govaerts M,van der Vleuten CP

doi

10.1111/medu.12289

subject

Has Abstract

pub_date

2013-12-01 00:00:00

pages

1164-74

issue

12

eissn

0308-0110

issn

1365-2923

journal_volume

47

pub_type

杂志文章
  • A healing curriculum.

    abstract:CONTEXT:The banner of patient-centredness flies over many academic institutions; however, the practice and teaching of medicine remain oriented to disease. This incongruence is the result of an original Flexnerian dichotomy between the basic and clinical sciences and is maintained by a more recent distinction between d...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2007.02905.x

    authors: Boudreau JD,Cassell EJ,Fuks A

    更新日期:2007-12-01 00:00:00

  • Student views on the effective teaching of physical examination skills: a qualitative study.

    abstract:OBJECTIVES:The lack of published studies into effective skills teaching in clinical skills centres inspired this study of student views of the teaching behaviours of skills teachers. METHODS:We organised focus group discussions with students from Years 1-3 of a 6-year undergraduate medical curriculum. A total of 30 ra...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2008.03283.x

    authors: Martens MJ,Duvivier RJ,van Dalen J,Verwijnen GM,Scherpbier AJ,van der Vleuten CP

    更新日期:2009-02-01 00:00:00

  • Medical specialization in Europe: the way forward. Promotion of educational quality.

    abstract::The medical specialties are being intensively reconsidered in the countries of Europe. The important need is for promoting improvement of educational training programmes. Evaluation and improvement of specialist training programmes is the priority and not the setting up of qualifying examinations. The first necessity ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00274.x

    authors: Karle H,Nystrup J,Walton H

    更新日期:1993-07-01 00:00:00

  • Chaos, complexity and complicatedness: lessons from rocket science.

    abstract:CONTEXT:Recently several authors have drawn parallels between educational research and some theories of natural science, in particular complexity theory and chaos theory. The central claim is that both the natural science theories are useful metaphors for education research in that they deal with phenomena that involve...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.03945.x

    authors: Norman G

    更新日期:2011-06-01 00:00:00

  • Maturational differences in undergraduate medical students' perceptions about feedback.

    abstract:CONTEXT:Although medical students receive varied feedback throughout their training programmes, research demonstrates that they frequently perceive it as insufficient. However, supervisors tend to perceive that it is adequate. Students' responses to, and use of, feedback are not clearly understood. The purposes of this...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04291.x

    authors: Murdoch-Eaton D,Sargeant J

    更新日期:2012-07-01 00:00:00

  • Do patients have an obligation to participate in student teaching?

    abstract:CONTEXT:Patients may participate in teaching in many ways, in different settings and with different degrees of expert supervision. The majority of patients are generally very willing to participate in teaching. At times, however, patients may decline to see students because they are too sick, wish to maintain their pri...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2007.02948.x

    authors: Lowe M,Kerridge I,McPhee J,Hart C

    更新日期:2008-03-01 00:00:00

  • Assessment tools in pre-licensure interprofessional education: A systematic review, quality appraisal and narrative synthesis.

    abstract:OBJECTIVES:Interprofessional education (IPE) aims to provide students with the opportunity to develop and demonstrate the team working behaviors and skills that will lead to positive patient outcomes. This systematic review aims to identify and critically appraise the assessment tools used after a pre-licensure IPE int...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.14453

    authors: Almoghirah H,Nazar H,Illing J

    更新日期:2021-01-13 00:00:00

  • Stress responses in medical students in ambulatory and in-hospital patient consultations.

    abstract:CONTEXT: Little is known about health professionals' responses to acute stressors encountered in the clinical environment. The goal of this study was to measure the subjective and physiological stress responses of medical students to consultations in familiar (in-hospital) and unfamiliar (ambulatory) settings. We hypot...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.03935.x

    authors: Pottier P,Hardouin JB,Dejoie T,Bonnaud A,Le Loupp AG,Planchon B,Leblanc V

    更新日期:2011-07-01 00:00:00

  • Student assessment in undergraduate medical education in the United Kingdom, 1998.

    abstract::This report describes the results of the project 'Assessment of Undergraduate Medical Education: Re-inventing the Wheel?' funded by the Nuffield Trust. The project was initiated in order to obtain information on current assessment practices in medical schools across the UK, to determine the extent of change as a conse...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.0340s1001.x

    authors: Fowell SL,Maudsley G,Maguire P,Leinster SJ,Bligh J

    更新日期:2000-09-01 00:00:00

  • Assessment of students' experiences in technical procedures in a medical clerkship.

    abstract::This study was designed to provide some insight into the manner and degree of students' acquisition of practical skills. One hundred and fifty-two of a total of 166 students in a medical clerkship during the first clinical year answered a questionnaire. The questionnaire contained fifty-eight different laboratory test...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1983.tb00962.x

    authors: Hunskaar S,Seim SH

    更新日期:1983-09-01 00:00:00

  • Medical student attitudes to psychiatry: lack of effect of psychiatric hospital experience.

    abstract::Medical students' attitudes toward psychiatry before and after their final (sixth) year psychiatric clerkship at a large psychiatric hospital were measured. We anticipated that exposure to severe, chronic psychiatric illness would affect student attitudes, and we undertook this study to investigate the direction and p...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02870.x

    authors: Galletly CA,Schrader GD,Chesterman HM,Tsourtos G

    更新日期:1995-11-01 00:00:00

  • A critical narrative review of transfer of basic science knowledge in health professions education.

    abstract:CONTEXT:'Transfer' is the application of a previously learned concept to solve a new problem in another context. Transfer is essential for basic science education because, to be valuable, basic science knowledge must be transferred to clinical problem solving. Therefore, better understanding of interventions that enhan...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.13519

    authors: Castillo JM,Park YS,Harris I,Cheung JJH,Sood L,Clark MD,Kulasegaram K,Brydges R,Norman G,Woods N

    更新日期:2018-06-01 00:00:00

  • Kabisa: an interactive computer-assisted training program for tropical diseases.

    abstract::In Europe, tropical pathology is usually taught in special short courses, intended for those planning to practise in developing countries. The theoretical knowledge to be assimilated during this short period is considerable, and turning such newly acquired knowledge into competence is difficult. Kabisa is a computer-b...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1997.tb02568.x

    authors: Van den Ende J,Blot K,Kestens L,Van Gompel A,Van den Enden E

    更新日期:1997-05-01 00:00:00

  • Sustainability of change with quality general practitioner education in adolescent health: a 5-year follow-up.

    abstract:OBJECTIVE:To determine whether improvements gained in general practitioners' (GPs') self-perceived competency, attitudes and knowledge after an intervention in adolescent health care designed with evidence-based strategies in continuing medical education, are maintained longterm, 5 years post intervention. The interven...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02172.x

    authors: Sanci L,Coffey C,Patton G,Bowes G

    更新日期:2005-06-01 00:00:00

  • Beyond the self: The role of co-regulation in medical students' self-regulated learning.

    abstract:CONTEXT:Medical students are expected to self-regulate their learning within complex and unpredictable clinical learning environments. Research increasingly focuses on the effects of social interactions on the development of self-regulation in workplace settings, a notion embodied within the concept of co-regulated lea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14018

    authors: Bransen D,Govaerts MJB,Sluijsmans DMA,Driessen EW

    更新日期:2020-03-01 00:00:00

  • Evaluation of a strategy to improve undergraduate experience in obstetrics and gynaecology.

    abstract:CONTEXT:Poor interprofessional relationships in maternity units have resulted in a number of suboptimal outcomes: students are reluctant to pursue careers in obstetrics and gynaecology (O & G); trainees feel bullied, and poor communication between professionals results in avoidable adverse events. Interprofessional lea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2009.03394.x

    authors: Siassakos D,Timmons C,Hogg F,Epee M,Marshall L,Draycott T

    更新日期:2009-07-01 00:00:00

  • A solution to the cueing effects of multiple choice questions: the Un-Q format.

    abstract::Although the cueing effects inherent in conventional multiple choice questions (MCQs) present serious limitations, this format continues to dominate testing programmes. The present study was undertaken to estimate the effects of cueing when MCQs are used to test medical students, and to evaluate the reliability, valid...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00284.x

    authors: Veloski JJ,Rabinowitz HK,Robeson MR

    更新日期:1993-07-01 00:00:00

  • An update on British medical students' lifestyles.

    abstract::Information about medical students' lifestyles was obtained from 785 second-year students from seven medical schools in Great Britain by a personally administered questionnaire. Fifteen per cent of the students were non-drinkers. Among those who drank, 48% of the men and 38% of the women exceeded sensible weekly limit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00204.x

    authors: Webb E,Ashton CH,Kelly P,Kamah F

    更新日期:1998-05-01 00:00:00

  • Improving communication: a practical programme for teaching trainees about communication issues in the general practice consultation.

    abstract::This paper describes a teaching programme, for use in general practice vocational training, which provides a theoretical and practical framework for exploring key aspects of the consultation with trainees. A particular emphasis is on the educational or 'cognitive' outcomes of the consultation and skills for improving ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1984.tb01022.x

    authors: Boulton M,Griffiths J,Hall D,McIntyre M,Oliver B,Woodward J

    更新日期:1984-07-01 00:00:00

  • Simulation-based education for novices: complex learning tasks promote reflective practice.

    abstract:CONTEXT:Simulated clinical immersion (SCI), in which clinical situations are simulated in a realistic environment, safely and gradually exposes novices to complex problems. Given their limited experience, undergraduate students can potentially be quite overwhelmed by SCI learning tasks, which may result in misleading l...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13748

    authors: Tremblay ML,Leppink J,Leclerc G,Rethans JJ,Dolmans DHJM

    更新日期:2019-04-01 00:00:00

  • Teaching and learning away from the medical centre. The potential contribution of new technology to continuing medical education in the United Kingdom (working document).

    abstract::Continuing education should be convenient, relevant, individualized, systematic and include means of assessment. Educational technology provides the link between teaching and learning; it should accommodate the essential interactions between learner, instructor, environment and material. Media in open learning systems...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1985.tb01328.x

    authors: Cairncross RG

    更新日期:1985-07-01 00:00:00

  • Current status of curriculum mapping in Canada and the UK.

    abstract:CONTEXT:As part of curriculum evaluation, management and quality assurance strategies, many undergraduate medical schools are in the process of constructing computer-based curriculum maps. METHODS:A survey was distributed to Canadian and UK medical schools to determine the current status, characteristics, and challeng...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2923.2008.03093.x

    authors: Willett TG

    更新日期:2008-08-01 00:00:00

  • A systematic review of assessment and intervention strategies for effective clinical communication in culturally and linguistically diverse students.

    abstract:OBJECTIVE:Culturally and linguistically diverse (CALD) students often experience difficulties with the clinical communication skills that are essential for successful interactions in the workplace. However, there is little evidence on the effectiveness of assessment and intervention strategies for this population. The ...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.13117

    authors: Chan A,Purcell A,Power E

    更新日期:2016-09-01 00:00:00

  • A study of a multi-source feedback system for international medical graduates holding defined licences.

    abstract:OBJECTIVE:To develop and assess the feasibility and psychometric properties of multi-source feedback questionnaires to monitor international medical graduates practising in Canada under 'defined' licences. METHOD:Four questionnaires (patient, co-worker, colleague and self) were developed and administered in 2 phases t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02410.x

    authors: Lockyer J,Blackmore D,Fidler H,Crutcher R,Salte B,Shaw K,Ward B,Wolfish N

    更新日期:2006-04-01 00:00:00

  • Behavioural sciences teaching in UK dental schools.

    abstract::A survey was conducted of the dental schools in the UK, inquiring about the teaching of psychology, sociology, epidemiology and psychiatry to dental undergraduates. Epidemiology was the most frequently taught and assessed subject, followed by psychology and sociology. Overall, the results indicate an increased concern...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1987.tb00674.x

    authors: Kent G

    更新日期:1987-03-01 00:00:00

  • Validating the Readiness for Interprofessional Learning Scale (RIPLS) in the postgraduate context: are health care professionals ready for IPL?

    abstract:AIMS:This paper describes the process of validating the Readiness for Interprofessional Learning Scale (RIPLS) for use with postgraduate health care professionals. CONTEXT:The RIPLS questionnaire has proved useful in the undergraduate context, enabling tutors to assess the readiness of students to engage in interprofe...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02442.x

    authors: Reid R,Bruce D,Allstaff K,McLernon D

    更新日期:2006-05-01 00:00:00

  • Learning to value ethnic diversity--what, why and how?

    abstract:INTRODUCTION:Learning to value ethnic diversity is the appreciation of how variations in culture and background may affect health care. It involves acknowledging and responding to an individual's culture in its broadest sense. This requires learning the skills to negotiate effective communication, a heightened awarenes...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00474.x

    authors: Kai J,Spencer J,Wilkes M,Gill P

    更新日期:1999-08-01 00:00:00

  • Perceptions of how well graduates are prepared for the role of pre-registration house officer: a comparison of outcomes from a traditional and an integrated PBL curriculum.

    abstract:INTRODUCTION:Most medical schools in the UK have been engaged in major curriculum reform based on their premises of what might improve undergraduate medical education. In 1994 the course at the medical school of the University of Manchester changed to an integrated course using problem-based learning throughout and wit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01105.x

    authors: Jones A,McArdle PJ,O'Neill PA

    更新日期:2002-01-01 00:00:00

  • Training primary health care workers in Upper Volta.

    abstract::In collaboration with aid agencies and government health workers, Save the Children Fund medical staff have been involved in the training of primary health care workers in the Sahel region of upper Volta. This report deals specifically with the problems involved in training illiterate health workers. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1982.tb01233.x

    authors: Cross I

    更新日期:1982-03-01 00:00:00

  • Effect of reflection on medical students' situational interest: an experimental study.

    abstract:CONTEXT:Reflection has been considered crucial to learning. Engaging in reflection while solving problems is expected to foster identification of knowledge gaps and interest in learning more about them, the latter being a major motivational force in learning. Although theoretically sound, this assumption still lacks em...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13491

    authors: Ribeiro LMC,Mamede S,Moura AS,de Brito EM,de Faria RMD,Schmidt HG

    更新日期:2018-05-01 00:00:00