Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice.

Abstract:

:This study compares the predictive values of written-knowledge tests and a standardized multiple-station examination for the actual medical performance of general practitioners (GPs) in order to select effective assessment methods to be used in quality-improvement activities. A comprehensive assessment was performed in four phases. First, 100 GPs from the southern part of the Netherlands were assessed by a general medical knowledge test and by a knowledge test on technical skills. Second, in order to check for time-order effects, participants were randomly divided into two groups of 50 each, comparable on scores of both knowledge tests and on professional characteristics. Finally, both groups went through a multiple station examination using standardized patients and a practice video assessment of real surgery, but in opposite orders. Consultations were videotaped and assessed by well-trained peer observers. The drop-out rate was 10%. In both groups the predictive value of medical knowledge tests, ranging from 0.43 to 0.56 (Pearson correlation disattenuated), proved to be comparable with the predictive value of the multiple-station examination for actual performance (0.33-0.59). The overall explained variance of scores of the practice video assessment, measured by multiple regression analysis with performance scores as dependent variables and scores on the knowledge tests and the multiple-station examination as independent variables was moderate (19%). A time-order effect showed in only one direction: from practice video assessment to the multiple-station examination. The GP's professional characteristics did not contribute to the explanation of variation in performance. Medical knowledge tests can predict actual clinical performance to the same extent as a multiple-station examination. Compared with a station examination, a knowledge test may be a good alternative method for assessment the procedures of a large number of practising GPs.

journal_name

Med Educ

journal_title

Medical education

authors

Ram P,van der Vleuten C,Rethans JJ,Schouten B,Hobma S,Grol R

doi

10.1046/j.1365-2923.1999.00280.x

keywords:

subject

Has Abstract

pub_date

1999-03-01 00:00:00

pages

197-203

issue

3

eissn

0308-0110

issn

1365-2923

journal_volume

33

pub_type

杂志文章
  • Medical informatics education in paediatric residency training.

    abstract:OBJECTIVES:The objective of this study was to determine whether Medical Informatics education among house staff is included in the current residency curriculum, and to present ways in which this type of education may be improved. DESIGN:During autumn 1996 a mailed survey was distributed to chief residents of American ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00424.x

    authors: Roberts JR,Spooner SA

    更新日期:1999-10-01 00:00:00

  • The superiority of three-dimensional physical models to two-dimensional computer presentations in anatomy learning.

    abstract:BACKGROUND:Although several studies (Anat Sci Educ, 8 [6], 525, 2015) have shown that computer-based anatomy programs (three-dimensional visualisation technology [3DVT]) are inferior to ordinary physical models (PMs), the mechanism is not clear. In this study, we explored three mechanisms: haptic feedback, transfer-app...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13683

    authors: Wainman B,Wolak L,Pukas G,Zheng E,Norman GR

    更新日期:2018-11-01 00:00:00

  • Student evaluation of the clinical 'curriculum in action'.

    abstract:AIM:To examine how students' evaluations of the environment, process and outcome of clinical learning interrelated and correlated with assessment results. METHOD:A post hoc study in the 3rd of 5 years in a student-centred, horizontally integrated, objective-based medical curriculum. In the last week of each module, st...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2929.2006.02507.x

    authors: Dornan T,Arno M,Hadfield J,Scherpbier A,Boshuizen H

    更新日期:2006-07-01 00:00:00

  • Validity in work-based assessment: expanding our horizons.

    abstract:CONTEXT:Although work-based assessments (WBA) may come closest to assessing habitual performance, their use for summative purposes is not undisputed. Most criticism of WBA stems from approaches to validity consistent with the quantitative psychometric framework. However, there is increasing research evidence that indic...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12289

    authors: Govaerts M,van der Vleuten CP

    更新日期:2013-12-01 00:00:00

  • Continuing education courses in dentistry: assessing impact on practice.

    abstract:INTRODUCTION:In the context of movement towards mandatory continuing dental education, this paper describes how a delayed postal questionnaire can be used in course evaluation. Specifically, the value of the questionnaire as a tool for assessing the impact of short course attendance on general dental practice is examin...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00355.x

    authors: Bullock AD,Belfield CR,Butterfield S,Ribbins PM,Frame JW

    更新日期:1999-07-01 00:00:00

  • Content specificity and oral certification exams.

    abstract::This study reports on the generalizability of different skills assessed in the oral certification examinations in Internal Medicine of the Royal College of Physicians and Surgeons of Canada. Assessments from the 1992 examination were examined prospectively to determine (i) inter-rater reliability, (ii) correlation fro...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1996.tb00718.x

    authors: Turnbull J,Danoff D,Norman G

    更新日期:1996-01-01 00:00:00

  • The assessment of poorly performing doctors: the development of the assessment programmes for the General Medical Council's Performance Procedures.

    abstract:BACKGROUND:Modernization of medical regulation has included the introduction of the Professional Performance Procedures by the UK General Medical Council in 1995. The Council now has the power to assess any registered practitioner whose performance may be seriously deficient, thus calling registration (licensure) into ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:

    authors: Southgate L,Cox J,David T,Hatch D,Howes A,Johnson N,Jolly B,Macdonald E,McAvoy P,McCrorie P,Turner J

    更新日期:2001-12-01 00:00:00

  • The structure of medical education.

    abstract::The recurrent failure to adequately conceptualize the medical meaning of 'diease' is explained as a function of the way this is taught in the curriculum. It is not transmitted within the formal curriculum but within the internal structural relationships of the medical course. The limits of this particular definition e...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1977.tb00603.x

    authors: Armstrong D

    更新日期:1977-07-01 00:00:00

  • A course on collaboration between social workers and general practitioners during their vocational training.

    abstract::The educational programme reported was an experiment in the vocational training scheme of the department of General Practice, Erasmus University, Rotterdam, Holland, and is now part of the course. The programme focused on the training in team function (co-operation) given to trainee GPs and social workers. It became c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb00916.x

    authors: Schenk F

    更新日期:1979-01-01 00:00:00

  • Brief problem-solving questions in medical school examinations: is it necessary for students to explain their answers?

    abstract:OBJECTIVE:To compare outcomes when answers to objective type problem-solving questions are marked with and without consideration of students' explanations of their answers. DESIGN:Students answered six multiple-part problem-solving questions on the final examination for a course in clinical biochemistry. Each part req...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00382.x

    authors: Schwartz PL,Loten EG

    更新日期:1999-11-01 00:00:00

  • Responding to the implications of the genetics revolution for the education and training of doctors: a medical humanities approach.

    abstract:BACKGROUND:Rapid advances in the field of genetics continue to present medical educators with significant challenges. Whilst there is undoubtedly a pressing need to educate doctors about genetic disorders, research and therapies, there is a parallel need to provide a context for all of these. CONTENT:An interdisciplin...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01433.x

    authors: Kirklin D

    更新日期:2003-02-01 00:00:00

  • Ethnic and social disparities in performance on medical school selection criteria.

    abstract:CONTEXT:Medical schools in Western societies seek measures to increase the diversity of their student bodies with respect to ethnicity and social background. Currently, little is known about the effects of different selection procedures on student diversity. OBJECTIVES:This prospective cohort study aimed to determine ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12536

    authors: Stegers-Jager KM,Steyerberg EW,Lucieer SM,Themmen AP

    更新日期:2015-01-01 00:00:00

  • Using simulated patients to develop doctors' skills in facilitating behaviour change: addressing childhood obesity.

    abstract:OBJECTIVES:This study aimed to describe the application, feasibility and outcomes of using simulated patients (SPs) to increase the skills of general practitioners (GPs) delivering a behavioural intervention to reduce childhood overweight and mild obesity. METHODS:Five female actors were trained as SPs. A total of 67 ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03686.x

    authors: Gerner B,Sanci L,Cahill H,Ukoumunne OC,Gold L,Rogers L,McCallum Z,Wake M

    更新日期:2010-07-01 00:00:00

  • The dual nature of medical enculturation in postgraduate medical training and practice.

    abstract:OBJECTIVES:Enculturation is a normal and continuing part of human development. This study examined how medical graduates perceive the process of enculturation after graduation. METHODS:We conducted a qualitative study of the values of medical graduates associated with Sydney Medical School to identify processes that c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04301.x

    authors: Gordon J,Markham P,Lipworth W,Kerridge I,Little M

    更新日期:2012-09-01 00:00:00

  • Advanced training in general practice in the UK for overseas postgraduates.

    abstract::The strengths of general practice in the UK as a training environment for overseas doctors intending to implement the World Health Organization strategy 'Health for All by the Year 2000' in primary care are identified. A course of advanced training for teachers and administrators of primary care is described and evalu...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00027.x

    authors: al-Bashir M,Bundred PE,Stanley IM

    更新日期:1991-01-01 00:00:00

  • Changes in performance: a 5-year longitudinal study of participants in a multi-source feedback programme.

    abstract:OBJECTIVES:Multi-source feedback (MSF) enables performance data to be provided to doctors from patients, co-workers and medical colleagues. This study examined the evidence for the validity of MSF instruments for general practice, investigated changes in performance for doctors who participated twice, 5 years apart, an...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2008.03127.x

    authors: Violato C,Lockyer JM,Fidler H

    更新日期:2008-10-01 00:00:00

  • Emotional intelligence in medical students: does it correlate with selection measures?

    abstract:CONTEXT:Much attention and emphasis are placed on the selection of medical students. Although selection measures have been validated in the literature, it is not yet known whether high scores at selection are indicative of high levels of interpersonal aptitude. Emotional intelligence (EI) is reported to be a predictor ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2009.03496.x

    authors: Carr SE

    更新日期:2009-11-01 00:00:00

  • The rotational approach to medical education: time to confront our assumptions?

    abstract:CONTEXT:Trainees in undergraduate and postgraduate medical education engage in multiple transitions as part of the educational process, including many transitions that occur on both periodic and daily bases within medical education programmes. The clinical rotation, based on either a medical discipline or clinical care...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03847.x

    authors: Holmboe E,Ginsburg S,Bernabeo E

    更新日期:2011-01-01 00:00:00

  • Influence of new educational technology on problem-based learning at Harvard Medical School.

    abstract:PURPOSE:Computers with 50-inch, wall-mounted plasma screens and broadband Internet access were installed in all small group tutorial rooms at Harvard Medical School. This study examines how the introduction of this educational technology impacted on the problem-based learning tutorials. METHOD:A total of 37 tutorial g...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02105.x

    authors: Kerfoot BP,Masser BA,Hafler JP

    更新日期:2005-04-01 00:00:00

  • The management of patient encounter time in a high-stakes assessment using standardized patients.

    abstract:OBJECTIVES:The purpose of this study was to gather information regarding the appropriateness of the length of time allotted for candidates to complete the history taking and physical examination tasks in a high-stakes standardized patient (SP) assessment. DESIGN:Data were collected on actual time used by 1548 examinee...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.00752.x

    authors: Chambers KA,Boulet JR,Gary NE

    更新日期:2000-10-01 00:00:00

  • Resourcing innovative teaching of audit--models, methods and MAAGs.

    abstract::Audit is an important part of clinical practice, and has been promoted as a core aspect of undergraduate and postgraduate medical education. Few examples of how audit is taught in the undergraduate curriculum exist. This article presents a model for student teaching using innovative methods, which include an extended ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00240.x

    authors: Howe AC,Purkiss V

    更新日期:1998-11-01 00:00:00

  • Preclinical progress in relation to personality and academic profiles.

    abstract::One hundred and forty-six (93%) of the University of Wales College of Medicine intake of new students completed a personality questionnaire (Cattell 16PF) on registration in October 1988. The students were divided into four groups depending on their academic progress up to and including 2nd MB BCh. Whereas the majorit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00244.x

    authors: Green A,Peters TJ,Webster DJ

    更新日期:1993-03-01 00:00:00

  • An electronic learning portfolio for reflective continuing professional development.

    abstract:OBJECTIVES:These were to measure the uptake and use of an electronic learning portfolio to support reflective continuing professional development, and to characterize attitudes towards its use and obstacles to its adoption. DESIGN:Uncontrolled, longitudinal intervention study with quantitative and qualitative evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01278.x

    authors: Dornan T,Carroll C,Parboosingh J

    更新日期:2002-08-01 00:00:00

  • Thinking critically about critical thinking: ability, disposition or both?

    abstract:OBJECTIVES:The objectives of this study were to determine the extent to which clinician-educators agree on definitions of critical thinking and to determine whether their descriptions of critical thinking in clinical practice are consistent with these definitions. METHODS:Ninety-seven medical educators at five medical...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03910.x

    authors: Krupat E,Sprague JM,Wolpaw D,Haidet P,Hatem D,O'Brien B

    更新日期:2011-06-01 00:00:00

  • Career preferences of graduate and non-graduate entrants to medical schools in the UK.

    abstract:OBJECTIVE:Recent UK policy has been to increase substantially the number of graduate entrants to medical schools. Our aim was to study whether graduate and non-graduate entrants have different long-term career preferences. METHODS:We conducted postal questionnaire surveys of medical qualifiers from all UK medical scho...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2007.02706.x

    authors: Goldacre MJ,Davidson JM,Lambert TW

    更新日期:2007-04-01 00:00:00

  • Educational intervention in pharmacy students' attitudes to HIV/AIDS and drug misuse.

    abstract::By providing injecting equipment to drug misusers, community pharmacists in the UK may become involved in preventing the spread of HIV via the intravenous route. Over 60% of pharmacy graduates from the School of Pharmacy enter community pharmacy and, as part of their undergraduate course, attend a series of lectures a...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1994.tb02725.x

    authors: Sheridan J,Bates IP,Webb DG,Barber ND

    更新日期:1994-11-01 00:00:00

  • Resident doctors' understanding of their roles as clinical teachers.

    abstract:INTRODUCTION:Limited data illuminate how resident doctors view their important roles as teachers, supervisors and role models. Analysing qualitative data about resident teachers' self-perceptions can offer helpful insights. METHODS:One year after a randomised trial of a residents-as-teachers curriculum at a university...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.02063.x

    authors: Morrison EH,Shapiro JF,Harthill M

    更新日期:2005-02-01 00:00:00

  • Reducing variability in treatment decision-making: effectiveness of educating clinicians about uncertainty.

    abstract::The objective of this study was to investigate whether or not education about the concept of uncertainty reduced variability in treatment decision-making. Three small groups of dentists in North York, Canada were asked to make restorative treatment decisions about simulated bitewing radiographs. They subsequently took...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00153.x

    authors: Choi BC,Jokovic A,Kay EJ,Main PA,Leake JL

    更新日期:1998-01-01 00:00:00

  • Implementation of problem-based learning in Asian medical schools and students' perceptions of their experience.

    abstract:BACKGROUND:Since the introduction of problem-based learning (PBL) at McMaster University in 1969, many medical schools in the USA, Canada and Europe have included PBL in their curricula. In the past decade, many medical schools in Asia have also done so. However, so far no one has questioned whether the outcomes expect...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01489.x

    authors: Khoo HE

    更新日期:2003-05-01 00:00:00

  • Supporting the problem-based learning process in the clinical years: evaluation of an online Clinical Reasoning Guide.

    abstract:PURPOSE:Implementing problem-based learning (PBL) in the clinical years of a medical degree presents particular challenges. This study investigated the effectiveness of using an online Clinical Reasoning Guide to assist integration of PBL in the clinical setting and promote further development of students' clinical rea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.01839.x

    authors: Ryan G,Dolling T,Barnet S

    更新日期:2004-06-01 00:00:00