A test of medical problem-solving scored by nurses and doctors: the handicap of expertise.

Abstract:

:There is evidence that nurses fulfil the requirements of objective judgement better than doctors. Simulation of Initial Medical Problem-Solving (SIMP), a paper-and-pencil test for the assessment of medical problem-solving, consists of case histories, followed by an open-ended question. The scoring of open-ended questions is time-consuming and adds subjective bias to measurement error. In order to reduce scoring error, answers on SIMP are scored by means of scoring models in the form of check-lists with descriptions of elements of a correct answer. The reliability of the scoring was analysed in a study, with six nurses rating 500 answers. The overall interrater reliability was high, expressed by an intra-class correlation of 0.83. Selection of raters, and improvement of the scoring models, could increase the interrater reliability even further. In addition to the scoring by the nurses part of the material was scored again by two experienced doctors. The reliability of the scoring method on the whole was confirmed. Nevertheless, some evidence was found of misinterpretation of the scoring models by the nurses. Analysis at the item level revealed several instances in which both doctors agreed on a score for an element in an answer and all the nurses agreed on the opposite score. On the other hand, however, the two doctors were less consistent between themselves than the nurses. The disagreement between the doctors seems to be a consequence of differences in their own medical judgement of the case in question. The impact of the mistakes that are made by the nurses is much smaller than the loss of reliability caused by the inconsistency among the doctors.

journal_name

Med Educ

journal_title

Medical education

authors

de Graaff E

doi

10.1111/j.1365-2923.1989.tb01564.x

subject

Has Abstract

pub_date

1989-07-01 00:00:00

pages

381-6

issue

4

eissn

0308-0110

issn

1365-2923

journal_volume

23

pub_type

杂志文章
  • Undergraduate psychiatry teaching in Ethiopia.

    abstract::Many epidemiological studies have shown the magnitude and seriousness of mental disorders in developing countries. However, mental health care remains unsatisfactory owing to lack of skilled manpower and many other social and medical priorities. General practitioners and other health personnel can significantly help i...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1986.tb01374.x

    authors: Khandelwal SK,Workneh F

    更新日期:1986-07-01 00:00:00

  • Contribution of medical student research to the Medline-indexed publications of a German medical faculty.

    abstract::Medical students in Germany have to write a research thesis to acquire the title of medical doctor. This study evaluates the contribution of student research to the Medline-indexed publications of a German medical faculty. A 1993-1995 Medline-publication list, on which medical students among authors should be marked, ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00255.x

    authors: Cursiefen C,Altunbas A

    更新日期:1998-07-01 00:00:00

  • Dimensions, discourses and differences: trainees conceptualising health care leadership and followership.

    abstract:CONTEXT:As doctors in all specialties are expected to undertake leadership within health care organisations, leadership development has become an inherent part of medical education. Whereas the leadership literature within medical education remains mostly focused on individual, hierarchical leadership, contemporary the...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12832

    authors: Gordon LJ,Rees CE,Ker JS,Cleland J

    更新日期:2015-12-01 00:00:00

  • Characteristics of graduating medical students who were matched and unmatched to hospital training posts.

    abstract::The purpose of this paper is to examine similarities and differences between graduating medical students who do and do not match through the National Internship and Resident Matching Programme (NIRMP). Data from graduates of 3- and 4-year undergraduate curricula were examined separately. A two way analysis of variance...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb01530.x

    authors: Garrard J

    更新日期:1979-09-01 00:00:00

  • Integrated medical student teaching. A combined course in community medicine, general practice, geriatric medicine and mental health.

    abstract::In order to provide "horizontal" integration of related clinical subjects, a combined teaching course in community medicine, general practice, geriatric medicine and mental health has been devised. The course lasts 12 weeks and is divided between joint teaching of topics of common interest and clinical clerkships in i...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1982.tb01074.x

    authors: Stout RW,Irwin WG

    更新日期:1982-05-01 00:00:00

  • Coping efficacy and perceived family support: potential factors for reducing stress in premedical students.

    abstract:OBJECTIVE:This study investigated the relationship between perceived family support and coping efficacy in premedical (i.e. prior to entering medical school) students, an understudied subset of undergraduate students who are particularly at risk for academia- related stress. The relationships between students' perceive...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2008.03091.x

    authors: Klink JL,Byars-Winston A,Bakken LL

    更新日期:2008-06-01 00:00:00

  • Multiple choice question tests in physiology: a preliminary attempt to apply the minimum pass level.

    abstract::At the mid-term test in Part I Physiology at the University of Zagreb the students (n = 280) were graded by our standard pass level (SPL) arbitrarily set at 54% correct answers (SPL = 0.54). The test consisted of 50 items of the one best answer type. Items were selected from the pool by one examiner to conform, by his...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1994.tb02552.x

    authors: Pokrajac N,Culo F

    更新日期:1994-09-01 00:00:00

  • Inadequate recording of alcohol-drinking, tobacco-smoking and discharge diagnosis in medical in-patients: failure to recognize risks including drug interactions.

    abstract::The records of 62 men and 43 women, 14-88 years old, admitted to general medical wards in a public teaching hospital during 1991 were examined for discharge medications and for the recording of alcohol-drinking, tobacco-smoking and discharge diagnosis. Drinking and smoking status was unrecorded in 22.9% and 21.9% of p...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00313.x

    authors: Bairstow BM,Burke V,Beilin LJ,Deutscher C

    更新日期:1993-11-01 00:00:00

  • New consultants mastering the role of on-call supervisor: a longitudinal qualitative study.

    abstract:CONTEXT:The supervision of specialty registrars during on-call shifts is essential to ensure the quality of both health care and medical education, but has been identified as a major novelty and stressor for new consultants in the transition from specialty training. There is a paucity of research on how consultants dea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12129

    authors: Westerman M,Teunissen PW,Fokkema JP,Siegert CE,van der Vleuten CP,Scherpbier AJ,Scheele F

    更新日期:2013-04-01 00:00:00

  • Medical students' note-taking in a medical biochemistry course: an initial exploration.

    abstract::Beginning medical students spend numerous hours every week attending basic science lectures and taking notes. Medical faculty often wonder whether they should give students pre-printed instructors' notes before lectures. Proponents of this strategy argue that provided notes enhance learning by facilitating the accurat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01167.x

    authors: Morrison EH,McLaughlin C,Rucker L

    更新日期:2002-04-01 00:00:00

  • Who are the providers of postgraduate medical education?

    abstract::The view, background and motivation of providers of medical education was studied using a structured questionnaire which was sent to all those who organized courses for the Postgraduate Education Allowance in the West of Scotland. Two hundred and twenty-five replies were received from 254 course providers, giving an 8...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00300.x

    authors: Kelly MH,Murray TS

    更新日期:1993-09-01 00:00:00

  • Cognitive appraisals and team performance under stress: A simulation study.

    abstract:OBJECTIVES:The present study explored how challenge and threat responses to stress relate to performance, anxiety, confidence, team identity and team characteristics (time spent in training and postgraduate experience) in a medical simulation-based team competition. METHODS:The study was conducted during a national si...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14050

    authors: Carenzo L,Braithwaite EC,Carfagna F,Franc J,Ingrassia PL,Turner MJ,Slater MJ,Jones MV

    更新日期:2020-03-01 00:00:00

  • Undergraduate education in the cost-effective use of laboratory and radiological investigations in clinical decision-making.

    abstract::This paper describes a strategy for helping students to learn about laboratory and radiological investigations in diagnosis and management, and to make decisions about the use of investigations, taking into account such features as safety, patient comfort and cost. Learning takes place through the use of a programmed ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02310.x

    authors: Clarke RM

    更新日期:1981-01-01 00:00:00

  • Examination anxiety in medical students: experiences with the visual analogue scale for anxiety.

    abstract::Medical students' levels of anxiety under different conditions of stress were investigated, as well as the stability of anxiety ratings from one examination to another. After completing an end-of-term psychiatry examination, fourth-year medical students at Monash University were asked to score the Visual Analogue Scal...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1982.tb01259.x

    authors: Kidson M,Hornblow A

    更新日期:1982-09-01 00:00:00

  • Teaching of primary health care in practice: a model using local health centres in undergraduate medical education.

    abstract::In Finland primary health care has a long historical background. The local communities, the state and the church have at various times and places been responsible for primary health care during the last few centuries. In 1972, a major reform took place when a new Primary Health Care Act came into force. In the same ye...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1987.tb00392.x

    authors: Kumpusalo E,Tuomilehto J

    更新日期:1987-09-01 00:00:00

  • Medical statistics: content and objectives of a core course for medical students.

    abstract::British medical school teachers of medical statistics aspire to teach statistical concepts without requiring medical students to undertake every statistical technique in the book. In the typical course of 20 to 30 hours, about 50 topics are taught, usually requiring the student to perform a technique. In a survey of c...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1994.tb02686.x

    authors: Dixon RA

    更新日期:1994-01-01 00:00:00

  • Assessing procedural skills in context: Exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI).

    abstract:BACKGROUND:The assessment of clinical procedural skills has traditionally focused on technical elements alone. However, in real practice, clinicians are expected to be able to integrate technical with communication and other professional skills. We describe an integrated procedural performance instrument (IPPI), where ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02612.x

    authors: Kneebone R,Nestel D,Yadollahi F,Brown R,Nolan C,Durack J,Brenton H,Moulton C,Archer J,Darzi A

    更新日期:2006-11-01 00:00:00

  • Determination of aims for an undergraduate general practitioner apprenticeship.

    abstract::This study was undertaken to clarify the goals of the clinical general practitioner attachment scheme at the University of Queensland. Emphasis was placed on comparing the aims of the academics, the general practitioner preceptors and the students. Prior to the 2-week attachments students selected a different set of g...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1980.tb02392.x

    authors: Colditz GA,Munro JG,Sheehan M

    更新日期:1980-11-01 00:00:00

  • Towards evidence-based practice in medical training: making evaluations more meaningful.

    abstract:CONTEXT:The evaluation of training is problematic and the evidence base inconclusive. This situation may arise for 2 main reasons: training is not understood as a complex intervention and, related to this, the evaluation methods applied are often overly simplistic. METHOD:This paper makes the case for construing train...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.02021.x

    authors: Drescher U,Warren F,Norton K

    更新日期:2004-12-01 00:00:00

  • Population-based longitudinal analyses of offer likelihood in UK medical schools: 1996-2012.

    abstract:CONTEXT:The challenge of ensuring 'fair' selection processes confronts all medical schools around the globe. In the UK, historical analyses suggest applicants who are male, non-White, and from less advantaged socio-economic and school backgrounds have been less likely to be offered a place at medical school. We provide...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12981

    authors: Mathers J,Sitch A,Parry J

    更新日期:2016-06-01 00:00:00

  • A critical narrative review of transfer of basic science knowledge in health professions education.

    abstract:CONTEXT:'Transfer' is the application of a previously learned concept to solve a new problem in another context. Transfer is essential for basic science education because, to be valuable, basic science knowledge must be transferred to clinical problem solving. Therefore, better understanding of interventions that enhan...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.13519

    authors: Castillo JM,Park YS,Harris I,Cheung JJH,Sood L,Clark MD,Kulasegaram K,Brydges R,Norman G,Woods N

    更新日期:2018-06-01 00:00:00

  • Kabisa: an interactive computer-assisted training program for tropical diseases.

    abstract::In Europe, tropical pathology is usually taught in special short courses, intended for those planning to practise in developing countries. The theoretical knowledge to be assimilated during this short period is considerable, and turning such newly acquired knowledge into competence is difficult. Kabisa is a computer-b...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1997.tb02568.x

    authors: Van den Ende J,Blot K,Kestens L,Van Gompel A,Van den Enden E

    更新日期:1997-05-01 00:00:00

  • International co-operation for medical education and practice: a view from Thailand.

    abstract::Medical practice and medical education are undergoing revolutionary changes all over the world. Even though the denominators of change are usually viewed at national and institutional levels, global trends also play an important role, and international co-operation is needed now, more than ever. Thailand with its rapi...

    journal_title:Medical education

    pub_type: 历史文章,杂志文章

    doi:10.1111/j.1365-2923.1996.tb00858.x

    authors: Suwanwela C

    更新日期:1996-11-01 00:00:00

  • Gender in authorship and editorship in medical education journals: A bibliometric review.

    abstract:CONTEXT:Gender bias has been observed in the authorship and editorship of academic literature in varied medical specialties. This is important as peer-reviewed publications, and participation on editorial boards, are closely related to academic productivity and advancement. The aim of this paper was to examine whether ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14427

    authors: Madden C,O'Malley R,O'Connor P,O'Dowd E,Byrne D,Lydon S

    更新日期:2020-12-01 00:00:00

  • Assessing suitability for a problem-based learning curriculum: evaluating a new student selection instrument.

    abstract:CONTEXT:A new student selection instrument has been designed to assess candidate suitability for a problem-based learning, small group curriculum. OBJECTIVE:To evaluate the performance of the new teamwork selection instrument in terms of its discriminatory power, fairness, validity, reliability and acceptability among...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02086.x

    authors: Chamberlain SE,Searle J

    更新日期:2005-03-01 00:00:00

  • Length of in-patient stay in teaching hospitals in Japan.

    abstract::The average length of in-patient stay (LOS) in Japan is longer than that of the other Organization for Economic Cooperation and Development (OECD) countries. The tendency towards long LOS is also apparent in teaching hospitals in Japan. This paper examines factors responsible for the long LOS in teaching hospitals, fo...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00269.x

    authors: Yamaoka K,Kobayashi Y,Yano E

    更新日期:1993-05-01 00:00:00

  • Phenomenological analysis of patient experiences of medical student teaching encounters.

    abstract:CONTEXT:It is important to know how patients are affected by becoming opportunistically involved in medical student education. In previous studies, researchers rather than patients set the research agenda and expert patients or people well known to teachers were more often involved than ordinary people. OBJECTIVES:Thi...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2012.04332.x

    authors: McLachlan E,King N,Wenger E,Dornan T

    更新日期:2012-10-01 00:00:00

  • Louder than words: power and conflict in interprofessional education articles, 1954-2013.

    abstract:CONTEXT:Interprofessional education (IPE) aspires to enable collaborative practice. Current IPE offerings, although rapidly proliferating, lack evidence of efficacy and theoretical grounding. OBJECTIVES:Our research aimed to explore the historical emergence of the field of IPE and to analyse the positioning of this ac...

    journal_title:Medical education

    pub_type: 历史文章,杂志文章

    doi:10.1111/medu.12668

    authors: Paradis E,Whitehead CR

    更新日期:2015-04-01 00:00:00

  • Family and community health in a new medical school.

    abstract::The planning and implementation of a curriculum for a department of family and community health in a new medical school in a developing country presents special problems. The evolution of the programme at Sultan Qaboos University in the Sultanate of Oman is described and discussed. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1990.tb02510.x

    authors: Musgrove JP

    更新日期:1990-03-01 00:00:00

  • Attitudes of medical students to the teaching of medical ethics.

    abstract::The teaching of ethics to medical students has recently become a topic of much importance to all concerned with medical education. However, those most involved, the students themselves, have been consulted very little. This paper reports the views of a sample of medical students at Oxford University on what ethics tea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1988.tb00401.x

    authors: Delaney B,Kean L

    更新日期:1988-01-01 00:00:00