The impact of cueing on written examinations of clinical decision making: a case study.

Abstract:

CONTEXT:Selected-response (SR) formats (e.g. multiple-choice questions) and constructed-response (CR) formats (e.g. short-answer questions) are commonly used to test the knowledge of examinees. Scores on SR formats are typically higher than scores on CR formats. This difference is often attributed to examinees being cued by options within an SR question, but there could be alternative explanations. The purpose of this study was to expand on previous work with regards to the cueing effect of SR formats by directly contrasting conditions that support cueing versus memory of previously seen questions. METHODS:During an objective structured clinical examination, students (n = 144) completed two consecutive stations in which they were presented with the same written cases but in different formats. Group 1 students were presented with CR questions followed by SR questions. Group 2 students were presented with questions in reverse order. Participants were asked to describe their testing experience. RESULTS:Selected-response scores (M = 4.21/10) were statistically higher than the CR scores (M = 3.82/10). However, there was no significant interaction between sequence and format (F(1,142) = 1.59, p = 0.21, ηp2 = 0.01) with scores increasing from 3.49/10 to 4.06/10 in the group that started with CR and decreasing (4.38/10-4.15/10) in the group that started with SR first. Correlations between SR scores and CR scores were high (CR first = 0.78, SR first = 0.89). Questionnaire results indicated that students felt the SR format was easier and led to cueing. CONCLUSION:To better understand test performance, it is important to know how different response formats could influence results. Because SR scores were higher than CR scores, irrespective of the format seen first, the pattern is consistent with what would be expected if cueing rather than memory for prior questions led to higher SR scores. This could have implications for test designers, especially when selecting question formats.

journal_name

Med Educ

journal_title

Medical education

authors

Desjardins I,Touchie C,Pugh D,Wood TJ,Humphrey-Murto S

doi

10.1111/medu.12296

subject

Has Abstract

pub_date

2014-03-01 00:00:00

pages

255-61

issue

3

eissn

0308-0110

issn

1365-2923

journal_volume

48

pub_type

杂志文章
  • Everyday classism in medical school: experiencing marginality and resistance.

    abstract:OBJECTIVE:To explore the medical school experiences of students who self-identify as coming from a working-class or impoverished family background. METHODS:A questionnaire was administered to Year 3 medical students at a Canadian medical school and in-depth interviews were held with 25 of these students (cohort 1). Th...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02225.x

    authors: Beagan BL

    更新日期:2005-08-01 00:00:00

  • An electronic study guide for problem-based learning.

    abstract::This paper describes the development and structure of an Electronic Study Guide for Oncology (LETSGO) for undergraduate medical students. LETSGO is aimed at clinical students learning about cancer. The subject of the guide is breast cancer and learning objectives cover structure and function, behavioural science, publ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02860.x

    authors: Mooney GA,Bligh JG,Leinster SF,Warenius HM

    更新日期:1995-11-01 00:00:00

  • Strategies to read and learn: overcoming learning by consumption.

    abstract:OBJECTIVES:This article discusses the need for, and value of, providing students with instruction in how to use comprehension strategies as well as the effectiveness of inducing strategy use through cognitive disequilibrium. The leading assumption that guides this article is that learning facts and figures is not enoug...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2009.03550.x

    authors: McNamara DS

    更新日期:2010-04-01 00:00:00

  • Reducing variability in treatment decision-making: effectiveness of educating clinicians about uncertainty.

    abstract::The objective of this study was to investigate whether or not education about the concept of uncertainty reduced variability in treatment decision-making. Three small groups of dentists in North York, Canada were asked to make restorative treatment decisions about simulated bitewing radiographs. They subsequently took...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1998.00153.x

    authors: Choi BC,Jokovic A,Kay EJ,Main PA,Leake JL

    更新日期:1998-01-01 00:00:00

  • Avoidable breaches of confidentiality: a study among students of medicine and of law.

    abstract:OBJECTIVES:Avoidable breaches of patient confidentiality due to inadvertence or ignorance occur frequently. The aim of this study was to explore whether participants were able to identify violations of confidentiality and how serious these violations were. DESIGN:After a 2-hour theoretical education session, participa...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02097.x

    authors: Elger BS,Harding TW

    更新日期:2005-03-01 00:00:00

  • Student evaluation of the clinical 'curriculum in action'.

    abstract:AIM:To examine how students' evaluations of the environment, process and outcome of clinical learning interrelated and correlated with assessment results. METHOD:A post hoc study in the 3rd of 5 years in a student-centred, horizontally integrated, objective-based medical curriculum. In the last week of each module, st...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2929.2006.02507.x

    authors: Dornan T,Arno M,Hadfield J,Scherpbier A,Boshuizen H

    更新日期:2006-07-01 00:00:00

  • The observation of educational events.

    abstract::This booklet is a guide to using observational research methods in medical and health-care education. Emphasis is given to the role of observation in providing concrete, detailed descriptions of how educational events unfold. It is suggested that observational methods have a valuable contribution to make to our unders...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1990.tb02521.x

    authors: Fleming WG

    更新日期:1990-03-01 00:00:00

  • Problems of comprehension of medical education vocabulary.

    abstract::Medical teachers' understanding of the vocabulary of medical education has been studied by asking a group of medical teachers whether they understood twenty-two commonly used and important medical educational terms, and whether they could distinguish between the terms. All the words presented some problem of comprehen...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02640.x

    authors: Barker VF,Harden RM

    更新日期:1981-07-01 00:00:00

  • Online testable concept maps: benefits for learning about the pathogenesis of disease.

    abstract:CONTEXT:Concept maps have been used to promote meaningful learning and critical thinking. Although these are crucially important in all disciplines, evidence for the benefits of concept mapping for learning in medicine is limited. METHODS:We performed a randomised crossover study to assess the benefits of online testa...

    journal_title:Medical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/medu.12422

    authors: Ho V,Kumar RK,Velan G

    更新日期:2014-07-01 00:00:00

  • Analysing qualitative data: ethnography and the evaluation of medical education.

    abstract::Quantitative methods of evaluating the outcomes of medical education may not always deliver the information which course organizers and teachers most need in order to improve their courses. Qualitative methods of research could provide such information. However, the use of qualitative methods has been limited by the d...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1989.tb01575.x

    authors: Walker M

    更新日期:1989-11-01 00:00:00

  • Linked tutorial teaching by teleconference and videocassette.

    abstract::A system for linked tutorial teaching involving several groups of students at different locations has been introduced successfully into the teaching resources of the University of Wales College of Medicine. It utilizes standard telephone equipment supplemented by specially prepared videocassette material. The results ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1985.tb01344.x

    authors: Hibbard BM,Marshall RJ,Evans RW,Duthie HL

    更新日期:1985-09-01 00:00:00

  • Development of a tool to support holistic generic assessment of clinical procedure skills.

    abstract:CONTEXT:The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. OBJECTIVES:This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. METHODS:We carried ...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2008.03023.x

    authors: McKinley RK,Strand J,Gray T,Schuwirth L,Alun-Jones T,Miller H

    更新日期:2008-06-01 00:00:00

  • Changes in student approaches to learning with the introduction of computer-supported problem-based learning.

    abstract:OBJECTIVES:To study changes in student approaches to learning following the introduction of computer-supported, problem-based learning. SETTING:Medical students at the University of Oslo undertake a 12-week period of clinical placement during their 10th term. In this period they continue to undertake problem-based lea...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2004.01786.x

    authors: Strømsø HI,Grøttum P,Hofgaard Lycke K

    更新日期:2004-04-01 00:00:00

  • A preliminary study of the impact of a handover cognitive aid on clinical reasoning and information transfer.

    abstract:OBJECTIVES:To assess the impact of a written cognitive aid on expressed clinical reasoning and quantity and the accuracy of information transfer during resident doctor handover. METHODS:This study was a randomised controlled trial in an academic paediatric intensive care unit (PICU) of 20 handover events (10 events pe...

    journal_title:Medical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/medu.12212

    authors: Weiss MJ,Bhanji F,Fontela PS,Razack SI

    更新日期:2013-08-01 00:00:00

  • Content specificity and oral certification exams.

    abstract::This study reports on the generalizability of different skills assessed in the oral certification examinations in Internal Medicine of the Royal College of Physicians and Surgeons of Canada. Assessments from the 1992 examination were examined prospectively to determine (i) inter-rater reliability, (ii) correlation fro...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1996.tb00718.x

    authors: Turnbull J,Danoff D,Norman G

    更新日期:1996-01-01 00:00:00

  • Thinking critically about critical thinking: ability, disposition or both?

    abstract:OBJECTIVES:The objectives of this study were to determine the extent to which clinician-educators agree on definitions of critical thinking and to determine whether their descriptions of critical thinking in clinical practice are consistent with these definitions. METHODS:Ninety-seven medical educators at five medical...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03910.x

    authors: Krupat E,Sprague JM,Wolpaw D,Haidet P,Hatem D,O'Brien B

    更新日期:2011-06-01 00:00:00

  • A study of a multi-source feedback system for international medical graduates holding defined licences.

    abstract:OBJECTIVE:To develop and assess the feasibility and psychometric properties of multi-source feedback questionnaires to monitor international medical graduates practising in Canada under 'defined' licences. METHOD:Four questionnaires (patient, co-worker, colleague and self) were developed and administered in 2 phases t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02410.x

    authors: Lockyer J,Blackmore D,Fidler H,Crutcher R,Salte B,Shaw K,Ward B,Wolfish N

    更新日期:2006-04-01 00:00:00

  • Resuscitating paediatric induction: an action research approach.

    abstract:OBJECTIVES:To establish teaching objectives, methods and assessment for a paediatric induction programme. DESIGN:Action research over a 2-year period. PARTICIPANTS:88 doctors from three hospitals. MAIN OUTCOME MEASURES:These were end-of-course evaluations, using Likert scales, and free comments; independent evaluati...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2001.00982.x

    authors: Melville C,Wall D,Samuels M

    更新日期:2001-08-01 00:00:00

  • Advanced training in general practice in the UK for overseas postgraduates.

    abstract::The strengths of general practice in the UK as a training environment for overseas doctors intending to implement the World Health Organization strategy 'Health for All by the Year 2000' in primary care are identified. A course of advanced training for teachers and administrators of primary care is described and evalu...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00027.x

    authors: al-Bashir M,Bundred PE,Stanley IM

    更新日期:1991-01-01 00:00:00

  • Motivations for studying dentistry among first-year dental students.

    abstract::Reasons for choosing dentistry as a profession were analysed among first-year dental students at the University of Toronto. The motivations of various sub-groups were also examined. It was found that an extrinsic motivation, financial rewards, was the most widespread, although the other widely chosen motivations refer...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1977.tb00578.x

    authors: Cohen R,Coburn D

    更新日期:1977-03-01 00:00:00

  • Characteristics of graduating medical students who were matched and unmatched to hospital training posts.

    abstract::The purpose of this paper is to examine similarities and differences between graduating medical students who do and do not match through the National Internship and Resident Matching Programme (NIRMP). Data from graduates of 3- and 4-year undergraduate curricula were examined separately. A two way analysis of variance...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1979.tb01530.x

    authors: Garrard J

    更新日期:1979-09-01 00:00:00

  • Responses to non-emergency questions in rural medicine: their usefulness to practice decisions.

    abstract::This study reports the nature of non-emergency, day-to-day practice-related questions which arose in rural practice and were phoned in to a medical information system (MIS). The usefulness of these questions, and their responses, to clinical decision-making is outlined. Sixty-seven practitioners from 10 rural communit...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00057.x

    authors: Jennett PA,Kishinevsky M,Parboosingh IT,Lockyer JM,Maes WR

    更新日期:1991-05-01 00:00:00

  • Management of somatic presentations of psychiatric illness in general medical settings: evaluation of a new training course for general practitioners.

    abstract::An improved teaching package is described which aims to help general practice trainees manage somatized presentations of psychological distress. The package comprises a training videotape in which a reattribution model is demonstrated, with material for role-play of new skills and small-group video feedback of consult...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1992.tb00139.x

    authors: Kaaya S,Goldberg D,Gask L

    更新日期:1992-03-01 00:00:00

  • A solution to the cueing effects of multiple choice questions: the Un-Q format.

    abstract::Although the cueing effects inherent in conventional multiple choice questions (MCQs) present serious limitations, this format continues to dominate testing programmes. The present study was undertaken to estimate the effects of cueing when MCQs are used to test medical students, and to evaluate the reliability, valid...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00284.x

    authors: Veloski JJ,Rabinowitz HK,Robeson MR

    更新日期:1993-07-01 00:00:00

  • Using standardised students in faculty development workshops to improve clinical teaching skills.

    abstract:PURPOSE:We describe the use of standardised students (SSs) in interdisciplinary faculty development programmes to improve clinical teaching skills. Standardised students are actual health professions students who are trained to portray a prototypical teaching challenge consistently across many encounters with different...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01556.x

    authors: Gelula MH,Yudkowsky R

    更新日期:2003-07-01 00:00:00

  • Educational supervisors evaluate the preparedness of graduates from a reformed UK curriculum to work as pre-registration house officers (PRHOs): a qualitative study.

    abstract:INTRODUCTION:In 1996 the University of Liverpool introduced an integrated problem-based learning (PBL) medical curriculum incorporating the recommendations of Tomorrow's Doctors. This paper investigates whether the PRHO (pre-registration house officer) educational supervisors who supervise Liverpool graduates believe t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02563.x

    authors: Watmough S,Taylor D,Garden A

    更新日期:2006-10-01 00:00:00

  • Medical faculty as humanistic physicians and teachers: the perceptions of students at innovative and traditional medical schools.

    abstract:BACKGROUND AND OBJECTIVES:The training of caring physicians represents an important goal of medical education. Little is known however, on whether medical faculty constitute good role models for teaching humanistic skills to medical students. In this study, we examined to what extent medical students at innovative and ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.00543.x

    authors: Maheux B,Beaudoin C,Berkson L,Côté L,Des Marchais J,Jean P

    更新日期:2000-08-01 00:00:00

  • Evaluation of teaching on interpersonal interactions.

    abstract::In 1978, the second-year pre-clinical Behavioural Sciences course at Monash University Medical School was restructured to improve monitoring of, and feedback on, the development of interpersonal relationships between individual students and individual old age pensioners they were studying. Results indicate that integr...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02314.x

    authors: Jones KV,Hornblow AR,Tiller JW

    更新日期:1981-01-01 00:00:00

  • Career preferences of graduate and non-graduate entrants to medical schools in the UK.

    abstract:OBJECTIVE:Recent UK policy has been to increase substantially the number of graduate entrants to medical schools. Our aim was to study whether graduate and non-graduate entrants have different long-term career preferences. METHODS:We conducted postal questionnaire surveys of medical qualifiers from all UK medical scho...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2007.02706.x

    authors: Goldacre MJ,Davidson JM,Lambert TW

    更新日期:2007-04-01 00:00:00

  • Computer analysis of the student log diary: an aid in the teaching of general practice and family medicine.

    abstract::At the University of Queensland all medical students in their fifth year rotate through a 2-week attachment to a general practitioner tutor as part of the course in community practice. As a means of learning from this experience each student records information in a log diary on seventy-five consecutive patients seen,...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1984.tb00976.x

    authors: Munro JG

    更新日期:1984-03-01 00:00:00