Cheating in OSCEs: The Impact of Simulated Security Breaches on OSCE Performance.

Abstract:

:Construct: Valid score interpretation is important for constructs in performance assessments such as objective structured clinical examinations (OSCEs). An OSCE is a type of performance assessment in which a series of standardized patients interact with the student or candidate who is scored by either the standardized patient or a physician examiner. BACKGROUND:In high-stakes examinations, test security is an important issue. Students accessing unauthorized test materials can create an unfair advantage and lead to examination scores that do not reflect students' true ability level. The purpose of this study was to assess the impact of various simulated security breaches on OSCE scores. APPROACH:Seventy-six 3rd-year medical students participated in an 8-station OSCE and were randomized to either a control group or to 1 of 2 experimental conditions simulating test security breaches: station topic (i.e., providing a list of station topics prior to the examination) or egregious security breach (i.e., providing detailed content information prior to the examination). Overall total scores were compared for the 3 groups using both a one-way between-subjects analysis of variance and a repeated measure analysis of variance to compare the checklist, rating scales, and oral question subscores across the three conditions. RESULTS:Overall total scores were highest for the egregious security breach condition (81.8%), followed by the station topic condition (73.6%), and they were lowest for the control group (67.4%). This trend was also found with checklist subscores only (79.1%, 64.9%, and 60.3%, respectively for the security breach, station topic, and control conditions). Rating scale subscores were higher for both the station topic and egregious security breach conditions compared to the control group (82.6%, 83.1%, and 77.6%, respectively). Oral question subscores were significantly higher for the egregious security breach condition (88.8%) followed by the station topic condition (64.3%), and they were the lowest for the control group (48.6%). CONCLUSIONS:This simulation of different OSCE security breaches demonstrated that student performance is greatly advantaged by having prior access to test materials. This has important implications for medical educators as they develop policies and procedures regarding the safeguarding and reuse of test content.

journal_name

Teach Learn Med

authors

Gotzmann A,De Champlain A,Homayra F,Fotheringham A,de Vries I,Forgie M,Pugh D

doi

10.1080/10401334.2016.1202832

subject

Has Abstract

pub_date

2017-01-01 00:00:00

pages

52-58

issue

1

eissn

1040-1334

issn

1532-8015

journal_volume

29

pub_type

杂志文章,随机对照试验
  • Increasing Medical Students' Confidence in Procedural Skills Using a Junior Doctor-Delivered Bedside Supervision Program.

    abstract:PROBLEM:Clinical procedural skills are formally taught to medical students in clinical skills centers using mannequins. Exposure to procedural skills involving patients and opportunities to practice under the supervision of doctors are limited. INTERVENTION:A bedside supervision program was piloted at a district gener...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1077130

    authors: Mughal Z,Noory S

    更新日期:2015-01-01 00:00:00

  • Pimping: perspectives of 4th year medical students.

    abstract:BACKGROUND:A well-known phenomenon among U.S. medical students known as pimping, or the pedagogical device of questioning students in the clinical setting, receives virtually no attention in medical literature. PURPOSE:Identifying 4th-year medical students' relevant knowledge and attitudes about pimping may help educa...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1702_14

    authors: Wear D,Kokinova M,Keck-McNulty C,Aultman J

    更新日期:2005-04-01 00:00:00

  • Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

    abstract:UNLABELLED:CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. BACKGROUND:The objective structured clinical examination (OSCE) was established for valid...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1044749

    authors: Yousuf N,Violato C,Zuberi RW

    更新日期:2015-01-01 00:00:00

  • Attending Emergency Physicians' Perceptions of a Programmatic Workplace-Based Assessment System: The McMaster Modular Assessment Program (McMAP).

    abstract::Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA sys...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1574581

    authors: Acai A,Li SA,Sherbino J,Chan TM

    更新日期:2019-08-01 00:00:00

  • The Feasibility of Longitudinal Patient Contacts in a Large Medical School.

    abstract:PROBLEM:Longitudinal patient contacts are being implemented worldwide as a way to enhance a patient-centered orientation among medical students. In large medical schools, longitudinal integrated clerkships may not be feasible, so other ways must be sought to expose students to prolonged contact with patients. INTERVEN...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2018.1524330

    authors: Mol SS,Chen HC,Steerneman AH,de Groot E,Zwart DL

    更新日期:2019-04-01 00:00:00

  • Benefits of testable concept maps for learning about pathogenesis of disease.

    abstract:BACKGROUND:Concept maps can assist learning by integrating new information with existing cognitive structure to facilitate meaningful understanding. The benefits of testable concept maps to illustrate cause-and-effect sequences in the pathogenesis of disease have not yet been determined. PURPOSE:A controlled trial was...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.561700

    authors: Kumar S,Dee F,Kumar R,Velan G

    更新日期:2011-04-01 00:00:00

  • Evaluation of the University of Virginia Leadership in Academic Medicine Program.

    abstract:BACKGROUND:Developing effective transformational leaders is essential for a diverse and complex academic medical system. The purpose of this study is to elicit faculty perspectives on their leadership skills before and after participation in a Leadership in Academic Medicine (LAM) Program. SUMMARY:The two-part study c...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.611773

    authors: Sanfey H,Harris I,Pollart S,Schwartz A

    更新日期:2011-10-01 00:00:00

  • Alliance for clinical education perspective paper: recommendations for redesigning the "final year" of medical school.

    abstract:BACKGROUND:Although medical school typically lasts 4 years, little attention has been devoted to the structure of the educational experience that takes place during the final year of medical school. SUMMARY:In this perspectives paper, we outline goals for the 4th year of medical school to facilitate a transition from ...

    journal_title:Teaching and learning in medicine

    pub_type: 社论

    doi:10.1080/10401334.2014.945027

    authors: Reddy ST,Chao J,Carter JL,Drucker R,Katz NT,Nesbit R,Roman B,Wallenstein J,Beck GL

    更新日期:2014-01-01 00:00:00

  • Outcomes of a teaching scholars program to promote leadership in faculty development.

    abstract:BACKGROUND:Provision of adequate opportunities for faculty to receive training in teaching skills requires persons with faculty development expertise to provide this training. PURPOSE:In this study, we examined outcomes of a teaching scholars program (TSP) aimed at promoting leaders in faculty development in teaching ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1703_8

    authors: Rosenbaum ME,Lenoch S,Ferguson KJ

    更新日期:2005-07-01 00:00:00

  • Seeing Is Believing: Evaluating a Point-of-Care Ultrasound Curriculum for 1st-Year Medical Students.

    abstract:PROBLEM:Point-of-care ultrasound has been a novel addition to undergraduate medical education at a few medical schools. The impact is not fully understood, and few rigorous assessments of educational outcomes exist. This study assessed the impact of a point-of-care ultrasound curriculum on image acquisition, interpreta...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1172012

    authors: Nelson BP,Hojsak J,Dei Rossi E,Karani R,Narula J

    更新日期:2017-01-01 00:00:00

  • Authorship Order in Medical Education Publications: In Search of Practical Guidance for the Community.

    abstract::Phenomenon: With scholarly collaborations come questions about the order of authorship. Authorship order is an important consideration because it often used as an indicator of seniority, expertise, leadership, and scholarly productivity. As a result, authorship order factors into decisions about hiring, salary, resour...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2018.1533836

    authors: Mavis B,Durning SJ,Uijtdehaage S

    更新日期:2019-06-01 00:00:00

  • A longitudinal investigation of medical student attitudes toward the medically indigent.

    abstract:BACKGROUND:Studies have shown that medical student attitudes decline as students progress through school. Controversy persists about the meaning and generalizability of these findings because studies have not been longitudinal and many were conducted prior to an influx of female students. Much of medical education occu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm0904_2

    authors: Crandall SJ,Volk RJ,Cacy D

    更新日期:1997-01-01 00:00:00

  • Refugee Health Curriculum in Undergraduate Medical Education (UME): A Scoping Review.

    abstract::Phenomenon: An increasing number of refugees in recent years has led to changes in healthcare delivery. Historically, health care providers did not receive systematic and longitudinal training in refugee health. There is increasing interest among educators in developing educational opportunities for medical students t...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2020.1779071

    authors: Rashid M,Cervantes AD,Goez H

    更新日期:2020-10-01 00:00:00

  • In Brief: Validity of Case Summaries in Written Examinations of Clinical Reasoning.

    abstract::Construct: The purpose of this study was to provide initial evidence of the validity of written case summaries as assessments of clinical problem representation in a classroom setting. BACKGROUND:To solve clinical problems, clinicians must gain a clear representation of the issues. In the clinical setting, oral case ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1190730

    authors: Dory V,Gagnon R,Charlin B,Vanpee D,Leconte S,Duyver C,Young M,Loye N

    更新日期:2016-10-01 00:00:00

  • Effect of year in school on medical students' perceptions evaluated with the Cognitive Behavior Survey, Attitudes Toward Social Issues in Medicine Survey, and Learning Environment Questionnaire.

    abstract:BACKGROUND:We administered selected scales from the Cognitive Behavior Survey, Attitudes Toward Social Issues in Medicine survey, and Learning Environment Questionnaire. We gathered data from other medical schools to put our results into context. PURPOSE:To present results on these scales from our own and other medica...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1604_6

    authors: Schwartz PL,Loten EG

    更新日期:2004-10-01 00:00:00

  • The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship.

    abstract:BACKGROUND:A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been st...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1401_3

    authors: Battistone MJ,Milne C,Sande MA,Pangaro LN,Hemmer PA,Shomaker TS

    更新日期:2002-01-01 00:00:00

  • Resident performance on the in-training and board examinations in obstetrics and gynecology: implications for the ACGME Outcome Project.

    abstract:BACKGROUND:The Accreditation Council on Graduate Medical Education (ACGME) Outcomes Project has endorsed the in-training examination (ITE) as an example of a multiple-choice question examination that is a valid measure of a resident's attainment of medical knowledge. An outcome measure for performance on the ITE would ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330801991642

    authors: Withiam-Leitch M,Olawaiye A

    更新日期:2008-04-01 00:00:00

  • The patient safety OSCE for PGY-1 residents: a centralized response to the challenge of culture change.

    abstract:BACKGROUND:Accreditation and Institute of Medicine mandates require retooling of graduate medical education curriculum and assessment processes. This Objective Structured Clinical Exam (OSCE) focused on patient safety-specific skills important to stakeholders from multiple institutions. PURPOSES:A 10-station OSCE was ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330802573837

    authors: Wagner DP,Hoppe RB,Lee CP

    更新日期:2009-01-01 00:00:00

  • Building Collaboration: A Scoping Review of Cultural Competency and Safety Education and Training for Healthcare Students and Professionals in Canada.

    abstract::Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. APPROACH:Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal comm...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,评审

    doi:10.1080/10401334.2016.1234960

    authors: Guerra O,Kurtz D

    更新日期:2017-04-01 00:00:00

  • Two techniques for teaching the estimation of prior probabilities.

    abstract:BACKGROUND:Studies indicate that practicing clinicians do not employ quantitative techniques in diagnosis. If evidence-based approaches to clinical care are to succeed, there is a need to develop pedagogical tools to introduce the relevant techniques in clinical medicine. DESCRIPTION:This article describes 2 heuristic...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1203_4

    authors: Upshur RE

    更新日期:2000-07-01 00:00:00

  • Trial use of the Personal Qualities Assessment (PQA) in the entrance examination of a Japanese medical university: similarities to the results in western countries.

    abstract:BACKGROUND:The Personal Qualities Assessment (PQA), developed by the University of Newcastle, Australia to assess the aptitude of future medical professionals, has been used in Western countries. PURPOSES:The objective was to investigate whether the PQA is appropriate for Japanese medical school applicants. METHODS:T...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.945029

    authors: Fukui Y,Noda S,Okada M,Mihara N,Kawakami Y,Bore M,Munro D,Powis D

    更新日期:2014-01-01 00:00:00

  • A comparison of faculty-led small group learning in combination with computer-based instruction versus computer-based instruction alone on identifying simulated pulmonary sounds.

    abstract:BACKGROUND:Computer-based learning has gained widespread acceptance in medical curricula, but can it replace faculty-led teaching. PURPOSE:To investigate the effectiveness of independent computer-based learning of pulmonary auscultation alone and in combination with faculty-led teaching. METHODS:The first method invo...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1601_6

    authors: Karnath BM,Das Carlo M,Holden MD

    更新日期:2004-01-01 00:00:00

  • Validation and use of an instrument to measure the learning environment as perceived by medical students.

    abstract:BACKGROUND:Aiming to inform curriculum changes in medical school, we developed, administered, and validated a 31-question survey to measure the learning environment as perceived by medical students. DESCRIPTION:We administered the survey annually in 4 medical school classes in a Southeastern medical school from May 19...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1204_7

    authors: Pololi L,Price J

    更新日期:2000-10-01 00:00:00

  • The Influence of Students' Perceptions of Learning Environment on Coping with Academic Challenges: A Structural Equation Modeling Study.

    abstract::Theory: Self-compassion has been identified as a promising interventional target enabling medical learners to respond effectively to stressors and challenges of medical training. Determining factors in the learning environment that support self-compassion is critical for developing such interventions. What is already ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1667241

    authors: Rashid M,Guo Q,Babenko O

    更新日期:2020-04-01 00:00:00

  • An Institutional Approach to Fostering Inclusion and Addressing Racial Bias: Implications for Diversity in Academic Medicine.

    abstract::Issue: While an increasingly diverse workforce of clinicians, researchers, and educators will be needed to address the nation's future healthcare challenges, underrepresented in medicine (UIM) perspectives remain relatively absent from academic medicine. Evidence: Prior studies have identified differential experiences...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1670665

    authors: Diaz T,Navarro JR,Chen EH

    更新日期:2020-01-01 00:00:00

  • A "medical student practice profile" as the foundation for a case-based curriculum revision.

    abstract:BACKGROUND:In 2001, the Keck School of Medicine of the University of Southern California initiated a major curriculum reform with fully integrated teaching of the basic sciences. DESCRIPTION:The new curriculum integrated a set of selected clinical cases called the student practice profile (SPP). The SPP cases were des...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.512834

    authors: Abbott A,Sullivan M,Nyquist J,Mylona E,Taylor C

    更新日期:2010-10-01 00:00:00

  • Medical education and the arts: a survey of U.S. medical schools.

    abstract:BACKGROUND:Although the literary arts initiated the movement to include the humanities in medical education, little is known about the incorporation of other art forms. PURPOSE:A study was designed to determine the variety of arts-related activities in U.S. medical schools. METHODS:Questionnaires were mailed twice to...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1404_11

    authors: Strickland MA,Gambala CT,Rodenhauser P

    更新日期:2002-10-01 00:00:00

  • Assessing residents' competency in care management: report of a consensus conference.

    abstract:BACKGROUND:Residency programs must prepare physicians to practice in the current health care environment. This mandate is reflected in 3 of the 6 competency domains now required by the Accreditation Council for Graduate Medical Education: systems-based practice, interpersonal skills and communication, and practice-base...

    journal_title:Teaching and learning in medicine

    pub_type: 共识发展会议,杂志文章,评审

    doi:10.1207/s15328015tlm1601_16

    authors: Frohna JG,Kalet A,Kachur E,Zabar S,Cox M,Halpern R,Hewson MG,Yedidia MJ,Williams BC

    更新日期:2004-01-01 00:00:00

  • Competency in electrocardiogram interpretation among graduating medical students.

    abstract:BACKGROUND:The ability to accurately interpret electrocardiogram (ECG) abnormalities is a core competency for graduating medical students (GMS). Incorrect interpretation of ECG findings can result in adverse patient outcomes. To our knowledge, there has been no published study evaluating the level of competency in ECG ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.918882

    authors: Jablonover RS,Lundberg E,Zhang Y,Stagnaro-Green A

    更新日期:2014-01-01 00:00:00

  • Systems survivor: a program for house staff in systems-based practice.

    abstract:BACKGROUND:The Systems-Based Practice competency expanded the scope of graduate medical education. Innovative approaches are needed to teach this material. PURPOSE:We have designed and implemented a rotation in Systems-Based Practice focused on the interrelationships of patient care, clinical revenue, and the physicia...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701332201

    authors: Turley CB,Roach R,Marx M

    更新日期:2007-04-01 00:00:00