Examiners' Perceptions in Surgical Education: The Blind Spot in the Assessment of OSCEs.

Abstract:

PURPOSE OF THE ARTICLE:Interpreting objective structured clinical examination (OSCE) scores remains a challenging task.1 It remains unclear how examiners make a decision to score an OSCE the way they do. The examiners' thoughts and decision-making processes remain a hidden part of the OSCE assessment. One cannot assume that all examiners have a shared belief about what is important in an OSCE or what is the aim of an OSCE assessment. These differences are problematic, since they lead to students not getting the 'correct' score for their OSCE. MATERIALS AND METHODS:Using a qualitative case study design,2 this study aims to gain in-depth insight into examiners' perceptions of OSCEs and their role as an examiner. For this purpose, semi-structured interviews with OSCE observers (n = 6) were conducted. RESULTS AND CONCLUSIONS:The results show that the perception of examiners on the aim of OSCES and their motivation and task as examiner are crucial in understanding the differences among OSCE scores of examiners. Training and discussion among the examiners are needed to decrease the differences among the OSCE scores of examiners.

journal_name

J Surg Educ

authors

van der Want AC,Bloemendaal PM,van der Hage JA

doi

10.1016/j.jsurg.2020.07.024

subject

Has Abstract

pub_date

2020-08-17 00:00:00

eissn

1931-7204

issn

1878-7452

pii

S1931-7204(20)30258-0

pub_type

杂志文章
  • Skills in Open Surgery do not Predict Arthroscopic Skills in Medical Students.

    abstract:OBJECTIVE:Teaching of basic open surgical skills like skin closure has been well established in medical schools' surgical curricula. The same cannot be said for basic arthroscopic skills even though the importance of arthroscopic surgery in Orthopaedics has been well documented. The goal of this study was to evaluate t...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.01.001

    authors: Liem D,Plasger A,Gosheger G,Rickert C,Dedy N,Schorn D,Hauschild G

    更新日期:2020-01-01 00:00:00

  • A Randomized Prospective Blinded Study Evaluating the Effect of Music on Novice Surgical Trainees' Ability to Perform a Simulated Surgical Task.

    abstract:OBJECTIVE:To determine if playing music would affect novice surgical trainees' ability to perform a complex surgical task. BACKGROUND:The effect of music in the operating room (OR) is controversial. Some studies from the anesthesiology literature suggest that OR music is distracting and should be banned. Other nonblin...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.08.020

    authors: Shover A,Holloway J,Dauphine C,Benharash P,Xing H,Kansal N,Bowens N,Archie M,Kaji AH,de Virgilio C

    更新日期:2020-09-08 00:00:00

  • A Randomized Cross-Over Trial Focused on Clinical Breast Exam Skill Acquisition Using High Fidelity versus Low Fidelity Simulation Models in Rwanda.

    abstract:OBJECTIVE:Breast cancer incidence is rising for women in low and middle income country (LMIC)s. Growing the health care workforce trained in clinical breast exam (CBE) is critical to mitigating breast cancer globally. We developed a CBE simulation training course and determined whether training on a low-fidelity (LF) s...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.02.030

    authors: Murthy SS,Ntakiyiruta G,Ntirenganya F,Ingabire A,Defregger SK,Reznor G,Lipitz S,Troyan SL,Raza S,Dunnington G,Riviello R

    更新日期:2020-01-01 00:00:00

  • Outcomes registries: an untapped resource for use in surgical education.

    abstract:OBJECTIVE:To examine the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) for use in profiling the aggregated resident operative experience by postgraduate training year and to demonstrate the extent to which a surgical registry could be used to examine resident exposure to adverse...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.08.014

    authors: Hoffman RL,Bartlett EK,Medbery RL,Sakran JV,Morris JB,Kelz RR

    更新日期:2015-03-01 00:00:00

  • Levels of evidence have increased for musculoskeletal trauma questions on the orthopaedic in-training examination.

    abstract:OBJECTIVE:The purpose of this study was to determine if the levels of evidence for primary journal articles used as references for musculoskeletal trauma questions on the Orthopaedic In-Training Examination (OITE) have increased over a 15-year period. DESIGN:Basic science article. SETTING:Geisinger Medical Center (Da...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.10.005

    authors: Grandizio LC,Huston JC,Shim SS,Parenti JM,Graham J,Klena JC

    更新日期:2015-03-01 00:00:00

  • Communication Skills Training in Ophthalmology: Results of a Needs Assessment and Pilot Training Program.

    abstract:OBJECTIVE:To conduct a needs assessment to identify gaps in communication skills training in ophthalmology residency programs and to use these results to pilot a communication workshop that prepares residents for difficult conversations. DESIGN:A mixed-methods design was used to perform the needs assessment. A pre-and...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.08.011

    authors: Mishra A,Browning D,Haviland MJ,Jackson ML,Luff D,Meyer EC,Talcott K,Kloek CE

    更新日期:2018-01-01 00:00:00

  • Vessel Ligation Fundamentals: A Comparison of Technical Evaluations by Crowdsourced Nonclinical Personnel and Surgical Faculty.

    abstract:BACKGROUND:Evaluation of fundamental surgical skills is invaluable to the training of medical students and junior residents. This study assessed the effectiveness of crowdsourcing nonmedical personnel to evaluate technical proficiency at simulated vessel ligation. STUDY DESIGN:Fifteen videos were captured of participa...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.09.030

    authors: Hu Y,Jiang B,Kim H,Schroen AT,Smith PW,Rasmussen SK

    更新日期:2018-01-01 00:00:00

  • Training Effects of Visual Stroboscopic Impairment on Surgical Performance: A Randomized-Controlled Trial.

    abstract:OBJECTIVE:There have been numerous advances to accelerate and improve quality and dexterous proficiency of surgical training to meet the growing US demand of graduating surgeons. The authors aimed to investigate the learning effects of such limited visual input on the surgical proficiency in untrained novice surgeons. ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2018.07.018

    authors: Zavlin D,Chegireddy V,Nguyen-Lee JJ,Shih L,Nia AM,Friedman JD,Echo A

    更新日期:2019-01-01 00:00:00

  • A National Survey of Undergraduate Suture and Local Anesthetic Training in the United Kingdom.

    abstract:BACKGROUND:Suturing is a skill expected to be attained by all medical students on graduation, according to the General Medical Council's (GMC) Tomorrow's Doctors. There are no GMC recommendations for the amount of suture training required at medical school nor the level of competence to be achieved. This study examines...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.09.017

    authors: Rufai SR,Holland LC,Dimovska EO,Bing Chuo C,Tilley S,Ellis H

    更新日期:2016-03-01 00:00:00

  • What do surgical nurses know about surgical residents?

    abstract:OBJECTIVE:A fundamental premise of establishing collaborative relationships between residents and nurses is a basic understanding of the attributes of each group. The intent of this study was to determine what surgical nurses know about surgical residents. DESIGN:A piloted survey tool was administered to a cross-secti...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2009.08.001

    authors: Schlitzkus LL,Agle SC,McNally MM,Schenarts KD,Schenarts PJ

    更新日期:2009-11-01 00:00:00

  • The effect of a new surgery residency program on case volume and case complexity in a sub-Saharan African hospital.

    abstract:BACKGROUND:Improved access to surgical care could prevent a significant burden of disease and disability-adjusted life years, and workforce shortages are the biggest obstacle to surgical care. To address this shortage, a 5-year surgical residency program was established at Kamuzu Central Hospital (KCH) in July 2009. As...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.09.011

    authors: Kendig C,Tyson A,Young S,Mabedi C,Cairns B,Charles A

    更新日期:2015-07-01 00:00:00

  • Long-Term Impact of a Mission-Based Surgical Training Rotation on Plastic Surgery Capacity Building in Rwanda.

    abstract:OBJECTIVE:Short-term, high-volume surgical training experiences can lead to successful skills transfer and be an effective method of training surgical providers in low-resource settings. However, immediate skills acquisition does not guarantee long-term performance of surgical procedures by trainees. This study aims to...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2019.08.009

    authors: Munabi NCO,Durnwald L,Nagengast ES,Ntirenganya F,Magee Iii WP

    更新日期:2020-01-01 00:00:00

  • Case-based multimedia program enhances the maturation of surgical residents regarding the concepts of professionalism.

    abstract:INTRODUCTION:The Accreditation Council for Graduate Medical Education (ACGME) has mandated that surgical residencies incorporate formal curricula in each of the 6 competencies, including professionalism. A questionnaire study was developed by the authors that aimed (1) to measure the ability of surgical residents to de...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2007.04.002

    authors: Kumar AS,Shibru D,Bullard MK,Liu T,Harken AH

    更新日期:2007-07-01 00:00:00

  • Evaluation of Changes in Quality Improvement Knowledge Following a Formal Educational Curriculum Within a Statewide Learning Collaborative.

    abstract:OBJECTIVE:Our objectives were to (1) develop a curriculum based upon participants' needs, (2) evaluate baseline QI knowledge of the Illinois Surgical Quality Improvement Collaborative (ISQIC) members, and (3) evaluate the effectiveness of the educational curriculum. DESIGN:The Surgeon Champion (SC), Surgical Clinical ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.04.018

    authors: Berger ER,Kreutzer L,Halverson A,Yang AD,Reinhart S,Leary KJO,Williams MV,Bilimoria KY,Johnson JK,ISQIC Advisory Committee.

    更新日期:2020-01-01 00:00:00

  • The impact of a formal minimally invasive service on the resident's ability to achieve new ACGME guidelines for laparoscopy.

    abstract:PURPOSE:As laparoscopy continues to permeate general surgery, there is an increased need for residents to acquire advanced laparoscopic skills during a surgical training program. To underscore its importance, the Accreditation Council of Graduate Medical Education (ACGME) recently increased the requirements for laparos...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2007.06.013

    authors: McFadden CL,Cobb WS,Lokey JS,Cull DL,Smith DE,Taylor SM

    更新日期:2007-11-01 00:00:00

  • Impact of endovascular technique in vascular surgery training at a large university hospital in Brazil.

    abstract:OBJECTIVES:The aim of this study was to determine the impact of endovascular surgery versus open vascular technique training in a Brazilian teaching service. DESIGN:Cross-sectional study. SETTING:Hospital das Clinicas-Faculty of Medicine-University of Sao Paulo, a tertiary institutional hospital-Brazil. PARTICIPANTS...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.08.002

    authors: Puech-Leão P,Wolosker N,Zerati AE,Nascimento LD

    更新日期:2011-01-01 00:00:00

  • Development of the User Experience (UX) and Video Quality Evaluation (VQE) Instruments for Assessment of Intraoperative Video Capture Technology.

    abstract:OBJECTIVE:There exists a lack of technology to reliably and routinely capture high-quality video of open surgical procedures. To critically evaluate and compare new and existing technology solutions, we must have widely accepted evaluation criteria for intraoperative camera devices. The objective, therefore, was to dev...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.06.011

    authors: Saun TJ,Grantcharov TP

    更新日期:2021-01-01 00:00:00

  • Surgeons and Surgical Trainees Underestimate the Total Charges and Reimbursements Associated With Commonly Performed General Surgery Procedures✰.

    abstract:INTRODUCTION:Surgical care contributes significantly to the fiscal challenges facing the US health care system. Multiple studies have demonstrated surgeons' lack of awareness of the costs associated with individual portions of surgical care, namely operating room supplies. We sought to assess surgeon and trainee awaren...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.11.001

    authors: Paine AN,Krompf BL,Osler TM,Hebert JC

    更新日期:2019-01-01 00:00:00

  • Prevention training of wrong-site spine surgery.

    abstract:OBJECTIVE:Wrong-site surgery (WSS) is considered a sentinel event by the Joint Commission. The education of spine surgery fellows on WSS is unknown. Our objective was to evaluate North American spine surgery fellows' education, awareness, and experience with WSS. DESIGN:Observational survey study. SETTING:Spine surge...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.01.010

    authors: Mesfin A,Canham C,Okafor L

    更新日期:2015-07-01 00:00:00

  • Cadaveric Dissection vs Homemade Model: What is the Best Way to Teach Endoscopic Totally Extraperitoneal Inguinal Hernia Repair?

    abstract:BACKGROUND:Endoscopic totally extraperitoneal inguinal hernia repair (TEP-IHR) requires practice and training to perform well. We developed a simple, low-cost, inanimate model to teach surgical residents inguinal anatomy and the technique of mesh insertion for a safe, endoscopic TEP-IHR. The objective of this study was...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2017.09.003

    authors: AlJamal Y,Buckarma E,Ruparel R,Allen S,Farley D

    更新日期:2018-01-01 00:00:00

  • Ear Disease Knowledge and Otoscopy Skills Transfer to Real Patients: A Randomized Controlled Trial.

    abstract:OBJECTIVE:To determine which teaching method-otoscopy simulation (OS), web-based module (WM), or standard classroom instruction (SI)-produced greater translation of knowledge and otoscopy examination skills to real patients. DESIGN:In a prospective randomized controlled nonclinical trial, medical students were randomi...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2017.12.011

    authors: Wu V,Sattar J,Cheon S,Beyea JA

    更新日期:2018-01-01 00:00:00

  • Surgical Resident Radiation Knowledge, Attitudes, Practices, and Exposures.

    abstract:OBJECTIVE:To investigate the level of ionizing radiation exposure among surgical residents and to evaluate resident knowledge, attitudes, and practices regarding exposures. DESIGN:An observational study was conducted using radiation exposure data for surgical residents who wore film badge dosimeters. A cross-sectional...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.05.002

    authors: Sidwell RA,Smith HL,Halsey JP,McFarlane MJ

    更新日期:2016-01-01 00:00:00

  • Practical Bioethics for the Humanitarian Surgeon: The Development, Implementation and Assessment of an Ethics Curriculum for Residents Participating in Humanitarian Missions.

    abstract:BACKGROUND:Humanitarian surgeons face many ethical challenges. Despite increasing resident participation during humanitarian activities, minimal literature exists describing premission ethics training. METHODS:A systematic literature review was conducted to identify publications on humanitarian surgery. A 3-tiered rev...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2019.11.015

    authors: McDonald VS,Ignacio RC,Kuettel MA,Schlitzkus LL,Sullivan ME,Tadlock MD

    更新日期:2020-01-01 00:00:00

  • Effect of petroleum gauze packing on the mechanical properties of suture materials.

    abstract:OBJECTIVE:To test the tensile properties of knotted suture made of 4 different suture materials and exposed to petroleum gauze. STUDY DESIGN:We tested the tensile strength of United States Pharmacopeia size 0-0 gauge polydioxanone, polyglyconate, glycolide/lactide copolymer, and silk when exposed to petroleum packing ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.06.012

    authors: Muffly TM,Couri B,Edwards A,Kow N,Bonham AJ,Paraíso MF

    更新日期:2012-01-01 00:00:00

  • The Fellowship Effect: Does Surgical Subspecialty Training Affect Pediatric Surgery Case Volume?

    abstract:PURPOSE:The Accreditation Council for Graduate Medical Education (ACGME) monitors fellow case numbers. Previous literature has shown new fellowships detrimentally affecting general surgery residency case numbers. We hypothesize that an increase in pediatric otolaryngology and pediatric urology fellowships would decreas...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2021.01.004

    authors: Esparaz JR,Mathis MS,Russell RT

    更新日期:2021-01-19 00:00:00

  • Academic differences among male and female candidates applying for obstetrics and gynecology residency: the experience of one program.

    abstract:OBJECTIVE:The purpose of this study was to identify academic differences between male and female candidates applying to our obstetrics and gynecology (OBGYN) residency. METHODS:We reviewed the Electronic Residency Application Service applications of candidates applying to our residency program from 2005 to 2009. Acade...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2013.03.012

    authors: Brandt JS,Kramer SE,Chasen ST

    更新日期:2013-07-01 00:00:00

  • Thoughts of Quitting General Surgery Residency: Factors in Canada.

    abstract:OBJECTIVE:Attrition rates in general surgery training are higher than other surgical disciplines. We sought to determine the prevalence with which Canadian general surgery residents consider leaving their training and the contributing factors. DESIGN, SETTING, AND PARTICIPANTS:An anonymous survey was administered to a...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.11.008

    authors: Ginther DN,Dattani S,Miller S,Hayes P

    更新日期:2016-05-01 00:00:00

  • Variation in faculty evaluations of clerkship students attributable to surgical service.

    abstract:OBJECTIVE:The purpose of this study was to determine whether students' performance evaluations by faculty were influenced by the clinical service on which the student was evaluated. METHODS:Third-year medical students spent 8 weeks rotating on 3 (or 2) surgical services. Typically, students rotate on one 4-week genera...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.03.003

    authors: Plymale MA,French J,Donnelly MB,Iocono J,Pulito AR

    更新日期:2010-05-01 00:00:00

  • Developing a comprehensive resident education evaluation system in the era of milestone assessment.

    abstract:OBJECTIVES:In an effort to move training programs toward competency-based education, the Accreditation Council for Graduate Medical Education (ACGME) introduced the Next Accreditation System (NAS), which organizes specific milestones regarding resident skills, knowledge, and abilities along a continuum. In order to fos...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.12.007

    authors: Gardner AK,Scott DJ,Choti MA,Mansour JC

    更新日期:2015-07-01 00:00:00

  • Assuring the research competence of orthopedic graduates.

    abstract:OBJECTIVES:To assure that orthopaedic residents have the knowledge needed to critically appraise the medical/surgical literature and the skills needed to design and conduct musculoskeletal and orthopaedic research. SETTING:Residency program of the Department of Orthopaedic Surgery, Sports Medicine and Rehabilitation a...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.04.002

    authors: Konstantakos EK,Laughlin RT,Markert RJ,Crosby LA

    更新日期:2010-05-01 00:00:00