The Usefulness of Procedure-Based Assessments in Postgraduate Surgical Training Within the Intercollegiate Surgical Curriculum Programme; A Scoping Review.

Abstract:

BACKGROUND:Workplace-based assessments are a mandatory component of postgraduate surgical training within the United Kingdom and Ireland. Procedure-based assessments (PBAs) and direct observation of practical skills (DOPS) are integrated within the Intercollegiate Surgical Curriculum Programme online platform and aim to assess trainees' performance in practical surgical skills; no reviews have previously investigated their educational usefulness in postgraduate surgical training. Usefulness was defined by the 5 criteria detailed by Van der Vleuten for determining the usefulness of educational assessment tools: validity; reliability; acceptability to learners and faculty; impact on future learning and practice; and costs (to the individual trainee, the institution, and society at large). METHODS:Scoping review methodology was used to examine the educational usefulness of PBA and DOPS assessments in postgraduate surgical training. A literature search of Ovid MEDLINE, EMBASE, and Web of Science databases was undertaken. The preferred reporting items for systematic reviews and meta-analyses standards for systematic reviews were followed. RESULTS/DISCUSSION:Ten studies met the inclusion criteria, with 1368 trainees and trainers included. A variety of study methodologies were identified. Although there is some evidence for the validity and reliability of both PBA and DOPS assessments, further work is required in both these domains including on the number of assessments required to ensure satisfactory reliability. This is a research priority, especially if these assessments become a component of summative assessment of trainee competency. The literature indicates that these assessments are generally acceptable to learners and faculty but their acceptability is negatively impacted upon by uncertainty over whether these assessments constitute a formative or summative assessment of trainees. With regards to costs, correct use of PBAs does require allocated time and resources to ensure their correct use and this must be factored into trainer and trainee job plans. CONCLUSIONS:PBA and DOPS assessments are educationally useful tools in postgraduate surgical training. Further research is required to determine the number of assessments required to ensure adequate reliability. To ensure the educational benefits of these assessments are not diminished, clarification from postgraduate training schemes is required regarding whether these assessments an assessment for learning or an assessment of learning.

journal_name

J Surg Educ

authors

Mayne A,Wilson L,Kennedy N

doi

10.1016/j.jsurg.2020.03.005

subject

Has Abstract

pub_date

2020-01-01 00:00:00

pages

1227-1235

issue

5

eissn

1931-7204

issn

1878-7452

pii

S1931-7204(20)30071-4

journal_volume

77

pub_type

杂志文章
  • Resident Self-Entrustment and Expectations of Autonomy: OB > GYN?

    abstract:INTRODUCTION:Entrustment is a key component connecting to resident preparedness for surgical practice in the operating room (OR). Residents' self-entrustment of their surgical competencies closely associates with their OR training experience and granted autonomy. Some recent studies have investigated how attending surg...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.07.019

    authors: Smith BQ,Woelfel I,Salani R,Harzman A,Chen X

    更新日期:2021-01-01 00:00:00

  • Isolated congenital agenesis of the gallbladder and cystic duct: report of a case.

    abstract::Congenital agenesis of the gallbladder and cystic duct represents a rare anomaly of the biliary system. It likely results from an embryologic mishap in the development of the hepatobiliary bud and can occur with other associated malformations. We report the case of congenital absence of the gallbladder and cystic duct...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2012.07.001

    authors: Joliat GR,Shubert CR,Farley DR

    更新日期:2013-01-01 00:00:00

  • Initial performance of a modified milestones global evaluation tool for semiannual evaluation of residents by faculty.

    abstract:OBJECTIVES:To determine whether faculty could successfully evaluate residents using a competency-based modified Milestones global evaluation tool. DESIGN:A program's leadership team modified a draft Surgery Milestones Working Group summative global assessment instrument into a modified Milestones tool (MMT) for local ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,评审

    doi:10.1016/j.jsurg.2013.08.004

    authors: Borman KR,Augustine R,Leibrandt T,Pezzi CM,Kukora JS

    更新日期:2013-11-01 00:00:00

  • Utility and relevance of diagnostic peritoneal lavage in trauma education.

    abstract:OBJECTIVES:During the last 2 decades, the advent of new technologies in trauma patient care may have resulted in a decreased number of diagnostic peritoneal lavage (DPL) evaluations. In this study, it is hypothesized that fewer DPL are being performed at a midwestern trauma center. Such negative trends may make the inc...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.02.003

    authors: Rhodes CM,Smith HL,Sidwell RA

    更新日期:2011-07-01 00:00:00

  • An experience in surgical anatomy to provide first-year medical students with an early exposure to general surgery: a pilot study.

    abstract:INTRODUCTION:The level of interest expressed by medical students toward the field of general surgery has decreased. The aims of this study were to (1) describe an educational scheme in surgical anatomy that increases interaction between practicing surgeons and first-year medical students and (2) garner feedback and opi...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2009.04.005

    authors: Are C,Stoddard HA,Northam LC,Thompson JS,Todd GL

    更新日期:2009-07-01 00:00:00

  • Nomogram to predict successful placement in surgical subspecialty fellowships using applicant characteristics.

    abstract:PURPOSE:The purpose of the study was to develop a model that predicts an individual applicant's probability of successful placement into a surgical subspecialty fellowship program. METHODS:Candidates who applied to surgical fellowships during a 3-year period were identified in a set of databases that included the elec...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.11.006

    authors: Muffly TM,Barber MD,Karafa MT,Kattan MW,Shniter A,Jelovsek JE

    更新日期:2012-05-01 00:00:00

  • Surgical skills acquisition among left-handed trainees-true inferiority or unfair assessment: a preliminary study.

    abstract:INTRODUCTION:Studies involving the formal assessment of surgical skills have often reported inferior abilities among left-handed surgical trainees (LHT). Most surgical training curricula and assessment methods, however, are inherently geared toward right-handed trainees (RHT); potentially placing LHT at both a training...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2012.09.007

    authors: Lee JY,Mucksavage P,McDougall EM

    更新日期:2013-03-01 00:00:00

  • National Incidence of Medication Error in Surgical Patients Before and After Accreditation Council for Graduate Medical Education Duty-Hour Reform.

    abstract:OBJECTIVE:The Accreditation Council for Graduate Medical Education (ACGME) established duty-hour regulations for accredited residency programs on July 1, 2003. It is unclear what changes occurred in the national incidence of medication errors in surgical patients before and after ACGME regulations. DESIGN:Patient and ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.05.013

    authors: Vadera S,Griffith SD,Rosenbaum BP,Chan AY,Thompson NR,Kshettry VR,Kelly ML,Weil RJ,Bingaman W,Jehi L

    更新日期:2015-11-01 00:00:00

  • Analysis of Instrument Motion and the Impact of Residency Level and Concurrent Distraction on Laparoscopic Skills.

    abstract:OBJECTIVE:Using a laparoscopic box trainer fitted with motion analysis trackers and software, we aim to identify differences between junior and senior residents performing the peg transfer task, and the impact of a distracting secondary task on performance. DESIGN:General surgery residents were asked to perform the la...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.07.012

    authors: Pastewski J,Baker D,Somerset A,Leonard K,Azzie G,Roach VA,Ziegler K,Brahmamdam P

    更新日期:2021-01-01 00:00:00

  • Cadaveric Dissection vs Homemade Model: What is the Best Way to Teach Endoscopic Totally Extraperitoneal Inguinal Hernia Repair?

    abstract:BACKGROUND:Endoscopic totally extraperitoneal inguinal hernia repair (TEP-IHR) requires practice and training to perform well. We developed a simple, low-cost, inanimate model to teach surgical residents inguinal anatomy and the technique of mesh insertion for a safe, endoscopic TEP-IHR. The objective of this study was...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2017.09.003

    authors: AlJamal Y,Buckarma E,Ruparel R,Allen S,Farley D

    更新日期:2018-01-01 00:00:00

  • Fundamentals of Laparoscopic Surgery manual test: is videotaped performance assessment an option?

    abstract:BACKGROUND:In efforts to maintain standards required to evaluate the high-stakes assessment, Society of American Gastrointestinal and Endoscopic Surgeons Fundamentals of Laparoscopic Surgery (FLS) requires all new proctors to complete the train-the-proctor workshop. As the pool of FLS proctors expands, new methods to s...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.07.008

    authors: Rooney DM,Brissman IC,Finks JF,Gauger PG

    更新日期:2015-01-01 00:00:00

  • Global Health Education for Medical Students: When Learning Objectives Include Research.

    abstract:BACKGROUND:The Luke Commission, a provider of comprehensive mobile health outreach in rural Swaziland, focuses on human immunodeficiency virus testing and prevention, including the performance of over 100 circumcisions weekly. Educational objectives for medical student global health electives are essential. Learning re...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.09.015

    authors: Bales AM,Oddo AR,Dennis DJ,Siska RC,VanderWal E,VanderWal H,Dlamini N,Markert RJ,McCarthy MC

    更新日期:2018-01-01 00:00:00

  • The Surgery Fellow's Education Workshop: A Pilot Study to Determine the Feasibility of Training Senior Learners to Teach in the Operating Room.

    abstract:BACKGROUND:In 2013, we developed an education workshop to enhance the teaching skills of surgical fellows. We sought to investigate the feasibility of the monthly educational workshop format and its effect on participant teaching skills. STUDY DESIGN:Surgical and medical education faculty created a broadly applicable ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.02.001

    authors: Ambani SN,Lypson ML,Englesbe MJ,Santen S,Kasten S,Mullan P,Lee CT

    更新日期:2016-07-01 00:00:00

  • The Fellowship Effect: Does Surgical Subspecialty Training Affect Pediatric Surgery Case Volume?

    abstract:PURPOSE:The Accreditation Council for Graduate Medical Education (ACGME) monitors fellow case numbers. Previous literature has shown new fellowships detrimentally affecting general surgery residency case numbers. We hypothesize that an increase in pediatric otolaryngology and pediatric urology fellowships would decreas...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2021.01.004

    authors: Esparaz JR,Mathis MS,Russell RT

    更新日期:2021-01-19 00:00:00

  • Predictors of Undergraduate and Postgraduate Clinical Performance: A Longitudinal Cohort Study.

    abstract:OBJECTIVE:Though many medical schools applied various admission criteria in the selection process, the evidence of using those criteria is unclear. This study examined the predictive validity of each admission criterion for student competency. DESIGN, SETTING, AND PARTICIPANTS:We conducted a prospective cohort study o...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.03.006

    authors: Kim T,Chang JY,Myung SJ,Chang Y,Park KD,Park WB,Shin CS

    更新日期:2016-07-01 00:00:00

  • Educational debt of physicians-in-training: determining the level of interest in a loan repayment program for service in a medically underserved area.

    abstract:PURPOSE:The amount of financial debt incurred by Texas medical students and residents during training was examined as well as the impact of this debt on these trainees' career choices. METHOD:An invitation to participate was sent in a Web-based survey to medical students and residents at 6 university programs in Texas...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2008.09.003

    authors: Price MA,Cohn SM,Love J,Dent DL,Esterl R

    更新日期:2009-01-01 00:00:00

  • Resident guideline development to standardize intensive care unit care delivery: a competency-based educational method.

    abstract:PURPOSE:We developed a system of resident-driven, evidence-based standardization of care in our trauma-surgical intensive care unit (TSICU). Our main purposes are to improve patient care and outcomes and to help the residents develop practical competency in practice-based learning and improvement and in systems-based p...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2008.01.003

    authors: Marinaro J,Tawil I,Nelson MT

    更新日期:2008-03-01 00:00:00

  • Can a Clinician-Scientist Training Program Develop Academic Orthopaedic Surgeons? One Program's Thirty-Year Experience.

    abstract:BACKGROUND:Clinician-scientist numbers have been stagnant over the past few decades despite awareness of this trend. Interventions attempting to change this problem have been seemingly ineffective, but research residency positions have shown potential benefit. OBJECTIVE:We sought to evaluate the effectiveness of a cli...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.10.003

    authors: Brandt AM,Rettig SA,Kale NK,Zuckerman JD,Egol KA

    更新日期:2018-01-01 00:00:00

  • Evaluating the Use of Cleft Lip and Palate 3D-Printed Models as a Teaching Aid.

    abstract:OBJECTIVE:Visualization tools are essential for effective medical education, to aid students understanding of complex anatomical systems. Three dimensional (3D) printed models are showing a wide-reaching potential in the field of medical education, to aid the interpretation of 2D imaging. This study investigates the us...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2017.07.023

    authors: AlAli AB,Griffin MF,Calonge WM,Butler PE

    更新日期:2018-01-01 00:00:00

  • Popularity of Online Multimedia Educational Resources in Neurosurgery: Insights from The Neurosurgical Atlas Project.

    abstract:OBJECTIVE:The Neurosurgical Atlas is a popular world-wide multimedia website in neurosurgery with informative chapters and videos to promote excellence and safety in neurosurgical techniques. Here, we present our analysis of the viewing data of this website. This is intended to describe how online neurosurgical resourc...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.05.001

    authors: Davidson B,Alotaibi NM,Hendricks BK,Cohen-Gadol AA

    更新日期:2018-11-01 00:00:00

  • A National Survey of Undergraduate Suture and Local Anesthetic Training in the United Kingdom.

    abstract:BACKGROUND:Suturing is a skill expected to be attained by all medical students on graduation, according to the General Medical Council's (GMC) Tomorrow's Doctors. There are no GMC recommendations for the amount of suture training required at medical school nor the level of competence to be achieved. This study examines...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.09.017

    authors: Rufai SR,Holland LC,Dimovska EO,Bing Chuo C,Tilley S,Ellis H

    更新日期:2016-03-01 00:00:00

  • Transition to Residency: The Successful Development and Implementation of a Nonclinical Elective in Perioperative Management.

    abstract:OBJECTIVE:Few medical school programs in Canada address challenges related to the significant increase in responsibility for patient care between medical school and residency. This is particularly important in surgery and anesthesia due to the high-acuity care required during the perioperative period. The purpose of th...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.08.022

    authors: McDonald H,Gawad N,Raîche I,Rubens FD

    更新日期:2018-01-01 00:00:00

  • Evaluation of Changes in Quality Improvement Knowledge Following a Formal Educational Curriculum Within a Statewide Learning Collaborative.

    abstract:OBJECTIVE:Our objectives were to (1) develop a curriculum based upon participants' needs, (2) evaluate baseline QI knowledge of the Illinois Surgical Quality Improvement Collaborative (ISQIC) members, and (3) evaluate the effectiveness of the educational curriculum. DESIGN:The Surgeon Champion (SC), Surgical Clinical ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.04.018

    authors: Berger ER,Kreutzer L,Halverson A,Yang AD,Reinhart S,Leary KJO,Williams MV,Bilimoria KY,Johnson JK,ISQIC Advisory Committee.

    更新日期:2020-01-01 00:00:00

  • Long-Term Impact of a Mission-Based Surgical Training Rotation on Plastic Surgery Capacity Building in Rwanda.

    abstract:OBJECTIVE:Short-term, high-volume surgical training experiences can lead to successful skills transfer and be an effective method of training surgical providers in low-resource settings. However, immediate skills acquisition does not guarantee long-term performance of surgical procedures by trainees. This study aims to...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2019.08.009

    authors: Munabi NCO,Durnwald L,Nagengast ES,Ntirenganya F,Magee Iii WP

    更新日期:2020-01-01 00:00:00

  • Minimum number of throws needed for knot security.

    abstract:OBJECTIVE:The purpose of the study was to determine the optimal number of throws to ensure knot security. STUDY DESIGN:Knots were tied with 3, 4, 5, or 6 square throws with 0-gauge coated polyester, polydioxanone, polypropylene, and polyglactin 910. The suture was soaked in 0.9% sodium chloride and subsequently transf...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.11.001

    authors: Muffly TM,Kow N,Iqbal I,Barber MD

    更新日期:2011-03-01 00:00:00

  • Prevention training of wrong-site spine surgery.

    abstract:OBJECTIVE:Wrong-site surgery (WSS) is considered a sentinel event by the Joint Commission. The education of spine surgery fellows on WSS is unknown. Our objective was to evaluate North American spine surgery fellows' education, awareness, and experience with WSS. DESIGN:Observational survey study. SETTING:Spine surge...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.01.010

    authors: Mesfin A,Canham C,Okafor L

    更新日期:2015-07-01 00:00:00

  • Year one outcomes assessment of a masters suturing and knot-tying program for surgical interns.

    abstract:PURPOSE:We implemented and evaluated the outcomes of a proficiency-based program to enhance basic suturing and knot-tying skills in surgical interns. METHODS:A suturing and knot-tying "masters program" was implemented for 9 surgical interns. Assessment consisted of timed and videotaped technical performance (TP) of 6 ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.04.005

    authors: Schill M,Tiemann D,Klingensmith ME,Brunt LM

    更新日期:2011-11-01 00:00:00

  • Value of Dedicated Research Time for IMGs in Obtaining Surgical Residency Training Positions: A 10-Year Review of Applicants from a Medical College in Pakistan.

    abstract:OBJECTIVE:International Medical Graduates (IMGs) secured greater than 10% of all general surgery (GS) residency positions in the US during the past decade. The Match process remains competitive, with a significant number of IMGs performing dedicated research before residency application. The impact of such research rem...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.06.003

    authors: Jajja MR,Tariq M,Hashmi SS,Dodson TF,Ahmed R

    更新日期:2019-01-01 00:00:00

  • Developing and Assessing the Feasibility of Implementing a Surgical Objective Structured Clinical Skills Examination (S-OSCE).

    abstract:OBJECTIVE:To1 describe the development and evaluate the feasibility of a surgical objective structured clinical examination (OSCE) for the purpose of competency assessment based on the Royal College of Canada's CanMEDS framework. DESIGN:A unique surgical OSCE was developed to evaluate the clinical and surgical managem...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.02.018

    authors: Gillis ME,Scott SA,Richardson CG,Oxner WM,Gauthier L,Wilson DA,Glennie RA

    更新日期:2020-01-01 00:00:00

  • Multilevel Quality Improvement Teams: An Alternative Approach for Surgical Academic Training Programs to Meet ACGME Core Competency Milestones.

    abstract:BACKGROUND:Quality improvement (QI) activities are an integral part of residency training. We started the process to implement team-based, multilevel QI project streams within our academic surgical residency by studying resident perceptions. OBJECTIVE:Our residency carried out 6 QI projects in line with the American C...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.10.006

    authors: Hajjar-Nejad MJ,Kubicki N,Morales D,Kavic SM

    更新日期:2019-01-01 00:00:00