Entrustable Professional Activities in General Surgery: Trends in Resident Self-Assessment.

Abstract:

OBJECTIVE:Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery. DESIGN, SETTING, PARTICIPANTS:Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights. RESULTS:One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p < 0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κ = 0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κ = 0.58 vs 0.36). CONCLUSIONS:Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.

journal_name

J Surg Educ

authors

Stahl CC,Jung SA,Rosser AA,Kraut AS,Schnapp BH,Westergaard M,Hamedani AG,Minter RM,Greenberg JA

doi

10.1016/j.jsurg.2020.05.005

subject

Has Abstract

pub_date

2020-01-01 00:00:00

pages

1562-1567

issue

6

eissn

1931-7204

issn

1878-7452

pii

S1931-7204(20)30140-9

journal_volume

77

pub_type

杂志文章
  • Multilevel Quality Improvement Teams: An Alternative Approach for Surgical Academic Training Programs to Meet ACGME Core Competency Milestones.

    abstract:BACKGROUND:Quality improvement (QI) activities are an integral part of residency training. We started the process to implement team-based, multilevel QI project streams within our academic surgical residency by studying resident perceptions. OBJECTIVE:Our residency carried out 6 QI projects in line with the American C...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.10.006

    authors: Hajjar-Nejad MJ,Kubicki N,Morales D,Kavic SM

    更新日期:2019-01-01 00:00:00

  • An alternative certification examination ("ACE") in surgery.

    abstract:BACKGROUND:Medical graduates are required to be competent in many domains of professional practice when joining the health care workforce. Current undergraduate examination methods robustly assess up to 5 of these 8 required skills. This study sought to evaluate an alternative certification examination ("ACE") in asses...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.05.011

    authors: Morris MC,Gillis AE,Smoothey CO,Hennessy M,Conlon KC,Ridgway PF

    更新日期:2014-11-01 00:00:00

  • An In-Depth Analysis of Research Output in Successful Integrated Plastic Surgery Match Applicants and Factors Associated With Matching at Top-Ranked Programs.

    abstract:OBJECTIVE:With USMLE Step I score reports becoming pass/fail, research output may become a more important factor for applicants in the integrated plastic surgery match. The authors aim to assess the research output of successful applicants and bibliometric variables associated with matching at higher tier programs. DE...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.06.026

    authors: Mellia JA,Jou C,Rathi S,Perzia BM,Morel A,Azoury SC,Fischer JP

    更新日期:2021-01-01 00:00:00

  • Giant colonic diverticulum: an unusual abdominal lump.

    abstract::Giant colonic diverticulum is a rare complication of diverticular disease of the colon and is thought to result, in most cases, from a "ball-valve" effect. The presentation and clinical course can be variable and confusing. The most common symptoms are abdominal pain and a palpable abdominal lump, with many patients p...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,评审

    doi:10.1016/j.jsurg.2006.10.007

    authors: Praveen BV,Suraparaju L,Jaunoo SS,Tang T,Walsh SR,Ogunbiyi OA

    更新日期:2007-03-01 00:00:00

  • Modern management of omental torsion and omental infarction: a surgeon's perspective.

    abstract::Omental infarction is a rare cause of acute abdomen that until recently was diagnosed only on exploratory surgery for presumed acute appendicitis or similar abdominal emergency. The increasing use of high-quality imaging, especially computerized tomography, in the diagnosis of appendicitis and the acute abdomen, has a...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.01.003

    authors: Itenberg E,Mariadason J,Khersonsky J,Wallack M

    更新日期:2010-01-01 00:00:00

  • Qualitative Analysis of Effective Teamwork in the Operating Room (OR).

    abstract:OBJECTIVE:To conduct focus group interviews with operating room (OR) personnel to determine components of effective teamwork to inform a revision of a teamwork assessment instrument. DESIGN:Qualitative research study targeting OR personnel using semi-structured focus group interviews of interprofessional OR personnel....

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.09.019

    authors: Paige JT,Garbee DD,Bonanno LS,Kerdolff KE

    更新日期:2020-11-04 00:00:00

  • Outcomes registries: an untapped resource for use in surgical education.

    abstract:OBJECTIVE:To examine the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) for use in profiling the aggregated resident operative experience by postgraduate training year and to demonstrate the extent to which a surgical registry could be used to examine resident exposure to adverse...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.08.014

    authors: Hoffman RL,Bartlett EK,Medbery RL,Sakran JV,Morris JB,Kelz RR

    更新日期:2015-03-01 00:00:00

  • Teaching subcuticular suturing to medical students: video versus expert instructor feedback.

    abstract:OBJECTIVE:Given limitations in surgical educational resources, more efficient teaching methods are needed. We sought to evaluate 3 strategies for improving skills in subcuticular suturing-practice with an instructional video, practice with expert instructor supervision, and independent practice. DESIGN:Fifty-eight med...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2011.04.006

    authors: Shippey SH,Chen TL,Chou B,Knoepp LR,Bowen CW,Handa VL

    更新日期:2011-09-01 00:00:00

  • Changing Objective Structured Clinical Examinations Stations at Lunchtime During All Day Postgraduate Surgery Examinations Improves Examiner Morale and Stress.

    abstract:BACKGROUND:Human factors are important causes of error, but little is known about their possible effect during objective structured clinical examinations (OSCE). We have previously identified stress and pressure in OSCE examiners in the postgraduate intercollegiate Membership of the Royal College of Surgeons (MRCS) exa...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jsurg.2016.12.013

    authors: Brennan PA,Scrimgeour DS,Patel S,Patel R,Griffiths G,Croke DT,Smith L,Arnett R

    更新日期:2017-01-01 00:00:00

  • Procedural Skills of the Entrustable Professional Activities: Are Graduating US Medical Students Prepared to Perform Procedures in Residency?

    abstract:PURPOSE:Competency-based medical education has been successfully instituted in graduate medical education through the development of Milestones. Consequently, the Association of American Medical Colleges implemented the core entrustable professional activities initiative to complement this framework in undergraduate me...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.01.002

    authors: Bruce AN,Kumar A,Malekzadeh S

    更新日期:2017-01-01 00:00:00

  • The effect of a new surgery residency program on case volume and case complexity in a sub-Saharan African hospital.

    abstract:BACKGROUND:Improved access to surgical care could prevent a significant burden of disease and disability-adjusted life years, and workforce shortages are the biggest obstacle to surgical care. To address this shortage, a 5-year surgical residency program was established at Kamuzu Central Hospital (KCH) in July 2009. As...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.09.011

    authors: Kendig C,Tyson A,Young S,Mabedi C,Cairns B,Charles A

    更新日期:2015-07-01 00:00:00

  • Cross-Sectional Analysis of Global Surgery Opportunities Among General Surgery Residency Programs.

    abstract:BACKGROUND:Global surgery is a rising field within academic surgery. With the publication of recent landmark papers highlighting the need for increased global efforts to combat surgical disease, many general surgery residents seek opportunities to gain clinical, research, and educational experience related to global su...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.03.017

    authors: Abraham PJ,Abraham MN,Corey BL,Lindeman B,Chen H

    更新日期:2020-01-01 00:00:00

  • Service versus education, what are we talking about?

    abstract:OBJECTIVE:To investigate the degree of variability in perception as related to the service versus education issue in general surgery residency education. STUDY DESIGN:A survey questionnaire was designed with 15 scenarios constructed by the author to represent an array of resident experiences with differing educational...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.11.007

    authors: Smith DE,Johnson B,Jones Y

    更新日期:2012-05-01 00:00:00

  • Impact of fellowship training on research productivity in academic ophthalmology.

    abstract:OBJECTIVES:To assess whether scholarly impact of academic ophthalmologists, as measured using the h-index, is affected by fellowship training status and to further characterize differences in productivity among the various subspecialties and by departmental rank. DESIGN:A descriptive and correlational design was used....

    journal_title:Journal of surgical education

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jsurg.2014.10.010

    authors: Huang G,Fang CH,Lopez SA,Bhagat N,Langer PD,Eloy JA

    更新日期:2015-05-01 00:00:00

  • Surgical Resident Radiation Knowledge, Attitudes, Practices, and Exposures.

    abstract:OBJECTIVE:To investigate the level of ionizing radiation exposure among surgical residents and to evaluate resident knowledge, attitudes, and practices regarding exposures. DESIGN:An observational study was conducted using radiation exposure data for surgical residents who wore film badge dosimeters. A cross-sectional...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.05.002

    authors: Sidwell RA,Smith HL,Halsey JP,McFarlane MJ

    更新日期:2016-01-01 00:00:00

  • Descriptive operative reports: teaching, learning, and milestones to safe surgery.

    abstract:OBJECTIVE:Few tasks are more ingrained within the minds of practicing surgeons than the dictation of the narrative report of an operation. However, the construct of these reports varies widely among surgeons and is rarely formally taught and not tested formally during surgical training or board certification. DESIGN:A...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.06.015

    authors: Porterfield JR Jr,Altom LK,Graham LA,Gray SH,Urist MM,Hawn MT

    更新日期:2011-11-01 00:00:00

  • Arthroscopic Shoulder Surgical Simulation Training Curriculum: Transfer Reliability and Maintenance of Skill Over Time.

    abstract:BACKGROUND:Surgical education is evolving as work hour constraints limit the exposure of residents to the operating room. Potential consequences may include erosion of resident education and decreased quality of patient care. Surgical simulation training has become a focus of study in an effort to counter these challen...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2015.06.021

    authors: Dunn JC,Belmont PJ,Lanzi J,Martin K,Bader J,Owens B,Waterman BR

    更新日期:2015-11-01 00:00:00

  • Complexity theory and the "puzzling" competencies: Systems-based Practice And Practice-based Learning explored.

    abstract::Of all the clinical competencies, the least understood are Systems-Based Practice and Practice-Based Learning and Improvement. With a shift to competency-based education and evaluation across the spectrum of surgical education and practice, a clear understanding of the power and utility of each competency is paramount...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2009.12.001

    authors: Gonnering RS

    更新日期:2010-03-01 00:00:00

  • Isolated congenital agenesis of the gallbladder and cystic duct: report of a case.

    abstract::Congenital agenesis of the gallbladder and cystic duct represents a rare anomaly of the biliary system. It likely results from an embryologic mishap in the development of the hepatobiliary bud and can occur with other associated malformations. We report the case of congenital absence of the gallbladder and cystic duct...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2012.07.001

    authors: Joliat GR,Shubert CR,Farley DR

    更新日期:2013-01-01 00:00:00

  • The effect of problem-based learning with cooperative-learning strategies in surgery clerkships.

    abstract:BACKGROUND:Cooperative learning is used often as part of the problem-based learning (PBL) process. But PBL does not demand that students work together until all individuals master the material or share the rewards for their work together. OBJECTIVE:A cooperative learning and assessment structure was introduced in a PB...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.07.010

    authors: Turan S,Konan A,Kılıç YA,Özvarış ŞB,Sayek I

    更新日期:2012-03-01 00:00:00

  • Evaluation of a "Subintern" Role: Action Over Observation For Final-Year Medical Students in Surgery.

    abstract:BACKGROUND:This study sought to investigate the potential of a subinternship apprentice role as a structured experiential learning opportunity by enabling final-year medical students to learn through action rather than observation. METHODS:A convenience sample of 65 final-year medical students was allocated to "intern...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.03.003

    authors: Morris MC,Hennessy M,Conlon KC,Ridgway PF

    更新日期:2015-09-01 00:00:00

  • Levels of evidence have increased for musculoskeletal trauma questions on the orthopaedic in-training examination.

    abstract:OBJECTIVE:The purpose of this study was to determine if the levels of evidence for primary journal articles used as references for musculoskeletal trauma questions on the Orthopaedic In-Training Examination (OITE) have increased over a 15-year period. DESIGN:Basic science article. SETTING:Geisinger Medical Center (Da...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.10.005

    authors: Grandizio LC,Huston JC,Shim SS,Parenti JM,Graham J,Klena JC

    更新日期:2015-03-01 00:00:00

  • Analysis of Practice Settings for Craniofacial Surgery Fellowship Graduates in North America.

    abstract:OBJECTIVE:In North America, the number of craniofacial surgery fellowship graduates is increasing, yet an analysis of practice settings upon graduation is lacking. We characterize the practice types of recent graduates of craniofacial fellowship programs in the United States and Canada. DESIGN:A 6-year cohort of crani...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jsurg.2016.08.014

    authors: Silvestre J,Runyan C,Taylor JA

    更新日期:2017-01-01 00:00:00

  • Live-Streaming Surgery for Medical Student Education - Educational Solutions in Neurosurgery During the COVID-19 Pandemic.

    abstract:OBJECTIVE:The COVID-19 pandemic significantly altered medical student education. The ability for students to be a part of the operating room team was highly restricted. Technology can be used to ensure ongoing surgical education during this time of limited in-person educational opportunities. DESIGN:We have developed ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.07.005

    authors: Jack MM,Gattozzi DA,Camarata PJ,Shah KJ

    更新日期:2021-01-01 00:00:00

  • Transition to Residency: The Successful Development and Implementation of a Nonclinical Elective in Perioperative Management.

    abstract:OBJECTIVE:Few medical school programs in Canada address challenges related to the significant increase in responsibility for patient care between medical school and residency. This is particularly important in surgery and anesthesia due to the high-acuity care required during the perioperative period. The purpose of th...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.08.022

    authors: McDonald H,Gawad N,Raîche I,Rubens FD

    更新日期:2018-01-01 00:00:00

  • Developing and Assessing the Feasibility of Implementing a Surgical Objective Structured Clinical Skills Examination (S-OSCE).

    abstract:OBJECTIVE:To1 describe the development and evaluate the feasibility of a surgical objective structured clinical examination (OSCE) for the purpose of competency assessment based on the Royal College of Canada's CanMEDS framework. DESIGN:A unique surgical OSCE was developed to evaluate the clinical and surgical managem...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.02.018

    authors: Gillis ME,Scott SA,Richardson CG,Oxner WM,Gauthier L,Wilson DA,Glennie RA

    更新日期:2020-01-01 00:00:00

  • Evaluation of Changes in Quality Improvement Knowledge Following a Formal Educational Curriculum Within a Statewide Learning Collaborative.

    abstract:OBJECTIVE:Our objectives were to (1) develop a curriculum based upon participants' needs, (2) evaluate baseline QI knowledge of the Illinois Surgical Quality Improvement Collaborative (ISQIC) members, and (3) evaluate the effectiveness of the educational curriculum. DESIGN:The Surgeon Champion (SC), Surgical Clinical ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.04.018

    authors: Berger ER,Kreutzer L,Halverson A,Yang AD,Reinhart S,Leary KJO,Williams MV,Bilimoria KY,Johnson JK,ISQIC Advisory Committee.

    更新日期:2020-01-01 00:00:00

  • Year one outcomes assessment of a masters suturing and knot-tying program for surgical interns.

    abstract:PURPOSE:We implemented and evaluated the outcomes of a proficiency-based program to enhance basic suturing and knot-tying skills in surgical interns. METHODS:A suturing and knot-tying "masters program" was implemented for 9 surgical interns. Assessment consisted of timed and videotaped technical performance (TP) of 6 ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.04.005

    authors: Schill M,Tiemann D,Klingensmith ME,Brunt LM

    更新日期:2011-11-01 00:00:00

  • Vessel Ligation Fundamentals: A Comparison of Technical Evaluations by Crowdsourced Nonclinical Personnel and Surgical Faculty.

    abstract:BACKGROUND:Evaluation of fundamental surgical skills is invaluable to the training of medical students and junior residents. This study assessed the effectiveness of crowdsourcing nonmedical personnel to evaluate technical proficiency at simulated vessel ligation. STUDY DESIGN:Fifteen videos were captured of participa...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.09.030

    authors: Hu Y,Jiang B,Kim H,Schroen AT,Smith PW,Rasmussen SK

    更新日期:2018-01-01 00:00:00

  • Global Collaboration to Modernize Advanced Trauma Life Support Training.

    abstract:BACKGROUND:Each year, thousands of surgeons and other trauma health care providers participate in the American College of Surgeon's Advanced Trauma Life Support (ATLS) program, which historically has allowed trainees to practice cricothyroidotomy, chest tube insertion, pericardiocentesis, venous cutdown, and diagnostic...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.08.011

    authors: Gala SG,Crandall ML

    更新日期:2019-01-01 00:00:00