Vessel Ligation Fundamentals: A Comparison of Technical Evaluations by Crowdsourced Nonclinical Personnel and Surgical Faculty.

Abstract:

BACKGROUND:Evaluation of fundamental surgical skills is invaluable to the training of medical students and junior residents. This study assessed the effectiveness of crowdsourcing nonmedical personnel to evaluate technical proficiency at simulated vessel ligation. STUDY DESIGN:Fifteen videos were captured of participants performing vessel ligation using a low-fidelity model (5 attending surgeons and 5 medical students before and after training). These videos were evaluated by nonmedical personnel recruited through Amazon Mechanical Turk, as well as by 3 experienced surgical faculty. Evaluation criteria were based on Objective Structured Assessment of Technical Skills (scale: 5-25). Results were compared using Wilcoxon signed rank-sum and Cronbach's alpha (α). RESULTS:Thirty-two crowd workers evaluated all 15 videos. Crowd workers scored attending surgeon videos significantly higher than pretraining medical student videos (20.5 vs 14.9, p < 0.001), demonstrating construct validity. Across all videos, crowd evaluations were more lenient than expert evaluations (19.1 vs 14.5, p < 0.001). However, average volunteer evaluations correlated more strongly with average expert evaluations (α = 0.95) than the strength of correlation between any 2 individual expert evaluators (α = 0.72-0.88). Combined reimbursement for all workers was $80.00. CONCLUSION:After adjustments for score inflation, crowdsourced can evaluate surgical fundamentals with excellent validity. This resource is considerably less costly and potentially more reliable than individual expert evaluations.

journal_name

J Surg Educ

authors

Hu Y,Jiang B,Kim H,Schroen AT,Smith PW,Rasmussen SK

doi

10.1016/j.jsurg.2017.09.030

subject

Has Abstract

pub_date

2018-01-01 00:00:00

pages

664-670

issue

3

eissn

1931-7204

issn

1878-7452

pii

S1931-7204(17)30181-2

journal_volume

75

pub_type

杂志文章
  • Global Health Education for Medical Students: When Learning Objectives Include Research.

    abstract:BACKGROUND:The Luke Commission, a provider of comprehensive mobile health outreach in rural Swaziland, focuses on human immunodeficiency virus testing and prevention, including the performance of over 100 circumcisions weekly. Educational objectives for medical student global health electives are essential. Learning re...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.09.015

    authors: Bales AM,Oddo AR,Dennis DJ,Siska RC,VanderWal E,VanderWal H,Dlamini N,Markert RJ,McCarthy MC

    更新日期:2018-01-01 00:00:00

  • Resident guideline development to standardize intensive care unit care delivery: a competency-based educational method.

    abstract:PURPOSE:We developed a system of resident-driven, evidence-based standardization of care in our trauma-surgical intensive care unit (TSICU). Our main purposes are to improve patient care and outcomes and to help the residents develop practical competency in practice-based learning and improvement and in systems-based p...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2008.01.003

    authors: Marinaro J,Tawil I,Nelson MT

    更新日期:2008-03-01 00:00:00

  • Implementation and Effectiveness of Coaching for Surgeons in Practice - A Mixed Studies Systematic Review.

    abstract:INTRODUCTION:Despite recent changes to medical education, surgical training remains largely based on the apprenticeship model. However, after completing training, there are few structured learning opportunities available for surgeons in practice to refine their skills or acquire new skills. Personalized observation wit...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.01.007

    authors: Valanci-Aroesty S,Alhassan N,Feldman LS,Landry T,Mastropietro V,Fiore J Jr,Lee L,Fried GM,Mueller CL

    更新日期:2020-01-01 00:00:00

  • Hemorrhage Control Training Promotes Resilience-Associated Traits in Medical Students.

    abstract:OBJECTIVE:Given rising rates of physician burnout, the potential for clinical skills training programs to develop and reinforce resilience-associated traits in medical students warrants investigation. The primary objective of this study was to examine the impact of a hemorrhage control training program on resilience-as...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.06.007

    authors: Levy-Carrick NC,McCarty JC,Chaudhary MA,Caterson EJ,Haider AH,Eyre AJ,Mahon PB,Goralnick E

    更新日期:2019-01-01 00:00:00

  • Year one outcomes assessment of a masters suturing and knot-tying program for surgical interns.

    abstract:PURPOSE:We implemented and evaluated the outcomes of a proficiency-based program to enhance basic suturing and knot-tying skills in surgical interns. METHODS:A suturing and knot-tying "masters program" was implemented for 9 surgical interns. Assessment consisted of timed and videotaped technical performance (TP) of 6 ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2011.04.005

    authors: Schill M,Tiemann D,Klingensmith ME,Brunt LM

    更新日期:2011-11-01 00:00:00

  • (Re)thinking the Residential in Residency: Modern Surgical Practice Continues to Move Away From the Inpatient Setting.

    abstract:PURPOSE:Despite the overall shift in care delivery to an ambulatory setting, the majority of general surgical education still relies on the experience of caring for inpatients. We aimed to investigate how the inpatient practice patterns of newly minted general surgeons (GS) have changed since 2008, in order to better i...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.12.005

    authors: Mavroudis CL,Tong J,Wirtalla C,Brooks ES,Morris JB,Aarons CB,Kelz RR

    更新日期:2020-12-23 00:00:00

  • The Sex Difference in Basic Surgical Skills Learning: A Comparative Study.

    abstract:BACKGROUND:Very little is known of sex-related differences among medical students in the acquisition of basic surgical skills at an undergraduate level. The aim of this study was to investigate the sex differences in basic surgical skills learning and the possible explanations for sex disparities within basic surgical ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.04.002

    authors: Lou Z,Yan FH,Zhao ZQ,Zhang W,Shui XQ,Liu J,Zhuo DL,Li L,Yu ED

    更新日期:2016-09-01 00:00:00

  • Qualitative Analysis of Effective Teamwork in the Operating Room (OR).

    abstract:OBJECTIVE:To conduct focus group interviews with operating room (OR) personnel to determine components of effective teamwork to inform a revision of a teamwork assessment instrument. DESIGN:Qualitative research study targeting OR personnel using semi-structured focus group interviews of interprofessional OR personnel....

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.09.019

    authors: Paige JT,Garbee DD,Bonanno LS,Kerdolff KE

    更新日期:2020-11-04 00:00:00

  • Communication Skills Training in Ophthalmology: Results of a Needs Assessment and Pilot Training Program.

    abstract:OBJECTIVE:To conduct a needs assessment to identify gaps in communication skills training in ophthalmology residency programs and to use these results to pilot a communication workshop that prepares residents for difficult conversations. DESIGN:A mixed-methods design was used to perform the needs assessment. A pre-and...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2017.08.011

    authors: Mishra A,Browning D,Haviland MJ,Jackson ML,Luff D,Meyer EC,Talcott K,Kloek CE

    更新日期:2018-01-01 00:00:00

  • A randomized controlled study to establish the effect of articulating instruments on performance in single-incision laparoscopic surgery.

    abstract:OBJECTIVE:In single-incision laparoscopic surgery (SILS), operating through 1 incision presents ergonomic challenges. No consensus exists on whether articulating instruments (ARTs) may help. This study evaluated their effect on simulated SILS, hypothesizing that they would affect performance and workload. DESIGN:Surge...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2014.08.004

    authors: Corker HP,Singh P,Sodergren MH,Balaji S,Kwasnicki RM,Darzi AW,Paraskeva P

    更新日期:2015-01-01 00:00:00

  • Social Media in Surgical Training: Opportunities and Risks.

    abstract:BACKGROUND:Surgeon engagement with social media is growing rapidly. Innovative applications in diverse fields of health care are increasingly available. OBJECTIVE:The aim of this review is to explore the current and future applications of social media in surgical training. In addition, risks and barriers of social med...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,评审

    doi:10.1016/j.jsurg.2018.04.004

    authors: Ovaere S,Zimmerman DDE,Brady RR

    更新日期:2018-11-01 00:00:00

  • A Sensitivity Analysis and Opportunity Cost Evaluation of the Surgical Council on Resident Education Curriculum.

    abstract:OBJECTIVE:The study purpose is to evaluate the Surgical Council on Resident Education (SCORE) Curriculum regarding American Board of Surgery Qualifying Examination (ABS QE) outcomes. The goal is to perform effect size analyses, sensitivity analyses, and sample size analyses with opportunity cost estimates required to f...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.09.009

    authors: Falcone JL,Feinn RS

    更新日期:2016-01-01 00:00:00

  • The Surgery Fellow's Education Workshop: A Pilot Study to Determine the Feasibility of Training Senior Learners to Teach in the Operating Room.

    abstract:BACKGROUND:In 2013, we developed an education workshop to enhance the teaching skills of surgical fellows. We sought to investigate the feasibility of the monthly educational workshop format and its effect on participant teaching skills. STUDY DESIGN:Surgical and medical education faculty created a broadly applicable ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2016.02.001

    authors: Ambani SN,Lypson ML,Englesbe MJ,Santen S,Kasten S,Mullan P,Lee CT

    更新日期:2016-07-01 00:00:00

  • Giant colonic diverticulum: an unusual abdominal lump.

    abstract::Giant colonic diverticulum is a rare complication of diverticular disease of the colon and is thought to result, in most cases, from a "ball-valve" effect. The presentation and clinical course can be variable and confusing. The most common symptoms are abdominal pain and a palpable abdominal lump, with many patients p...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,评审

    doi:10.1016/j.jsurg.2006.10.007

    authors: Praveen BV,Suraparaju L,Jaunoo SS,Tang T,Walsh SR,Ogunbiyi OA

    更新日期:2007-03-01 00:00:00

  • Trauma and Orthopedic Surgery Curriculum Concordance: An Operative Learning Curve Trajectory Perspective.

    abstract:INTRODUCTION:Certification of completion of training in Trauma and Orthopedic (T&O) surgery in the UK requires the demonstration of operative competence in 12 index procedures, achieved through attaining a level 4 consultant-validated procedure-based assessment (PBA). The aim of this study was to evaluate the trajector...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2019.05.009

    authors: Hopkins L,Robinson DBT,Brown C,Egan R,Iorwerth A,Holt M,Lewis WG

    更新日期:2019-01-01 00:00:00

  • The influence of surgeon personality factors on risk tolerance: a pilot study.

    abstract:OBJECTIVE:This study attempts to assess the association between surgeon personality factors (measured by the Myers-Briggs Type Indicator personality inventory (MBTI(®))) and risk tolerance (measured by the Revised Physicians' Reactions to Uncertainty (PRU) and Physician Risk Attitude (PRA) scales). DESIGN:Instrument a...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,评审

    doi:10.1016/j.jsurg.2013.07.014

    authors: Contessa J,Suarez L,Kyriakides T,Nadzam G

    更新日期:2013-11-01 00:00:00

  • Surgical skills acquisition among left-handed trainees-true inferiority or unfair assessment: a preliminary study.

    abstract:INTRODUCTION:Studies involving the formal assessment of surgical skills have often reported inferior abilities among left-handed surgical trainees (LHT). Most surgical training curricula and assessment methods, however, are inherently geared toward right-handed trainees (RHT); potentially placing LHT at both a training...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jsurg.2012.09.007

    authors: Lee JY,Mucksavage P,McDougall EM

    更新日期:2013-03-01 00:00:00

  • Case-based multimedia program enhances the maturation of surgical residents regarding the concepts of professionalism.

    abstract:INTRODUCTION:The Accreditation Council for Graduate Medical Education (ACGME) has mandated that surgical residencies incorporate formal curricula in each of the 6 competencies, including professionalism. A questionnaire study was developed by the authors that aimed (1) to measure the ability of surgical residents to de...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2007.04.002

    authors: Kumar AS,Shibru D,Bullard MK,Liu T,Harken AH

    更新日期:2007-07-01 00:00:00

  • National Incidence of Medication Error in Surgical Patients Before and After Accreditation Council for Graduate Medical Education Duty-Hour Reform.

    abstract:OBJECTIVE:The Accreditation Council for Graduate Medical Education (ACGME) established duty-hour regulations for accredited residency programs on July 1, 2003. It is unclear what changes occurred in the national incidence of medication errors in surgical patients before and after ACGME regulations. DESIGN:Patient and ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.05.013

    authors: Vadera S,Griffith SD,Rosenbaum BP,Chan AY,Thompson NR,Kshettry VR,Kelly ML,Weil RJ,Bingaman W,Jehi L

    更新日期:2015-11-01 00:00:00

  • Building a global surgery initiative through evaluation, collaboration, and training: the Massachusetts General Hospital experience.

    abstract:OBJECTIVE:The Massachusetts General Hospital (MGH) Department of Surgery established the Global Surgery Initiative (GSI) in 2013 to transform volunteer and mission-based global surgery efforts into an educational experience in surgical systems strengthening. The objective of this newly conceived mission is not only to ...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2014.12.018

    authors: Chao TE,Riesel JN,Anderson GA,Mullen JT,Doyle J,Briggs SM,Lillemoe KD,Goldstein C,Kitya D,Cusack JC Jr

    更新日期:2015-07-01 00:00:00

  • Efficacy of Medical Student Surgery Journal Club.

    abstract:BACKGROUND:Journal clubs exist in a variety of forms in medical schools across the United States. Many incorporate a full spectrum of medical specialties, some are specific to certain interest groups or specialties, and many widely vary in whether or not they are school mandated or student-run. While these clubs are ub...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.06.006

    authors: Berman D,Braig Z,Simms B,Anderson T,Dougherty K,Marcinkowski K,Seaman R

    更新日期:2019-01-01 00:00:00

  • Identifying Managerial Roles of General Surgery Coordinators: Making the Case for Utilization of a Standardized Job Description Framework.

    abstract:OBJECTIVE:Residency coordinators are valuable members of the education leadership administration. In General Surgery, program directors must devote time to both their clinical practice and as the leader of the education program for surgical residents. With the introduction of competencies and the Next Accreditation Sys...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2018.07.003

    authors: Nickel BL,Roof J,Dolejs S,Choi JN,Torbeck L

    更新日期:2018-11-01 00:00:00

  • Practical Bioethics for the Humanitarian Surgeon: The Development, Implementation and Assessment of an Ethics Curriculum for Residents Participating in Humanitarian Missions.

    abstract:BACKGROUND:Humanitarian surgeons face many ethical challenges. Despite increasing resident participation during humanitarian activities, minimal literature exists describing premission ethics training. METHODS:A systematic literature review was conducted to identify publications on humanitarian surgery. A 3-tiered rev...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2019.11.015

    authors: McDonald VS,Ignacio RC,Kuettel MA,Schlitzkus LL,Sullivan ME,Tadlock MD

    更新日期:2020-01-01 00:00:00

  • The Fellowship Effect: Does Surgical Subspecialty Training Affect Pediatric Surgery Case Volume?

    abstract:PURPOSE:The Accreditation Council for Graduate Medical Education (ACGME) monitors fellow case numbers. Previous literature has shown new fellowships detrimentally affecting general surgery residency case numbers. We hypothesize that an increase in pediatric otolaryngology and pediatric urology fellowships would decreas...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2021.01.004

    authors: Esparaz JR,Mathis MS,Russell RT

    更新日期:2021-01-19 00:00:00

  • Modern management of omental torsion and omental infarction: a surgeon's perspective.

    abstract::Omental infarction is a rare cause of acute abdomen that until recently was diagnosed only on exploratory surgery for presumed acute appendicitis or similar abdominal emergency. The increasing use of high-quality imaging, especially computerized tomography, in the diagnosis of appendicitis and the acute abdomen, has a...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2010.01.003

    authors: Itenberg E,Mariadason J,Khersonsky J,Wallack M

    更新日期:2010-01-01 00:00:00

  • Assessment of surgical trainees' quality of knot-tying.

    abstract:BACKGROUND:This study aimed to assess surgical trainees' knot tying technique and determine the type and security of knots created. METHODS:Twenty-five participants were requested to tie 40 knots each, using Vicryl 2-0 and Prolene 2-0 sutures. With each suture material, the participants tied: in series 1, 4 knots as t...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2012.07.002

    authors: Ching SS,Mok CW,Koh YX,Tan SM,Tan YK

    更新日期:2013-01-01 00:00:00

  • Complexity theory and the "puzzling" competencies: Systems-based Practice And Practice-based Learning explored.

    abstract::Of all the clinical competencies, the least understood are Systems-Based Practice and Practice-Based Learning and Improvement. With a shift to competency-based education and evaluation across the spectrum of surgical education and practice, a clear understanding of the power and utility of each competency is paramount...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2009.12.001

    authors: Gonnering RS

    更新日期:2010-03-01 00:00:00

  • Skills in Open Surgery do not Predict Arthroscopic Skills in Medical Students.

    abstract:OBJECTIVE:Teaching of basic open surgical skills like skin closure has been well established in medical schools' surgical curricula. The same cannot be said for basic arthroscopic skills even though the importance of arthroscopic surgery in Orthopaedics has been well documented. The goal of this study was to evaluate t...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2020.01.001

    authors: Liem D,Plasger A,Gosheger G,Rickert C,Dedy N,Schorn D,Hauschild G

    更新日期:2020-01-01 00:00:00

  • A Descriptive Analysis of the Use of Workplace-Based Assessments in UK Surgical Training.

    abstract:BACKGROUND:Workplace-based assessments (WBAs) were introduced formally in the UK in 2007. The aim of the study was to describe the use of WBAs by UK surgical trainees and examine variations by training region, specialty, and level of training. METHODS:The database of the Intercollegiate Surgical Curriculum Programme w...

    journal_title:Journal of surgical education

    pub_type: 杂志文章

    doi:10.1016/j.jsurg.2015.03.019

    authors: Shalhoub J,Santos C,Bussey M,Eardley I,Allum W

    更新日期:2015-09-01 00:00:00

  • Status of Resident Attrition From Surgical Residency in the Past, Present, and Future Outlook.

    abstract:OBJECTIVE:To investigate the current rate of attrition in general surgery residency, assess the risk factors, and identify prevention strategies. DESIGN:A literature review of the PubMed and MEDLINE databases, from January 1, 1980 to February 1, 2016, for relevant articles. The calculated attrition rate and the statis...

    journal_title:Journal of surgical education

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jsurg.2017.07.015

    authors: Shweikeh F,Schwed AC,Hsu CH,Nfonsam VN

    更新日期:2018-01-01 00:00:00