A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

Abstract:

PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings of 20 PLNDs were included. The quality of lymph node clearance was assessed based on the features derived from the computer vision process which include: the number and cleared area of the vessels/nerve (N-Vs); image median color map; and mean entropy (measures the level of disorganization) in the video frame. The automated scores were compared to the validated pelvic lymphadenectomy appropriateness and completion evaluation (PLACE) scoring rated by a panel of expert surgeons. Logistic regression analysis was employed to compare automated scores versus PLACE scores. RESULTS:Fourteen procedures were used to develop the AASP algorithm. A logistic regression model was trained and validated using the aforementioned features with 30% holdout cross-validation. The model was tested on the remaining six procedures, and the accuracy of predicting the expert-based PLACE scores was 83.3%. CONCLUSIONS:To our knowledge, this is the first automated surgical skill assessment tool that provides an objective evaluation of surgical performance with high accuracy compared to expert surgeons' assessment that can be extended to any endoscopic or robotic video-enabled surgical procedure.

authors

Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

doi

10.1007/s11548-018-1881-9

subject

Has Abstract

pub_date

2019-04-01 00:00:00

pages

697-707

issue

4

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-018-1881-9

journal_volume

14

pub_type

杂志文章
  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • PyDBS: an automated image processing workflow for deep brain stimulation surgery.

    abstract:PURPOSE:Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmenta...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1007-y

    authors: D'Albis T,Haegelen C,Essert C,Fernández-Vidal S,Lalys F,Jannin P

    更新日期:2015-02-01 00:00:00

  • Detection and modelling of contacts in explicit finite-element simulation of soft tissue biomechanics.

    abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1142-5

    authors: Johnsen SF,Taylor ZA,Han L,Hu Y,Clarkson MJ,Hawkes DJ,Ourselin S

    更新日期:2015-11-01 00:00:00

  • Patient-specific catheter shaping for the minimally invasive closure of the left atrial appendage.

    abstract:PURPOSE:The minimally invasive closure of the left atrial appendage is a promising alternative to anticoagulation for stroke prevention in patients suffering from atrial fibrillation. One of the challenges of this procedure is the correct positioning and the coaxial alignment of the tip of the catheter sheath to the im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1752-4

    authors: Graf EC,Ott I,Praceus J,Bourier F,Lueth TC

    更新日期:2018-06-01 00:00:00

  • A practical marker-less image registration method for augmented reality oral and maxillofacial surgery.

    abstract:BACKGROUND:Image registration lies in the core of augmented reality (AR), which aligns the virtual scene with the reality. In AR surgical navigation, the performance of image registration is vital to the surgical outcome. METHODS:This paper presents a practical marker-less image registration method for AR-guided oral ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01921-5

    authors: Wang J,Shen Y,Yang S

    更新日期:2019-05-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • A fully 3D work context for oral implant planning and simulation.

    abstract:PURPOSE:Most software systems for oral implantology are based on a two-dimensional multi-view approach, often accompanied with a surface rendered model. Usually they are affected by common errors like anisotropy of the volume and distortion on measurements. A more integrated and realistic 3D approach for implant surger...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0394-y

    authors: Chiarelli T,Lamma E,Sansoni T

    更新日期:2010-01-01 00:00:00

  • Path generator control system and virtual compliance calculator for maxillofacial massage robots.

    abstract:PURPOSE:Oral disorders such as temporomandibular joint disorders (TMD) and dry mouth are common and often require treatment. Maxillofacial massage is used as a complementary and alternative therapy for these disorders. We developed an oral rehabilitation robot that massages the maxillofacial tissues for this purpose. I...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0383-1

    authors: Ishii H,Koga H,Obokawa Y,Solis J,Takanishi A,Katsumata A

    更新日期:2010-01-01 00:00:00

  • Real-time marker-free patient registration for electromagnetic navigated bronchoscopy: a phantom study.

    abstract:PURPOSE:To perform bronchoscopy safely and smoothly, it is very important to develop a bronchoscopic guidance system. Transbronchial lung biopsy (TBLB) with a bronchoscopic guidance system especially should permit safe image-guided procedures. Recently, electromagnetic tracking (EMT) is utilized to track the tip of the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0626-9

    authors: Deguchi D,Feuerstein M,Kitasaka T,Suenaga Y,Ide I,Murase H,Imaizumi K,Hasegawa Y,Mori K

    更新日期:2012-05-01 00:00:00

  • A computer analysis method for correlating knee X-rays with continuous indicators.

    abstract:PURPOSE:To develop an image analysis method that can automatically find correlations between a set of plain radiographs and continuous clinical or physiological indicators. METHODS:Knee X-rays taken from the Baltimore Longitudinal Study of Aging are used in this study. The computer analysis method is based on the WND-...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0550-z

    authors: Shamir L

    更新日期:2011-09-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • Planning and simulation of microsurgical laser bone ablation.

    abstract:PURPOSE:Laser ablation of hard tissue is not completely understood until now and not modeled for computer-assisted microsurgery. A precise planning and simulation is an essential step toward the usage of microsurgical laser bone ablation in the operating room. METHODS:Planning the volume for laser bone ablation is bas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0303-4

    authors: Kahrs LA,Burgner J,Klenzner T,Raczkowsky J,Schipper J,Wörn H

    更新日期:2010-03-01 00:00:00

  • Automated pulmonary nodule CT image characterization in lung cancer screening.

    abstract:PURPOSE:In lung cancer screening, pulmonary nodules are first identified in low-dose chest CT images. Costly follow-up procedures could be avoided if it were possible to establish the malignancy status of these nodules from these initial images. Preliminary computer methods have been proposed to characterize the malign...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1245-7

    authors: Reeves AP,Xie Y,Jirapatnakul A

    更新日期:2016-01-01 00:00:00

  • A low-cost tracked C-arm (TC-arm) upgrade system for versatile quantitative intraoperative imaging.

    abstract:PURPOSE:C-arm fluoroscopy is frequently used in clinical applications as a low-cost and mobile real-time qualitative assessment tool. C-arms, however, are not widely accepted for applications involving quantitative assessments, mainly due to the lack of reliable and low-cost position tracking methods, as well as adequa...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0957-9

    authors: Amiri S,Wilson DR,Masri BA,Anglin C

    更新日期:2014-07-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • Scaled, patient-specific 3D vertebral model reconstruction based on 2D lateral fluoroscopy.

    abstract:BACKGROUNDS:Accurate three-dimensional (3D) models of lumbar vertebrae are required for image-based 3D kinematics analysis. MRI or CT datasets are frequently used to derive 3D models but have the disadvantages that they are expensive, time-consuming or involving ionizing radiation (e.g., CT acquisition). An alternative...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0515-7

    authors: Zheng G,Nolte LP,Ferguson SJ

    更新日期:2011-05-01 00:00:00

  • Interactive determination of robust safety margins for oncologic liver surgery.

    abstract:OBJECTIVE:Complex oncologic interventions in the liver require an extensive and careful preoperative analysis. Particularly the achievement of an optimal safety margin around tumors remains a difficult task for surgeons. METHODS:We present new methods for evaluating different safety margins and their effect on the ass...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0359-1

    authors: Hansen C,Zidowitz S,Hindennach M,Schenk A,Hahn H,Peitgen HO

    更新日期:2009-09-01 00:00:00

  • Force estimation from OCT volumes using 3D CNNs.

    abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1777-8

    authors: Gessert N,Beringhoff J,Otte C,Schlaefer A

    更新日期:2018-07-01 00:00:00

  • Breast masses detection using phase portrait analysis and fuzzy inference systems.

    abstract:PURPOSE:Breast masses exhibit variability in margins, shapes, and dimensions, so their detection is a difficult task in mammographic computer-aided diagnosis. Mass detection is usually a two-step procedure: mass identification and false-positive reduction. A new method to automatically detect mass lesions in mammograph...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0659-0

    authors: Mencattini A,Salmeri M

    更新日期:2012-07-01 00:00:00

  • Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks.

    abstract:PURPOSE:During needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes. METHODS:We present a novel appr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1798-3

    authors: Pourtaherian A,Ghazvinian Zanjani F,Zinger S,Mihajlovic N,Ng GC,Korsten HHM,de With PHN

    更新日期:2018-09-01 00:00:00

  • A clinically applicable laser-based image-guided system for laparoscopic liver procedures.

    abstract:PURPOSE:Laser range scanners (LRS) allow performing a surface scan without physical contact with the organ, yielding higher registration accuracy for image-guided surgery (IGS) systems. However, the use of LRS-based registration in laparoscopic liver surgery is still limited because current solutions are composed of ex...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1309-8

    authors: Fusaglia M,Hess H,Schwalbe M,Peterhans M,Tinguely P,Weber S,Lu H

    更新日期:2016-08-01 00:00:00

  • Ultrasound texture-based CAD system for detecting neuromuscular diseases.

    abstract:PURPOSE:Diagnosis of neuromuscular diseases in ultrasonography is a challenging task since experts are often unable to discriminate between healthy and pathological cases. A computer-aided diagnosis (CAD) system for skeletal muscle ultrasonography was developed and tested for myositis detection in ultrasound images of ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1133-6

    authors: König T,Steffen J,Rak M,Neumann G,von Rohden L,Tönnies KD

    更新日期:2015-09-01 00:00:00

  • Language-based translation and prediction of surgical navigation steps for endoscopic wayfinding assistance in minimally invasive surgery.

    abstract:PURPOSE:In the context of aviation and automotive navigation technology, assistance functions are associated with predictive planning and wayfinding tasks. In endoscopic minimally invasive surgery, however, assistance so far relies primarily on image-based localization and classification. We show that navigation workfl...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02264-2

    authors: Bieck R,Heuermann K,Pirlich M,Neumann J,Neumuth T

    更新日期:2020-12-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Computer-aided cephalometric landmark annotation for CBCT data.

    abstract:PURPOSE:Nowadays, with the increased diffusion of Cone Beam Computerized Tomography (CBCT) scanners in dental and maxillo-facial practice, 3D cephalometric analysis is emerging. Maxillofacial surgeons and dentists make wide use of cephalometric analysis in diagnosis, surgery and treatment planning. Accuracy and repeata...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1453-9

    authors: Codari M,Caffini M,Tartaglia GM,Sforza C,Baselli G

    更新日期:2017-01-01 00:00:00

  • Model-based segmentation in orbital volume measurement with cone beam computed tomography and evaluation against current concepts.

    abstract:PURPOSE:Objective determination of the orbital volume is important in the diagnostic process and in evaluating the efficacy of medical and/or surgical treatment of orbital diseases. Tools designed to measure orbital volume with computed tomography (CT) often cannot be used with cone beam CT (CBCT) because of inferior t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1228-8

    authors: Wagner ME,Gellrich NC,Friese KI,Becker M,Wolter FE,Lichtenstein JT,Stoetzer M,Rana M,Essig H

    更新日期:2016-01-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00

  • Formal verification of software-based medical devices considering medical guidelines.

    abstract:OBJECTIVE:Software-based devices have increasingly become an important part of several clinical scenarios. Due to their critical impact on human life, medical devices have very strict safety requirements. It is therefore necessary to apply verification methods to ensure that the safety requirements are met. Verificatio...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0919-2

    authors: Daw Z,Cleaveland R,Vetter M

    更新日期:2014-01-01 00:00:00

  • Hybrid simulation using mixed reality for interventional ultrasound imaging training.

    abstract:PURPOSE:Ultrasound (US) imaging offers advantages over other imaging modalities and has become the most widespread modality for many diagnostic and interventional procedures. However, traditional 2D US requires a long training period, especially to learn how to manipulate the probe. A hybrid interactive system based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1113-x

    authors: Freschi C,Parrini S,Dinelli N,Ferrari M,Ferrari V

    更新日期:2015-07-01 00:00:00

  • Learned optical flow for intra-operative tracking of the retinal fundus.

    abstract:PURPOSE:Sustained delivery of regenerative retinal therapies by robotic systems requires intra-operative tracking of the retinal fundus. We propose a supervised deep convolutional neural network to densely predict semantic segmentation and optical flow of the retina as mutually supportive tasks, implicitly inpainting r...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02160-9

    authors: Ravasio CS,Pissas T,Bloch E,Flores B,Jalali S,Stoyanov D,Cardoso JM,Da Cruz L,Bergeles C

    更新日期:2020-05-01 00:00:00