Patch-based classification of gallbladder wall vascularity from laparoscopic images using deep learning.

Abstract:

PURPOSE:In this study, we propose a deep learning approach for assessment of gallbladder (GB) wall vascularity from images of laparoscopic cholecystectomy (LC). Difficulty in the visualization of GB wall vessels may be the result of fatty infiltration or increased thickening of the GB wall, potentially as a result of cholecystitis or other diseases. METHODS:The dataset included 800 patches and 181 region outlines of the GB wall extracted from 53 operations of the Cholec80 video collection. The GB regions and patches were annotated by two expert surgeons using two labeling schemes: 3 classes (low, medium and high vascularity) and 2 classes (low vs. high). Two convolutional neural network (CNN) architectures were investigated. Preprocessing (vessel enhancement) and post-processing (late fusion of CNN output) techniques were applied. RESULTS:The best model yielded accuracy 94.48% and 83.77% for patch classification into 2 and 3 classes, respectively. For the GB wall regions, the best model yielded accuracy 91.16% (2 classes) and 80.66% (3 classes). The inter-observer agreement was 91.71% (2 classes) and 78.45% (3 classes). Late fusion analysis allowed the computation of spatial probability maps, which provided a visual representation of the probability for each vascularity class across the GB wall region. CONCLUSIONS:This study is the first significant step forward to assess the vascularity of the GB wall from intraoperative images based on computer vision and deep learning techniques. The classification performance of the CNNs was comparable to the agreement of two expert surgeons. The approach may be used for various applications such as for classification of LC operations and context-aware assistance in surgical education and practice.

authors

Loukas C,Frountzas M,Schizas D

doi

10.1007/s11548-020-02285-x

subject

Has Abstract

pub_date

2021-01-01 00:00:00

pages

103-113

issue

1

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02285-x

journal_volume

16

pub_type

杂志文章
  • Predicting underestimation of ductal carcinoma in situ: a comparison between radiomics and conventional approaches.

    abstract:PURPOSE:We aimed to investigate the feasibility of predicting invasion carcinoma from ductal carcinoma in situ (DCIS) lesions diagnosed by preoperative core needle biopsy using radiomics signatures, clinical imaging characteristics, and breast imaging reporting and data system (BI-RADS) descriptors on mammography. MET...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1900-x

    authors: Li J,Song Y,Xu S,Wang J,Huang H,Ma W,Jiang X,Wu Y,Cai H,Li L

    更新日期:2019-04-01 00:00:00

  • Vertebra identification using template matching modelmp and K-means clustering.

    abstract:PURPOSE:Accurate vertebra detection and segmentation are essential steps for automating the diagnosis of spinal disorders. This study is dedicated to vertebra alignment measurement, the first step in a computer-aided diagnosis tool for cervical spine trauma. Automated vertebral segment alignment determination is a chal...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-013-0927-2

    authors: Larhmam MA,Benjelloun M,Mahmoudi S

    更新日期:2014-03-01 00:00:00

  • Analytical derivation of elasticity in breast phantoms for deformation tracking.

    abstract:PURPOSE:Patient-specific biomedical modeling of the breast is of interest for medical applications such as image registration, image guided procedures and the alignment for biopsy or surgery purposes. The computation of elastic properties is essential to simulate deformations in a realistic way. This study presents an ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1803-x

    authors: Groenhuis V,Visentin F,Siepel FJ,Maris BM,Dall'alba D,Fiorini P,Stramigioli S

    更新日期:2018-10-01 00:00:00

  • A Survey of auditory display in image-guided interventions.

    abstract:PURPOSE:This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of publi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-017-1547-z

    authors: Black D,Hansen C,Nabavi A,Kikinis R,Hahn H

    更新日期:2017-10-01 00:00:00

  • Automated identification and reduction of artifacts in cine four-dimensional computed tomography (4DCT) images using respiratory motion model.

    abstract:PURPOSE:Four-dimensional computed tomography (4DCT) images are often marred by artifacts that substantially degrade image quality and confound image interpretation. Human observation remains the standard method of 4DCT artifact evaluation, which is time-consuming and subjective. We develop a method to automatically ide...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1538-0

    authors: Li M,Castillo SJ,Castillo R,Castillo E,Guerrero T,Xiao L,Zheng X

    更新日期:2017-09-01 00:00:00

  • Patient-specific estimation of detailed cochlear shape from clinical CT images.

    abstract:PURPOSE:A personalized estimation of the cochlear shape can be used to create computational anatomical models to aid cochlear implant (CI) surgery and CI audio processor programming ultimately resulting in improved hearing restoration. The purpose of this work is to develop and test a method for estimation of the detai...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1701-7

    authors: Kjer HM,Fagertun J,Wimmer W,Gerber N,Vera S,Barazzetti L,Mangado N,Ceresa M,Piella G,Stark T,Stauber M,Reyes M,Weber S,Caversaccio M,González Ballester MÁ,Paulsen RR

    更新日期:2018-03-01 00:00:00

  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • Automatic cardiac ventricle segmentation in MR images: a validation study.

    abstract:PURPOSE:Segmenting the cardiac ventricles in magnetic resonance (MR) images is required for cardiac function assessment. Numerous segmentation methods have been developed and applied to MR ventriculography. Quantitative validation of these segmentation methods with ground truth is needed prior to clinical use, but requ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0532-6

    authors: Grosgeorge D,Petitjean C,Caudron J,Fares J,Dacher JN

    更新日期:2011-09-01 00:00:00

  • Use the force: deformation correction in robotic 3D ultrasound.

    abstract:PURPOSE:Ultrasound acquisitions are typically affected by deformations due to the pressure applied onto the contact surface. While a certain amount of pressure is necessary to ensure good acoustic coupling and visibility of the anatomy under examination, the caused deformations hinder accurate localization and geometri...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1716-8

    authors: Virga S,Göbl R,Baust M,Navab N,Hennersperger C

    更新日期:2018-05-01 00:00:00

  • Orbital volume analysis: validation of a semi-automatic software segmentation method.

    abstract:PURPOSE:The purpose of this study was to validate a quick, accurate and reproducible (semi-) automatic software segmentation method to measure orbital volume in the unaffected bony orbit. Precise volume measurement of the orbital cavity is a useful addition to pre-operative planning and intraoperative navigation in orb...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1254-6

    authors: Jansen J,Schreurs R,Dubois L,Maal TJ,Gooris PJ,Becking AG

    更新日期:2016-01-01 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • A preregistered STAMP method for image-guided temporal bone surgery.

    abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0916-5

    authors: Oka M,Cho B,Matsumoto N,Hong J,Jinnouchi M,Ouchida R,Komune S,Hashizume M

    更新日期:2014-01-01 00:00:00

  • Decision support system for the planning of minimally invasive aortic valve replacement surgery.

    abstract:PURPOSE:Minimally invasive aortic valve replacement (MIAVR) procedures remain more complex and technically challenging compared to conventional full sternotomy surgery. This technique involves a restricted surgical field and a limited workspace, which is, at present, strictly reserved for the most experienced surgeons....

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1725-7

    authors: Li H,Castro M,Haigron P,Verhoye JP,Ruggieri VG

    更新日期:2018-08-01 00:00:00

  • Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI.

    abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1483-3

    authors: Soltaninejad M,Yang G,Lambrou T,Allinson N,Jones TL,Barrick TR,Howe FA,Ye X

    更新日期:2017-02-01 00:00:00

  • Translatory hip kinematics measured with optoelectronic surgical navigation.

    abstract:PURPOSE:An optoelectronic surgical navigation system was used to detect small but measurable translational motion of human hip cadavers in high-range passive motions. Kinematic data were also examined to demonstrate the role of soft tissues in constraining hip translation. METHODS:Twelve cadaver hips were scanned usin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1629-y

    authors: Zakani S,Rudan JF,Ellis RE

    更新日期:2017-08-01 00:00:00

  • Accuracy of 3D cephalometric measurements based on an automatic knowledge-based landmark detection algorithm.

    abstract:PURPOSE:To evaluate the accuracy of three-dimensional cephalometric measurements obtained through an automatic landmark detection algorithm compared to those obtained through manual identification. METHODS:The study demonstrates a comparison of 51 cephalometric measurements (28 linear, 16 angles and 7 ratios) on 30 CB...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1334-7

    authors: Gupta A,Kharbanda OP,Sardana V,Balachandran R,Sardana HK

    更新日期:2016-07-01 00:00:00

  • Fast, robust, and accurate monocular peer-to-peer tracking for surgical navigation.

    abstract:PURPOSE:This work presents a new monocular peer-to-peer tracking concept overcoming the distinction between tracking tools and tracked tools for optical navigation systems. A marker model concept based on marker triplets combined with a fast and robust algorithm for assigning image feature points to the corresponding m...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02111-z

    authors: Strzeletz S,Hazubski S,Moctezuma JL,Hoppe H

    更新日期:2020-03-01 00:00:00

  • Spine labeling in MRI via regularized distribution matching.

    abstract:PURPOSE:This study investigates an efficient (nearly real-time) two-stage spine labeling algorithm that removes the need for an external training while being applicable to different types of MRI data and acquisition protocols. METHODS:Based solely on the image being labeled (i.e., we do not use training data), the fir...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1651-0

    authors: Hojjat SP,Ayed I,Garvin GJ,Punithakumar K

    更新日期:2017-11-01 00:00:00

  • Four-dimensional fully convolutional residual network-based liver segmentation in Gd-EOB-DTPA-enhanced MRI.

    abstract:PURPOSE:Gadolinium-ethoxybenzyl-diethylenetriamine pentaacetic acid (Gd-EOB-DTPA)-enhanced magnetic resonance imaging (MRI) tends to show higher diagnostic accuracy than other modalities. There is a demand for computer-assisted detection (CAD) software for Gd-EOB-DTPA-enhanced MRI. Segmentation with high accuracy is im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01935-z

    authors: Takenaga T,Hanaoka S,Nomura Y,Nemoto M,Murata M,Nakao T,Miki S,Yoshikawa T,Hayashi N,Abe O

    更新日期:2019-08-01 00:00:00

  • Scaled, patient-specific 3D vertebral model reconstruction based on 2D lateral fluoroscopy.

    abstract:BACKGROUNDS:Accurate three-dimensional (3D) models of lumbar vertebrae are required for image-based 3D kinematics analysis. MRI or CT datasets are frequently used to derive 3D models but have the disadvantages that they are expensive, time-consuming or involving ionizing radiation (e.g., CT acquisition). An alternative...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0515-7

    authors: Zheng G,Nolte LP,Ferguson SJ

    更新日期:2011-05-01 00:00:00

  • Differential geometry-based techniques for characterization of boundary roughness of pulmonary nodules in CT images.

    abstract:PURPOSE:Boundary roughness of a pulmonary nodule is an important indication of its malignancy. The irregularity of the shape of a nodule is represented in terms of a few diagnostic characteristics such as spiculation, lobulation, and sphericity. Quantitative characterization of these diagnostic characteristics is essen...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1284-0

    authors: Dhara AK,Mukhopadhyay S,Saha P,Garg M,Khandelwal N

    更新日期:2016-03-01 00:00:00

  • Assessment of two 3-D fluoroscopic systems for articular fracture reduction: a cadaver study.

    abstract:OBJECTIVE:The most commonly used imaging device for assessment of fracture reduction is the two-dimensional X-ray fluoroscope. Two recently introduced 3D fluoroscopic devices, the Siremobil ISO-C3D (Siemens) and the C-InSight (Mazor Surgical Technologies), enable the surgeon to obtain spatial information for the assess...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0548-6

    authors: Weil YA,Liebergall M,Mosheiff R,Singer SB,Joskowicz L,Khoury A

    更新日期:2011-09-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00

  • Interactive bone drilling using a 2D pointing device to support Microendoscopic Discectomy planning.

    abstract:PURPOSE:To support preoperative planning of bone drilling for Microendoscopic Discectomy, we present a set of interactive bone-drilling methods using a general 2D pointing device. METHODS:Unlike the existing methods, our framework has the following features: (1) the user can directly cut away arbitrary 3D regions on t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0413-z

    authors: Imanishi K,Nakao M,Kioka M,Mori M,Yoshida M,Takahashi T,Minato K

    更新日期:2010-09-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Comparing calibration approaches for 3D ultrasound probes.

    abstract:OBJECTIVE:By adding a tracking sensor to a 3D ultrasound (US) probe and thus locating the probe in space, new applications within the fields of image guided surgery and radiation therapy are possible. To locate the US volume in space, a calibration is necessary to determine the mathematical transformation for mapping p...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-008-0258-x

    authors: Bergmeir C,Seitel M,Frank C,De Simone R,Meinzer HP,Wolf I

    更新日期:2009-03-01 00:00:00

  • Planning and simulation of microsurgical laser bone ablation.

    abstract:PURPOSE:Laser ablation of hard tissue is not completely understood until now and not modeled for computer-assisted microsurgery. A precise planning and simulation is an essential step toward the usage of microsurgical laser bone ablation in the operating room. METHODS:Planning the volume for laser bone ablation is bas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0303-4

    authors: Kahrs LA,Burgner J,Klenzner T,Raczkowsky J,Schipper J,Wörn H

    更新日期:2010-03-01 00:00:00

  • Detection and modelling of contacts in explicit finite-element simulation of soft tissue biomechanics.

    abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1142-5

    authors: Johnsen SF,Taylor ZA,Han L,Hu Y,Clarkson MJ,Hawkes DJ,Ourselin S

    更新日期:2015-11-01 00:00:00