A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.

Abstract:

PURPOSE:Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods were primarily evaluated on rigid, real-world environments. In this study, existing segmentation methods were evaluated for their use on a new dataset of transoral endoscopic exploration. METHODS:Four machine learning-based methods SegNet, UNet, ENet and ErfNet were trained with supervision on a novel 7-class dataset of the human larynx. The dataset contains 536 manually segmented images from two patients during laser incisions. The Intersection-over-Union (IoU) evaluation metric was used to measure the accuracy of each method. Data augmentation and network ensembling were employed to increase segmentation accuracy. Stochastic inference was used to show uncertainties of the individual models. Patient-to-patient transfer was investigated using patient-specific fine-tuning. RESULTS:In this study, a weighted average ensemble network of UNet and ErfNet was best suited for the segmentation of laryngeal soft tissue with a mean IoU of 84.7%. The highest efficiency was achieved by ENet with a mean inference time of 9.22 ms per image. It is shown that 10 additional images from a new patient are sufficient for patient-specific fine-tuning. CONCLUSION:CNN-based methods for semantic segmentation are applicable to endoscopic images of laryngeal soft tissue. The segmentation can be used for active constraints or to monitor morphological changes and autonomously detect pathologies. Further improvements could be achieved by using a larger dataset or training the models in a self-supervised manner on additional unlabeled data.

authors

Laves MH,Bicker J,Kahrs LA,Ortmaier T

doi

10.1007/s11548-018-01910-0

subject

Has Abstract

pub_date

2019-03-01 00:00:00

pages

483-492

issue

3

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-018-01910-0

journal_volume

14

pub_type

杂志文章
  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • Accuracy analysis in MRI-guided robotic prostate biopsy.

    abstract:PURPOSE:To assess retrospectively the clinical accuracy of an magnetic resonance imaging-guided robotic prostate biopsy system that has been used in the US National Cancer Institute for over 6 years. METHODS:Series of 2D transverse volumetric MR image slices of the prostate both pre (high-resolution T2-weighted)- and ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0831-9

    authors: Xu H,Lasso A,Guion P,Krieger A,Kaushal A,Singh AK,Pinto PA,Coleman J,Grubb RL 3rd,Lattouf JB,Menard C,Whitcomb LL,Fichtinger G

    更新日期:2013-11-01 00:00:00

  • Vertebra identification using template matching modelmp and K-means clustering.

    abstract:PURPOSE:Accurate vertebra detection and segmentation are essential steps for automating the diagnosis of spinal disorders. This study is dedicated to vertebra alignment measurement, the first step in a computer-aided diagnosis tool for cervical spine trauma. Automated vertebral segment alignment determination is a chal...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-013-0927-2

    authors: Larhmam MA,Benjelloun M,Mahmoudi S

    更新日期:2014-03-01 00:00:00

  • MINARO HD: control and evaluation of a handheld, highly dynamic surgical robot.

    abstract:PURPOSE:Current surgical robotic systems are either large serial arms, resulting in higher risks due to their high inertia and no inherent limitations of the working space, or they are bone-mounted, adding substantial additional task steps to the surgical workflow. The robot presented in this paper has a handy and ligh...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02306-9

    authors: Vossel M,Müller M,Niesche A,Theisgen L,Radermacher K,de la Fuente M

    更新日期:2021-01-23 00:00:00

  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • Analytical derivation of elasticity in breast phantoms for deformation tracking.

    abstract:PURPOSE:Patient-specific biomedical modeling of the breast is of interest for medical applications such as image registration, image guided procedures and the alignment for biopsy or surgery purposes. The computation of elastic properties is essential to simulate deformations in a realistic way. This study presents an ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1803-x

    authors: Groenhuis V,Visentin F,Siepel FJ,Maris BM,Dall'alba D,Fiorini P,Stramigioli S

    更新日期:2018-10-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00

  • A vision-based system for fast and accurate laser scanning in robot-assisted phonomicrosurgery.

    abstract:PURPOSE:Surgical quality in phonomicrosurgery can be improved by open-loop laser control (e.g., high-speed scanning capabilities) with a robust and accurate closed-loop visual servoing systems. A new vision-based system for laser scanning control during robot-assisted phonomicrosurgery was developed and tested. METHOD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1078-9

    authors: Dagnino G,Mattos LS,Caldwell DG

    更新日期:2015-02-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • [¹¹C]acetate and PET/CT assessment of muscle activation in rat studies.

    abstract:PURPOSE:The purpose of the present study is to apply kinetic analysis to investigate exercise-related changes in the metabolism of the skeletal muscle of the rat hindlimb by [[Formula: see text]]acetate positron emission tomography and computed tomography (PET/CT). METHODS:Contractions were induced in Wistar rats' lef...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1260-8

    authors: Trombella S,García D,Colin DJ,Germain S,Seimbille Y,Ratib O

    更新日期:2016-05-01 00:00:00

  • Breast tumor classification using different features of quantitative ultrasound parametric images.

    abstract:RATIONALE AND OBJECTIVES:The ultrasound B-mode-based morphological and texture analysis and Nakagami parametric imaging have been proposed to characterize breast tumors. Since these three feature categories of ultrasonic tissue characterization supply information on different physical characteristics of breast tumors, ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01908-8

    authors: Hsu SM,Kuo WH,Kuo FC,Liao YY

    更新日期:2019-04-01 00:00:00

  • Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT.

    abstract:PURPOSE:Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately. METHODS:The proposed method starts with manually delineated ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1457-5

    authors: Liu Y,Jin R,Chen M,Song E,Xu X,Zhang S,Hung CC

    更新日期:2016-12-01 00:00:00

  • A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

    abstract:PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1881-9

    authors: Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

    更新日期:2019-04-01 00:00:00

  • Design considerations for a novel MRI compatible manipulator for prostate cryoablation.

    abstract:PURPOSE:Prostate carcinoma is a commonly diagnosed cancer in men. Nonsurgical treatment of early stage prostate cancer is an important alternative. The use of MRI for tumor cryoablation is of particular interest: it offers lower morbidity compared with other localized techniques. However, the current manual procedure i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0558-4

    authors: Abdelaziz S,Esteveny L,Renaud P,Bayle B,Barbé L,De Mathelin M,Gangi A

    更新日期:2011-11-01 00:00:00

  • Multimodal mixed reality visualisation for intraoperative surgical guidance.

    abstract:PURPOSE:In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02165-4

    authors: Cartucho J,Shapira D,Ashrafian H,Giannarou S

    更新日期:2020-05-01 00:00:00

  • A deep learning framework for efficient analysis of breast volume and fibroglandular tissue using MR data with strong artifacts.

    abstract:PURPOSE:The main purpose of this work is to develop, apply, and evaluate an efficient approach for breast density estimation in magnetic resonance imaging data, which contain strong artifacts including intensity inhomogeneities. METHODS:We present a pipeline for breast density estimation, which consists of intensity i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01928-y

    authors: Ivanovska T,Jentschke TG,Daboul A,Hegenscheid K,Völzke H,Wörgötter F

    更新日期:2019-10-01 00:00:00

  • Accuracy and reliability of computer-assisted semi-automated morphological analysis of intracranial aneurysms: an experimental study with digital phantoms and clinical aneurysm cases.

    abstract:PURPOSE:Morphological parameters are very important for predicting aneurysm rupture. However, due to geometric radiographic distortion and plane/angle selection bias, the traditional manual measurements (MM) of aneurysm morphology are inaccurate and suffer from severe variability. Our study is to evaluate the accuracy ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02218-8

    authors: Geng J,Hu P,Ji Z,Li C,Li L,Shen J,Feng X,Wang W,Yang G,Li J,Zhang H

    更新日期:2020-10-01 00:00:00

  • Finger-attachment device for the feedback of gripping and pulling force in a manipulating system for brain tumor resection.

    abstract:PURPOSE:Development and evaluation of an effective attachment device for a bilateral brain tumor resection robotic surgery system based on the sensory performance of the human index finger in order to precisely detect gripping- and pulling-force feedback. METHODS:First, a basic test was conducted to investigate the pe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1640-3

    authors: Chinbe H,Yoneyama T,Watanabe T,Miyashita K,Nakada M

    更新日期:2018-01-01 00:00:00

  • Real-time inextensible surgical thread simulation.

    abstract:PURPOSE:This paper discusses a real-time simulation method of inextensible surgical thread based on the Cosserat rod theory using position-based dynamics (PBD). The method realizes stable twining and knotting of surgical thread while including inextensibility, bending, twisting and coupling effects. METHODS:The Cosser...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1739-1

    authors: Xu L,Liu Q

    更新日期:2018-07-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • A Survey of auditory display in image-guided interventions.

    abstract:PURPOSE:This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of publi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-017-1547-z

    authors: Black D,Hansen C,Nabavi A,Kikinis R,Hahn H

    更新日期:2017-10-01 00:00:00

  • Designing and validating a PVA liver phantom with respiratory motion for needle-based interventions.

    abstract:PURPOSE:The purpose is to design and validate an anthropomorphic polyvinyl alcohol (PVA) liver phantom with respiratory motion to simulate needle-based interventions. Such a system can, for example, be used as a validation tool for novel needles. METHODS:Image segmentations of CT scans of four patients during inspirat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02029-6

    authors: de Jong TL,Moelker A,Dankelman J,van den Dobbelsteen JJ

    更新日期:2019-12-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • Temporal bone borehole accuracy for cochlear implantation influenced by drilling strategy: an in vitro study.

    abstract:PURPOSE:Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0997-9

    authors: Kobler JP,Schoppe M,Lexow GJ,Rau TS,Majdani O,Kahrs LA,Ortmaier T

    更新日期:2014-11-01 00:00:00

  • Endoscopic scene labelling and augmentation using intraoperative pulsatile motion and colour appearance cues with preoperative anatomical priors.

    abstract:PURPOSE:Despite great advances in medical image segmentation, the accurate and automatic segmentation of endoscopic scenes remains a challenging problem. Two important aspects have to be considered in segmenting an endoscopic scene: (1) noise and clutter due to light reflection and smoke from cutting tissue, and (2) st...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1331-x

    authors: Nosrati MS,Amir-Khalili A,Peyrat JM,Abinahed J,Al-Alao O,Al-Ansari A,Abugharbieh R,Hamarneh G

    更新日期:2016-08-01 00:00:00

  • Automatic airway tree segmentation based on multi-scale context information.

    abstract:PURPOSE:Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies. METHODS...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02293-x

    authors: Zhou K,Chen N,Xu X,Wang Z,Guo J,Liu L,Yi Z

    更新日期:2021-01-19 00:00:00

  • Hand-eye calibration for surgical cameras: a Procrustean Perspective-n-Point solution.

    abstract:PURPOSE:Surgical cameras are prevalent in modern operating theatres often used as surrogates for direct vision. A surgical navigational system is a useful adjunct, but requires an accurate "hand-eye" calibration to determine the geometrical relationship between the surgical camera and tracking markers. METHODS:Using a...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1590-9

    authors: Morgan I,Jayarathne U,Rankin A,Peters TM,Chen ECS

    更新日期:2017-07-01 00:00:00

  • MIDG-Emerging grid technologies for multi-site preclinical molecular imaging research communities.

    abstract:PURPOSE:Molecular imaging is the visualization and identification of specific molecules in anatomy for insight into metabolic pathways, tissue consistency, and tracing of solute transport mechanisms. This paper presents the Molecular Imaging Data Grid (MIDG) which utilizes emerging grid technologies in preclinical mole...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0524-6

    authors: Lee J,Documet J,Liu B,Park R,Tank A,Huang HK

    更新日期:2011-03-01 00:00:00

  • Fusion of 3D real-time echocardiography and cine MRI using a saliency analysis.

    abstract:PURPOSE:This paper presents a novel 3D multimodal registration strategy to fuse 3D real-time echocardiography images with cardiac cine MRI images. This alignment is performed in a saliency space, which is designed to maximize similarity between the two imaging modalities. This fusion improves the quality of the availab...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02087-w

    authors: Atehortúa A,Garreau M,Simon A,Donal E,Lederlin M,Romero E

    更新日期:2020-02-01 00:00:00