Generative multi-adversarial network for striking the right balance in abdominal image segmentation.

Abstract:

:Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, while the more frequently occurring samples of the majority class hamper the generalization of the classification boundary between infrequently occurring target objects and classes. In this paper, we developed a novel generative multi-adversarial network, called Ensemble-GAN, for mitigating this class imbalance problem in the semantic segmentation of abdominal images.Method The Ensemble-GAN framework is composed of a single-generator and a multi-discriminator variant for handling the class imbalance problem to provide a better generalization than existing approaches. The ensemble model aggregates the estimates of multiple models by training from different initializations and losses from various subsets of the training data. The single generator network analyzes the input image as a condition to predict a corresponding semantic segmentation image by use of feedback from the ensemble of discriminator networks. To evaluate the framework, we trained our framework on two public datasets, with different imbalance ratios and imaging modalities: the Chaos 2019 and the LiTS 2017.Result In terms of the F1 score, the accuracies of the semantic segmentation of healthy spleen, liver, and left and right kidneys were 0.93, 0.96, 0.90 and 0.94, respectively. The overall F1 scores for simultaneous segmentation of the lesions and liver were 0.83 and 0.94, respectively.Conclusion The proposed Ensemble-GAN framework demonstrated outstanding performance in the semantic segmentation of medical images in comparison with other approaches on popular abdominal imaging benchmarks. The Ensemble-GAN has the potential to segment abdominal images more accurately than human experts.

authors

Rezaei M,Näppi JJ,Lippert C,Meinel C,Yoshida H

doi

10.1007/s11548-020-02254-4

subject

Has Abstract

pub_date

2020-11-01 00:00:00

pages

1847-1858

issue

11

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02254-4

journal_volume

15

pub_type

杂志文章
  • [¹¹C]acetate and PET/CT assessment of muscle activation in rat studies.

    abstract:PURPOSE:The purpose of the present study is to apply kinetic analysis to investigate exercise-related changes in the metabolism of the skeletal muscle of the rat hindlimb by [[Formula: see text]]acetate positron emission tomography and computed tomography (PET/CT). METHODS:Contractions were induced in Wistar rats' lef...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1260-8

    authors: Trombella S,García D,Colin DJ,Germain S,Seimbille Y,Ratib O

    更新日期:2016-05-01 00:00:00

  • Detection and modelling of contacts in explicit finite-element simulation of soft tissue biomechanics.

    abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1142-5

    authors: Johnsen SF,Taylor ZA,Han L,Hu Y,Clarkson MJ,Hawkes DJ,Ourselin S

    更新日期:2015-11-01 00:00:00

  • Altered brain anatomical networks and disturbed connection density in brain tumor patients revealed by diffusion tensor tractography.

    abstract:PURPOSE:Brain tumor patients are usually accompanied by impairments in cognitive functions, and these dysfunctions arise from the altered diffusion tensor of water molecules and disrupted neuronal conduction in white matter. Diffusion tensor imaging (DTI) is a powerful noninvasive imaging technique that can reflect dif...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1330-y

    authors: Yu Z,Tao L,Qian Z,Wu J,Liu H,Yu Y,Song J,Wang S,Sun J

    更新日期:2016-11-01 00:00:00

  • Use the force: deformation correction in robotic 3D ultrasound.

    abstract:PURPOSE:Ultrasound acquisitions are typically affected by deformations due to the pressure applied onto the contact surface. While a certain amount of pressure is necessary to ensure good acoustic coupling and visibility of the anatomy under examination, the caused deformations hinder accurate localization and geometri...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1716-8

    authors: Virga S,Göbl R,Baust M,Navab N,Hennersperger C

    更新日期:2018-05-01 00:00:00

  • Interactive bone drilling using a 2D pointing device to support Microendoscopic Discectomy planning.

    abstract:PURPOSE:To support preoperative planning of bone drilling for Microendoscopic Discectomy, we present a set of interactive bone-drilling methods using a general 2D pointing device. METHODS:Unlike the existing methods, our framework has the following features: (1) the user can directly cut away arbitrary 3D regions on t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0413-z

    authors: Imanishi K,Nakao M,Kioka M,Mori M,Yoshida M,Takahashi T,Minato K

    更新日期:2010-09-01 00:00:00

  • Finger-attachment device for the feedback of gripping and pulling force in a manipulating system for brain tumor resection.

    abstract:PURPOSE:Development and evaluation of an effective attachment device for a bilateral brain tumor resection robotic surgery system based on the sensory performance of the human index finger in order to precisely detect gripping- and pulling-force feedback. METHODS:First, a basic test was conducted to investigate the pe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1640-3

    authors: Chinbe H,Yoneyama T,Watanabe T,Miyashita K,Nakada M

    更新日期:2018-01-01 00:00:00

  • Automated identification and reduction of artifacts in cine four-dimensional computed tomography (4DCT) images using respiratory motion model.

    abstract:PURPOSE:Four-dimensional computed tomography (4DCT) images are often marred by artifacts that substantially degrade image quality and confound image interpretation. Human observation remains the standard method of 4DCT artifact evaluation, which is time-consuming and subjective. We develop a method to automatically ide...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1538-0

    authors: Li M,Castillo SJ,Castillo R,Castillo E,Guerrero T,Xiao L,Zheng X

    更新日期:2017-09-01 00:00:00

  • Segmentation of the placenta and its vascular tree in Doppler ultrasound for fetal surgery planning.

    abstract:PURPOSE:Twin-to-twin transfusion syndrome (TTTS) is a serious condition that occurs in about 10-15% of monochorionic twin pregnancies. In most instances, the blood flow is unevenly distributed throughout the placenta anastomoses leading to the death of both fetuses if no surgical procedure is performed. Fetoscopic lase...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02256-2

    authors: Perera-Bel E,Ceresa M,Torrents-Barrena J,Masoller N,Valenzuela-Alcaraz B,Gratacós E,Eixarch E,González Ballester MA

    更新日期:2020-11-01 00:00:00

  • MRI-compatible positioning device for guiding a focused ultrasound system for transrectal treatment of prostate cancer.

    abstract:BACKGROUND:High-intensity focused ultrasound (HIFU) is a promising treatment method for many common cancers, including prostate cancer. Magnetic resonance image (MRI) guidance of HIFU permits targeting and monitoring of therapy. A prototype MRI-compatible positioning device that navigates a HIFU transducer was designed...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0964-x

    authors: Yiallouras C,Mylonas N,Damianou C

    更新日期:2014-07-01 00:00:00

  • Temporal bone borehole accuracy for cochlear implantation influenced by drilling strategy: an in vitro study.

    abstract:PURPOSE:Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0997-9

    authors: Kobler JP,Schoppe M,Lexow GJ,Rau TS,Majdani O,Kahrs LA,Ortmaier T

    更新日期:2014-11-01 00:00:00

  • Accuracy analysis in MRI-guided robotic prostate biopsy.

    abstract:PURPOSE:To assess retrospectively the clinical accuracy of an magnetic resonance imaging-guided robotic prostate biopsy system that has been used in the US National Cancer Institute for over 6 years. METHODS:Series of 2D transverse volumetric MR image slices of the prostate both pre (high-resolution T2-weighted)- and ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0831-9

    authors: Xu H,Lasso A,Guion P,Krieger A,Kaushal A,Singh AK,Pinto PA,Coleman J,Grubb RL 3rd,Lattouf JB,Menard C,Whitcomb LL,Fichtinger G

    更新日期:2013-11-01 00:00:00

  • PyDBS: an automated image processing workflow for deep brain stimulation surgery.

    abstract:PURPOSE:Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmenta...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1007-y

    authors: D'Albis T,Haegelen C,Essert C,Fernández-Vidal S,Lalys F,Jannin P

    更新日期:2015-02-01 00:00:00

  • Automatic airway tree segmentation based on multi-scale context information.

    abstract:PURPOSE:Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies. METHODS...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02293-x

    authors: Zhou K,Chen N,Xu X,Wang Z,Guo J,Liu L,Yi Z

    更新日期:2021-01-19 00:00:00

  • Automated muscle segmentation from CT images of the hip and thigh using a hierarchical multi-atlas method.

    abstract:PURPOSE:Patient-specific quantitative assessments of muscle mass and biomechanical musculoskeletal simulations require segmentation of the muscles from medical images. The objective of this work is to automate muscle segmentation from CT data of the hip and thigh. METHOD:We propose a hierarchical multi-atlas method in...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1758-y

    authors: Yokota F,Otake Y,Takao M,Ogawa T,Okada T,Sugano N,Sato Y

    更新日期:2018-07-01 00:00:00

  • Robust GPU-based virtual reality simulation of radio-frequency ablations for various needle geometries and locations.

    abstract:PURPOSE:Radio-frequency ablations play an important role in the therapy of malignant liver lesions. The navigation of a needle to the lesion poses a challenge for both the trainees and intervening physicians. METHODS:This publication presents a new GPU-based, accurate method for the simulation of radio-frequency ablat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02033-w

    authors: Kath N,Handels H,Mastmeyer A

    更新日期:2019-11-01 00:00:00

  • Robotic laser osteotomy through penscriptive structured light visual servoing.

    abstract:PURPOSE:Planning osteotomies is a task that surgeons do as part of standard surgical workflow. This task, however, becomes more difficult and less intuitive when a robot is tasked with performing the osteotomy. In this study, we aim to provide a new method for surgeons to allow for highly intuitive trajectory planning,...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01905-x

    authors: Jivraj J,Deorajh R,Lai P,Chen C,Nguyen N,Ramjist J,Yang VXD

    更新日期:2019-05-01 00:00:00

  • Interactive navigation of segmented MR angiograms using simultaneous curved planar and volume visualizations.

    abstract:PURPOSE:Interactive visualization is required to inspect and monitor the automatic segmentation of vessels derived from contrast-enhanced magnetic resonance angiography (CE-MRA). A dual-view visualization scheme consisting of curved planar reformation (CPR) and direct volume rendering (DVR) was developed for this purpo...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0534-4

    authors: van Schooten BW,van Dijk EM,Suinesiaputra A,Reiber JH

    更新日期:2011-09-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • Projection-based visual guidance for robot-aided RF needle insertion.

    abstract:PURPOSE:The use of projector-based augmented reality (AR) in surgery may enable surgeons to directly view anatomical models and surgical data from the patient's surface (skin). It has the advantages of a consistent viewing focus on the patient, an extended field of view and augmented interaction. This paper presents an...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0897-4

    authors: Wen R,Chui CK,Ong SH,Lim KB,Chang SK

    更新日期:2013-11-01 00:00:00

  • Spine labeling in MRI via regularized distribution matching.

    abstract:PURPOSE:This study investigates an efficient (nearly real-time) two-stage spine labeling algorithm that removes the need for an external training while being applicable to different types of MRI data and acquisition protocols. METHODS:Based solely on the image being labeled (i.e., we do not use training data), the fir...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1651-0

    authors: Hojjat SP,Ayed I,Garvin GJ,Punithakumar K

    更新日期:2017-11-01 00:00:00

  • Automatic phase prediction from low-level surgical activities.

    abstract:PURPOSE:Analyzing surgical activities has received a growing interest in recent years. Several methods have been proposed to identify surgical activities and surgical phases from data acquired in operating rooms. These context-aware systems have multiple applications including: supporting the surgical team during the i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1195-0

    authors: Forestier G,Riffaud L,Jannin P

    更新日期:2015-06-01 00:00:00

  • Long-term experience with setup and implementation of an IHE-based image management and distribution system in intersectoral clinical routine.

    abstract:PURPOSE:Sharing of medical data is crucial for the proper treatment of patients as it could reduce the risk of duplicated medical tests and speed up the care process if all documents are readily available. Despite great technical progress, sharing patient data while maintaining full control over the process in an inter...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1819-2

    authors: Schwind F,Münch H,Schröter A,Brandner R,Kutscha U,Brandner A,Heinze O,Bergh B,Engelmann U

    更新日期:2018-11-01 00:00:00

  • Regional infarction identification from cardiac CT images: a computer-aided biomechanical approach.

    abstract:PURPOSE:Regional infarction identification is important for heart disease diagnosis and management, and myocardial deformation has been shown to be effective for this purpose. Although tagged and strain-encoded MR images can provide such measurements, they are uncommon in clinical routine. On the contrary, cardiac CT i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-016-1404-5

    authors: Wong KC,Tee M,Chen M,Bluemke DA,Summers RM,Yao J

    更新日期:2016-09-01 00:00:00

  • A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images.

    abstract:PURPOSE:The objective of medical content-based image retrieval (CBIR) is to assist clinicians in decision making by retrieving the most similar cases to a given query image from a large database. Herein, a new method for content-based image retrieval of cone beam CT (CBCT) scans is presented. METHODS:The introduced fr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01946-w

    authors: Abdolali F,Zoroofi RA,Otake Y,Sato Y

    更新日期:2019-05-01 00:00:00

  • Segmentation-based registration of ultrasound volumes for glioma resection in image-guided neurosurgery.

    abstract:PURPOSE:In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02045-6

    authors: Canalini L,Klein J,Miller D,Kikinis R

    更新日期:2019-10-01 00:00:00

  • Multistage segmentation model and SVM-ensemble for precise lung nodule detection.

    abstract:PURPOSE:Lung cancer detection at its initial stages increases the survival chances of patients. Automatic detection of lung nodules facilitates radiologists during the diagnosis. However, there is a challenge of false positives in automated systems which may lead to wrong findings. Precise segmentation facilitates to a...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1715-9

    authors: Naqi SM,Sharif M,Yasmin M

    更新日期:2018-07-01 00:00:00

  • Deep neural maps for unsupervised visualization of high-grade cancer in prostate biopsies.

    abstract::Prostate cancer (PCa) is the most frequent noncutaneous cancer in men. Early detection of PCa is essential for clinical decision making, and reducing metastasis and mortality rates. The current approach for PCa diagnosis is histopathologic analysis of core biopsies taken under transrectal ultrasound guidance (TRUS-gui...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01950-0

    authors: Sedghi A,Pesteie M,Javadi G,Azizi S,Yan P,Kwak JT,Xu S,Turkbey B,Choyke P,Pinto P,Wood B,Rohling R,Abolmaesumi P,Mousavi P

    更新日期:2019-06-01 00:00:00

  • A CAD of fully automated colonic polyp detection for contrasted and non-contrasted CT scans.

    abstract:PURPOSE:Computer-aided detection (CAD) systems are developed to help radiologists detect colonic polyps over CT scans. It is possible to reduce the detection time and increase the detection accuracy rates by using CAD systems. In this paper, we aimed to develop a fully integrated CAD system for automated detection of p...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1521-9

    authors: Tulum G,Bolat B,Osman O

    更新日期:2017-04-01 00:00:00

  • Model-based registration of preprocedure MR and intraprocedure US of the lumbar spine.

    abstract:PURPOSE:Epidural and spinal needle insertions, as well as facet joint denervation and injections are widely performed procedures on the lumbar spine for delivering anesthesia and analgesia. Ultrasound (US)-based approaches have gained popularity for accurate needle placement, as they use a non-ionizing, inexpensive and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1552-2

    authors: Behnami D,Sedghi A,Anas EMA,Rasoulian A,Seitel A,Lessoway V,Ungi T,Yen D,Osborn J,Mousavi P,Rohling R,Abolmaesumi P

    更新日期:2017-06-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00