Abdominal multi-organ segmentation with organ-attention networks and statistical fusion.

Abstract:

:Accurate and robust segmentation of abdominal organs on CT is essential for many clinical applications such as computer-aided diagnosis and computer-aided surgery. But this task is challenging due to the weak boundaries of organs, the complexity of the background, and the variable sizes of different organs. To address these challenges, we introduce a novel framework for multi-organ segmentation of abdominal regions by using organ-attention networks with reverse connections (OAN-RCs) which are applied to 2D views, of the 3D CT volume, and output estimates which are combined by statistical fusion exploiting structural similarity. More specifically, OAN is a two-stage deep convolutional network, where deep network features from the first stage are combined with the original image, in a second stage, to reduce the complex background and enhance the discriminative information for the target organs. Intuitively, OAN reduces the effect of the complex background by focusing attention so that each organ only needs to be discriminated from its local background. RCs are added to the first stage to give the lower layers more semantic information thereby enabling them to adapt to the sizes of different organs. Our networks are trained on 2D views (slices) enabling us to use holistic information and allowing efficient computation (compared to using 3D patches). To compensate for the limited cross-sectional information of the original 3D volumetric CT, e.g., the connectivity between neighbor slices, multi-sectional images are reconstructed from the three different 2D view directions. Then we combine the segmentation results from the different views using statistical fusion, with a novel term relating the structural similarity of the 2D views to the original 3D structure. To train the network and evaluate results, 13 structures were manually annotated by four human raters and confirmed by a senior expert on 236 normal cases. We tested our algorithm by 4-fold cross-validation and computed Dice-Sørensen similarity coefficients (DSC) and surface distances for evaluating our estimates of the 13 structures. Our experiments show that the proposed approach gives strong results and outperforms 2D- and 3D-patch based state-of-the-art methods in terms of DSC and mean surface distances.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Wang Y,Zhou Y,Shen W,Park S,Fishman EK,Yuille AL

doi

10.1016/j.media.2019.04.005

subject

Has Abstract

pub_date

2019-07-01 00:00:00

pages

88-102

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(18)30252-4

journal_volume

55

pub_type

杂志文章
  • Image guidance in orthopaedics and traumatology: A historical perspective.

    abstract::In this note we summarize the history of computer aided surgery in orthopaedics and traumatology from the end of the nineteenth century to currently observable future trends. We concentrate on the two major components of such systems, pre-operative planning and intra-operative execution. The evolution of the necessary...

    journal_title:Medical image analysis

    pub_type: 社论

    doi:10.1016/j.media.2016.06.033

    authors: Székely G,Nolte LP

    更新日期:2016-10-01 00:00:00

  • Large deformation diffeomorphic registration of diffusion-weighted imaging data.

    abstract::Registration plays an important role in group analysis of diffusion-weighted imaging (DWI) data. It can be used to build a reference anatomy for investigating structural variation or tracking changes in white matter. Unlike traditional scalar image registration where spatial alignment is the only focus, registration o...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.06.012

    authors: Zhang P,Niethammer M,Shen D,Yap PT

    更新日期:2014-12-01 00:00:00

  • Automatic detection of over 100 anatomical landmarks in medical CT images: A framework with independent detectors and combinatorial optimization.

    abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.04.001

    authors: Hanaoka S,Shimizu A,Nemoto M,Nomura Y,Miki S,Yoshikawa T,Hayashi N,Ohtomo K,Masutani Y

    更新日期:2017-01-01 00:00:00

  • Stochastic finite element framework for simultaneous estimation of cardiac kinematic functions and material parameters.

    abstract::A stochastic finite element framework is presented for the simultaneous estimation of the cardiac kinematic functions and material model parameters from periodic medical image sequences. While existing biomechanics studies of the myocardial material constitutive laws have assumed known tissue kinematic measurements, a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00066-5

    authors: Shi P,Liu H

    更新日期:2003-12-01 00:00:00

  • Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization.

    abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.07.007

    authors: Genet M,Stoeck CT,von Deuster C,Lee LC,Kozerke S

    更新日期:2018-12-01 00:00:00

  • Integrating segmentation methods from the Insight Toolkit into a visualization application.

    abstract::The Insight Toolkit (ITK) initiative from the National Library of Medicine has provided a suite of state-of-the-art segmentation and registration algorithms ideally suited to volume visualization and analysis. A volume visualization application that effectively utilizes these algorithms provides many benefits: it allo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.04.009

    authors: Martin K,Ibáñez L,Avila L,Barré S,Kaspersen JH

    更新日期:2005-12-01 00:00:00

  • CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation.

    abstract::Accurate segmentation of the prostate and organs at risk (e.g., bladder and rectum) in CT images is a crucial step for radiation therapy in the treatment of prostate cancer. However, it is a very challenging task due to unclear boundaries, large intra- and inter-patient shape variability, and uncertain existence of bo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.03.003

    authors: Wang S,He K,Nie D,Zhou S,Gao Y,Shen D

    更新日期:2019-05-01 00:00:00

  • Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge.

    abstract::Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the l...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101537

    authors: Zhuang X,Li L,Payer C,Štern D,Urschler M,Heinrich MP,Oster J,Wang C,Smedby Ö,Bian C,Yang X,Heng PA,Mortazi A,Bagci U,Yang G,Sun C,Galisot G,Ramel JY,Brouard T,Tong Q,Si W,Liao X,Zeng G,Shi Z,Zheng G,Wang

    更新日期:2019-12-01 00:00:00

  • Disentangled representation learning in cardiac image analysis.

    abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101535

    authors: Chartsias A,Joyce T,Papanastasiou G,Semple S,Williams M,Newby DE,Dharmakumar R,Tsaftaris SA

    更新日期:2019-12-01 00:00:00

  • Groupwise multi-atlas segmentation of the spinal cord's internal structure.

    abstract::The spinal cord is an essential and vulnerable component of the central nervous system. Differentiating and localizing the spinal cord internal structure (i.e., gray matter vs. white matter) is critical for assessment of therapeutic impacts and determining prognosis of relevant conditions. Fortunately, new magnetic re...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.01.003

    authors: Asman AJ,Bryan FW,Smith SA,Reich DS,Landman BA

    更新日期:2014-04-01 00:00:00

  • Directional wavelet based features for colonic polyp classification.

    abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.02.001

    authors: Wimmer G,Tamaki T,Tischendorf JJ,Häfner M,Yoshida S,Tanaka S,Uhl A

    更新日期:2016-07-01 00:00:00

  • Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm.

    abstract::In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori inform...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.005

    authors: Lorenzo-Valdés M,Sanchez-Ortiz GI,Elkington AG,Mohiaddin RH,Rueckert D

    更新日期:2004-09-01 00:00:00

  • An accurate, fast and robust method to generate patient-specific cubic Hermite meshes.

    abstract::In-silico continuum simulations of organ and tissue scale physiology often require a discretisation or mesh of the solution domain. Cubic Hermite meshes provide a smooth representation of anatomy that is well-suited for simulating large deformation mechanics. Models of organ mechanics and deformation have demonstrated...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.06.010

    authors: Lamata P,Niederer S,Nordsletten D,Barber DC,Roy I,Hose DR,Smith N

    更新日期:2011-12-01 00:00:00

  • Coupled parametric model for estimation of visual field tests based on OCT macular thickness maps, and vice versa, in glaucoma care.

    abstract::The current standard of care for glaucoma patients consists of functional assessment of vision via visual field (VF) testing, which is sensitive but subjective, time-consuming, and often unreliable. A new imaging technology, Fourier domain optical coherence tomography (OCT), is being introduced to assess the structura...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.05.012

    authors: Tsai A,Caprioli J,Shen LQ

    更新日期:2012-01-01 00:00:00

  • HookNet: Multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images.

    abstract::We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentric patches at multiple resolutions with different fields of view, feed different branches of HookNet, and intermedi...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101890

    authors: van Rijthoven M,Balkenhol M,Siliņa K,van der Laak J,Ciompi F

    更新日期:2021-02-01 00:00:00

  • Predicting the progression of mild cognitive impairment using machine learning: A systematic, quantitative and critical review.

    abstract::We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101848

    authors: Ansart M,Epelbaum S,Bassignana G,Bône A,Bottani S,Cattai T,Couronné R,Faouzi J,Koval I,Louis M,Thibeau-Sutre E,Wen J,Wild A,Burgos N,Dormont D,Colliot O,Durrleman S

    更新日期:2021-01-01 00:00:00

  • A symbolic environment for visualizing activated foci in functional neuroimaging datasets.

    abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80020-0

    authors: Rehm K,Lakshminaryan K,Frutiger S,Schaper KA,Sumners DW,Strother SC,Anderson JR,Rottenberg DA

    更新日期:1998-09-01 00:00:00

  • Context specific descriptors for tracking deforming tissue.

    abstract::In minimally invasive surgery, deployment of motion compensation, dynamic active constraints and adaptive intra-operative guidance require accurate estimation of deforming tissue in 3D. To this end, the use of vision-based techniques is advantageous in that it does not require the integration of additional hardware to...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.02.010

    authors: Mountney P,Yang GZ

    更新日期:2012-04-01 00:00:00

  • Interactive training system for interventional electrocardiology procedures.

    abstract::Recent progress in cardiac catheterization and devices has allowed the development of new therapies for severe cardiac diseases like arrhythmias and heart failure. The skills required for such interventions are very challenging to learn, and are typically acquired over several years. Virtual reality simulators may red...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.06.040

    authors: Talbot H,Spadoni F,Duriez C,Sermesant M,O'Neill M,Jaïs P,Cotin S,Delingette H

    更新日期:2017-01-01 00:00:00

  • An information theoretic approach for non-rigid image registration using voxel class probabilities.

    abstract::We propose two information theoretic similarity measures that allow to incorporate tissue class information in non-rigid image registration. The first measure assumes that tissue class probabilities have been assigned to each of the images to be registered by prior segmentation of both of them. One image is then non-r...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.03.004

    authors: D'Agostino E,Maes F,Vandermeulen D,Suetens P

    更新日期:2006-06-01 00:00:00

  • CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation.

    abstract::Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) introduced new state-of-the-art segmentation systems. Despite outperforming the overall accuracy of existing systems, the effects of DL model proper...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101950

    authors: Kavur AE,Gezer NS,Barış M,Aslan S,Conze PH,Groza V,Pham DD,Chatterjee S,Ernst P,Özkan S,Baydar B,Lachinov D,Han S,Pauli J,Isensee F,Perkonigg M,Sathish R,Rajan R,Sheet D,Dovletov G,Speck O,Nürnberger A,Maier-H

    更新日期:2020-12-25 00:00:00

  • Multiple hypothesis template tracking of small 3D vessel structures.

    abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.12.003

    authors: Friman O,Hindennach M,Kühnel C,Peitgen HO

    更新日期:2010-04-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Adaptive, template moderated, spatially varying statistical classification.

    abstract::A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00003-7

    authors: Warfield SK,Kaus M,Jolesz FA,Kikinis R

    更新日期:2000-03-01 00:00:00

  • Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network.

    abstract::Synthesized medical images have several important applications. For instance, they can be used as an intermedium in cross-modality image registration or used as augmented training samples to boost the generalization capability of a classifier. In this work, we propose a generic cross-modality synthesis approach with t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.12.002

    authors: Cai J,Zhang Z,Cui L,Zheng Y,Yang L

    更新日期:2019-02-01 00:00:00

  • CATARACTS: Challenge on automatic tool annotation for cataRACT surgery.

    abstract::Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient sol...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.11.008

    authors: Al Hajj H,Lamard M,Conze PH,Roychowdhury S,Hu X,Maršalkaitė G,Zisimopoulos O,Dedmari MA,Zhao F,Prellberg J,Sahu M,Galdran A,Araújo T,Vo DM,Panda C,Dahiya N,Kondo S,Bian Z,Vahdat A,Bialopetravičius J,Flouty E,Qiu

    更新日期:2019-02-01 00:00:00

  • Development and comparison of new hybrid motion tracking for bronchoscopic navigation.

    abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.001

    authors: Luó X,Feuerstein M,Deguchi D,Kitasaka T,Takabatake H,Mori K

    更新日期:2012-04-01 00:00:00

  • Concurrent tumor segmentation and registration with uncertainty-based sparse non-uniform graphs.

    abstract::In this paper, we present a graph-based concurrent brain tumor segmentation and atlas to diseased patient registration framework. Both segmentation and registration problems are modeled using a unified pairwise discrete Markov Random Field model on a sparse grid superimposed to the image domain. Segmentation is addres...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.02.006

    authors: Parisot S,Wells W 3rd,Chemouny S,Duffau H,Paragios N

    更新日期:2014-05-01 00:00:00

  • An image space approach to Cartesian based parallel MR imaging with total variation regularization.

    abstract::The Cartesian parallel magnetic imaging problem is formulated variationally using a high-order penalty for coil sensitivities and a total variation like penalty for the reconstructed image. Then the optimality system is derived and numerically discretized. The objective function used is non-convex, but it possesses a ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.07.002

    authors: Keeling SL,Clason C,Hintermüller M,Knoll F,Laurain A,von Winckel G

    更新日期:2012-01-01 00:00:00

  • Noise reduction in diffusion MRI using non-local self-similar information in joint x-q space.

    abstract::Diffusion MRI affords valuable insights into white matter microstructures, but suffers from low signal-to-noise ratio (SNR), especially at high diffusion weighting (i.e., b-value). To avoid time-intensive repeated acquisition, post-processing algorithms are often used to reduce noise. Among existing methods, non-local...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.006

    authors: Chen G,Wu Y,Shen D,Yap PT

    更新日期:2019-04-01 00:00:00