Ω-Net (Omega-Net): Fully automatic, multi-view cardiac MR detection, orientation, and segmentation with deep neural networks.

Abstract:

:Pixelwise segmentation of the left ventricular (LV) myocardium and the four cardiac chambers in 2-D steady state free precession (SSFP) cine sequences is an essential preprocessing step for a wide range of analyses. Variability in contrast, appearance, orientation, and placement of the heart between patients, clinical views, scanners, and protocols makes fully automatic semantic segmentation a notoriously difficult problem. Here, we present Ω-Net (Omega-Net): A novel convolutional neural network (CNN) architecture for simultaneous localization, transformation into a canonical orientation, and semantic segmentation. First, an initial segmentation is performed on the input image; second, the features learned during this initial segmentation are used to predict the parameters needed to transform the input image into a canonical orientation; and third, a final segmentation is performed on the transformed image. In this work, Ω-Nets of varying depths were trained to detect five foreground classes in any of three clinical views (short axis, SA; four-chamber, 4C; two-chamber, 2C), without prior knowledge of the view being segmented. This constitutes a substantially more challenging problem compared with prior work. The architecture was trained using three-fold cross-validation on a cohort of patients with hypertrophic cardiomyopathy (HCM, N=42) and healthy control subjects (N=21). Network performance, as measured by weighted foreground intersection-over-union (IoU), was substantially improved for the best-performing Ω-Net compared with U-Net segmentation without localization or orientation (0.858 vs 0.834). In addition, to be comparable with other works, Ω-Net was retrained from scratch using five-fold cross-validation on the publicly available 2017 MICCAI Automated Cardiac Diagnosis Challenge (ACDC) dataset. The Ω-Net outperformed the state-of-the-art method in segmentation of the LV and RV bloodpools, and performed slightly worse in segmentation of the LV myocardium. We conclude that this architecture represents a substantive advancement over prior approaches, with implications for biomedical image segmentation more generally.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Vigneault DM,Xie W,Ho CY,Bluemke DA,Noble JA

doi

10.1016/j.media.2018.05.008

subject

Has Abstract

pub_date

2018-08-01 00:00:00

pages

95-106

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(18)30299-8

journal_volume

48

pub_type

杂志文章
  • Wavelet optimization for content-based image retrieval in medical databases.

    abstract::We propose in this article a content-based image retrieval (CBIR) method for diagnosis aid in medical fields. In the proposed system, images are indexed in a generic fashion, without extracting domain-specific features: a signature is built for each image from its wavelet transform. These image signatures characterize...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.11.004

    authors: Quellec G,Lamard M,Cazuguel G,Cochener B,Roux C

    更新日期:2010-04-01 00:00:00

  • Disentangled representation learning in cardiac image analysis.

    abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101535

    authors: Chartsias A,Joyce T,Papanastasiou G,Semple S,Williams M,Newby DE,Dharmakumar R,Tsaftaris SA

    更新日期:2019-12-01 00:00:00

  • A work flow to build and validate patient specific left atrium electrophysiology models from catheter measurements.

    abstract::Biophysical models of the atrium provide a physically constrained framework for describing the current state of an atrium and allow predictions of how that atrium will respond to therapy. We propose a work flow to simulate patient specific electrophysiological heterogeneity from clinical data and validate the resultin...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.04.005

    authors: Corrado C,Williams S,Karim R,Plank G,O'Neill M,Niederer S

    更新日期:2018-07-01 00:00:00

  • Towards model-based analysis of cardiac MR tagging data: relation between left ventricular shear strain and myofiber orientation.

    abstract::Many cardiac pathologies are reflected in abnormal myocardial deformation, accessible through magnetic resonance tagging (MRT). Interpretation of the MRT data is difficult, since the relation between pathology and deformation is not straightforward. Mathematical models of cardiac mechanics could be used to translate m...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2006.04.001

    authors: Ubbink SW,Bovendeerd PH,Delhaas T,Arts T,van de Vosse FN

    更新日期:2006-08-01 00:00:00

  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • Joint optimization of segmentation and shape prior from level-set-based statistical shape model, and its application to the automated segmentation of abdominal organs.

    abstract::The goal of this study is to provide a theoretical framework for accurately optimizing the segmentation energy considering all of the possible shapes generated from the level-set-based statistical shape model (SSM). The proposed algorithm solves the well-known open problem, in which a shape prior may not be optimal in...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.11.003

    authors: Saito A,Nawano S,Shimizu A

    更新日期:2016-02-01 00:00:00

  • Automatic segmentation of 3D micro-CT coronary vascular images.

    abstract::Although there are many algorithms available in the literature aimed at segmentation and model reconstruction of 3D angiographic images, many are focused on characterizing only a part of the vascular network. This study is motivated by the recent emerging prospects of whole-organ simulations in coronary hemodynamics, ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.06.012

    authors: Lee J,Beighley P,Ritman E,Smith N

    更新日期:2007-12-01 00:00:00

  • An improved deep network for tissue microstructure estimation with uncertainty quantification.

    abstract::Deep learning based methods have improved the estimation of tissue microstructure from diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients. These methods learn the mapping from diffusion signals in a voxel or patch to tissue microstructure measures. In particular, it...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101650

    authors: Ye C,Li Y,Zeng X

    更新日期:2020-04-01 00:00:00

  • Regularized siamese neural network for unsupervised outlier detection on brain multiparametric magnetic resonance imaging: Application to epilepsy lesion screening.

    abstract::In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101618

    authors: Alaverdyan Z,Jung J,Bouet R,Lartizien C

    更新日期:2020-02-01 00:00:00

  • Involuntary eye motion correction in retinal optical coherence tomography: Hardware or software solution?

    abstract::In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional ha...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2017.02.002

    authors: Baghaie A,Yu Z,D'Souza RM

    更新日期:2017-04-01 00:00:00

  • Cardiac function estimation from MRI using a heart model and data assimilation: advances and difficulties.

    abstract::In this paper, we present a framework to estimate local ventricular myocardium contractility using clinical MRI, a heart model and data assimilation. First, we build a generic anatomical model of the ventricles including muscle fibre orientations and anatomical subdivisions. Then, this model is deformed to fit a clini...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2006.04.002

    authors: Sermesant M,Moireau P,Camara O,Sainte-Marie J,Andriantsimiavona R,Cimrman R,Hill DL,Chapelle D,Razavi R

    更新日期:2006-08-01 00:00:00

  • Major depressive disorder identification by referenced multiset canonical correlation analysis with clinical scores.

    abstract::A novel method based on multiset canonical correlation analysis (mCCA) and linear discriminant analysis (LDA) is presented to identify the major depressive disorder (MDD). The new method comprises two parts, namely, the mCCA-rreg and sparse LDA models. The mCCA-rreg model extends the classical canonical correlation mo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101600

    authors: Lin W,Lv D,Han Z,Dong J,Yang L

    更新日期:2020-02-01 00:00:00

  • Computer technology in detection and staging of prostate carcinoma: a review.

    abstract::After two decades of increasing interest and research activity, computer-assisted diagnostic approaches are reaching the stage where more routine deployment in clinical practice is becoming a possibility [Kruppinski, E.A., 2004. Computer-aided detection in clinical environment: Benefits and challenges for radiologists...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2005.06.003

    authors: Zhu Y,Williams S,Zwiggelaar R

    更新日期:2006-04-01 00:00:00

  • Independent component analysis using prior information for signal detection in a functional imaging system of the retina.

    abstract::Independent component analysis (ICA) is a statistical technique that estimates a set of sources mixed by an unknown mixing matrix using only a set of observations. For this purpose, the only assumption is that the sources are statistically independent. In many applications, some information about the nature of the unk...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.06.009

    authors: Barriga ES,Pattichis M,Ts'o D,Abramoff M,Kardon R,Kwon Y,Soliz P

    更新日期:2011-02-01 00:00:00

  • An efficient Riemannian statistical shape model using differential coordinates: With application to the classification of data from the Osteoarthritis Initiative.

    abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.09.004

    authors: von Tycowicz C,Ambellan F,Mukhopadhyay A,Zachow S

    更新日期:2018-01-01 00:00:00

  • Longitudinal segmentation of age-related white matter hyperintensities.

    abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.02.007

    authors: Sudre CH,Cardoso MJ,Ourselin S,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2017-05-01 00:00:00

  • Spatially variable Rician noise in magnetic resonance imaging.

    abstract::Magnetic resonance images tend to be influenced by various random factors usually referred to as "noise". The principal sources of noise and related artefacts can be divided into two types: arising from hardware (acquisition coil arrays, gradient coils, field inhomogeneity); and arising from the subject (physiological...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.12.002

    authors: Maximov II,Farrher E,Grinberg F,Shah NJ

    更新日期:2012-02-01 00:00:00

  • Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization.

    abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.07.007

    authors: Genet M,Stoeck CT,von Deuster C,Lee LC,Kozerke S

    更新日期:2018-12-01 00:00:00

  • Multiple hypothesis template tracking of small 3D vessel structures.

    abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.12.003

    authors: Friman O,Hindennach M,Kühnel C,Peitgen HO

    更新日期:2010-04-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • Continuous diffusion signal, EAP and ODF estimation via Compressive Sensing in diffusion MRI.

    abstract::In this paper, we exploit the ability of Compressed Sensing (CS) to recover the whole 3D Diffusion MRI (dMRI) signal from a limited number of samples while efficiently recovering important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Some attempts to...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.02.010

    authors: Merlet SL,Deriche R

    更新日期:2013-07-01 00:00:00

  • Shape regression machine and efficient segmentation of left ventricle endocardium from 2D B-mode echocardiogram.

    abstract::We present a machine learning approach called shape regression machine (SRM) for efficient segmentation of an anatomic structure that exhibits a deformable shape in a medical image, e.g., left ventricle endocardial wall in an echocardiogram. The SRM achieves efficient segmentation via statistical learning of the inter...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.002

    authors: Zhou SK

    更新日期:2010-08-01 00:00:00

  • Confhusius: a robust and fully automatic calibration method for 3D freehand ultrasound.

    abstract::This paper describes a new robust and fully automatic method for calibration of three-dimensional (3D) freehand ultrasound called Confhusius (CalibratiON for FreeHand UltraSound Imaging USage). 3D Freehand ultrasound consists in mounting a position sensor on a standard probe. The echographic B-scans can be localized i...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.021

    authors: Rousseau F,Hellier P,Barillot C

    更新日期:2005-02-01 00:00:00

  • Automated localization of breast cancer in DCE-MRI.

    abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly being used for the detection and diagnosis of breast cancer. Compared to mammography, DCE-MRI provides higher sensitivity, however its specificity is variable. Moreover, DCE-MRI data analysis is time consuming and depends on reader expertis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.12.001

    authors: Gubern-Mérida A,Martí R,Melendez J,Hauth JL,Mann RM,Karssemeijer N,Platel B

    更新日期:2015-02-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Nonlinear multiscale regularisation in MR elastography: Towards fine feature mapping.

    abstract::Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.05.012

    authors: Barnhill E,Hollis L,Sack I,Braun J,Hoskins PR,Pankaj P,Brown C,van Beek EJR,Roberts N

    更新日期:2017-01-01 00:00:00

  • A deep network for tissue microstructure estimation using modified LSTM units.

    abstract::Diffusion magnetic resonance imaging (dMRI) offers a unique tool for noninvasively assessing tissue microstructure. However, accurate estimation of tissue microstructure described by complicated signal models can be challenging when a reduced number of diffusion gradients are used. Deep learning based microstructure e...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.04.006

    authors: Ye C,Li X,Chen J

    更新日期:2019-07-01 00:00:00

  • A computational diffusion MRI and parametric dictionary learning framework for modeling the diffusion signal and its features.

    abstract::In this work, we first propose an original and efficient computational framework to model continuous diffusion MRI (dMRI) signals and analytically recover important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Then, we develop an efficient parametric...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.04.011

    authors: Merlet S,Caruyer E,Ghosh A,Deriche R

    更新日期:2013-10-01 00:00:00

  • A comprehensive study of stent visualization enhancement in X-ray images by image processing means.

    abstract::In this work we propose a comprehensive study of Digital Stent Enhancement (DSE), from the analysis of the requirements to the validation of the proposed solution. First, we derive the stent visualization requirements in the context of the clinical application and workflow. Then, we propose a DSE algorithm combining a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.03.002

    authors: Bismuth V,Vaillant R,Funck F,Guillard N,Najman L

    更新日期:2011-08-01 00:00:00

  • Capturing intraoperative deformations: research experience at Brigham and Women's Hospital.

    abstract::During neurosurgical procedures the objective of the neurosurgeon is to achieve the resection of as much diseased tissue as possible while achieving the preservation of healthy brain tissue. The restricted capacity of the conventional operating room to enable the surgeon to visualize critical healthy brain structures ...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2004.11.005

    authors: Warfield SK,Haker SJ,Talos IF,Kemper CA,Weisenfeld N,Mewes AU,Goldberg-Zimring D,Zou KH,Westin CF,Wells WM,Tempany CM,Golby A,Black PM,Jolesz FA,Kikinis R

    更新日期:2005-04-01 00:00:00