Abstract:
:Pixelwise segmentation of the left ventricular (LV) myocardium and the four cardiac chambers in 2-D steady state free precession (SSFP) cine sequences is an essential preprocessing step for a wide range of analyses. Variability in contrast, appearance, orientation, and placement of the heart between patients, clinical views, scanners, and protocols makes fully automatic semantic segmentation a notoriously difficult problem. Here, we present Ω-Net (Omega-Net): A novel convolutional neural network (CNN) architecture for simultaneous localization, transformation into a canonical orientation, and semantic segmentation. First, an initial segmentation is performed on the input image; second, the features learned during this initial segmentation are used to predict the parameters needed to transform the input image into a canonical orientation; and third, a final segmentation is performed on the transformed image. In this work, Ω-Nets of varying depths were trained to detect five foreground classes in any of three clinical views (short axis, SA; four-chamber, 4C; two-chamber, 2C), without prior knowledge of the view being segmented. This constitutes a substantially more challenging problem compared with prior work. The architecture was trained using three-fold cross-validation on a cohort of patients with hypertrophic cardiomyopathy (HCM, N=42) and healthy control subjects (N=21). Network performance, as measured by weighted foreground intersection-over-union (IoU), was substantially improved for the best-performing Ω-Net compared with U-Net segmentation without localization or orientation (0.858 vs 0.834). In addition, to be comparable with other works, Ω-Net was retrained from scratch using five-fold cross-validation on the publicly available 2017 MICCAI Automated Cardiac Diagnosis Challenge (ACDC) dataset. The Ω-Net outperformed the state-of-the-art method in segmentation of the LV and RV bloodpools, and performed slightly worse in segmentation of the LV myocardium. We conclude that this architecture represents a substantive advancement over prior approaches, with implications for biomedical image segmentation more generally.
journal_name
Med Image Analjournal_title
Medical image analysisauthors
Vigneault DM,Xie W,Ho CY,Bluemke DA,Noble JAdoi
10.1016/j.media.2018.05.008subject
Has Abstractpub_date
2018-08-01 00:00:00pages
95-106eissn
1361-8415issn
1361-8423pii
S1361-8415(18)30299-8journal_volume
48pub_type
杂志文章abstract::We propose in this article a content-based image retrieval (CBIR) method for diagnosis aid in medical fields. In the proposed system, images are indexed in a generic fashion, without extracting domain-specific features: a signature is built for each image from its wavelet transform. These image signatures characterize...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.11.004
更新日期:2010-04-01 00:00:00
abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101535
更新日期:2019-12-01 00:00:00
abstract::Biophysical models of the atrium provide a physically constrained framework for describing the current state of an atrium and allow predictions of how that atrium will respond to therapy. We propose a work flow to simulate patient specific electrophysiological heterogeneity from clinical data and validate the resultin...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.04.005
更新日期:2018-07-01 00:00:00
abstract::Many cardiac pathologies are reflected in abnormal myocardial deformation, accessible through magnetic resonance tagging (MRT). Interpretation of the MRT data is difficult, since the relation between pathology and deformation is not straightforward. Mathematical models of cardiac mechanics could be used to translate m...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2006.04.001
更新日期:2006-08-01 00:00:00
abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2012.09.007
更新日期:2013-12-01 00:00:00
abstract::The goal of this study is to provide a theoretical framework for accurately optimizing the segmentation energy considering all of the possible shapes generated from the level-set-based statistical shape model (SSM). The proposed algorithm solves the well-known open problem, in which a shape prior may not be optimal in...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2015.11.003
更新日期:2016-02-01 00:00:00
abstract::Although there are many algorithms available in the literature aimed at segmentation and model reconstruction of 3D angiographic images, many are focused on characterizing only a part of the vascular network. This study is motivated by the recent emerging prospects of whole-organ simulations in coronary hemodynamics, ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2007.06.012
更新日期:2007-12-01 00:00:00
abstract::Deep learning based methods have improved the estimation of tissue microstructure from diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients. These methods learn the mapping from diffusion signals in a voxel or patch to tissue microstructure measures. In particular, it...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101650
更新日期:2020-04-01 00:00:00
abstract::In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101618
更新日期:2020-02-01 00:00:00
abstract::In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional ha...
journal_title:Medical image analysis
pub_type: 杂志文章,评审
doi:10.1016/j.media.2017.02.002
更新日期:2017-04-01 00:00:00
abstract::In this paper, we present a framework to estimate local ventricular myocardium contractility using clinical MRI, a heart model and data assimilation. First, we build a generic anatomical model of the ventricles including muscle fibre orientations and anatomical subdivisions. Then, this model is deformed to fit a clini...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2006.04.002
更新日期:2006-08-01 00:00:00
abstract::A novel method based on multiset canonical correlation analysis (mCCA) and linear discriminant analysis (LDA) is presented to identify the major depressive disorder (MDD). The new method comprises two parts, namely, the mCCA-rreg and sparse LDA models. The mCCA-rreg model extends the classical canonical correlation mo...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101600
更新日期:2020-02-01 00:00:00
abstract::After two decades of increasing interest and research activity, computer-assisted diagnostic approaches are reaching the stage where more routine deployment in clinical practice is becoming a possibility [Kruppinski, E.A., 2004. Computer-aided detection in clinical environment: Benefits and challenges for radiologists...
journal_title:Medical image analysis
pub_type: 杂志文章,评审
doi:10.1016/j.media.2005.06.003
更新日期:2006-04-01 00:00:00
abstract::Independent component analysis (ICA) is a statistical technique that estimates a set of sources mixed by an unknown mixing matrix using only a set of observations. For this purpose, the only assumption is that the sources are statistically independent. In many applications, some information about the nature of the unk...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.06.009
更新日期:2011-02-01 00:00:00
abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.09.004
更新日期:2018-01-01 00:00:00
abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.02.007
更新日期:2017-05-01 00:00:00
abstract::Magnetic resonance images tend to be influenced by various random factors usually referred to as "noise". The principal sources of noise and related artefacts can be divided into two types: arising from hardware (acquisition coil arrays, gradient coils, field inhomogeneity); and arising from the subject (physiological...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.12.002
更新日期:2012-02-01 00:00:00
abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.07.007
更新日期:2018-12-01 00:00:00
abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.12.003
更新日期:2010-04-01 00:00:00
abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.10.005
更新日期:2012-02-01 00:00:00
abstract::In this paper, we exploit the ability of Compressed Sensing (CS) to recover the whole 3D Diffusion MRI (dMRI) signal from a limited number of samples while efficiently recovering important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Some attempts to...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.02.010
更新日期:2013-07-01 00:00:00
abstract::We present a machine learning approach called shape regression machine (SRM) for efficient segmentation of an anatomic structure that exhibits a deformable shape in a medical image, e.g., left ventricle endocardial wall in an echocardiogram. The SRM achieves efficient segmentation via statistical learning of the inter...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.04.002
更新日期:2010-08-01 00:00:00
abstract::This paper describes a new robust and fully automatic method for calibration of three-dimensional (3D) freehand ultrasound called Confhusius (CalibratiON for FreeHand UltraSound Imaging USage). 3D Freehand ultrasound consists in mounting a position sensor on a standard probe. The echographic B-scans can be localized i...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2004.06.021
更新日期:2005-02-01 00:00:00
abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly being used for the detection and diagnosis of breast cancer. Compared to mammography, DCE-MRI provides higher sensitivity, however its specificity is variable. Moreover, DCE-MRI data analysis is time consuming and depends on reader expertis...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.12.001
更新日期:2015-02-01 00:00:00
abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2004.06.013
更新日期:2004-09-01 00:00:00
abstract::Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.05.012
更新日期:2017-01-01 00:00:00
abstract::Diffusion magnetic resonance imaging (dMRI) offers a unique tool for noninvasively assessing tissue microstructure. However, accurate estimation of tissue microstructure described by complicated signal models can be challenging when a reduced number of diffusion gradients are used. Deep learning based microstructure e...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.04.006
更新日期:2019-07-01 00:00:00
abstract::In this work, we first propose an original and efficient computational framework to model continuous diffusion MRI (dMRI) signals and analytically recover important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Then, we develop an efficient parametric...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.04.011
更新日期:2013-10-01 00:00:00
abstract::In this work we propose a comprehensive study of Digital Stent Enhancement (DSE), from the analysis of the requirements to the validation of the proposed solution. First, we derive the stent visualization requirements in the context of the clinical application and workflow. Then, we propose a DSE algorithm combining a...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.03.002
更新日期:2011-08-01 00:00:00
abstract::During neurosurgical procedures the objective of the neurosurgeon is to achieve the resection of as much diseased tissue as possible while achieving the preservation of healthy brain tissue. The restricted capacity of the conventional operating room to enable the surgeon to visualize critical healthy brain structures ...
journal_title:Medical image analysis
pub_type: 杂志文章,评审
doi:10.1016/j.media.2004.11.005
更新日期:2005-04-01 00:00:00