Abstract：
:Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image naturally factors into some spatial factors depicting anatomy and factors that denote the imaging characteristics. Here, we explicitly learn this decomposed (disentangled) representation of imaging data, focusing in particular on cardiac images. We propose Spatial Decomposition Network (SDNet), which factorises 2D medical images into spatial anatomical factors and non-spatial modality factors. We demonstrate that this high-level representation is ideally suited for several medical image analysis tasks, such as semi-supervised segmentation, multi-task segmentation and regression, and image-to-image synthesis. Specifically, we show that our model can match the performance of fully supervised segmentation models, using only a fraction of the labelled images. Critically, we show that our factorised representation also benefits from supervision obtained either when we use auxiliary tasks to train the model in a multi-task setting (e.g. regressing to known cardiac indices), or when aggregating multimodal data from different sources (e.g. pooling together MRI and CT data). To explore the properties of the learned factorisation, we perform latent-space arithmetic and show that we can synthesise CT from MR and vice versa, by swapping the modality factors. We also demonstrate that the factor holding image specific information can be used to predict the input modality with high accuracy. Code will be made available at https://github.com/agis85/anatomy_modality_decomposition.
journal_name
Med Image Analjournal_title
Medical image analysisauthors
Chartsias A,Joyce T,Papanastasiou G,Semple S,Williams M,Newby DE,Dharmakumar R,Tsaftaris SAdoi
10.1016/j.media.2019.101535subject
Has Abstractpub_date
2019-12-01 00:00:00pages
101535eissn
1361-8415issn
1361-8423pii
S1361-8415(19)30068-4journal_volume
58pub_type
杂志文章abstract：:Current neuroimaging investigation of the white matter typically focuses on measurements derived from diffusion tensor imaging, such as fractional anisotropy (FA). In contrast, imaging studies of the gray matter oftentimes focus on morphological features such as cortical thickness, folding and surface curvature. As a ...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2014.06.013
更新日期：2014-12-01 00:00:00
abstract：:As a common disease in the elderly, neural foramina stenosis (NFS) brings a significantly negative impact on the quality of life due to its symptoms including pain, disability, fall risk and depression. Accurate boundary delineation is essential to the clinical diagnosis and treatment of NFS. However, existing clinica...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2016.10.009
更新日期：2017-02-01 00:00:00
abstract：:The current standard of care for glaucoma patients consists of functional assessment of vision via visual field (VF) testing, which is sensitive but subjective, time-consuming, and often unreliable. A new imaging technology, Fourier domain optical coherence tomography (OCT), is being introduced to assess the structura...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2011.05.012
更新日期：2012-01-01 00:00:00
abstract：:For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2009.02.004
更新日期：2009-06-01 00:00:00
abstract：:Sulcal pits are the points of maximal depth within the folds of the cortical surface. These shape descriptors give a unique opportunity to access to a rich, fine-scale representation of the geometry and the developmental milestones of the cortical surface. However, using sulcal pits analysis at group level requires ne...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2020.101749
更新日期：2020-12-01 00:00:00
abstract：:We introduce a new approach to medical image analysis that combines deformable model methodologies with concepts from the field of artificial life. In particular, we propose "deformable organisms", autonomous agents whose task is the automatic segmentation, labeling, and quantitative analysis of anatomical structures ...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(02)00083-x
更新日期：2002-09-01 00:00:00
abstract：:Interpretation of ultrasound videos of the fetal heart is crucial for the antenatal diagnosis of congenital heart disease (CHD). We believe that automated image analysis techniques could make an important contribution towards improving CHD detection rates. However, to our knowledge, no previous work has been done in t...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2016.11.006
更新日期：2017-02-01 00:00:00
abstract：:This paper presents a new approach for multimodal medical image registration and compares it to normalized mutual information (NMI) and the correlation ratio (CR). Like NMI and CR, the new method's measure of registration quality is based on the distribution of points in the joint intensity scatter plot (JISP); compac...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2007.12.002
更新日期：2008-08-01 00:00:00
abstract：:Creating a feature-preserving average of three dimensional anatomical surfaces extracted from volume image data is a complex task. Unlike individual images, averages present right-left symmetry and smooth surfaces which give insight into typical proportions. Averaging multiple biological surface images requires carefu...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(00)00031-1
更新日期：2000-12-01 00:00:00
abstract：:Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2016.05.012
更新日期：2017-01-01 00:00:00
abstract：:We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2017.09.004
更新日期：2018-01-01 00:00:00
abstract：:An automated vendor-independent system for dose monitoring in computed tomography (CT) medical examinations involving ionizing radiation is presented in this paper. The system provides precise size-specific dose estimates (SSDE) following the American Association of Physicists in Medicine regulations. Our dose managem...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2020.101898
更新日期：2021-02-01 00:00:00
abstract：:Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2010.04.001
更新日期：2010-08-01 00:00:00
abstract：:This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2010.11.001
更新日期：2012-04-01 00:00:00
abstract：:We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2019.06.001
更新日期：2019-08-01 00:00:00
abstract：:Accurate segmentation of a pulmonary nodule is an important and active area of research in medical image processing. Although many algorithms have been reported in literature for this problem, those that are applicable to various density types have not been available until recently. In this paper, we propose a new alg...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2010.08.005
更新日期：2011-02-01 00:00:00
abstract：:This article describes a combination of interactive classification and super-sampling visualization algorithms that greatly enhances the realism of 3-D reconstructions of the Visible Human data sets. Objects are classified on the basis of ellipsoidal regions in RGB space. The ellipsoids are used for super-sampling in ...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(97)85001-3
更新日期：1997-09-01 00:00:00
abstract：:Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The f...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2020.101711
更新日期：2020-08-01 00:00:00
abstract：:This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(98)80020-0
更新日期：1998-09-01 00:00:00
abstract：:In this paper, we present a framework to estimate local ventricular myocardium contractility using clinical MRI, a heart model and data assimilation. First, we build a generic anatomical model of the ventricles including muscle fibre orientations and anatomical subdivisions. Then, this model is deformed to fit a clini...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2006.04.002
更新日期：2006-08-01 00:00:00
abstract：:The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2010.01.003
更新日期：2010-06-01 00:00:00
abstract：:In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2019.101618
更新日期：2020-02-01 00:00:00
abstract：:The in vivo investigation of joint kinematics in normal and injured wrist requires the segmentation of carpal bones from 3D (CT) images, and their registration over time. The non-uniformity of bone tissue, ranging from dense cortical bone to textured spongy bone, the irregular shape of closely packed carpal bones, sma...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(02)00065-8
更新日期：2003-03-01 00:00:00
abstract：:We address the medical image analysis issue of predicting the final lesion in stroke from early perfusion magnetic resonance imaging. The classical processing approach for the dynamical perfusion images consists in a temporal deconvolution to improve the temporal signals associated with each voxel before performing pr...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2018.08.008
更新日期：2018-12-01 00:00:00
abstract：:A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/s1361-8415(00)00003-7
更新日期：2000-03-01 00:00:00
abstract：:In this paper, we propose a new strategy for modelling sliding conditions when registering 3D images in a piecewise-diffeomorphic framework. More specifically, our main contribution is the development of a mathematical formalism to perform Large Deformation Diffeomorphic Metric Mapping registration with sliding condit...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2012.10.001
更新日期：2013-02-01 00:00:00
abstract：:In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori inform...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2004.06.005
更新日期：2004-09-01 00:00:00
abstract：:An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2016.04.001
更新日期：2017-01-01 00:00:00
abstract：:Diffusion tensor imaging can provide the fundamental information required for viewing structural connectivity. However, robust and accurate acquisition and processing algorithms are needed to accurately map the nerve connectivity. In this paper, we present a novel algorithm for extracting and visualizing the fiber tra...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2003.12.001
更新日期：2004-06-01 00:00:00
abstract：:The automatic extraction of blood vessels in non-fluorescein eye fundus images is a tough task in applications such as diabetic retinopathy screening. However, vessel shapes have complex variations, and accurate modeling of retinal vascular structures is challenging. We have therefore developed a new approach to accur...
journal_title：Medical image analysis
pub_type： 杂志文章
doi：10.1016/j.media.2015.09.002
更新日期：2015-12-01 00:00:00
