Recovering from missing data in population imaging - Cardiac MR image imputation via conditional generative adversarial nets.

Abstract:

:Accurate ventricular volume measurements are the primary indicators of normal/abnor- mal cardiac function and are dependent on the Cardiac Magnetic Resonance (CMR) volumes being complete. However, missing or unusable slices owing to the presence of image artefacts such as respiratory or motion ghosting, aliasing, ringing and signal loss in CMR sequences, significantly hinder accuracy of anatomical and functional cardiac quantification, and recovering from those is insufficiently addressed in population imaging. In this work, we propose a new robust approach, coined Image Imputation Generative Adversarial Network (I2-GAN), to learn key features of cardiac short axis (SAX) slices near missing information, and use them as conditional variables to infer missing slices in the query volumes. In I2-GAN, the slices are first mapped to latent vectors with position features through a regression net. The latent vector corresponding to the desired position is then projected onto the slice manifold, conditioned on intensity features through a generator net. The generator comprises residual blocks with normalisation layers that are modulated with auxiliary slice information, enabling propagation of fine details through the network. In addition, a multi-scale discriminator was implemented, along with a discriminator-based feature matching loss, to further enhance performance and encourage the synthesis of visually realistic slices. Experimental results show that our method achieves significant improvements over the state-of-the-art, in missing slice imputation for CMR, with an average SSIM of 0.872. Linear regression analysis yields good agreement between reference and imputed CMR images for all cardiac measurements, with correlation coefficients of 0.991 for left ventricular volume, 0.977 for left ventricular mass and 0.961 for right ventricular volume.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Xia Y,Zhang L,Ravikumar N,Attar R,Piechnik SK,Neubauer S,Petersen SE,Frangi AF

doi

10.1016/j.media.2020.101812

subject

Has Abstract

pub_date

2021-01-01 00:00:00

pages

101812

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30176-6

journal_volume

67

pub_type

杂志文章
  • Dynamically constructed network with error correction for accurate ventricle volume estimation.

    abstract::Automated ventricle volume estimation (AVVE) on cardiac magnetic resonance (CMR) images is very important for clinical cardiac disease diagnosis. However, current AVVE methods ignore the error correction for the estimated volume. This results in clinically intolerable ventricle volume estimation error and further lead...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101723

    authors: Luo G,Wang W,Tam C,Wang K,Cao S,Zhang H,Chen B,Li S

    更新日期:2020-08-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • Respiratory motion models: a review.

    abstract::The problem of respiratory motion has proved a serious obstacle in developing techniques to acquire images or guide interventions in abdominal and thoracic organs. Motion models offer a possible solution to these problems, and as a result the field of respiratory motion modelling has become an active one over the past...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2012.09.005

    authors: McClelland JR,Hawkes DJ,Schaeffter T,King AP

    更新日期:2013-01-01 00:00:00

  • Cardiac image modelling: Breadth and depth in heart disease.

    abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...

    journal_title:Medical image analysis

    pub_type: 社论,评审

    doi:10.1016/j.media.2016.06.027

    authors: Suinesiaputra A,McCulloch AD,Nash MP,Pontre B,Young AA

    更新日期:2016-10-01 00:00:00

  • Multi-modal volume registration by maximization of mutual information.

    abstract::A new information-theoretic approach is presented for finding the registration of volumetric medical images of differing modalities. Registration is achieved by adjustment of the relative position and orientation until the mutual information between the images is maximized. In our derivation of the registration proced...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(01)80004-9

    authors: Wells WM 3rd,Viola P,Atsumi H,Nakajima S,Kikinis R

    更新日期:1996-03-01 00:00:00

  • Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM.

    abstract::In order to improve the accuracy of image-guided neurosurgery, different biomechanical models have been developed to correct preoperative images with respect to intraoperative changes like brain shift or tumor resection. All existing biomechanical models simulate different anatomical structures by using either appropr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00059-2

    authors: Hagemann A,Rohr K,Stiehl HS

    更新日期:2002-12-01 00:00:00

  • Attentive neural cell instance segmentation.

    abstract::Neural cell instance segmentation, which aims at joint detection and segmentation of every neural cell in a microscopic image, is essential to many neuroscience applications. The challenge of this task involves cell adhesion, cell distortion, unclear cell contours, low-contrast cell protrusion structures, and backgrou...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.05.004

    authors: Yi J,Wu P,Jiang M,Huang Q,Hoeppner DJ,Metaxas DN

    更新日期:2019-07-01 00:00:00

  • Tumor sensitive matching flow: A variational method to detecting and segmenting perihepatic and perisplenic ovarian cancer metastases on contrast-enhanced abdominal CT.

    abstract::Accurate automated segmentation and detection of ovarian cancer metastases may improve the diagnosis and prognosis of women with ovarian cancer. In this paper, we focus on an important subset of ovarian cancer metastases that spread to the surface of the liver and spleen. Automated ovarian cancer metastasis detection ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.04.001

    authors: Liu J,Wang S,Linguraru MG,Yao J,Summers RM

    更新日期:2014-07-01 00:00:00

  • A comparison of freehand three-dimensional ultrasound reconstruction techniques.

    abstract::Three-dimensional freehand ultrasound imaging produces a set of irregularly spaced B-scans, which are typically reconstructed on a regular grid for visualization and data analysis. Most standard reconstruction algorithms are designed to minimize computational requirements and do not exploit the underlying shape of the...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(99)80028-0

    authors: Rohling R,Gee A,Berman L

    更新日期:1999-12-01 00:00:00

  • Advances and challenges in deformable image registration: From image fusion to complex motion modelling.

    abstract::Over the past 20 years, the field of medical image registration has significantly advanced from multi-modal image fusion to highly non-linear, deformable image registration for a wide range of medical applications and imaging modalities, involving the compensation and analysis of physiological organ motion or of tissu...

    journal_title:Medical image analysis

    pub_type: 社论

    doi:10.1016/j.media.2016.06.031

    authors: Schnabel JA,Heinrich MP,Papież BW,Brady SJM

    更新日期:2016-10-01 00:00:00

  • Adaptive local window for level set segmentation of CT and MRI liver lesions.

    abstract::We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and the changes of th...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.002

    authors: Hoogi A,Beaulieu CF,Cunha GM,Heba E,Sirlin CB,Napel S,Rubin DL

    更新日期:2017-04-01 00:00:00

  • RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification.

    abstract::The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze them are quite challenging during the automatic diagnosis process. The multi-instance learning bas...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101549

    authors: Wang S,Zhu Y,Yu L,Chen H,Lin H,Wan X,Fan X,Heng PA

    更新日期:2019-12-01 00:00:00

  • Improved fidelity of brain microstructure mapping from single-shell diffusion MRI.

    abstract::Diffusion weighted imaging (DWI) is sensitive to alterations in the diffusion of water molecules caused by microstructural barriers. Different microstructural compartments are characterized by differences in DWI signal. Diffusion tensor imaging conflates the signal from these compartments into a single tensor, which p...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.10.004

    authors: Taquet M,Scherrer B,Boumal N,Peters JM,Macq B,Warfield SK

    更新日期:2015-12-01 00:00:00

  • Neighborhood resolved fiber orientation distributions (NRFOD) in automatic labeling of white matter fiber pathways.

    abstract::Accurate digital representation of major white matter bundles in the brain is an important goal in neuroscience image computing since the representations can be used for surgical planning, intra-patient longitudinal analysis and inter-subject population connectivity studies. Reconstructing desired fiber bundles genera...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.02.008

    authors: Ugurlu D,Firat Z,Türe U,Unal G

    更新日期:2018-05-01 00:00:00

  • Automated classification of lung bronchovascular anatomy in CT using AdaBoost.

    abstract::Lung CAD systems require the ability to classify a variety of pulmonary structures as part of the diagnostic process. The purpose of this work was to develop a methodology for fully automated voxel-by-voxel classification of airways, fissures, nodules, and vessels from chest CT images using a single feature set and cl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.03.004

    authors: Ochs RA,Goldin JG,Abtin F,Kim HJ,Brown K,Batra P,Roback D,McNitt-Gray MF,Brown MS

    更新日期:2007-06-01 00:00:00

  • Longitudinal segmentation of age-related white matter hyperintensities.

    abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.02.007

    authors: Sudre CH,Cardoso MJ,Ourselin S,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2017-05-01 00:00:00

  • Non-invasive estimation of relative pressure in turbulent flow using virtual work-energy.

    abstract::Vascular pressure differences are established risk markers for a number of cardiovascular diseases. Relative pressures are, however, often driven by turbulence-induced flow fluctuations, where conventional non-invasive methods may yield inaccurate results. Recently, we proposed a novel method for non-turbulent flows, ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101627

    authors: Marlevi D,Ha H,Dillon-Murphy D,Fernandes JF,Fovargue D,Colarieti-Tosti M,Larsson M,Lamata P,Figueroa CA,Ebbers T,Nordsletten DA

    更新日期:2020-02-01 00:00:00

  • Statistical shape models for 3D medical image segmentation: a review.

    abstract::Statistical shape models (SSMs) have by now been firmly established as a robust tool for segmentation of medical images. While 2D models have been in use since the early 1990 s, wide-spread utilization of three-dimensional models appeared only in recent years, primarily made possible by breakthroughs in automatic dete...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2009.05.004

    authors: Heimann T,Meinzer HP

    更新日期:2009-08-01 00:00:00

  • A comprehensive study of stent visualization enhancement in X-ray images by image processing means.

    abstract::In this work we propose a comprehensive study of Digital Stent Enhancement (DSE), from the analysis of the requirements to the validation of the proposed solution. First, we derive the stent visualization requirements in the context of the clinical application and workflow. Then, we propose a DSE algorithm combining a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.03.002

    authors: Bismuth V,Vaillant R,Funck F,Guillard N,Najman L

    更新日期:2011-08-01 00:00:00

  • Wavelet optimization for content-based image retrieval in medical databases.

    abstract::We propose in this article a content-based image retrieval (CBIR) method for diagnosis aid in medical fields. In the proposed system, images are indexed in a generic fashion, without extracting domain-specific features: a signature is built for each image from its wavelet transform. These image signatures characterize...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.11.004

    authors: Quellec G,Lamard M,Cazuguel G,Cochener B,Roux C

    更新日期:2010-04-01 00:00:00

  • Semi-supervised mp-MRI data synthesis with StitchLayer and auxiliary distance maximization.

    abstract::The availability of a large amount of annotated data is critical for many medical image analysis applications, in particular for those relying on deep learning methods which are known to be data-hungry. However, annotated medical data, especially multimodal data, is often scarce and costly to obtain. In this paper, we...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101565

    authors: Wang Z,Lin Y,Cheng KT,Yang X

    更新日期:2020-01-01 00:00:00

  • Automated model-based vertebra detection, identification, and segmentation in CT images.

    abstract::For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.02.004

    authors: Klinder T,Ostermann J,Ehm M,Franz A,Kneser R,Lorenz C

    更新日期:2009-06-01 00:00:00

  • Groupwise registration with global-local graph shrinkage in atlas construction.

    abstract::Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101711

    authors: Fu T,Yang J,Li Q,Ai D,Song H,Jiang Y,Wang Y,Frangi AF

    更新日期:2020-08-01 00:00:00

  • Discriminant snakes for 3D reconstruction of anatomical organs.

    abstract::In this work a new statistic deformable model for 3D segmentation of anatomical organs in medical images is proposed. A statistic discriminant snake performs a supervised learning of the object boundary in an image slice to segment the next slice of the image sequence. Each part of the object boundary is projected in ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00014-8

    authors: Pardo XM,Radeva P,Cabello D

    更新日期:2003-09-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Hierarchical max-flow segmentation framework for multi-atlas segmentation with Kohonen self-organizing map based Gaussian mixture modeling.

    abstract::The incorporation of intensity, spatial, and topological information into large-scale multi-region segmentation has been a topic of ongoing research in medical image analysis. Multi-region segmentation problems, such as segmentation of brain structures, pose unique challenges in image segmentation in which regions may...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.05.005

    authors: Rajchl M,Baxter JS,McLeod AJ,Yuan J,Qiu W,Peters TM,Khan AR

    更新日期:2016-01-01 00:00:00

  • Identifying Cross-individual Correspondences of 3-hinge Gyri.

    abstract::Human brain alignment based on imaging data has long been an intriguing research topic. One of the challenges is the huge inter-individual variabilities, which are pronounced not only in cortical folding patterns, but also in the underlying structural and functional patterns. Also, it is still not fully understood how...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101700

    authors: Zhang T,Huang Y,Zhao L,He Z,Jiang X,Guo L,Hu X,Liu T

    更新日期:2020-07-01 00:00:00

  • Multimodal image registration using floating regressors in the joint intensity scatter plot.

    abstract::This paper presents a new approach for multimodal medical image registration and compares it to normalized mutual information (NMI) and the correlation ratio (CR). Like NMI and CR, the new method's measure of registration quality is based on the distribution of points in the joint intensity scatter plot (JISP); compac...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.12.002

    authors: Orchard J

    更新日期:2008-08-01 00:00:00

  • An image space approach to Cartesian based parallel MR imaging with total variation regularization.

    abstract::The Cartesian parallel magnetic imaging problem is formulated variationally using a high-order penalty for coil sensitivities and a total variation like penalty for the reconstructed image. Then the optimality system is derived and numerically discretized. The objective function used is non-convex, but it possesses a ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.07.002

    authors: Keeling SL,Clason C,Hintermüller M,Knoll F,Laurain A,von Winckel G

    更新日期:2012-01-01 00:00:00

  • Confhusius: a robust and fully automatic calibration method for 3D freehand ultrasound.

    abstract::This paper describes a new robust and fully automatic method for calibration of three-dimensional (3D) freehand ultrasound called Confhusius (CalibratiON for FreeHand UltraSound Imaging USage). 3D Freehand ultrasound consists in mounting a position sensor on a standard probe. The echographic B-scans can be localized i...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.021

    authors: Rousseau F,Hellier P,Barillot C

    更新日期:2005-02-01 00:00:00