Pseudo-healthy synthesis with pathology disentanglement and adversarial learning.

Abstract:

:Pseudo-healthy synthesis is the task of creating a subject-specific 'healthy' image from a pathological one. Such images can be helpful in tasks such as anomaly detection and understanding changes induced by pathology and disease. In this paper, we present a model that is encouraged to disentangle the information of pathology from what seems to be healthy. We disentangle what appears to be healthy and where disease is as a segmentation map, which are then recombined by a network to reconstruct the input disease image. We train our models adversarially using either paired or unpaired settings, where we pair disease images and maps when available. We quantitatively and subjectively, with a human study, evaluate the quality of pseudo-healthy images using several criteria. We show in a series of experiments, performed on ISLES, BraTS and Cam-CAN datasets, that our method is better than several baselines and methods from the literature. We also show that due to better training processes we could recover deformations, on surrounding tissue, caused by disease. Our implementation is publicly available at https://github.com/xiat0616/pseudo-healthy-synthesis.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Xia T,Chartsias A,Tsaftaris SA

doi

10.1016/j.media.2020.101719

subject

Has Abstract

pub_date

2020-08-01 00:00:00

pages

101719

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30083-9

journal_volume

64

pub_type

杂志文章
  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • Automated classification of lung bronchovascular anatomy in CT using AdaBoost.

    abstract::Lung CAD systems require the ability to classify a variety of pulmonary structures as part of the diagnostic process. The purpose of this work was to develop a methodology for fully automated voxel-by-voxel classification of airways, fissures, nodules, and vessels from chest CT images using a single feature set and cl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.03.004

    authors: Ochs RA,Goldin JG,Abtin F,Kim HJ,Brown K,Batra P,Roback D,McNitt-Gray MF,Brown MS

    更新日期:2007-06-01 00:00:00

  • Segmentation of the skull in MRI volumes using deformable model and taking the partial volume effect into account.

    abstract::Segmentation of the skull in medical imagery is an important stage in applications that require the construction of realistic models of the head. Such models are used, for example, to simulate the behavior of electro-magnetic fields in the head and to model the electrical activity of the cortex in EEG and MEG data. In...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00016-5

    authors: Rifa H,Bloch I,Hutchinson S,Wiart J,Garnero L

    更新日期:2000-09-01 00:00:00

  • Automated model-based vertebra detection, identification, and segmentation in CT images.

    abstract::For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.02.004

    authors: Klinder T,Ostermann J,Ehm M,Franz A,Kneser R,Lorenz C

    更新日期:2009-06-01 00:00:00

  • Quantification of the detailed cardiac left ventricular trabecular morphogenesis in the mouse embryo.

    abstract::During embryogenesis, a mammalian heart develops from a simple tubular shape into a complex 4-chamber organ, going through four distinct phases: early primitive tubular heart, emergence of trabeculations, trabecular remodeling and development of the compact myocardium. In this paper we propose a framework for standard...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.08.001

    authors: Paun B,Bijnens B,Cook AC,Mohun TJ,Butakoff C

    更新日期:2018-10-01 00:00:00

  • Reducing annotation effort in digital pathology: A Co-Representation learning framework for classification tasks.

    abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101859

    authors: Pati P,Foncubierta-Rodríguez A,Goksel O,Gabrani M

    更新日期:2021-01-01 00:00:00

  • A novel approach to 2D/3D registration of X-ray images using Grangeat's relation.

    abstract::Fast and accurate 2D/3D registration plays an important role in many applications, ranging from scientific and engineering domains all the way to medical care. Today's predominant methods are based on computationally expensive approaches, such as virtual forward or back projections, that limit the real-time applicabil...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101815

    authors: Frysch R,Pfeiffer T,Rose G

    更新日期:2021-01-01 00:00:00

  • Groupwise registration with global-local graph shrinkage in atlas construction.

    abstract::Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101711

    authors: Fu T,Yang J,Li Q,Ai D,Song H,Jiang Y,Wang Y,Frangi AF

    更新日期:2020-08-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • An automated pipeline for cortical sulcal fundi extraction.

    abstract::In this paper, we propose a novel automated pipeline for extraction of sulcal fundi from triangulated cortical surfaces. This method consists of four consecutive steps. Firstly, we adopt a finite difference method to estimate principal curvatures, principal directions and curvature derivatives, along the principal dir...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.005

    authors: Li G,Guo L,Nie J,Liu T

    更新日期:2010-06-01 00:00:00

  • Wavelet optimization for content-based image retrieval in medical databases.

    abstract::We propose in this article a content-based image retrieval (CBIR) method for diagnosis aid in medical fields. In the proposed system, images are indexed in a generic fashion, without extracting domain-specific features: a signature is built for each image from its wavelet transform. These image signatures characterize...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.11.004

    authors: Quellec G,Lamard M,Cazuguel G,Cochener B,Roux C

    更新日期:2010-04-01 00:00:00

  • Segmentation of carpal bones from CT images using skeletally coupled deformable models.

    abstract::The in vivo investigation of joint kinematics in normal and injured wrist requires the segmentation of carpal bones from 3D (CT) images, and their registration over time. The non-uniformity of bone tissue, ranging from dense cortical bone to textured spongy bone, the irregular shape of closely packed carpal bones, sma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00065-8

    authors: Sebastian TB,Tek H,Crisco JJ,Kimia BB

    更新日期:2003-03-01 00:00:00

  • A novel cortical thickness estimation method based on volumetric Laplace-Beltrami operator and heat kernel.

    abstract::Cortical thickness estimation in magnetic resonance imaging (MRI) is an important technique for research on brain development and neurodegenerative diseases. This paper presents a heat kernel based cortical thickness estimation algorithm, which is driven by the graph spectrum and the heat kernel theory, to capture the...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.01.005

    authors: Wang G,Zhang X,Su Q,Shi J,Caselli RJ,Wang Y,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2015-05-01 00:00:00

  • Continuous diffusion signal, EAP and ODF estimation via Compressive Sensing in diffusion MRI.

    abstract::In this paper, we exploit the ability of Compressed Sensing (CS) to recover the whole 3D Diffusion MRI (dMRI) signal from a limited number of samples while efficiently recovering important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Some attempts to...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.02.010

    authors: Merlet SL,Deriche R

    更新日期:2013-07-01 00:00:00

  • Luminosity and contrast normalization in retinal images.

    abstract::Retinal images are routinely acquired and assessed to provide diagnostic evidence for many important diseases, e.g. diabetes or hypertension. Because of the acquisition process, very often these images are non-uniformly illuminated and exhibit local luminosity and contrast variability. This problem may seriously affec...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.07.001

    authors: Foracchia M,Grisan E,Ruggeri A

    更新日期:2005-06-01 00:00:00

  • High resolution cortical bone thickness measurement from clinical CT data.

    abstract::The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.003

    authors: Treece GM,Gee AH,Mayhew PM,Poole KE

    更新日期:2010-06-01 00:00:00

  • Large deformation diffeomorphic registration of diffusion-weighted imaging data.

    abstract::Registration plays an important role in group analysis of diffusion-weighted imaging (DWI) data. It can be used to build a reference anatomy for investigating structural variation or tracking changes in white matter. Unlike traditional scalar image registration where spatial alignment is the only focus, registration o...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.06.012

    authors: Zhang P,Niethammer M,Shen D,Yap PT

    更新日期:2014-12-01 00:00:00

  • Towards intelligent robust detection of anatomical structures in incomplete volumetric data.

    abstract::Robust and fast detection of anatomical structures represents an important component of medical image analysis technologies. Current solutions for anatomy detection are based on machine learning, and are generally driven by suboptimal and exhaustive search strategies. In particular, these techniques do not effectively...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.06.007

    authors: Ghesu FC,Georgescu B,Grbic S,Maier A,Hornegger J,Comaniciu D

    更新日期:2018-08-01 00:00:00

  • Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow.

    abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.001

    authors: Zheng Q,Delingette H,Ayache N

    更新日期:2019-08-01 00:00:00

  • MR to ultrasound registration for image-guided prostate interventions.

    abstract::A deformable registration method is described that enables automatic alignment of magnetic resonance (MR) and 3D transrectal ultrasound (TRUS) images of the prostate gland. The method employs a novel "model-to-image" registration approach in which a deformable model of the gland surface, derived from an MR image, is r...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.003

    authors: Hu Y,Ahmed HU,Taylor Z,Allen C,Emberton M,Hawkes D,Barratt D

    更新日期:2012-04-01 00:00:00

  • Generalised coherent point drift for group-wise multi-dimensional analysis of diffusion brain MRI data.

    abstract::A probabilistic framework for registering generalised point sets comprising multiple voxel-wise data features such as positions, orientations and scalar-valued quantities, is proposed. It is employed for the analysis of magnetic resonance diffusion tensor image (DTI)-derived quantities, such as fractional anisotropy (...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.001

    authors: Ravikumar N,Gooya A,Beltrachini L,Frangi AF,Taylor ZA

    更新日期:2019-04-01 00:00:00

  • Suite of meshless algorithms for accurate computation of soft tissue deformation for surgical simulation.

    abstract::The ability to predict patient-specific soft tissue deformations is key for computer-integrated surgery systems and the core enabling technology for a new era of personalized medicine. Element-Free Galerkin (EFG) methods are better suited for solving soft tissue deformation problems than the finite element method (FEM...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.004

    authors: Joldes G,Bourantas G,Zwick B,Chowdhury H,Wittek A,Agrawal S,Mountris K,Hyde D,Warfield SK,Miller K

    更新日期:2019-08-01 00:00:00

  • Bayesian principal geodesic analysis for estimating intrinsic diffeomorphic image variability.

    abstract::In this paper, we present a generative Bayesian approach for estimating the low-dimensional latent space of diffeomorphic shape variability in a population of images. We develop a latent variable model for principal geodesic analysis (PGA) that provides a probabilistic framework for factor analysis in the space of dif...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.04.009

    authors: Zhang M,Fletcher PT

    更新日期:2015-10-01 00:00:00

  • Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM.

    abstract::In order to improve the accuracy of image-guided neurosurgery, different biomechanical models have been developed to correct preoperative images with respect to intraoperative changes like brain shift or tumor resection. All existing biomechanical models simulate different anatomical structures by using either appropr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00059-2

    authors: Hagemann A,Rohr K,Stiehl HS

    更新日期:2002-12-01 00:00:00

  • Directional wavelet based features for colonic polyp classification.

    abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.02.001

    authors: Wimmer G,Tamaki T,Tischendorf JJ,Häfner M,Yoshida S,Tanaka S,Uhl A

    更新日期:2016-07-01 00:00:00

  • Tongue contour tracking in dynamic ultrasound via higher-order MRFs and efficient fusion moves.

    abstract::Analyses of the human tongue motion as captured from 2D dynamic ultrasound data often requires segmentation of the mid-sagittal tongue contours. However, semi-automatic extraction of the tongue shape presents practical challenges. We approach this segmentation problem by proposing a novel higher-order Markov random fi...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.07.001

    authors: Tang L,Bressmann T,Hamarneh G

    更新日期:2012-12-01 00:00:00

  • Attentive neural cell instance segmentation.

    abstract::Neural cell instance segmentation, which aims at joint detection and segmentation of every neural cell in a microscopic image, is essential to many neuroscience applications. The challenge of this task involves cell adhesion, cell distortion, unclear cell contours, low-contrast cell protrusion structures, and backgrou...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.05.004

    authors: Yi J,Wu P,Jiang M,Huang Q,Hoeppner DJ,Metaxas DN

    更新日期:2019-07-01 00:00:00

  • Development and comparison of new hybrid motion tracking for bronchoscopic navigation.

    abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.001

    authors: Luó X,Feuerstein M,Deguchi D,Kitasaka T,Takabatake H,Mori K

    更新日期:2012-04-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • A symbolic environment for visualizing activated foci in functional neuroimaging datasets.

    abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80020-0

    authors: Rehm K,Lakshminaryan K,Frutiger S,Schaper KA,Sumners DW,Strother SC,Anderson JR,Rottenberg DA

    更新日期:1998-09-01 00:00:00