Deformable image registration by combining uncertainty estimates from supervoxel belief propagation.

Abstract:

:Discrete optimisation strategies have a number of advantages over their continuous counterparts for deformable registration of medical images. For example: it is not necessary to compute derivatives of the similarity term; dense sampling of the search space reduces the risk of becoming trapped in local optima; and (in principle) an optimum can be found without resorting to iterative coarse-to-fine warping strategies. However, the large complexity of high-dimensional medical data renders a direct voxel-wise estimation of deformation vectors impractical. For this reason, previous work on medical image registration using graphical models has largely relied on using a parameterised deformation model and on the use of iterative coarse-to-fine optimisation schemes. In this paper, we propose an approach that enables accurate voxel-wise deformable registration of high-resolution 3D images without the need for intermediate image warping or a multi-resolution scheme. This is achieved by representing the image domain as multiple comprehensive supervoxel layers and making use of the full marginal distribution of all probable displacement vectors after inferring regularity of the deformations using belief propagation. The optimisation acts on the coarse scale representation of supervoxels, which provides sufficient spatial context and is robust to noise in low contrast areas. Minimum spanning trees, which connect neighbouring supervoxels, are employed to model pair-wise deformation dependencies. The optimal displacement for each voxel is calculated by considering the probabilities for all displacements over all overlapping supervoxel graphs and subsequently seeking the mode of this distribution. We demonstrate the applicability of this concept for two challenging applications: first, for intra-patient motion estimation in lung CT scans; and second, for atlas-based segmentation propagation of MRI brain scans. For lung registration, the voxel-wise mode of displacements is found using the mean-shift algorithm, which enables us to determine continuous valued sub-voxel motion vectors. Finding the mode of brain segmentation labels is performed using a voxel-wise majority voting weighted by the displacement uncertainty estimates. Our experimental results show significant improvements in registration accuracy when using the additional information provided by the registration uncertainty estimates. The multi-layer approach enables fusion of multiple complementary proposals, extending the popular fusion approaches from multi-image registration to probabilistic one-to-one image registration.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Heinrich MP,Simpson IJ,Papież BW,Brady SM,Schnabel JA

doi

10.1016/j.media.2015.09.005

subject

Has Abstract

pub_date

2016-01-01 00:00:00

pages

57-71

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(15)00146-2

journal_volume

27

pub_type

杂志文章
  • IDRiD: Diabetic Retinopathy - Segmentation and Grading Challenge.

    abstract::Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is chal...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101561

    authors: Porwal P,Pachade S,Kokare M,Deshmukh G,Son J,Bae W,Liu L,Wang J,Liu X,Gao L,Wu T,Xiao J,Wang F,Yin B,Wang Y,Danala G,He L,Choi YH,Lee YC,Jung SH,Li Z,Sui X,Wu J,Li X,Zhou T,Toth J,Baran A,Kori A,Ch

    更新日期:2020-01-01 00:00:00

  • Cardiac image modelling: Breadth and depth in heart disease.

    abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...

    journal_title:Medical image analysis

    pub_type: 社论,评审

    doi:10.1016/j.media.2016.06.027

    authors: Suinesiaputra A,McCulloch AD,Nash MP,Pontre B,Young AA

    更新日期:2016-10-01 00:00:00

  • Multi-modal volume registration by maximization of mutual information.

    abstract::A new information-theoretic approach is presented for finding the registration of volumetric medical images of differing modalities. Registration is achieved by adjustment of the relative position and orientation until the mutual information between the images is maximized. In our derivation of the registration proced...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(01)80004-9

    authors: Wells WM 3rd,Viola P,Atsumi H,Nakajima S,Kikinis R

    更新日期:1996-03-01 00:00:00

  • Exudate detection in color retinal images for mass screening of diabetic retinopathy.

    abstract::The automatic detection of exudates in color eye fundus images is an important task in applications such as diabetic retinopathy screening. The presented work has been undertaken in the framework of the TeleOphta project, whose main objective is to automatically detect normal exams in a tele-ophthalmology network, thu...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.05.004

    authors: Zhang X,Thibault G,Decencière E,Marcotegui B,Laÿ B,Danno R,Cazuguel G,Quellec G,Lamard M,Massin P,Chabouis A,Victor Z,Erginay A

    更新日期:2014-10-01 00:00:00

  • An efficient Riemannian statistical shape model using differential coordinates: With application to the classification of data from the Osteoarthritis Initiative.

    abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.09.004

    authors: von Tycowicz C,Ambellan F,Mukhopadhyay A,Zachow S

    更新日期:2018-01-01 00:00:00

  • Groupwise multi-atlas segmentation of the spinal cord's internal structure.

    abstract::The spinal cord is an essential and vulnerable component of the central nervous system. Differentiating and localizing the spinal cord internal structure (i.e., gray matter vs. white matter) is critical for assessment of therapeutic impacts and determining prognosis of relevant conditions. Fortunately, new magnetic re...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.01.003

    authors: Asman AJ,Bryan FW,Smith SA,Reich DS,Landman BA

    更新日期:2014-04-01 00:00:00

  • Multimodal image registration using floating regressors in the joint intensity scatter plot.

    abstract::This paper presents a new approach for multimodal medical image registration and compares it to normalized mutual information (NMI) and the correlation ratio (CR). Like NMI and CR, the new method's measure of registration quality is based on the distribution of points in the joint intensity scatter plot (JISP); compac...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.12.002

    authors: Orchard J

    更新日期:2008-08-01 00:00:00

  • Automatic online layer separation for vessel enhancement in X-ray angiograms for percutaneous coronary interventions.

    abstract::Percutaneous coronary intervention is a minimally invasive procedure that is usually performed under image guidance using X-ray angiograms in which coronary arteries are opacified with contrast agent. In X-ray images, 3D objects are projected on a 2D plane, generating semi-transparent layers that overlap each other. T...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.04.011

    authors: Ma H,Hoogendoorn A,Regar E,Niessen WJ,van Walsum T

    更新日期:2017-07-01 00:00:00

  • CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation.

    abstract::Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) introduced new state-of-the-art segmentation systems. Despite outperforming the overall accuracy of existing systems, the effects of DL model proper...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101950

    authors: Kavur AE,Gezer NS,Barış M,Aslan S,Conze PH,Groza V,Pham DD,Chatterjee S,Ernst P,Özkan S,Baydar B,Lachinov D,Han S,Pauli J,Isensee F,Perkonigg M,Sathish R,Rajan R,Sheet D,Dovletov G,Speck O,Nürnberger A,Maier-H

    更新日期:2020-12-25 00:00:00

  • A gradient-based optical-flow cardiac motion estimation method for cine and tagged MR images.

    abstract::A new method is proposed to quantify the myocardial motion from both 2D C(ine)-MRI and T(agged)-MRI sequences. The tag pattern offers natural landmarks within the image that makes it possible to accurately quantify the motion within the myocardial wall. Therefore, several methods have been proposed for T-MRI. However,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.016

    authors: Wang L,Clarysse P,Liu Z,Gao B,Liu W,Croisille P,Delachartre P

    更新日期:2019-10-01 00:00:00

  • Predicting the progression of mild cognitive impairment using machine learning: A systematic, quantitative and critical review.

    abstract::We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101848

    authors: Ansart M,Epelbaum S,Bassignana G,Bône A,Bottani S,Cattai T,Couronné R,Faouzi J,Koval I,Louis M,Thibeau-Sutre E,Wen J,Wild A,Burgos N,Dormont D,Colliot O,Durrleman S

    更新日期:2021-01-01 00:00:00

  • An automated pipeline for cortical sulcal fundi extraction.

    abstract::In this paper, we propose a novel automated pipeline for extraction of sulcal fundi from triangulated cortical surfaces. This method consists of four consecutive steps. Firstly, we adopt a finite difference method to estimate principal curvatures, principal directions and curvature derivatives, along the principal dir...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.005

    authors: Li G,Guo L,Nie J,Liu T

    更新日期:2010-06-01 00:00:00

  • Stochastic finite element framework for simultaneous estimation of cardiac kinematic functions and material parameters.

    abstract::A stochastic finite element framework is presented for the simultaneous estimation of the cardiac kinematic functions and material model parameters from periodic medical image sequences. While existing biomechanics studies of the myocardial material constitutive laws have assumed known tissue kinematic measurements, a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00066-5

    authors: Shi P,Liu H

    更新日期:2003-12-01 00:00:00

  • Analytical and fast Fiber Orientation Distribution reconstruction in 3D-Polarized Light Imaging.

    abstract::Three dimensional Polarized Light Imaging (3D-PLI) is an optical technique which allows mapping the spatial fiber architecture of fibrous postmortem tissues, at sub-millimeter resolutions. Here, we propose an analytical and fast approach to compute the fiber orientation distribution (FOD) from high-resolution vector d...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101760

    authors: Alimi A,Deslauriers-Gauthier S,Matuschke F,Müller A,Muenzing SEA,Axer M,Deriche R

    更新日期:2020-10-01 00:00:00

  • A symbolic environment for visualizing activated foci in functional neuroimaging datasets.

    abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80020-0

    authors: Rehm K,Lakshminaryan K,Frutiger S,Schaper KA,Sumners DW,Strother SC,Anderson JR,Rottenberg DA

    更新日期:1998-09-01 00:00:00

  • Recovering from missing data in population imaging - Cardiac MR image imputation via conditional generative adversarial nets.

    abstract::Accurate ventricular volume measurements are the primary indicators of normal/abnor- mal cardiac function and are dependent on the Cardiac Magnetic Resonance (CMR) volumes being complete. However, missing or unusable slices owing to the presence of image artefacts such as respiratory or motion ghosting, aliasing, ring...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101812

    authors: Xia Y,Zhang L,Ravikumar N,Attar R,Piechnik SK,Neubauer S,Petersen SE,Frangi AF

    更新日期:2021-01-01 00:00:00

  • Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

    abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101861

    authors: Zhang D,Chen B,Li S

    更新日期:2021-01-01 00:00:00

  • Segmentation of pulmonary nodules of various densities with morphological approaches and convexity models.

    abstract::Accurate segmentation of a pulmonary nodule is an important and active area of research in medical image processing. Although many algorithms have been reported in literature for this problem, those that are applicable to various density types have not been available until recently. In this paper, we propose a new alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.08.005

    authors: Kubota T,Jerebko AK,Dewan M,Salganicoff M,Krishnan A

    更新日期:2011-02-01 00:00:00

  • Segmentation of the skull in MRI volumes using deformable model and taking the partial volume effect into account.

    abstract::Segmentation of the skull in medical imagery is an important stage in applications that require the construction of realistic models of the head. Such models are used, for example, to simulate the behavior of electro-magnetic fields in the head and to model the electrical activity of the cortex in EEG and MEG data. In...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00016-5

    authors: Rifa H,Bloch I,Hutchinson S,Wiart J,Garnero L

    更新日期:2000-09-01 00:00:00

  • Coupled parametric model for estimation of visual field tests based on OCT macular thickness maps, and vice versa, in glaucoma care.

    abstract::The current standard of care for glaucoma patients consists of functional assessment of vision via visual field (VF) testing, which is sensitive but subjective, time-consuming, and often unreliable. A new imaging technology, Fourier domain optical coherence tomography (OCT), is being introduced to assess the structura...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.05.012

    authors: Tsai A,Caprioli J,Shen LQ

    更新日期:2012-01-01 00:00:00

  • Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model.

    abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.001

    authors: Lee S,Reinhardt JM,Cattin PC,Abràmoff MD

    更新日期:2010-08-01 00:00:00

  • Automated size-specific dose estimates using deep learning image processing.

    abstract::An automated vendor-independent system for dose monitoring in computed tomography (CT) medical examinations involving ionizing radiation is presented in this paper. The system provides precise size-specific dose estimates (SSDE) following the American Association of Physicists in Medicine regulations. Our dose managem...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101898

    authors: Juszczyk J,Badura P,Czajkowska J,Wijata A,Andrzejewski J,Bozek P,Smolinski M,Biesok M,Sage A,Rudzki M,Wieclawek W

    更新日期:2021-02-01 00:00:00

  • MR to ultrasound registration for image-guided prostate interventions.

    abstract::A deformable registration method is described that enables automatic alignment of magnetic resonance (MR) and 3D transrectal ultrasound (TRUS) images of the prostate gland. The method employs a novel "model-to-image" registration approach in which a deformable model of the gland surface, derived from an MR image, is r...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.003

    authors: Hu Y,Ahmed HU,Taylor Z,Allen C,Emberton M,Hawkes D,Barratt D

    更新日期:2012-04-01 00:00:00

  • Regularized siamese neural network for unsupervised outlier detection on brain multiparametric magnetic resonance imaging: Application to epilepsy lesion screening.

    abstract::In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101618

    authors: Alaverdyan Z,Jung J,Bouet R,Lartizien C

    更新日期:2020-02-01 00:00:00

  • Gaussianization of Diffusion MRI Data Using Spatially Adaptive Filtering.

    abstract::Diffusion MRI magnitude data, typically Rician or noncentral χ distributed, is affected by the noise floor, which falsely elevates signal, reduces image contrast, and biases estimation of diffusion parameters. Noise floor can be avoided by extracting real-valued Gaussian-distributed data from complex diffusion-weighte...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101828

    authors: Liu F,Feng J,Chen G,Shen D,Yap PT

    更新日期:2021-02-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification.

    abstract::The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze them are quite challenging during the automatic diagnosis process. The multi-instance learning bas...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101549

    authors: Wang S,Zhu Y,Yu L,Chen H,Lin H,Wan X,Fan X,Heng PA

    更新日期:2019-12-01 00:00:00

  • Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection.

    abstract::Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101724

    authors: Ayhan MS,Kühlewein L,Aliyeva G,Inhoffen W,Ziemssen F,Berens P

    更新日期:2020-08-01 00:00:00

  • Multi-task exclusive relationship learning for alzheimer's disease progression prediction with longitudinal data.

    abstract::Alzheimer's disease (AD) is a neurodegenerative disorder characterized by progressive impairment of memory and other cognitive functions. Currently, many multi-task learning approaches have been proposed to predict the disease progression at the early stage using longitudinal data, with each task corresponding to a pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.007

    authors: Wang M,Zhang D,Shen D,Liu M

    更新日期:2019-04-01 00:00:00

  • Reducing annotation effort in digital pathology: A Co-Representation learning framework for classification tasks.

    abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101859

    authors: Pati P,Foncubierta-Rodríguez A,Goksel O,Gabrani M

    更新日期:2021-01-01 00:00:00