Efficient multi-modal dense field non-rigid registration: alignment of histological and section images.

Abstract:

:We describe a new algorithm for non-rigid registration capable of estimating a constrained dense displacement field from multi-modal image data. We applied this algorithm to capture non-rigid deformation between digital images of histological slides and digital flat-bed scanned images of cryotomed sections of the larynx, and carried out validation experiments to measure the effectiveness of the algorithm. The implementation was carried out by extending the open-source Insight ToolKit software. In diagnostic imaging of cancer of the larynx, imaging modalities sensitive to both anatomy (such as MRI and CT) and function (PET) are valuable. However, these modalities differ in their capability to discriminate the margins of tumor. Gold standard tumor margins can be obtained from histological images from cryotomed sections of the larynx. Unfortunately, the process of freezing, fixation, cryotoming and staining the tissue to create histological images introduces non-rigid deformations and significant contrast changes. We demonstrate that the non-rigid registration algorithm we present is able to capture these deformations and the algorithm allows us to align histological images with scanned images of the larynx. Our non-rigid registration algorithm constructs a deformation field to warp one image onto another. The algorithm measures image similarity using a mutual information similarity criterion, and avoids spurious deformations due to noise by constraining the estimated deformation field with a linear elastic regularization term. The finite element method is used to represent the deformation field, and our implementation enables us to assign inhomogeneous material characteristics so that hard regions resist internal deformation whereas soft regions are more pliant. A gradient descent optimization strategy is used and this has enabled rapid and accurate convergence to the desired estimate of the deformation field. A further acceleration in speed without cost of accuracy is achieved by using an adaptive mesh refinement strategy.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

du Bois d'Aische A,Craene MD,Geets X,Gregoire V,Macq B,Warfield SK

doi

10.1016/j.media.2005.04.003

subject

Has Abstract

pub_date

2005-12-01 00:00:00

pages

538-46

issue

6

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(05)00030-7

journal_volume

9

pub_type

杂志文章
  • Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

    abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101861

    authors: Zhang D,Chen B,Li S

    更新日期:2021-01-01 00:00:00

  • Bayesian principal geodesic analysis for estimating intrinsic diffeomorphic image variability.

    abstract::In this paper, we present a generative Bayesian approach for estimating the low-dimensional latent space of diffeomorphic shape variability in a population of images. We develop a latent variable model for principal geodesic analysis (PGA) that provides a probabilistic framework for factor analysis in the space of dif...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.04.009

    authors: Zhang M,Fletcher PT

    更新日期:2015-10-01 00:00:00

  • HookNet: Multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images.

    abstract::We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentric patches at multiple resolutions with different fields of view, feed different branches of HookNet, and intermedi...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101890

    authors: van Rijthoven M,Balkenhol M,Siliņa K,van der Laak J,Ciompi F

    更新日期:2021-02-01 00:00:00

  • Segmentation of the skull in MRI volumes using deformable model and taking the partial volume effect into account.

    abstract::Segmentation of the skull in medical imagery is an important stage in applications that require the construction of realistic models of the head. Such models are used, for example, to simulate the behavior of electro-magnetic fields in the head and to model the electrical activity of the cortex in EEG and MEG data. In...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00016-5

    authors: Rifa H,Bloch I,Hutchinson S,Wiart J,Garnero L

    更新日期:2000-09-01 00:00:00

  • PCA-based groupwise image registration for quantitative MRI.

    abstract::Quantitative magnetic resonance imaging (qMRI) is a technique for estimating quantitative tissue properties, such as the T1 and T2 relaxation times, apparent diffusion coefficient (ADC), and various perfusion measures. This estimation is achieved by acquiring multiple images with different acquisition parameters (or a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.12.004

    authors: Huizinga W,Poot DH,Guyader JM,Klaassen R,Coolen BF,van Kranenburg M,van Geuns RJ,Uitterdijk A,Polfliet M,Vandemeulebroucke J,Leemans A,Niessen WJ,Klein S

    更新日期:2016-04-01 00:00:00

  • Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm.

    abstract::In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori inform...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.005

    authors: Lorenzo-Valdés M,Sanchez-Ortiz GI,Elkington AG,Mohiaddin RH,Rueckert D

    更新日期:2004-09-01 00:00:00

  • Pseudo-healthy synthesis with pathology disentanglement and adversarial learning.

    abstract::Pseudo-healthy synthesis is the task of creating a subject-specific 'healthy' image from a pathological one. Such images can be helpful in tasks such as anomaly detection and understanding changes induced by pathology and disease. In this paper, we present a model that is encouraged to disentangle the information of p...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101719

    authors: Xia T,Chartsias A,Tsaftaris SA

    更新日期:2020-08-01 00:00:00

  • A gradient-based optical-flow cardiac motion estimation method for cine and tagged MR images.

    abstract::A new method is proposed to quantify the myocardial motion from both 2D C(ine)-MRI and T(agged)-MRI sequences. The tag pattern offers natural landmarks within the image that makes it possible to accurately quantify the motion within the myocardial wall. Therefore, several methods have been proposed for T-MRI. However,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.016

    authors: Wang L,Clarysse P,Liu Z,Gao B,Liu W,Croisille P,Delachartre P

    更新日期:2019-10-01 00:00:00

  • Multi-task exclusive relationship learning for alzheimer's disease progression prediction with longitudinal data.

    abstract::Alzheimer's disease (AD) is a neurodegenerative disorder characterized by progressive impairment of memory and other cognitive functions. Currently, many multi-task learning approaches have been proposed to predict the disease progression at the early stage using longitudinal data, with each task corresponding to a pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.007

    authors: Wang M,Zhang D,Shen D,Liu M

    更新日期:2019-04-01 00:00:00

  • CorteXpert: A model-based method for automatic renal cortex segmentation.

    abstract::This paper introduces a model-based approach for a fully automatic delineation of kidney and cortex tissue from contrast-enhanced abdominal CT scans. The proposed framework, named CorteXpert, consists of two new strategies for kidney tissue delineation: cortex model adaptation and non-uniform graph search. CorteXpert ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.06.010

    authors: Xiang D,Bagci U,Jin C,Shi F,Zhu W,Yao J,Sonka M,Chen X

    更新日期:2017-12-01 00:00:00

  • Continuous diffusion signal, EAP and ODF estimation via Compressive Sensing in diffusion MRI.

    abstract::In this paper, we exploit the ability of Compressed Sensing (CS) to recover the whole 3D Diffusion MRI (dMRI) signal from a limited number of samples while efficiently recovering important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Some attempts to...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.02.010

    authors: Merlet SL,Deriche R

    更新日期:2013-07-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • Segmentation of the visible human for high-quality volume-based visualization.

    abstract::This article describes a combination of interactive classification and super-sampling visualization algorithms that greatly enhances the realism of 3-D reconstructions of the Visible Human data sets. Objects are classified on the basis of ellipsoidal regions in RGB space. The ellipsoids are used for super-sampling in ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(97)85001-3

    authors: Schiemann T,Tiede U,Höhne KH

    更新日期:1997-09-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Groupwise registration with global-local graph shrinkage in atlas construction.

    abstract::Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101711

    authors: Fu T,Yang J,Li Q,Ai D,Song H,Jiang Y,Wang Y,Frangi AF

    更新日期:2020-08-01 00:00:00

  • Advances and challenges in deformable image registration: From image fusion to complex motion modelling.

    abstract::Over the past 20 years, the field of medical image registration has significantly advanced from multi-modal image fusion to highly non-linear, deformable image registration for a wide range of medical applications and imaging modalities, involving the compensation and analysis of physiological organ motion or of tissu...

    journal_title:Medical image analysis

    pub_type: 社论

    doi:10.1016/j.media.2016.06.031

    authors: Schnabel JA,Heinrich MP,Papież BW,Brady SJM

    更新日期:2016-10-01 00:00:00

  • Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge.

    abstract::Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the l...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101537

    authors: Zhuang X,Li L,Payer C,Štern D,Urschler M,Heinrich MP,Oster J,Wang C,Smedby Ö,Bian C,Yang X,Heng PA,Mortazi A,Bagci U,Yang G,Sun C,Galisot G,Ramel JY,Brouard T,Tong Q,Si W,Liao X,Zeng G,Shi Z,Zheng G,Wang

    更新日期:2019-12-01 00:00:00

  • Comparison of atlas-based techniques for whole-body bone segmentation.

    abstract::We evaluate the accuracy of whole-body bone extraction from whole-body MR images using a number of atlas-based segmentation methods. The motivation behind this work is to find the most promising approach for the purpose of MRI-guided derivation of PET attenuation maps in whole-body PET/MRI. To this end, a variety of a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.11.003

    authors: Arabi H,Zaidi H

    更新日期:2017-02-01 00:00:00

  • SDAE-GAN: Enable high-dimensional pathological images in liver cancer survival prediction with a policy gradient based data augmentation method.

    abstract::High-dimensional pathological images produced by Immunohistochemistry (IHC) methods consist of many pathological indexes, which play critical roles in cancer treatment planning. However, these indexes currently cannot be utilized in survival prediction because joining them with patients' clinicopathological features (...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101640

    authors: Wu H,Gao R,Sheng YP,Chen B,Li S

    更新日期:2020-05-01 00:00:00

  • Statistical shape models for 3D medical image segmentation: a review.

    abstract::Statistical shape models (SSMs) have by now been firmly established as a robust tool for segmentation of medical images. While 2D models have been in use since the early 1990 s, wide-spread utilization of three-dimensional models appeared only in recent years, primarily made possible by breakthroughs in automatic dete...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2009.05.004

    authors: Heimann T,Meinzer HP

    更新日期:2009-08-01 00:00:00

  • Computer technology in detection and staging of prostate carcinoma: a review.

    abstract::After two decades of increasing interest and research activity, computer-assisted diagnostic approaches are reaching the stage where more routine deployment in clinical practice is becoming a possibility [Kruppinski, E.A., 2004. Computer-aided detection in clinical environment: Benefits and challenges for radiologists...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2005.06.003

    authors: Zhu Y,Williams S,Zwiggelaar R

    更新日期:2006-04-01 00:00:00

  • Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation.

    abstract::Phase contrast, a noninvasive microscopy imaging technique, is widely used to capture time-lapse images to monitor the behavior of transparent cells without staining or altering them. Due to the optical principle, phase contrast microscopy images contain artifacts such as the halo and shade-off that hinder image segme...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.12.006

    authors: Yin Z,Kanade T,Chen M

    更新日期:2012-07-01 00:00:00

  • Regularized siamese neural network for unsupervised outlier detection on brain multiparametric magnetic resonance imaging: Application to epilepsy lesion screening.

    abstract::In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101618

    authors: Alaverdyan Z,Jung J,Bouet R,Lartizien C

    更新日期:2020-02-01 00:00:00

  • A comparison of freehand three-dimensional ultrasound reconstruction techniques.

    abstract::Three-dimensional freehand ultrasound imaging produces a set of irregularly spaced B-scans, which are typically reconstructed on a regular grid for visualization and data analysis. Most standard reconstruction algorithms are designed to minimize computational requirements and do not exploit the underlying shape of the...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(99)80028-0

    authors: Rohling R,Gee A,Berman L

    更新日期:1999-12-01 00:00:00

  • 4D hyperspherical harmonic (HyperSPHARM) representation of surface anatomy: a holistic treatment of multiple disconnected anatomical structures.

    abstract::Image-based parcellation of the brain often leads to multiple disconnected anatomical structures, which pose significant challenges for analyses of morphological shapes. Existing shape models, such as the widely used spherical harmonic (SPHARM) representation, assume topological invariance, so are unable to simultaneo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.02.004

    authors: Pasha Hosseinbor A,Chung MK,Koay CG,Schaefer SM,van Reekum CM,Schmitz LP,Sutterer M,Alexander AL,Davidson RJ

    更新日期:2015-05-01 00:00:00

  • Computerized detection of pulmonary nodules in chest radiographs based on morphological features and wavelet snake model.

    abstract::We have developed a new computer-aided diagnosis scheme for automated detection of lung nodules in digital chest radiographs based on a combination of morphological features and the wavelet snake. In our scheme, two processes were applied in parallel to reduce the false-positive detections after initial nodule candida...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00064-6

    authors: Keserci B,Yoshida H

    更新日期:2002-12-01 00:00:00

  • CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation.

    abstract::Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) introduced new state-of-the-art segmentation systems. Despite outperforming the overall accuracy of existing systems, the effects of DL model proper...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101950

    authors: Kavur AE,Gezer NS,Barış M,Aslan S,Conze PH,Groza V,Pham DD,Chatterjee S,Ernst P,Özkan S,Baydar B,Lachinov D,Han S,Pauli J,Isensee F,Perkonigg M,Sathish R,Rajan R,Sheet D,Dovletov G,Speck O,Nürnberger A,Maier-H

    更新日期:2020-12-25 00:00:00

  • Dynamic MRI reconstruction with end-to-end motion-guided network.

    abstract::Temporal correlation in dynamic magnetic resonance imaging (MRI), such as cardiac MRI, is informative and important to understand motion mechanisms of body regions. Modeling such information into the MRI reconstruction process produces temporally coherent image sequence and reduces imaging artifacts and blurring. Howe...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101901

    authors: Huang Q,Xian Y,Yang D,Qu H,Yi J,Wu P,Metaxas DN

    更新日期:2021-02-01 00:00:00

  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • Cardiac image modelling: Breadth and depth in heart disease.

    abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...

    journal_title:Medical image analysis

    pub_type: 社论,评审

    doi:10.1016/j.media.2016.06.027

    authors: Suinesiaputra A,McCulloch AD,Nash MP,Pontre B,Young AA

    更新日期:2016-10-01 00:00:00