Abstract:
:Accurate and robust segmentation of abdominal organs on CT is essential for many clinical applications such as computer-aided diagnosis and computer-aided surgery. But this task is challenging due to the weak boundaries of organs, the complexity of the background, and the variable sizes of different organs. To address these challenges, we introduce a novel framework for multi-organ segmentation of abdominal regions by using organ-attention networks with reverse connections (OAN-RCs) which are applied to 2D views, of the 3D CT volume, and output estimates which are combined by statistical fusion exploiting structural similarity. More specifically, OAN is a two-stage deep convolutional network, where deep network features from the first stage are combined with the original image, in a second stage, to reduce the complex background and enhance the discriminative information for the target organs. Intuitively, OAN reduces the effect of the complex background by focusing attention so that each organ only needs to be discriminated from its local background. RCs are added to the first stage to give the lower layers more semantic information thereby enabling them to adapt to the sizes of different organs. Our networks are trained on 2D views (slices) enabling us to use holistic information and allowing efficient computation (compared to using 3D patches). To compensate for the limited cross-sectional information of the original 3D volumetric CT, e.g., the connectivity between neighbor slices, multi-sectional images are reconstructed from the three different 2D view directions. Then we combine the segmentation results from the different views using statistical fusion, with a novel term relating the structural similarity of the 2D views to the original 3D structure. To train the network and evaluate results, 13 structures were manually annotated by four human raters and confirmed by a senior expert on 236 normal cases. We tested our algorithm by 4-fold cross-validation and computed Dice-Sørensen similarity coefficients (DSC) and surface distances for evaluating our estimates of the 13 structures. Our experiments show that the proposed approach gives strong results and outperforms 2D- and 3D-patch based state-of-the-art methods in terms of DSC and mean surface distances.
journal_name
Med Image Analjournal_title
Medical image analysisauthors
Wang Y,Zhou Y,Shen W,Park S,Fishman EK,Yuille ALdoi
10.1016/j.media.2019.04.005subject
Has Abstractpub_date
2019-07-01 00:00:00pages
88-102eissn
1361-8415issn
1361-8423pii
S1361-8415(18)30252-4journal_volume
55pub_type
杂志文章abstract::In this note we summarize the history of computer aided surgery in orthopaedics and traumatology from the end of the nineteenth century to currently observable future trends. We concentrate on the two major components of such systems, pre-operative planning and intra-operative execution. The evolution of the necessary...
journal_title:Medical image analysis
pub_type: 社论
doi:10.1016/j.media.2016.06.033
更新日期:2016-10-01 00:00:00
abstract::Registration plays an important role in group analysis of diffusion-weighted imaging (DWI) data. It can be used to build a reference anatomy for investigating structural variation or tracking changes in white matter. Unlike traditional scalar image registration where spatial alignment is the only focus, registration o...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.06.012
更新日期:2014-12-01 00:00:00
abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.04.001
更新日期:2017-01-01 00:00:00
abstract::A stochastic finite element framework is presented for the simultaneous estimation of the cardiac kinematic functions and material model parameters from periodic medical image sequences. While existing biomechanics studies of the myocardial material constitutive laws have assumed known tissue kinematic measurements, a...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(03)00066-5
更新日期:2003-12-01 00:00:00
abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.07.007
更新日期:2018-12-01 00:00:00
abstract::The Insight Toolkit (ITK) initiative from the National Library of Medicine has provided a suite of state-of-the-art segmentation and registration algorithms ideally suited to volume visualization and analysis. A volume visualization application that effectively utilizes these algorithms provides many benefits: it allo...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2005.04.009
更新日期:2005-12-01 00:00:00
abstract::Accurate segmentation of the prostate and organs at risk (e.g., bladder and rectum) in CT images is a crucial step for radiation therapy in the treatment of prostate cancer. However, it is a very challenging task due to unclear boundaries, large intra- and inter-patient shape variability, and uncertain existence of bo...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.03.003
更新日期:2019-05-01 00:00:00
abstract::Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the l...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101537
更新日期:2019-12-01 00:00:00
abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101535
更新日期:2019-12-01 00:00:00
abstract::The spinal cord is an essential and vulnerable component of the central nervous system. Differentiating and localizing the spinal cord internal structure (i.e., gray matter vs. white matter) is critical for assessment of therapeutic impacts and determining prognosis of relevant conditions. Fortunately, new magnetic re...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.01.003
更新日期:2014-04-01 00:00:00
abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.02.001
更新日期:2016-07-01 00:00:00
abstract::In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori inform...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2004.06.005
更新日期:2004-09-01 00:00:00
abstract::In-silico continuum simulations of organ and tissue scale physiology often require a discretisation or mesh of the solution domain. Cubic Hermite meshes provide a smooth representation of anatomy that is well-suited for simulating large deformation mechanics. Models of organ mechanics and deformation have demonstrated...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.06.010
更新日期:2011-12-01 00:00:00
abstract::The current standard of care for glaucoma patients consists of functional assessment of vision via visual field (VF) testing, which is sensitive but subjective, time-consuming, and often unreliable. A new imaging technology, Fourier domain optical coherence tomography (OCT), is being introduced to assess the structura...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.05.012
更新日期:2012-01-01 00:00:00
abstract::We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentric patches at multiple resolutions with different fields of view, feed different branches of HookNet, and intermedi...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101890
更新日期:2021-02-01 00:00:00
abstract::We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extr...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101848
更新日期:2021-01-01 00:00:00
abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(98)80020-0
更新日期:1998-09-01 00:00:00
abstract::In minimally invasive surgery, deployment of motion compensation, dynamic active constraints and adaptive intra-operative guidance require accurate estimation of deforming tissue in 3D. To this end, the use of vision-based techniques is advantageous in that it does not require the integration of additional hardware to...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.02.010
更新日期:2012-04-01 00:00:00
abstract::Recent progress in cardiac catheterization and devices has allowed the development of new therapies for severe cardiac diseases like arrhythmias and heart failure. The skills required for such interventions are very challenging to learn, and are typically acquired over several years. Virtual reality simulators may red...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.06.040
更新日期:2017-01-01 00:00:00
abstract::We propose two information theoretic similarity measures that allow to incorporate tissue class information in non-rigid image registration. The first measure assumes that tissue class probabilities have been assigned to each of the images to be registered by prior segmentation of both of them. One image is then non-r...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2005.03.004
更新日期:2006-06-01 00:00:00
abstract::Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) introduced new state-of-the-art segmentation systems. Despite outperforming the overall accuracy of existing systems, the effects of DL model proper...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101950
更新日期:2020-12-25 00:00:00
abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.12.003
更新日期:2010-04-01 00:00:00
abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2004.06.013
更新日期:2004-09-01 00:00:00
abstract::A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(00)00003-7
更新日期:2000-03-01 00:00:00
abstract::Synthesized medical images have several important applications. For instance, they can be used as an intermedium in cross-modality image registration or used as augmented training samples to boost the generalization capability of a classifier. In this work, we propose a generic cross-modality synthesis approach with t...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.12.002
更新日期:2019-02-01 00:00:00
abstract::Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient sol...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.11.008
更新日期:2019-02-01 00:00:00
abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.11.001
更新日期:2012-04-01 00:00:00
abstract::In this paper, we present a graph-based concurrent brain tumor segmentation and atlas to diseased patient registration framework. Both segmentation and registration problems are modeled using a unified pairwise discrete Markov Random Field model on a sparse grid superimposed to the image domain. Segmentation is addres...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.02.006
更新日期:2014-05-01 00:00:00
abstract::The Cartesian parallel magnetic imaging problem is formulated variationally using a high-order penalty for coil sensitivities and a total variation like penalty for the reconstructed image. Then the optimality system is derived and numerically discretized. The objective function used is non-convex, but it possesses a ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2011.07.002
更新日期:2012-01-01 00:00:00
abstract::Diffusion MRI affords valuable insights into white matter microstructures, but suffers from low signal-to-noise ratio (SNR), especially at high diffusion weighting (i.e., b-value). To avoid time-intensive repeated acquisition, post-processing algorithms are often used to reduce noise. Among existing methods, non-local...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.01.006
更新日期:2019-04-01 00:00:00