Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

Abstract:

:Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the global spine pattern and the local VB appearance into consideration concurrently. In this paper, we propose a Sequential Conditional Reinforcement Learning network (SCRL) to tackle the simultaneous detection and segmentation of VBs from MR spine images. The SCRL, for the first time, applies deep reinforcement learning into VB detection and segmentation. It innovatively models the spatial correlation between VBs from top to bottom as sequential dynamic-interaction processes, thereby globally focusing detection and segmentation on each VB. Simultaneously, SCRL also perceives the local appearance feature of each desirable VB comprehensively, thereby achieving accurate detection and segmentation result. Particularly, SCRL seamlessly combines three parts: 1) Anatomy-Modeling Reinforcement Learning Network dynamically interacts with the image and focuses an attention-region on the VB; 2) Fully-Connected Residual Neural Network learns rich global context information of the VB including both the detailed low-level features and the abstracted high-level features to detect the accurate bounding-box of the VB based on the attention-region; 3) Y-shaped Network learns comprehensive detailed texture information of VB including multi-scale, coarse-to-fine features to segment the boundary of VB from the attention-region. On 240 subjects, SCRL achieves accurate detection and segmentation results, where on average the detection IoU is 92.3%, segmentation Dice is 92.6%, and classification mean accuracy is 96.4%. These excellent results demonstrate that SCRL can be an efficient aided-diagnostic tool to assist clinicians when diagnosing spinal diseases.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Zhang D,Chen B,Li S

doi

10.1016/j.media.2020.101861

subject

Has Abstract

pub_date

2021-01-01 00:00:00

pages

101861

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30225-5

journal_volume

67

pub_type

杂志文章
  • Intensity inhomogeneity correction of SD-OCT data using macular flatspace.

    abstract::Images of the retina acquired using optical coherence tomography (OCT) often suffer from intensity inhomogeneity problems that degrade both the quality of the images and the performance of automated algorithms utilized to measure structural changes. This intensity variation has many causes, including off-axis acquisit...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.09.008

    authors: Lang A,Carass A,Jedynak BM,Solomon SD,Calabresi PA,Prince JL

    更新日期:2018-01-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • Multiple hypothesis template tracking of small 3D vessel structures.

    abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.12.003

    authors: Friman O,Hindennach M,Kühnel C,Peitgen HO

    更新日期:2010-04-01 00:00:00

  • Hierarchical segmentation using equivalence test (HiSET): Application to DCE image sequences.

    abstract::Dynamical contrast enhanced (DCE) imaging allows non invasive access to tissue micro-vascularization. It appears as a promising tool to build imaging biomarkers for diagnostic, prognosis or anti-angiogenesis treatment monitoring of cancer. However, quantitative analysis of DCE image sequences suffers from low signal t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.10.007

    authors: Liu F,Cuenod CA,Thomassin-Naggara I,Chemouny S,Rozenholc Y

    更新日期:2019-01-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model.

    abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.001

    authors: Lee S,Reinhardt JM,Cattin PC,Abràmoff MD

    更新日期:2010-08-01 00:00:00

  • Automatic detection of over 100 anatomical landmarks in medical CT images: A framework with independent detectors and combinatorial optimization.

    abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.04.001

    authors: Hanaoka S,Shimizu A,Nemoto M,Nomura Y,Miki S,Yoshikawa T,Hayashi N,Ohtomo K,Masutani Y

    更新日期:2017-01-01 00:00:00

  • Robust estimation of carotid artery wall motion using the elasticity-based state-space approach.

    abstract::The dynamics of the carotid artery wall has been recognized as a valuable indicator to evaluate the status of atherosclerotic disease in the preclinical stage. However, it is still a challenge to accurately measure this dynamics from ultrasound images. This paper aims at developing an elasticity-based state-space appr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.004

    authors: Gao Z,Xiong H,Liu X,Zhang H,Ghista D,Wu W,Li S

    更新日期:2017-04-01 00:00:00

  • Integrating segmentation methods from the Insight Toolkit into a visualization application.

    abstract::The Insight Toolkit (ITK) initiative from the National Library of Medicine has provided a suite of state-of-the-art segmentation and registration algorithms ideally suited to volume visualization and analysis. A volume visualization application that effectively utilizes these algorithms provides many benefits: it allo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.04.009

    authors: Martin K,Ibáñez L,Avila L,Barré S,Kaspersen JH

    更新日期:2005-12-01 00:00:00

  • Automated annotation and quantitative description of ultrasound videos of the fetal heart.

    abstract::Interpretation of ultrasound videos of the fetal heart is crucial for the antenatal diagnosis of congenital heart disease (CHD). We believe that automated image analysis techniques could make an important contribution towards improving CHD detection rates. However, to our knowledge, no previous work has been done in t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.11.006

    authors: Bridge CP,Ioannou C,Noble JA

    更新日期:2017-02-01 00:00:00

  • Segmentation of the visible human for high-quality volume-based visualization.

    abstract::This article describes a combination of interactive classification and super-sampling visualization algorithms that greatly enhances the realism of 3-D reconstructions of the Visible Human data sets. Objects are classified on the basis of ellipsoidal regions in RGB space. The ellipsoids are used for super-sampling in ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(97)85001-3

    authors: Schiemann T,Tiede U,Höhne KH

    更新日期:1997-09-01 00:00:00

  • Vessel extraction from non-fluorescein fundus images using orientation-aware detector.

    abstract::The automatic extraction of blood vessels in non-fluorescein eye fundus images is a tough task in applications such as diabetic retinopathy screening. However, vessel shapes have complex variations, and accurate modeling of retinal vascular structures is challenging. We have therefore developed a new approach to accur...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.09.002

    authors: Yin B,Li H,Sheng B,Hou X,Chen Y,Wu W,Li P,Shen R,Bao Y,Jia W

    更新日期:2015-12-01 00:00:00

  • Comparison of atlas-based techniques for whole-body bone segmentation.

    abstract::We evaluate the accuracy of whole-body bone extraction from whole-body MR images using a number of atlas-based segmentation methods. The motivation behind this work is to find the most promising approach for the purpose of MRI-guided derivation of PET attenuation maps in whole-body PET/MRI. To this end, a variety of a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.11.003

    authors: Arabi H,Zaidi H

    更新日期:2017-02-01 00:00:00

  • Adaptive local window for level set segmentation of CT and MRI liver lesions.

    abstract::We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and the changes of th...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.002

    authors: Hoogi A,Beaulieu CF,Cunha GM,Heba E,Sirlin CB,Napel S,Rubin DL

    更新日期:2017-04-01 00:00:00

  • Attentive neural cell instance segmentation.

    abstract::Neural cell instance segmentation, which aims at joint detection and segmentation of every neural cell in a microscopic image, is essential to many neuroscience applications. The challenge of this task involves cell adhesion, cell distortion, unclear cell contours, low-contrast cell protrusion structures, and backgrou...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.05.004

    authors: Yi J,Wu P,Jiang M,Huang Q,Hoeppner DJ,Metaxas DN

    更新日期:2019-07-01 00:00:00

  • A novel cortical thickness estimation method based on volumetric Laplace-Beltrami operator and heat kernel.

    abstract::Cortical thickness estimation in magnetic resonance imaging (MRI) is an important technique for research on brain development and neurodegenerative diseases. This paper presents a heat kernel based cortical thickness estimation algorithm, which is driven by the graph spectrum and the heat kernel theory, to capture the...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.01.005

    authors: Wang G,Zhang X,Su Q,Shi J,Caselli RJ,Wang Y,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2015-05-01 00:00:00

  • Characterization of task-free and task-performance brain states via functional connectome patterns.

    abstract::Both resting state fMRI (R-fMRI) and task-based fMRI (T-fMRI) have been widely used to study the functional activities of the human brain during task-free and task-performance periods, respectively. However, due to the difficulty in strictly controlling the participating subject's mental status and their cognitive beh...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.07.003

    authors: Zhang X,Guo L,Li X,Zhang T,Zhu D,Li K,Chen H,Lv J,Jin C,Zhao Q,Li L,Liu T

    更新日期:2013-12-01 00:00:00

  • 4D hyperspherical harmonic (HyperSPHARM) representation of surface anatomy: a holistic treatment of multiple disconnected anatomical structures.

    abstract::Image-based parcellation of the brain often leads to multiple disconnected anatomical structures, which pose significant challenges for analyses of morphological shapes. Existing shape models, such as the widely used spherical harmonic (SPHARM) representation, assume topological invariance, so are unable to simultaneo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.02.004

    authors: Pasha Hosseinbor A,Chung MK,Koay CG,Schaefer SM,van Reekum CM,Schmitz LP,Sutterer M,Alexander AL,Davidson RJ

    更新日期:2015-05-01 00:00:00

  • IDRiD: Diabetic Retinopathy - Segmentation and Grading Challenge.

    abstract::Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is chal...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101561

    authors: Porwal P,Pachade S,Kokare M,Deshmukh G,Son J,Bae W,Liu L,Wang J,Liu X,Gao L,Wu T,Xiao J,Wang F,Yin B,Wang Y,Danala G,He L,Choi YH,Lee YC,Jung SH,Li Z,Sui X,Wu J,Li X,Zhou T,Toth J,Baran A,Kori A,Ch

    更新日期:2020-01-01 00:00:00

  • Hierarchical spherical deformation for cortical surface registration.

    abstract::We present hierarchical spherical deformation for a group-wise shape correspondence to address template selection bias and to minimize registration distortion. In this work, we aim at a continuous and smooth deformation field to guide accurate cortical surface registration. In conventional spherical registration metho...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.013

    authors: Lyu I,Kang H,Woodward ND,Styner MA,Landman BA

    更新日期:2019-10-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Nonlinear multiscale regularisation in MR elastography: Towards fine feature mapping.

    abstract::Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.05.012

    authors: Barnhill E,Hollis L,Sack I,Braun J,Hoskins PR,Pankaj P,Brown C,van Beek EJR,Roberts N

    更新日期:2017-01-01 00:00:00

  • Multiple instance learning for classification of dementia in brain MRI.

    abstract::Machine learning techniques have been widely used to detect morphological abnormalities from structural brain magnetic resonance imaging data and to support the diagnosis of neurological diseases such as dementia. In this paper, we propose to use a multiple instance learning (MIL) method in an application for the dete...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.04.006

    authors: Tong T,Wolz R,Gao Q,Guerrero R,Hajnal JV,Rueckert D,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2014-07-01 00:00:00

  • Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection.

    abstract::Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101724

    authors: Ayhan MS,Kühlewein L,Aliyeva G,Inhoffen W,Ziemssen F,Berens P

    更新日期:2020-08-01 00:00:00

  • A gradient-based optical-flow cardiac motion estimation method for cine and tagged MR images.

    abstract::A new method is proposed to quantify the myocardial motion from both 2D C(ine)-MRI and T(agged)-MRI sequences. The tag pattern offers natural landmarks within the image that makes it possible to accurately quantify the motion within the myocardial wall. Therefore, several methods have been proposed for T-MRI. However,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.016

    authors: Wang L,Clarysse P,Liu Z,Gao B,Liu W,Croisille P,Delachartre P

    更新日期:2019-10-01 00:00:00

  • Reducing annotation effort in digital pathology: A Co-Representation learning framework for classification tasks.

    abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101859

    authors: Pati P,Foncubierta-Rodríguez A,Goksel O,Gabrani M

    更新日期:2021-01-01 00:00:00

  • Luminosity and contrast normalization in retinal images.

    abstract::Retinal images are routinely acquired and assessed to provide diagnostic evidence for many important diseases, e.g. diabetes or hypertension. Because of the acquisition process, very often these images are non-uniformly illuminated and exhibit local luminosity and contrast variability. This problem may seriously affec...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.07.001

    authors: Foracchia M,Grisan E,Ruggeri A

    更新日期:2005-06-01 00:00:00

  • Segmentation of carpal bones from CT images using skeletally coupled deformable models.

    abstract::The in vivo investigation of joint kinematics in normal and injured wrist requires the segmentation of carpal bones from 3D (CT) images, and their registration over time. The non-uniformity of bone tissue, ranging from dense cortical bone to textured spongy bone, the irregular shape of closely packed carpal bones, sma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00065-8

    authors: Sebastian TB,Tek H,Crisco JJ,Kimia BB

    更新日期:2003-03-01 00:00:00

  • A variational framework for integrating segmentation and registration through active contours.

    abstract::Traditionally, segmentation and registration have been solved as two independent problems, even though it is often the case that the solution to one impacts the solution to the other. In this paper, we introduce a geometric, variational framework that uses active contours to simultaneously segment and register feature...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00004-5

    authors: Yezzi A,Zöllei L,Kapur T

    更新日期:2003-06-01 00:00:00