A review of machine learning methods for retinal blood vessel segmentation and artery/vein classification.

Abstract:

:The eye affords a unique opportunity to inspect a rich part of the human microvasculature non-invasively via retinal imaging. Retinal blood vessel segmentation and classification are prime steps for the diagnosis and risk assessment of microvascular and systemic diseases. A high volume of techniques based on deep learning have been published in recent years. In this context, we review 158 papers published between 2012 and 2020, focussing on methods based on machine and deep learning (DL) for automatic vessel segmentation and classification for fundus camera images. We divide the methods into various classes by task (segmentation or artery-vein classification), technique (supervised or unsupervised, deep and non-deep learning, hand-crafted methods) and more specific algorithms (e.g. multiscale, morphology). We discuss advantages and limitations, and include tables summarising results at-a-glance. Finally, we attempt to assess the quantitative merit of DL methods in terms of accuracy improvement compared to other methods. The results allow us to offer our views on the outlook for vessel segmentation and classification for fundus camera images.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Mookiah MRK,Hogg S,MacGillivray TJ,Prathiba V,Pradeepa R,Mohan V,Anjana RM,Doney AS,Palmer CNA,Trucco E

doi

10.1016/j.media.2020.101905

subject

Has Abstract

pub_date

2021-02-01 00:00:00

pages

101905

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30269-3

journal_volume

68

pub_type

杂志文章,评审
  • Adaptive, template moderated, spatially varying statistical classification.

    abstract::A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00003-7

    authors: Warfield SK,Kaus M,Jolesz FA,Kikinis R

    更新日期:2000-03-01 00:00:00

  • Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation.

    abstract::Phase contrast, a noninvasive microscopy imaging technique, is widely used to capture time-lapse images to monitor the behavior of transparent cells without staining or altering them. Due to the optical principle, phase contrast microscopy images contain artifacts such as the halo and shade-off that hinder image segme...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.12.006

    authors: Yin Z,Kanade T,Chen M

    更新日期:2012-07-01 00:00:00

  • Nonlinear multiscale regularisation in MR elastography: Towards fine feature mapping.

    abstract::Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.05.012

    authors: Barnhill E,Hollis L,Sack I,Braun J,Hoskins PR,Pankaj P,Brown C,van Beek EJR,Roberts N

    更新日期:2017-01-01 00:00:00

  • Ω-Net (Omega-Net): Fully automatic, multi-view cardiac MR detection, orientation, and segmentation with deep neural networks.

    abstract::Pixelwise segmentation of the left ventricular (LV) myocardium and the four cardiac chambers in 2-D steady state free precession (SSFP) cine sequences is an essential preprocessing step for a wide range of analyses. Variability in contrast, appearance, orientation, and placement of the heart between patients, clinical...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.05.008

    authors: Vigneault DM,Xie W,Ho CY,Bluemke DA,Noble JA

    更新日期:2018-08-01 00:00:00

  • Directional wavelet based features for colonic polyp classification.

    abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.02.001

    authors: Wimmer G,Tamaki T,Tischendorf JJ,Häfner M,Yoshida S,Tanaka S,Uhl A

    更新日期:2016-07-01 00:00:00

  • Coupled parametric model for estimation of visual field tests based on OCT macular thickness maps, and vice versa, in glaucoma care.

    abstract::The current standard of care for glaucoma patients consists of functional assessment of vision via visual field (VF) testing, which is sensitive but subjective, time-consuming, and often unreliable. A new imaging technology, Fourier domain optical coherence tomography (OCT), is being introduced to assess the structura...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.05.012

    authors: Tsai A,Caprioli J,Shen LQ

    更新日期:2012-01-01 00:00:00

  • A subject-specific technique for respiratory motion correction in image-guided cardiac catheterisation procedures.

    abstract::We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small numb...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.01.003

    authors: King AP,Boubertakh R,Rhode KS,Ma YL,Chinchapatnam P,Gao G,Tangcharoen T,Ginks M,Cooklin M,Gill JS,Hawkes DJ,Razavi RS,Schaeffter T

    更新日期:2009-06-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • Multi-modal volume registration by maximization of mutual information.

    abstract::A new information-theoretic approach is presented for finding the registration of volumetric medical images of differing modalities. Registration is achieved by adjustment of the relative position and orientation until the mutual information between the images is maximized. In our derivation of the registration proced...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(01)80004-9

    authors: Wells WM 3rd,Viola P,Atsumi H,Nakajima S,Kikinis R

    更新日期:1996-03-01 00:00:00

  • Stochastic finite element framework for simultaneous estimation of cardiac kinematic functions and material parameters.

    abstract::A stochastic finite element framework is presented for the simultaneous estimation of the cardiac kinematic functions and material model parameters from periodic medical image sequences. While existing biomechanics studies of the myocardial material constitutive laws have assumed known tissue kinematic measurements, a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00066-5

    authors: Shi P,Liu H

    更新日期:2003-12-01 00:00:00

  • Gaussianization of Diffusion MRI Data Using Spatially Adaptive Filtering.

    abstract::Diffusion MRI magnitude data, typically Rician or noncentral χ distributed, is affected by the noise floor, which falsely elevates signal, reduces image contrast, and biases estimation of diffusion parameters. Noise floor can be avoided by extracting real-valued Gaussian-distributed data from complex diffusion-weighte...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101828

    authors: Liu F,Feng J,Chen G,Shen D,Yap PT

    更新日期:2021-02-01 00:00:00

  • CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation.

    abstract::Accurate segmentation of the prostate and organs at risk (e.g., bladder and rectum) in CT images is a crucial step for radiation therapy in the treatment of prostate cancer. However, it is a very challenging task due to unclear boundaries, large intra- and inter-patient shape variability, and uncertain existence of bo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.03.003

    authors: Wang S,He K,Nie D,Zhou S,Gao Y,Shen D

    更新日期:2019-05-01 00:00:00

  • Cardiac image modelling: Breadth and depth in heart disease.

    abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...

    journal_title:Medical image analysis

    pub_type: 社论,评审

    doi:10.1016/j.media.2016.06.027

    authors: Suinesiaputra A,McCulloch AD,Nash MP,Pontre B,Young AA

    更新日期:2016-10-01 00:00:00

  • SNR enhancement of highly-accelerated real-time cardiac MRI acquisitions based on non-local means algorithm.

    abstract::Real-time cardiac MRI appears as a promising technique to evaluate the mechanical function of the heart. However, ultra-fast MRI acquisitions come with an important signal-to-noise ratio (SNR) penalty, which drastically reduces the image quality. Hence, a real-time denoising approach would be desirable for SNR amelior...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.05.006

    authors: Naegel B,Cernicanu A,Hyacinthe JN,Tognolini M,Vallée JP

    更新日期:2009-08-01 00:00:00

  • Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

    abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101861

    authors: Zhang D,Chen B,Li S

    更新日期:2021-01-01 00:00:00

  • Automated model-based vertebra detection, identification, and segmentation in CT images.

    abstract::For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.02.004

    authors: Klinder T,Ostermann J,Ehm M,Franz A,Kneser R,Lorenz C

    更新日期:2009-06-01 00:00:00

  • Computer technology in detection and staging of prostate carcinoma: a review.

    abstract::After two decades of increasing interest and research activity, computer-assisted diagnostic approaches are reaching the stage where more routine deployment in clinical practice is becoming a possibility [Kruppinski, E.A., 2004. Computer-aided detection in clinical environment: Benefits and challenges for radiologists...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2005.06.003

    authors: Zhu Y,Williams S,Zwiggelaar R

    更新日期:2006-04-01 00:00:00

  • IDRiD: Diabetic Retinopathy - Segmentation and Grading Challenge.

    abstract::Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is chal...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101561

    authors: Porwal P,Pachade S,Kokare M,Deshmukh G,Son J,Bae W,Liu L,Wang J,Liu X,Gao L,Wu T,Xiao J,Wang F,Yin B,Wang Y,Danala G,He L,Choi YH,Lee YC,Jung SH,Li Z,Sui X,Wu J,Li X,Zhou T,Toth J,Baran A,Kori A,Ch

    更新日期:2020-01-01 00:00:00

  • Discriminative dictionary learning for abdominal multi-organ segmentation.

    abstract::An automated segmentation method is presented for multi-organ segmentation in abdominal CT images. Dictionary learning and sparse coding techniques are used in the proposed method to generate target specific priors for segmentation. The method simultaneously learns dictionaries which have reconstructive power and clas...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.04.015

    authors: Tong T,Wolz R,Wang Z,Gao Q,Misawa K,Fujiwara M,Mori K,Hajnal JV,Rueckert D

    更新日期:2015-07-01 00:00:00

  • Development and comparison of new hybrid motion tracking for bronchoscopic navigation.

    abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.001

    authors: Luó X,Feuerstein M,Deguchi D,Kitasaka T,Takabatake H,Mori K

    更新日期:2012-04-01 00:00:00

  • CATARACTS: Challenge on automatic tool annotation for cataRACT surgery.

    abstract::Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient sol...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.11.008

    authors: Al Hajj H,Lamard M,Conze PH,Roychowdhury S,Hu X,Maršalkaitė G,Zisimopoulos O,Dedmari MA,Zhao F,Prellberg J,Sahu M,Galdran A,Araújo T,Vo DM,Panda C,Dahiya N,Kondo S,Bian Z,Vahdat A,Bialopetravičius J,Flouty E,Qiu

    更新日期:2019-02-01 00:00:00

  • Automatic online layer separation for vessel enhancement in X-ray angiograms for percutaneous coronary interventions.

    abstract::Percutaneous coronary intervention is a minimally invasive procedure that is usually performed under image guidance using X-ray angiograms in which coronary arteries are opacified with contrast agent. In X-ray images, 3D objects are projected on a 2D plane, generating semi-transparent layers that overlap each other. T...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.04.011

    authors: Ma H,Hoogendoorn A,Regar E,Niessen WJ,van Walsum T

    更新日期:2017-07-01 00:00:00

  • Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge.

    abstract::A number of algorithms for brain segmentation in preterm born infants have been published, but a reliable comparison of their performance is lacking. The NeoBrainS12 study (http://neobrains12.isi.uu.nl), providing three different image sets of preterm born infants, was set up to provide such a comparison. These sets a...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.11.001

    authors: Išgum I,Benders MJ,Avants B,Cardoso MJ,Counsell SJ,Gomez EF,Gui L,Hűppi PS,Kersbergen KJ,Makropoulos A,Melbourne A,Moeskops P,Mol CP,Kuklisova-Murgasova M,Rueckert D,Schnabel JA,Srhoj-Egekher V,Wu J,Wang S,de Vries

    更新日期:2015-02-01 00:00:00

  • Automated comprehensive Adolescent Idiopathic Scoliosis assessment using MVC-Net.

    abstract::Automated quantitative estimation of spinal curvature is an important task for the ongoing evaluation and treatment planning of Adolescent Idiopathic Scoliosis (AIS). It solves the widely accepted disadvantage of manual Cobb angle measurement (time-consuming and unreliable) which is currently the gold standard for AIS...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.05.005

    authors: Wu H,Bailey C,Rasoulinejad P,Li S

    更新日期:2018-08-01 00:00:00

  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • An accurate, fast and robust method to generate patient-specific cubic Hermite meshes.

    abstract::In-silico continuum simulations of organ and tissue scale physiology often require a discretisation or mesh of the solution domain. Cubic Hermite meshes provide a smooth representation of anatomy that is well-suited for simulating large deformation mechanics. Models of organ mechanics and deformation have demonstrated...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.06.010

    authors: Lamata P,Niederer S,Nordsletten D,Barber DC,Roy I,Hose DR,Smith N

    更新日期:2011-12-01 00:00:00

  • Discriminant snakes for 3D reconstruction of anatomical organs.

    abstract::In this work a new statistic deformable model for 3D segmentation of anatomical organs in medical images is proposed. A statistic discriminant snake performs a supervised learning of the object boundary in an image slice to segment the next slice of the image sequence. Each part of the object boundary is projected in ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00014-8

    authors: Pardo XM,Radeva P,Cabello D

    更新日期:2003-09-01 00:00:00

  • Rubik's Cube+: A self-supervised feature learning framework for 3D medical image analysis.

    abstract::Due to the development of deep learning, an increasing number of research works have been proposed to establish automated analysis systems for 3D volumetric medical data to improve the quality of patient care. However, it is challenging to obtain a large number of annotated 3D medical data needed to train a neural net...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101746

    authors: Zhu J,Li Y,Hu Y,Ma K,Zhou SK,Zheng Y

    更新日期:2020-08-01 00:00:00

  • Involuntary eye motion correction in retinal optical coherence tomography: Hardware or software solution?

    abstract::In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional ha...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2017.02.002

    authors: Baghaie A,Yu Z,D'Souza RM

    更新日期:2017-04-01 00:00:00

  • Neighborhood resolved fiber orientation distributions (NRFOD) in automatic labeling of white matter fiber pathways.

    abstract::Accurate digital representation of major white matter bundles in the brain is an important goal in neuroscience image computing since the representations can be used for surgical planning, intra-patient longitudinal analysis and inter-subject population connectivity studies. Reconstructing desired fiber bundles genera...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.02.008

    authors: Ugurlu D,Firat Z,Türe U,Unal G

    更新日期:2018-05-01 00:00:00