Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection.

Abstract:

:Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decisions. However, deep neural networks (DNNs) are being often overconfident in their predictions, and are not amenable to a straightforward probabilistic treatment. Here, we describe an intuitive framework based on test-time data augmentation for quantifying the diagnostic uncertainty of a state-of-the-art DNN for diagnosing diabetic retinopathy. We show that the derived measure of uncertainty is well-calibrated and that experienced physicians likewise find cases with uncertain diagnosis difficult to evaluate. This paves the way for an integrated treatment of uncertainty in DNN-based diagnostic systems.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Ayhan MS,Kühlewein L,Aliyeva G,Inhoffen W,Ziemssen F,Berens P

doi

10.1016/j.media.2020.101724

subject

Has Abstract

pub_date

2020-08-01 00:00:00

pages

101724

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30088-8

journal_volume

64

pub_type

杂志文章
  • Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black-blood MRI with a registration based geodesic active contour model.

    abstract::Segmentation of the geometric morphology of abdominal aortic aneurysm is important for interventional planning. However, the segmentation of both the lumen and the outer wall of aneurysm in magnetic resonance (MR) image remains challenging. This study proposes a registration based segmentation methodology for efficien...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.05.005

    authors: Wang Y,Seguro F,Kao E,Zhang Y,Faraji F,Zhu C,Haraldsson H,Hope M,Saloner D,Liu J

    更新日期:2017-08-01 00:00:00

  • Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model.

    abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.001

    authors: Lee S,Reinhardt JM,Cattin PC,Abràmoff MD

    更新日期:2010-08-01 00:00:00

  • Towards intelligent robust detection of anatomical structures in incomplete volumetric data.

    abstract::Robust and fast detection of anatomical structures represents an important component of medical image analysis technologies. Current solutions for anatomy detection are based on machine learning, and are generally driven by suboptimal and exhaustive search strategies. In particular, these techniques do not effectively...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.06.007

    authors: Ghesu FC,Georgescu B,Grbic S,Maier A,Hornegger J,Comaniciu D

    更新日期:2018-08-01 00:00:00

  • Noise reduction in diffusion MRI using non-local self-similar information in joint x-q space.

    abstract::Diffusion MRI affords valuable insights into white matter microstructures, but suffers from low signal-to-noise ratio (SNR), especially at high diffusion weighting (i.e., b-value). To avoid time-intensive repeated acquisition, post-processing algorithms are often used to reduce noise. Among existing methods, non-local...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.006

    authors: Chen G,Wu Y,Shen D,Yap PT

    更新日期:2019-04-01 00:00:00

  • Confhusius: a robust and fully automatic calibration method for 3D freehand ultrasound.

    abstract::This paper describes a new robust and fully automatic method for calibration of three-dimensional (3D) freehand ultrasound called Confhusius (CalibratiON for FreeHand UltraSound Imaging USage). 3D Freehand ultrasound consists in mounting a position sensor on a standard probe. The echographic B-scans can be localized i...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.021

    authors: Rousseau F,Hellier P,Barillot C

    更新日期:2005-02-01 00:00:00

  • Gaussianization of Diffusion MRI Data Using Spatially Adaptive Filtering.

    abstract::Diffusion MRI magnitude data, typically Rician or noncentral χ distributed, is affected by the noise floor, which falsely elevates signal, reduces image contrast, and biases estimation of diffusion parameters. Noise floor can be avoided by extracting real-valued Gaussian-distributed data from complex diffusion-weighte...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101828

    authors: Liu F,Feng J,Chen G,Shen D,Yap PT

    更新日期:2021-02-01 00:00:00

  • SNR enhancement of highly-accelerated real-time cardiac MRI acquisitions based on non-local means algorithm.

    abstract::Real-time cardiac MRI appears as a promising technique to evaluate the mechanical function of the heart. However, ultra-fast MRI acquisitions come with an important signal-to-noise ratio (SNR) penalty, which drastically reduces the image quality. Hence, a real-time denoising approach would be desirable for SNR amelior...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.05.006

    authors: Naegel B,Cernicanu A,Hyacinthe JN,Tognolini M,Vallée JP

    更新日期:2009-08-01 00:00:00

  • A procedure to average 3D anatomical structures.

    abstract::Creating a feature-preserving average of three dimensional anatomical surfaces extracted from volume image data is a complex task. Unlike individual images, averages present right-left symmetry and smooth surfaces which give insight into typical proportions. Averaging multiple biological surface images requires carefu...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00031-1

    authors: Subramanya K,Dean D

    更新日期:2000-12-01 00:00:00

  • Automated annotation and quantitative description of ultrasound videos of the fetal heart.

    abstract::Interpretation of ultrasound videos of the fetal heart is crucial for the antenatal diagnosis of congenital heart disease (CHD). We believe that automated image analysis techniques could make an important contribution towards improving CHD detection rates. However, to our knowledge, no previous work has been done in t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.11.006

    authors: Bridge CP,Ioannou C,Noble JA

    更新日期:2017-02-01 00:00:00

  • Directional wavelet based features for colonic polyp classification.

    abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.02.001

    authors: Wimmer G,Tamaki T,Tischendorf JJ,Häfner M,Yoshida S,Tanaka S,Uhl A

    更新日期:2016-07-01 00:00:00

  • An accurate, fast and robust method to generate patient-specific cubic Hermite meshes.

    abstract::In-silico continuum simulations of organ and tissue scale physiology often require a discretisation or mesh of the solution domain. Cubic Hermite meshes provide a smooth representation of anatomy that is well-suited for simulating large deformation mechanics. Models of organ mechanics and deformation have demonstrated...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.06.010

    authors: Lamata P,Niederer S,Nordsletten D,Barber DC,Roy I,Hose DR,Smith N

    更新日期:2011-12-01 00:00:00

  • High resolution cortical bone thickness measurement from clinical CT data.

    abstract::The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.003

    authors: Treece GM,Gee AH,Mayhew PM,Poole KE

    更新日期:2010-06-01 00:00:00

  • Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow.

    abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.001

    authors: Zheng Q,Delingette H,Ayache N

    更新日期:2019-08-01 00:00:00

  • An improved deep network for tissue microstructure estimation with uncertainty quantification.

    abstract::Deep learning based methods have improved the estimation of tissue microstructure from diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients. These methods learn the mapping from diffusion signals in a voxel or patch to tissue microstructure measures. In particular, it...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101650

    authors: Ye C,Li Y,Zeng X

    更新日期:2020-04-01 00:00:00

  • Simulation of cardiac pathologies using an electromechanical biventricular model and XMR interventional imaging.

    abstract::Simulating cardiac electromechanical activity is of great interest for a better understanding of pathologies and for therapy planning. Design and validation of such models is difficult due to the lack of clinical data. XMR systems are a new type of interventional facility in which patients can be rapidly transferred b...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.05.003

    authors: Sermesant M,Rhode K,Sanchez-Ortiz GI,Camara O,Andriantsimiavona R,Hegde S,Rueckert D,Lambiase P,Bucknall C,Rosenthal E,Delingette H,Hill DL,Ayache N,Razavi R

    更新日期:2005-10-01 00:00:00

  • Large deformation diffeomorphic registration of diffusion-weighted imaging data.

    abstract::Registration plays an important role in group analysis of diffusion-weighted imaging (DWI) data. It can be used to build a reference anatomy for investigating structural variation or tracking changes in white matter. Unlike traditional scalar image registration where spatial alignment is the only focus, registration o...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.06.012

    authors: Zhang P,Niethammer M,Shen D,Yap PT

    更新日期:2014-12-01 00:00:00

  • Nonlinear multiscale regularisation in MR elastography: Towards fine feature mapping.

    abstract::Fine-featured elastograms may provide additional information of radiological interest in the context of in vivo elastography. Here a new image processing pipeline called ESP (Elastography Software Pipeline) is developed to create Magnetic Resonance Elastography (MRE) maps of viscoelastic parameters (complex modulus ma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.05.012

    authors: Barnhill E,Hollis L,Sack I,Braun J,Hoskins PR,Pankaj P,Brown C,van Beek EJR,Roberts N

    更新日期:2017-01-01 00:00:00

  • Analytical and fast Fiber Orientation Distribution reconstruction in 3D-Polarized Light Imaging.

    abstract::Three dimensional Polarized Light Imaging (3D-PLI) is an optical technique which allows mapping the spatial fiber architecture of fibrous postmortem tissues, at sub-millimeter resolutions. Here, we propose an analytical and fast approach to compute the fiber orientation distribution (FOD) from high-resolution vector d...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101760

    authors: Alimi A,Deslauriers-Gauthier S,Matuschke F,Müller A,Muenzing SEA,Axer M,Deriche R

    更新日期:2020-10-01 00:00:00

  • CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation.

    abstract::Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) introduced new state-of-the-art segmentation systems. Despite outperforming the overall accuracy of existing systems, the effects of DL model proper...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101950

    authors: Kavur AE,Gezer NS,Barış M,Aslan S,Conze PH,Groza V,Pham DD,Chatterjee S,Ernst P,Özkan S,Baydar B,Lachinov D,Han S,Pauli J,Isensee F,Perkonigg M,Sathish R,Rajan R,Sheet D,Dovletov G,Speck O,Nürnberger A,Maier-H

    更新日期:2020-12-25 00:00:00

  • A comparison of freehand three-dimensional ultrasound reconstruction techniques.

    abstract::Three-dimensional freehand ultrasound imaging produces a set of irregularly spaced B-scans, which are typically reconstructed on a regular grid for visualization and data analysis. Most standard reconstruction algorithms are designed to minimize computational requirements and do not exploit the underlying shape of the...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(99)80028-0

    authors: Rohling R,Gee A,Berman L

    更新日期:1999-12-01 00:00:00

  • Generalised coherent point drift for group-wise multi-dimensional analysis of diffusion brain MRI data.

    abstract::A probabilistic framework for registering generalised point sets comprising multiple voxel-wise data features such as positions, orientations and scalar-valued quantities, is proposed. It is employed for the analysis of magnetic resonance diffusion tensor image (DTI)-derived quantities, such as fractional anisotropy (...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.01.001

    authors: Ravikumar N,Gooya A,Beltrachini L,Frangi AF,Taylor ZA

    更新日期:2019-04-01 00:00:00

  • Global localization of 3D anatomical structures by pre-filtered Hough forests and discrete optimization.

    abstract::The accurate localization of anatomical landmarks is a challenging task, often solved by domain specific approaches. We propose a method for the automatic localization of landmarks in complex, repetitive anatomical structures. The key idea is to combine three steps: (1) a classifier for pre-filtering anatomical landma...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.02.004

    authors: Donner R,Menze BH,Bischof H,Langs G

    更新日期:2013-12-01 00:00:00

  • Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis.

    abstract::In prostate cancer radiotherapy, computed tomography (CT) is widely used for dose planning purposes. However, because CT has low soft tissue contrast, it makes manual contouring difficult for major pelvic organs. In contrast, magnetic resonance imaging (MRI) provides high soft tissue contrast, which makes it ideal for...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.05.004

    authors: Cao X,Yang J,Gao Y,Guo Y,Wu G,Shen D

    更新日期:2017-10-01 00:00:00

  • Ω-Net (Omega-Net): Fully automatic, multi-view cardiac MR detection, orientation, and segmentation with deep neural networks.

    abstract::Pixelwise segmentation of the left ventricular (LV) myocardium and the four cardiac chambers in 2-D steady state free precession (SSFP) cine sequences is an essential preprocessing step for a wide range of analyses. Variability in contrast, appearance, orientation, and placement of the heart between patients, clinical...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.05.008

    authors: Vigneault DM,Xie W,Ho CY,Bluemke DA,Noble JA

    更新日期:2018-08-01 00:00:00

  • Tongue contour tracking in dynamic ultrasound via higher-order MRFs and efficient fusion moves.

    abstract::Analyses of the human tongue motion as captured from 2D dynamic ultrasound data often requires segmentation of the mid-sagittal tongue contours. However, semi-automatic extraction of the tongue shape presents practical challenges. We approach this segmentation problem by proposing a novel higher-order Markov random fi...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.07.001

    authors: Tang L,Bressmann T,Hamarneh G

    更新日期:2012-12-01 00:00:00

  • Ultrasound-fluoroscopy registration for prostate brachytherapy dosimetry.

    abstract::Prostate brachytherapy is a treatment for prostate cancer using radioactive seeds that are permanently implanted in the prostate. The treatment success depends on adequate coverage of the target gland with a therapeutic dose, while sparing the surrounding tissue. Since seed implantation is performed under transrectal ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.001

    authors: Dehghan E,Lee J,Fallavollita P,Kuo N,Deguet A,Le Y,Clif Burdette E,Song DY,Prince JL,Fichtinger G

    更新日期:2012-10-01 00:00:00

  • Deformable organisms for automatic medical image analysis.

    abstract::We introduce a new approach to medical image analysis that combines deformable model methodologies with concepts from the field of artificial life. In particular, we propose "deformable organisms", autonomous agents whose task is the automatic segmentation, labeling, and quantitative analysis of anatomical structures ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00083-x

    authors: McInerney T,Hamarneh G,Shenton M,Terzopoulos D

    更新日期:2002-09-01 00:00:00

  • Incomplete multi-modal representation learning for Alzheimer's disease diagnosis.

    abstract::Alzheimers disease (AD) is a complex neurodegenerative disease. Its early diagnosis and treatment have been a major concern of researchers. Currently, the multi-modality data representation learning of this disease is gradually becoming an emerging research field, attracting widespread attention. However, in practice,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101953

    authors: Liu Y,Fan L,Zhang C,Zhou T,Xiao Z,Geng L,Shen D

    更新日期:2021-01-01 00:00:00

  • Image guidance in orthopaedics and traumatology: A historical perspective.

    abstract::In this note we summarize the history of computer aided surgery in orthopaedics and traumatology from the end of the nineteenth century to currently observable future trends. We concentrate on the two major components of such systems, pre-operative planning and intra-operative execution. The evolution of the necessary...

    journal_title:Medical image analysis

    pub_type: 社论

    doi:10.1016/j.media.2016.06.033

    authors: Székely G,Nolte LP

    更新日期:2016-10-01 00:00:00

  • Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization.

    abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.07.007

    authors: Genet M,Stoeck CT,von Deuster C,Lee LC,Kozerke S

    更新日期:2018-12-01 00:00:00