Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection.

Abstract:

:Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decisions. However, deep neural networks (DNNs) are being often overconfident in their predictions, and are not amenable to a straightforward probabilistic treatment. Here, we describe an intuitive framework based on test-time data augmentation for quantifying the diagnostic uncertainty of a state-of-the-art DNN for diagnosing diabetic retinopathy. We show that the derived measure of uncertainty is well-calibrated and that experienced physicians likewise find cases with uncertain diagnosis difficult to evaluate. This paves the way for an integrated treatment of uncertainty in DNN-based diagnostic systems.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Ayhan MS,Kühlewein L,Aliyeva G,Inhoffen W,Ziemssen F,Berens P

doi

10.1016/j.media.2020.101724

subject

Has Abstract

pub_date

2020-08-01 00:00:00

pages

101724

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30088-8

journal_volume

64

pub_type

杂志文章
  • Computer aided diagnosis of thyroid nodules based on the devised small-datasets multi-view ensemble learning.

    abstract::With the development of deep learning, its application in diagnosis of benign and malignant thyroid nodules has been widely concerned. However, it is difficult to obtain medical images, resulting in insufficient number of data, which contradicts the large amount of data required for acquiring effective deep learning d...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101819

    authors: Chen Y,Li D,Zhang X,Jin J,Shen Y

    更新日期:2021-01-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • Deformable organisms for automatic medical image analysis.

    abstract::We introduce a new approach to medical image analysis that combines deformable model methodologies with concepts from the field of artificial life. In particular, we propose "deformable organisms", autonomous agents whose task is the automatic segmentation, labeling, and quantitative analysis of anatomical structures ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00083-x

    authors: McInerney T,Hamarneh G,Shenton M,Terzopoulos D

    更新日期:2002-09-01 00:00:00

  • An improved deep network for tissue microstructure estimation with uncertainty quantification.

    abstract::Deep learning based methods have improved the estimation of tissue microstructure from diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients. These methods learn the mapping from diffusion signals in a voxel or patch to tissue microstructure measures. In particular, it...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101650

    authors: Ye C,Li Y,Zeng X

    更新日期:2020-04-01 00:00:00

  • Multimodal image registration using floating regressors in the joint intensity scatter plot.

    abstract::This paper presents a new approach for multimodal medical image registration and compares it to normalized mutual information (NMI) and the correlation ratio (CR). Like NMI and CR, the new method's measure of registration quality is based on the distribution of points in the joint intensity scatter plot (JISP); compac...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2007.12.002

    authors: Orchard J

    更新日期:2008-08-01 00:00:00

  • Ultrasound-fluoroscopy registration for prostate brachytherapy dosimetry.

    abstract::Prostate brachytherapy is a treatment for prostate cancer using radioactive seeds that are permanently implanted in the prostate. The treatment success depends on adequate coverage of the target gland with a therapeutic dose, while sparing the surrounding tissue. Since seed implantation is performed under transrectal ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.001

    authors: Dehghan E,Lee J,Fallavollita P,Kuo N,Deguet A,Le Y,Clif Burdette E,Song DY,Prince JL,Fichtinger G

    更新日期:2012-10-01 00:00:00

  • Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm.

    abstract::In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori inform...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.005

    authors: Lorenzo-Valdés M,Sanchez-Ortiz GI,Elkington AG,Mohiaddin RH,Rueckert D

    更新日期:2004-09-01 00:00:00

  • Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis.

    abstract::In prostate cancer radiotherapy, computed tomography (CT) is widely used for dose planning purposes. However, because CT has low soft tissue contrast, it makes manual contouring difficult for major pelvic organs. In contrast, magnetic resonance imaging (MRI) provides high soft tissue contrast, which makes it ideal for...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.05.004

    authors: Cao X,Yang J,Gao Y,Guo Y,Wu G,Shen D

    更新日期:2017-10-01 00:00:00

  • Regularized siamese neural network for unsupervised outlier detection on brain multiparametric magnetic resonance imaging: Application to epilepsy lesion screening.

    abstract::In this study, we propose a novel anomaly detection model targeting subtle brain lesions in multiparametric MRI. To compensate for the lack of annotated data adequately sampling the heterogeneity of such pathologies, we cast this problem as an outlier detection problem and introduce a novel configuration of unsupervis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101618

    authors: Alaverdyan Z,Jung J,Bouet R,Lartizien C

    更新日期:2020-02-01 00:00:00

  • Characterization of task-free and task-performance brain states via functional connectome patterns.

    abstract::Both resting state fMRI (R-fMRI) and task-based fMRI (T-fMRI) have been widely used to study the functional activities of the human brain during task-free and task-performance periods, respectively. However, due to the difficulty in strictly controlling the participating subject's mental status and their cognitive beh...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.07.003

    authors: Zhang X,Guo L,Li X,Zhang T,Zhu D,Li K,Chen H,Lv J,Jin C,Zhao Q,Li L,Liu T

    更新日期:2013-12-01 00:00:00

  • Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model.

    abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.001

    authors: Lee S,Reinhardt JM,Cattin PC,Abràmoff MD

    更新日期:2010-08-01 00:00:00

  • Computerized detection of pulmonary nodules in chest radiographs based on morphological features and wavelet snake model.

    abstract::We have developed a new computer-aided diagnosis scheme for automated detection of lung nodules in digital chest radiographs based on a combination of morphological features and the wavelet snake. In our scheme, two processes were applied in parallel to reduce the false-positive detections after initial nodule candida...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00064-6

    authors: Keserci B,Yoshida H

    更新日期:2002-12-01 00:00:00

  • Robust estimation of carotid artery wall motion using the elasticity-based state-space approach.

    abstract::The dynamics of the carotid artery wall has been recognized as a valuable indicator to evaluate the status of atherosclerotic disease in the preclinical stage. However, it is still a challenge to accurately measure this dynamics from ultrasound images. This paper aims at developing an elasticity-based state-space appr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.004

    authors: Gao Z,Xiong H,Liu X,Zhang H,Ghista D,Wu W,Li S

    更新日期:2017-04-01 00:00:00

  • Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM.

    abstract::In order to improve the accuracy of image-guided neurosurgery, different biomechanical models have been developed to correct preoperative images with respect to intraoperative changes like brain shift or tumor resection. All existing biomechanical models simulate different anatomical structures by using either appropr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00059-2

    authors: Hagemann A,Rohr K,Stiehl HS

    更新日期:2002-12-01 00:00:00

  • Dynamically constructed network with error correction for accurate ventricle volume estimation.

    abstract::Automated ventricle volume estimation (AVVE) on cardiac magnetic resonance (CMR) images is very important for clinical cardiac disease diagnosis. However, current AVVE methods ignore the error correction for the estimated volume. This results in clinically intolerable ventricle volume estimation error and further lead...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101723

    authors: Luo G,Wang W,Tam C,Wang K,Cao S,Zhang H,Chen B,Li S

    更新日期:2020-08-01 00:00:00

  • Identifying Cross-individual Correspondences of 3-hinge Gyri.

    abstract::Human brain alignment based on imaging data has long been an intriguing research topic. One of the challenges is the huge inter-individual variabilities, which are pronounced not only in cortical folding patterns, but also in the underlying structural and functional patterns. Also, it is still not fully understood how...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101700

    authors: Zhang T,Huang Y,Zhao L,He Z,Jiang X,Guo L,Hu X,Liu T

    更新日期:2020-07-01 00:00:00

  • Incomplete multi-modal representation learning for Alzheimer's disease diagnosis.

    abstract::Alzheimers disease (AD) is a complex neurodegenerative disease. Its early diagnosis and treatment have been a major concern of researchers. Currently, the multi-modality data representation learning of this disease is gradually becoming an emerging research field, attracting widespread attention. However, in practice,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101953

    authors: Liu Y,Fan L,Zhang C,Zhou T,Xiao Z,Geng L,Shen D

    更新日期:2021-01-01 00:00:00

  • Discriminative dictionary learning for abdominal multi-organ segmentation.

    abstract::An automated segmentation method is presented for multi-organ segmentation in abdominal CT images. Dictionary learning and sparse coding techniques are used in the proposed method to generate target specific priors for segmentation. The method simultaneously learns dictionaries which have reconstructive power and clas...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.04.015

    authors: Tong T,Wolz R,Wang Z,Gao Q,Misawa K,Fujiwara M,Mori K,Hajnal JV,Rueckert D

    更新日期:2015-07-01 00:00:00

  • Adaptive, template moderated, spatially varying statistical classification.

    abstract::A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00003-7

    authors: Warfield SK,Kaus M,Jolesz FA,Kikinis R

    更新日期:2000-03-01 00:00:00

  • Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images.

    abstract::We describe a new 3-D statistical shape model of the heart consisting of atria, ventricles and epicardium. The model was constructed by combining information on standard short- and long-axis cardiac MR images. In the model, the variability of the shape was modeled with PCA- and ICA-based shape models as well as with n...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2004.06.013

    authors: Lötjönen J,Kivistö S,Koikkalainen J,Smutek D,Lauerma K

    更新日期:2004-09-01 00:00:00

  • Automated model-based vertebra detection, identification, and segmentation in CT images.

    abstract::For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.02.004

    authors: Klinder T,Ostermann J,Ehm M,Franz A,Kneser R,Lorenz C

    更新日期:2009-06-01 00:00:00

  • Statistical shape models for 3D medical image segmentation: a review.

    abstract::Statistical shape models (SSMs) have by now been firmly established as a robust tool for segmentation of medical images. While 2D models have been in use since the early 1990 s, wide-spread utilization of three-dimensional models appeared only in recent years, primarily made possible by breakthroughs in automatic dete...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2009.05.004

    authors: Heimann T,Meinzer HP

    更新日期:2009-08-01 00:00:00

  • Capturing intraoperative deformations: research experience at Brigham and Women's Hospital.

    abstract::During neurosurgical procedures the objective of the neurosurgeon is to achieve the resection of as much diseased tissue as possible while achieving the preservation of healthy brain tissue. The restricted capacity of the conventional operating room to enable the surgeon to visualize critical healthy brain structures ...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2004.11.005

    authors: Warfield SK,Haker SJ,Talos IF,Kemper CA,Weisenfeld N,Mewes AU,Goldberg-Zimring D,Zou KH,Westin CF,Wells WM,Tempany CM,Golby A,Black PM,Jolesz FA,Kikinis R

    更新日期:2005-04-01 00:00:00

  • Computer technology in detection and staging of prostate carcinoma: a review.

    abstract::After two decades of increasing interest and research activity, computer-assisted diagnostic approaches are reaching the stage where more routine deployment in clinical practice is becoming a possibility [Kruppinski, E.A., 2004. Computer-aided detection in clinical environment: Benefits and challenges for radiologists...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2005.06.003

    authors: Zhu Y,Williams S,Zwiggelaar R

    更新日期:2006-04-01 00:00:00

  • Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow.

    abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.001

    authors: Zheng Q,Delingette H,Ayache N

    更新日期:2019-08-01 00:00:00

  • Sensorless freehand 3D ultrasound in real tissue: speckle decorrelation without fully developed speckle.

    abstract::It has previously been demonstrated that freehand 3D ultrasound can be acquired without a position sensor by measuring the elevational speckle decorrelation from frame to frame. However, this requires that the B-scans contain significant amounts of fully developed speckle. In this paper, we show that this condition is...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.08.001

    authors: Gee AH,James Housden R,Hassenpflug P,Treece GM,Prager RW

    更新日期:2006-04-01 00:00:00

  • Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

    abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101861

    authors: Zhang D,Chen B,Li S

    更新日期:2021-01-01 00:00:00

  • Multiple instance learning for classification of dementia in brain MRI.

    abstract::Machine learning techniques have been widely used to detect morphological abnormalities from structural brain magnetic resonance imaging data and to support the diagnosis of neurological diseases such as dementia. In this paper, we propose to use a multiple instance learning (MIL) method in an application for the dete...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.04.006

    authors: Tong T,Wolz R,Gao Q,Guerrero R,Hajnal JV,Rueckert D,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2014-07-01 00:00:00

  • Predicting the progression of mild cognitive impairment using machine learning: A systematic, quantitative and critical review.

    abstract::We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101848

    authors: Ansart M,Epelbaum S,Bassignana G,Bône A,Bottani S,Cattai T,Couronné R,Faouzi J,Koval I,Louis M,Thibeau-Sutre E,Wen J,Wild A,Burgos N,Dormont D,Colliot O,Durrleman S

    更新日期:2021-01-01 00:00:00

  • Groupwise registration with global-local graph shrinkage in atlas construction.

    abstract::Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101711

    authors: Fu T,Yang J,Li Q,Ai D,Song H,Jiang Y,Wang Y,Frangi AF

    更新日期:2020-08-01 00:00:00