How to Extract More Information With Less Burden: Fundus Image Classification and Retinal Disease Localization With Ophthalmologist Intervention.

Abstract:

:Image classification using convolutional neural networks (CNNs) outperforms other state-of-the-art methods. Moreover, attention can be visualized as a heatmap to improve the explainability of results of a CNN. We designed a framework that can generate heatmaps reflecting lesion regions precisely. We generated initial heatmaps by using a gradient-based classification activation map (Grad-CAM). We assume that these Grad-CAM heatmaps correctly reveal the lesion regions; then we apply the attention mining technique to these heatmaps to obtain integrated heatmaps. Moreover, we assume that these Grad-CAM heatmaps incorrectly reveal the lesion regions and design a dissimilarity loss to increase their discrepancy with the Grad-CAM heatmaps. In this study, we found that having professional ophthalmologists select 30% of the heatmaps covering the lesion regions led to better results, because this step integrates (prior) clinical knowledge into the system. Furthermore, we design a knowledge preservation loss that minimizes the discrepancy between heatmaps generated from the updated CNN model and the selected heatmaps. Experiments using fundus images revealed that our method improved classification accuracy and generated attention regions closer to the ground truth lesion regions in comparison with existing methods.

authors

Meng Q,Hashimoto Y,Satoh S

doi

10.1109/JBHI.2020.3011805

subject

Has Abstract

pub_date

2020-12-01 00:00:00

pages

3351-3361

issue

12

eissn

2168-2194

issn

2168-2208

journal_volume

24

pub_type

杂志文章
  • Attention-aware Residual Network based Manifold Learning for White Blood Cells Classification.

    abstract::The classification of six types of white blood cells (WBCs) is considered essential for leukemia diagnosis, while the classification is labor-intensive and strict with the clinical experience. To relieve the complicated process with an efficient and automatic method, we propose the Attention-aware Residual Network bas...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3012711

    authors: Huang P,Wang J,Zhang J,Shen Y,Liu C,Song W,Wu S,Zuo Y,Lu Z,Li D

    更新日期:2020-07-29 00:00:00

  • A Multidimensional Time-Series Similarity Measure With Applications to Eldercare Monitoring.

    abstract::In the last decade, data mining techniques have been applied to sensor data in a wide range of application domains, such as healthcare monitoring systems, manufacturing processes, intrusion detection, database management, and others. Many data mining techniques are based on computing the similarity between two sensor ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2424711

    authors: Hajihashemi Z,Popescu M

    更新日期:2016-05-01 00:00:00

  • Multi-Scale Time-Series Kernel-Based Learning Method for Brain Disease Diagnosis.

    abstract::The functional magnetic resonance imaging (fMRI) is a noninvasive technique for studying brain activity, such as brain network analysis, neural disease automated diagnosis and so on. However, many existing methods have some drawbacks, such as limitations of graph theory, lack of global topology characteristic, local s...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2983456

    authors: Zhang Z,Ding J,Xu J,Tang J,Guo F

    更新日期:2021-01-01 00:00:00

  • Wireless gigabit data telemetry for large-scale neural recording.

    abstract::Implantable wireless neural recording from a large ensemble of simultaneously acting neurons is a critical component to thoroughly investigate neural interactions and brain dynamics from freely moving animals. Recent researches have shown the feasibility of simultaneously recording from hundreds of neurons and suggest...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2416202

    authors: Kuan YC,Lo YK,Kim Y,Chang MC,Liu W

    更新日期:2015-05-01 00:00:00

  • Nonnegative matrix factorization for the identification of EMG finger movements: evaluation using matrix analysis.

    abstract::Surface electromyography (sEMG) is widely used in evaluating the functional status of the hand to assist in hand gesture recognition, prosthetics and rehabilitation applications. The sEMG is a noninvasive, easy to record signal of superficial muscles from the skin surface. Considering the nonstationary characteristics...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2326660

    authors: Naik GR,Nguyen HT

    更新日期:2015-03-01 00:00:00

  • Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis.

    abstract::In the analysis of histopathological images, both holistic (e.g., architecture features) and local appearance features demonstrate excellent performance, while their accuracy may vary dramatically when providing different inputs. This motivates us to investigate how to fuse results from these features to enhance the a...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2461671

    authors: Zhang X,Dou H,Ju T,Xu J,Zhang S

    更新日期:2016-09-01 00:00:00

  • Statistical Metamodeling and Sequential Design of Computer Experiments to Model Glyco-Altered Gating of Sodium Channels in Cardiac Myocytes.

    abstract::Glycan structures account for up to 35% of the mass of cardiac sodium ( Nav ) channels. To question whether and how reduced sialylation affects Nav activity and cardiac electrical signaling, we conducted a series of in vitro experiments on ventricular apex myocytes under two different glycosylation conditions, reduced...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2458791

    authors: Du D,Yang H,Ednie AR,Bennett ES

    更新日期:2016-09-01 00:00:00

  • A study on quality assessment for medical ultrasound video compressed via HEVC.

    abstract::The quality of experience and quality of service provided in the healthcare sector are critical in evaluating the reliable delivery of the healthcare services provided. Medical images and videos play a major role in modern e-health services and have become an integral part of medical data communication systems. The qu...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2326891

    authors: Razaak M,Martini MG,Savino K

    更新日期:2014-09-01 00:00:00

  • A survey on ambient-assisted living tools for older adults.

    abstract::In recent years, we have witnessed a rapid surge in assisted living technologies due to a rapidly aging society. The aging population, the increasing cost of formal health care, the caregiver burden, and the importance that the individuals place on living independently, all motivate development of innovative-assisted ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/jbhi.2012.2234129

    authors: Rashidi P,Mihailidis A

    更新日期:2013-05-01 00:00:00

  • Investigating the Correlation of Ktrans With Semi-Quantitative MRI Parameters Towards More Robust and Reproducible Perfusion Imaging Biomarkers in Three Cancer Types.

    abstract::MRI Imaging biomarkers (IBs) have the potential to deliver quantitative cancer descriptors of pathophysiology for non-invasively screening, diagnosing, and monitoring cancer patients across the cancer continuum. Despite a worldwide effort to standardize IBs involving major cancer organizations, significant variability...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2888979

    authors: Ioannidis GS,Maris TG,Nikiforaki K,Karantanas A,Marias K

    更新日期:2019-09-01 00:00:00

  • α-Satellite: An AI-Driven System and Benchmark Datasets for Dynamic COVID-19 Risk Assessment in the United States.

    abstract::The fast evolving and deadly outbreak of coronavirus disease (COVID-19) has posed grand challenges to human society. To slow the spread of virus infections and better respond for community mitigation, by advancing capabilities of artificial intelligence (AI) and leveraging the large-scale and up-to-date data generated...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3009314

    authors: Ye Y,Hou S,Fan Y,Zhang Y,Qian Y,Sun S,Peng Q,Ju M,Song W,Loparo K

    更新日期:2020-10-01 00:00:00

  • A chance-constrained programming approach to preoperative planning of robotic cardiac surgery under task-level uncertainty.

    abstract::In this paper, a novel formulation for robust surgical planning of robotics-assisted minimally invasive cardiac surgery based on patient-specific preoperative images is proposed. In this context, robustness is quantified in terms of the likelihood of intraoperative collisions and of joint limit violations. The propose...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2315798

    authors: Azimian H,Naish MD,Kiaii B,Patel RV

    更新日期:2015-03-01 00:00:00

  • cuProCell: GPU-Accelerated Analysis of Cell Proliferation With Flow Cytometry Data.

    abstract::The investigation of cell proliferation can provide useful insights for the comprehension of cancer progression, resistance to chemotherapy and relapse. To this aim, computational methods and experimental measurements based on in vivo label-retaining assays can be coupled to explore the dynamic behavior of tumoral cel...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3005423

    authors: Nobile MS,Nisoli E,Vlachou T,Spolaor S,Cazzaniga P,Mauri G,Pelicci PG,Besozzi D

    更新日期:2020-11-01 00:00:00

  • Cooperative Low-Rank Models for Removing Stripe Noise From OCTA Images.

    abstract::Optical coherence tomography angiography (OCTA) is an emerging non-invasive imaging technique for imaging the microvasculature of the eye based on phase variance or amplitude decorrelation derived from repeated OCT images of the same tissue area. Stripe noise occurs during the OCTA acquisition process due to the invol...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2997381

    authors: Wu X,Gao D,Borroni D,Madhusudhan S,Jin Z,Zheng Y

    更新日期:2020-12-01 00:00:00

  • Contribution of a Trunk Accelerometer System to the Characterization of Gait in Patients With Mild-to-Moderate Parkinson's Disease.

    abstract:OBJECTIVE:Gait disturbances like shuffling and short steps are obvious at visual observation in patients with advanced Parkinson's disease (PD). However, quantitative methods are increasingly used to evaluate the wide range of gait abnormalities that may occur over the disease course. The goal of this study was to test...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2469540

    authors: Demonceau M,Donneau AF,Croisier JL,Skawiniak E,Boutaayamou M,Maquet D,Garraux G

    更新日期:2015-11-01 00:00:00

  • Laryngeal Tumor Detection and Classification in Endoscopic Video.

    abstract::The development of the narrow-band imaging (NBI) has been increasing the interest of medical specialists in the study of laryngeal microvascular network to establish diagnosis without biopsy and pathological examination. A possible solution to this challenging problem is presented in this paper, which proposes an auto...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2374975

    authors: Barbalata C,Mattos LS

    更新日期:2016-01-01 00:00:00

  • Neonatal Heart and Lung Sound Quality Assessment for Robust Heart and Breathing Rate Estimation for telehealth Applications.

    abstract::With advances in digital stethoscopes, internet of things, signal processing and machine learning, chest sounds can be easily collected and transmitted to the cloud for remote monitoring and diagnosis. However, low quality of recordings complicates remote monitoring and diagnosis, particularly for neonatal care. This ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3047602

    authors: Grooby E,He J,Kiewsky J,Fattahi D,Zhou L,King A,Ramanathan A,Malhotra A,Dumont GA,Marzbanrad F

    更新日期:2020-12-28 00:00:00

  • Q-Rank: Reinforcement Learning for Recommending Algorithms to Predict Drug Sensitivity to Cancer Therapy.

    abstract::In personalized medicine, a challenging task is to identify the most effective treatment for a patient. In oncology, several computational models have been developed to predict the response of drugs to therapy. However, the performance of these models depends on multiple factors. This paper presents a new approach, ca...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3004663

    authors: Daoud S,Mdhaffar A,Jmaiel M,Freisleben B

    更新日期:2020-11-01 00:00:00

  • Inverse estimation of multiple muscle activations from joint moment with muscle synergy extraction.

    abstract::Human movement is produced resulting from synergetic combinations of multiple muscle contractions. The resultant joint movement can be estimated through the related multiple-muscle activities, which is formulated as the forward problem. Neuroprosthetic applications may benefit from cocontraction of agonist and antagon...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章,随机对照试验

    doi:10.1109/JBHI.2014.2342274

    authors: Li Z,Guiraud D,Hayashibe M

    更新日期:2015-01-01 00:00:00

  • A multiprocessing scheme for PET image pre-screening, noise reduction, segmentation and lesion partitioning.

    abstract::Accurate segmentation and segmentation of lesions in PET images provide computer-aided procedures and doctors with parameters for tumour diagnosis, staging and prognosis. Currently, PET segmentation and lesion partitioning are manually measured by radiologists, which is time consuming and laborious, and tedious manual...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3024563

    authors: Cui R,Chen Z,Wu J,Tan Y,Yu G

    更新日期:2020-09-18 00:00:00

  • Accurate Joint-Alignment of Indocyanine Green and Fluorescein Angiograph Sequences for Treatment of Subretinal Lesions.

    abstract::In ophthalmology, aligning images in indocyanine green and fluorescein angiograph sequences is important for the treatment of subretinal lesions. This paper introduces an algorithm that is tailored to align jointly in a common reference space all the images in an angiogram sequence containing both modalities. To overc...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2016.2538265

    authors: Chia-Ling Tsai,Hung-Chuan Hsu,Xin-Chang Wu,Shih-Jen Chen,Wei-Yang Lin

    更新日期:2017-05-01 00:00:00

  • 2D and 3D CT Radiomic Features Performance Comparison in Characterization of Gastric Cancer: A Multi-center Study.

    abstract:OBJECTIVE:Radiomics, an emerging tool for medical image analysis, is potential towards precisely characterizing gastric cancer (GC). Whether using one-slice 2D annotation or whole-volume 3D annotation remains a long-time debate, especially for heterogeneous GC. We comprehensively compared 2D and 3D radiomic features' r...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3002805

    authors: Meng L,Dong D,Chen X,Fang M,Wang R,Li J,Liu Z,Tian J

    更新日期:2020-06-16 00:00:00

  • Unsupervised eye blink artifact denoising of EEG data with modified multiscale sample entropy, Kurtosis, and wavelet-ICA.

    abstract::Brain activities commonly recorded using the electroencephalogram (EEG) are contaminated with ocular artifacts. These activities can be suppressed using a robust independent component analysis (ICA) tool, but its efficiency relies on manual intervention to accurately identify the independent artifactual components. In...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2333010

    authors: Mahajan R,Morshed BI

    更新日期:2015-01-01 00:00:00

  • Exploring early glaucoma and the visual field test: classification and clustering using Bayesian networks.

    abstract::Bayesian networks (BNs) are probabilistic models used for classification and clustering in several fields. Their ability to deal with unobserved variables and to integrate data and expert knowledge make them an appropriate technique for modeling eye functionality measurements in glaucoma. In this study, a set of BNs i...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2013.2289367

    authors: Ceccon S,Garway-Heath DF,Crabb DP,Tucker A

    更新日期:2014-05-01 00:00:00

  • Robotic-Assisted Needle Steering Around Anatomical Obstacles Using Notched Steerable Needles.

    abstract::Robotic-assisted needle steering can enhance the accuracy of needle-based interventions. Application of current needle steering techniques are restricted by the limited deflection curvature of needles. Here, a novel steerable needle with improved curvature is developed and used with an online motion planner to steer t...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2017.2780192

    authors: Khadem M,Rossa C,Usmani N,Sloboda RS,Tavakoli M

    更新日期:2018-11-01 00:00:00

  • A novel and lightweight system to secure wireless medical sensor networks.

    abstract::Wireless medical sensor networks (MSNs) are a key enabling technology in e-healthcare that allows the data of a patient's vital body parameters to be collected by the wearable or implantable biosensors. However, the security and privacy protection of the collected data is a major unsolved issue, with challenges coming...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2013.2268897

    authors: He D,Chan S,Tang S

    更新日期:2014-01-01 00:00:00

  • Automatic Analysis of Food Intake and Meal Microstructure Based on Continuous Weight Measurements.

    abstract::The structure of the cumulative food intake (CFI) curve has been associated with obesity and eating disorders. Scales that record the weight loss of a plate from which a subject eats food are used for capturing this curve; however, their measurements are contaminated by additive noise and are distorted by certain type...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2812243

    authors: Papapanagiotou V,Diou C,Ioakimidis I,Sodersten P,Delopoulos A

    更新日期:2019-03-01 00:00:00

  • Automatic Polyp Detection via a Novel Unified Bottom-Up and Top-Down Saliency Approach.

    abstract::In this paper, we propose a novel automatic computer-aided method to detect polyps for colonoscopy videos. To capture perceptually and semantically meaningful salient polyp regions, we first segment images into multilevel superpixels. Each level corresponds to different sizes of superpixels. Rather than adopting hand-...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2017.2734329

    authors: Yuan Y,Li D,Meng MQ,Yixuan Yuan,Dengwang Li,Meng MQ

    更新日期:2018-07-01 00:00:00

  • A Patient-Centric Health Information Exchange Framework Using Blockchain Technology.

    abstract::Health Information Exchange (HIE) exhibits remarkable benefits for patient care such as improving healthcare quality and expediting coordinated care. The Office of the National Coordinator (ONC) for Health Information Technology is seeking patient-centric HIE designs that shift data ownership from providers to patient...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2993072

    authors: Zhuang Y,Sheets LR,Chen YW,Shae ZY,Tsai JJP,Shyu CR

    更新日期:2020-08-01 00:00:00

  • Groupwise Multichannel Image Registration.

    abstract::Multichannel image registration is an important challenge in medical image analysis. Multichannel images result from modalities such as dual-energy CT or multispectral microscopy. Besides, multichannel feature images can be derived from acquired images, for instance, by applying multiscale feature banks to the origina...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2844361

    authors: Guyader JM,Huizinga W,Fortunati V,Poot DHJ,Veenland JF,Paulides MM,Niessen WJ,Klein S

    更新日期:2019-05-01 00:00:00