Development of a deep learning-based image eligibility verification system for detecting and filtering out ineligible fundus images: A multicentre study.

Abstract:

BACKGROUND:Recent advances in artificial intelligence (AI) have shown great promise in detecting some diseases based on medical images. Most studies developed AI diagnostic systems only using eligible images. However, in real-world settings, ineligible images (including poor-quality and poor-location images) that can compromise downstream analysis are inevitable, leading to uncertainty about the performance of these AI systems. This study aims to develop a deep learning-based image eligibility verification system (DLIEVS) for detecting and filtering out ineligible fundus images. METHODS:A total of 18,031 fundus images (9,188 subjects) collected from 4 clinical centres were used to develop and evaluate the DLIEVS for detecting eligible, poor-location, and poor-quality fundus images. Four deep learning algorithms (AlexNet, DenseNet121, Inception V3, and ResNet50) were leveraged to train models to obtain the best model for the DLIEVS. The performance of the DLIEVS was evaluated using the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity, as compared with a reference standard determined by retina experts. RESULTS:In the internal test dataset, the best algorithm (DenseNet121) achieved AUCs of 1.000, 0.999, and 1.000 for the classification of eligible, poor-location, and poor-quality images, respectively. In the external test datasets, the AUCs of the best algorithm (DenseNet121) for detecting eligible, poor-location, and poor-quality images were ranged from 0.999-1.000, 0.997-1.000, and 0.997-0.999, respectively. CONCLUSIONS:Our DLIEVS can accurately discriminate poor-quality and poor-location images from eligible images. This system has the potential to serve as a pre-screening technique to filter out ineligible images obtained from real-world settings, ensuring only eligible images will be applied in the subsequent image-based AI diagnostic analyses.

journal_name

Int J Med Inform

authors

Li Z,Jiang J,Zhou H,Zheng Q,Liu X,Chen K,Weng H,Chen W

doi

10.1016/j.ijmedinf.2020.104363

subject

Has Abstract

pub_date

2021-03-01 00:00:00

pages

104363

eissn

1386-5056

issn

1872-8243

pii

S1386-5056(20)31899-2

journal_volume

147

pub_type

杂志文章
  • What are the main patient safety concerns of healthcare stakeholders: a mixed-method study of Web-based text.

    abstract:OBJECTIVES:Various healthcare stakeholders define quality of care in different ways. Public policy could advocate all these concerns. This study was conducted to identify the main themes on patient safety of stakeholders expressed before and after the Patient Safety Act was enacted in Korea in 2015. DESIGN:Longitudina...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104162

    authors: Cho I,Lee M,Kim Y

    更新日期:2020-08-01 00:00:00

  • CPOE in Iran--a viable prospect? Physicians' opinions on using CPOE in an Iranian teaching hospital.

    abstract:BACKGROUND:In recent years, the theory that on-line clinical decision support systems can improve patients' safety among hospitalised individuals has gained greater acceptance. However, the feasibility of implementing such a system in a middle or low-income country has rarely been studied. Understanding the current pre...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.07.004

    authors: Kazemi A,Ellenius J,Tofighi S,Salehi A,Eghbalian F,Fors UG

    更新日期:2009-03-01 00:00:00

  • Delivering the electronic healthcare record for the 21st century.

    abstract::In spite of over four decades of research into Electronic Healthcare Record Systems, the penetration of records which incorporate more than simply basic information, into the working life of healthcare organisations is relatively small. This paper discusses some of the key impediments to progress including in particul...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(01)00205-2

    authors: Grimson J

    更新日期:2001-12-01 00:00:00

  • Global healthcare and the flux of technology.

    abstract::For Medinfo '98, as an exercise in technological forecasting and analysis, we volunteered to project the direction of healthcare informatics into the next century. This paper is an extended discussion of that presentation. We open with the observation that healthcare informatics is merely one of the many endeavors tha...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00161-0

    authors: Lincoln TL,Builder C

    更新日期:1999-02-01 00:00:00

  • The application of a computerized problem-oriented medical record system and its impact on patient care.

    abstract::The present computer system is the first of its kind based on problem-oriented medical record (POMR) design developed and operated in a hospital in Hong Kong. It went live in May 1996 with two workstations installed in the medical record office (MRO). Doctors have no direct access to it. They dictate medical notes on ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(99)00019-2

    authors: Ho LM,McGhee SM,Hedley AJ,Leong JC

    更新日期:1999-07-01 00:00:00

  • Trustworthy reuse of health data: a transnational perspective.

    abstract:BACKGROUND:The widespread adoption of electronic health records (EHRs) is accelerating the collection of sensitive clinical data. The availability of these data raises privacy concerns, yet sharing the data is essential for public health, longitudinal patient care, and clinical research. METHOD:Following previous work...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2012.11.003

    authors: Geissbuhler A,Safran C,Buchan I,Bellazzi R,Labkoff S,Eilenberg K,Leese A,Richardson C,Mantas J,Murray P,De Moor G

    更新日期:2013-01-01 00:00:00

  • The use of a medical dictionary for regulatory activities terminology (MedDRA) in prescription-event monitoring in Japan (J-PEM).

    abstract::The Medical Dictionary for Regulatory Activities Terminology (MedDRA) version 2.1 (V2.1) was released in March 1999 accompanied by the MedDRA/J V2.1J specifically for Japanese users. In prescription-event monitoring in Japan (J-PEM), we have employed the MedDRA/J for data entry, signal generation and event listing. In...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(00)00062-9

    authors: Yokotsuka M,Aoyama M,Kubota K

    更新日期:2000-07-01 00:00:00

  • Is email an effective method for hospital discharge communication? A randomized controlled trial to examine delivery of computer-generated discharge summaries by email, fax, post and patient hand delivery.

    abstract:OBJECTIVE:To examine the effectiveness of delivering of computer-generated discharge summaries to general practice by email, fax, post and patient hand delivery. DESIGN:Blinded, randomized controlled trial. A pre-study audit ascertaining baseline statistics and a follow-up survey were conducted with general practice t...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.ijmedinf.2009.12.006

    authors: Chen Y,Brennan N,Magrabi F

    更新日期:2010-03-01 00:00:00

  • A smart wearable device for monitoring and self-management of diabetic foot: A proof of concept study.

    abstract:BACKGROUND AND OBJECTIVE:Diabetic foot is one of the important complications of diabetes, which is occurred due to the destructive parameters in different anatomical sites of feet. Management and monitoring of these parameters are very important to decrease or prevent foot ulcers. We aimed to develop a smart wearable d...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104343

    authors: Moulaei K,Malek M,Sheikhtaheri A

    更新日期:2021-02-01 00:00:00

  • Managing a mixed-registration-type appointment system in outpatient clinics.

    abstract:INTRODUCTION:Improving outpatient resource utilization significantly enhances the efficiency of healthcare organizations. Substantial number of walk-in patients (average of 72% in our study) to outpatient services is a universal characteristic of Taiwan's healthcare organizations. Consequently, scheduling becomes extre...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(03)00008-x

    authors: Su S,Shih CL

    更新日期:2003-04-01 00:00:00

  • Detection and characterization of usability problems in structured data entry interfaces in dentistry.

    abstract:BACKGROUND:Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2012.05.018

    authors: Walji MF,Kalenderian E,Tran D,Kookal KK,Nguyen V,Tokede O,White JM,Vaderhobli R,Ramoni R,Stark PC,Kimmes NS,Schoonheim-Klein ME,Patel VL

    更新日期:2013-02-01 00:00:00

  • The Yale Guideline Recommendation Corpus: a representative sample of the knowledge content of guidelines.

    abstract:OBJECTIVE:To develop and characterize a large, representative sample of guideline recommendations that can be used to better understand how current recommendations are written and to test the adequacy of guideline models. We refer to this sample as the Yale Guideline Recommendation Corpus (YGRC). METHOD:To develop the...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.11.001

    authors: Hussain T,Michel G,Shiffman RN

    更新日期:2009-05-01 00:00:00

  • Ontology driven health information systems architectures enable pHealth for empowered patients.

    abstract::The paradigm shift from organization-centered to managed care and on to personal health settings increases specialization and distribution of actors and services related to the health of patients or even citizens before becoming patients. As a consequence, extended communication and cooperation is required between all...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2010.10.004

    authors: Blobel B

    更新日期:2011-02-01 00:00:00

  • Healthcare professional's demand for knowledge in informatics.

    abstract:OBJECTIVE:To develop an economic model of health care professional demand for knowledge capital in health informatics. DESIGN:Case study with application of the contingent valuation method to develop a small-scale model. SETTING:Specialized clinic at a university Hospital in Sweden. RESULTS:The model displays the ec...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00151-8

    authors: Vimarlund V,Timpka T,Hallberg N

    更新日期:1999-02-01 00:00:00

  • IMIA Working Group 15: technology assessment and quality development in health informatics.

    abstract::The working group on technology assessment and quality development in health informatics was established as a follow-up to the recommendations made at the IMIA-ISTAHC working conference in 1990. The working group was approved by the IMIA General Assembly at Kyoto, September, 1993. The working group aims to further dev...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(99)00030-1

    authors: van Gennip EM

    更新日期:1999-12-01 00:00:00

  • Social media and flu: Media Twitter accounts as agenda setters.

    abstract:OBJECTIVES:This paper has two objectives. First, it categorizes the Twitter handles tweeted flu related information based on the amount of replies and mentions within the Twitter network. The collected Twitter accounts are categorized as media, health related individuals, organizations, government, individuals with no ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2016.04.009

    authors: Yun GW,Morin D,Park S,Joa CY,Labbe B,Lim J,Lee S,Hyun D

    更新日期:2016-07-01 00:00:00

  • Organisational influences on nurses' use of clinical decision support systems.

    abstract:OBJECTIVE:Nurses are increasingly using computerised decision support systems (CDSS) to support their practice. Previous studies have highlighted the importance organisational factors have on the successful implementation of new technologies in healthcare. However, it is unclear how the organisations where nurses work ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2010.02.003

    authors: Randell R,Dowding D

    更新日期:2010-06-01 00:00:00

  • Quality of service provision assessment in the healthcare information and telecommunications infrastructures.

    abstract::The continuous increase in the complexity and the heterogeneity of corporate and healthcare telecommunications infrastructures will require new assessment methods of quality of service (QoS) provision that are capable of addressing all engineering and social issues with much faster speeds. Speed and accessibility to a...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2005.07.019

    authors: Babulak E

    更新日期:2006-03-01 00:00:00

  • Mapping care processes within a hospital: from theory to a web-based proposal merging enterprise modelling and ISO normative principles.

    abstract::Today, the economic and regulatory environment, involving activity-based and prospective payment systems, healthcare quality and risk analysis, traceability of the acts performed and evaluation of care practices, accounts for the current interest in clinical and hospital information systems. The structured gathering o...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2004.07.003

    authors: Staccini P,Joubert M,Quaranta JF,Fieschi M

    更新日期:2005-03-01 00:00:00

  • Determinants and outcomes of patient access to medical records: Systematic review of systematic reviews.

    abstract:BACKGROUND:Patient access to electronic health records (EHRs) is associated with several determinants and outcomes, which are interrelated. However, individual studies and the reviews summarizing them have only addressed particular aspects, such as policy, usability or health outcomes of adoption. Therefore, no compreh...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2019.05.014

    authors: van Mens HJT,Duijm RD,Nienhuis R,de Keizer NF,Cornet R

    更新日期:2019-09-01 00:00:00

  • Finding the right decision tree's induction strategy for a hard real world problem.

    abstract::Decision trees have been already successfully used in medicine, but as in traditional statistics, some hard real world problems can not be solved successfully using the traditional way of induction. In our experiments we tested various methods for building univariate decision trees in order to find the best induction ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(01)00176-9

    authors: Zorman M,Podgorelec V,Kokol P,Peterson M,Sprogar M,Ojstersek M

    更新日期:2001-09-01 00:00:00

  • Interrupting providers with clinical decision support to improve care for heart failure.

    abstract:BACKGROUND:Evidence-based therapy for heart failure remains underutilized at hospital discharge, particularly for patients with heart failure who are hospitalized for another cause. We developed clinical decision support (CDS) to recommend an angiotensin converting enzyme (ACE) inhibitor during hospitalization to promo...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2019.103956

    authors: Blecker S,Austrian JS,Horwitz LI,Kuperman G,Shelley D,Ferrauiola M,Katz SD

    更新日期:2019-11-01 00:00:00

  • A tale of two countries: International comparison of online doctor reviews between China and the United States.

    abstract:BACKGROUND:Worldwide, patients have posted millions of online reviews for their doctors. The rich textual information in the online reviews holds the potential to generate insights into how patients' experience with their doctors differ across nations and how should we use them to improve our health service. OBJECTIVE...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2016.12.007

    authors: Hao H,Zhang K,Wang W,Gao G

    更新日期:2017-03-01 00:00:00

  • Commitment of project participants to developing health care services based on the internet technology.

    abstract:BACKGROUND:When developing Information and Communication Technology (ICT), such as services for the decision-making process, skilled health care professionals with their comprehensive knowledge of patients/clients are essential contributors to the project. Careful evaluation is needed to assess the effectiveness of pro...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2005.07.002

    authors: Kouri P,Karjalainen-Jurvelin R,Kinnunen J

    更新日期:2005-12-01 00:00:00

  • Self-assessed health among older people in Europe and internet use.

    abstract:BACKGROUND:About ten years ago, an age-related digital divide was identified, where 'the elderly' denoted a group of people at risk of losing the benefits of a digital society. The aims of this work are to find a relationship between self-assessed health and internet use by older people in European countries and to asc...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104240

    authors: Tavares AI

    更新日期:2020-09-01 00:00:00

  • Nurses' information management across complex health care organizations.

    abstract:UNLABELLED:The purpose of this study was to describe the information management used by hospital and home care nurses for patients in need of continuing care after an episode of hospitalization. METHOD:A prospective descriptive design was used. In total 287 hospital nurses and 220 home care nurses were asked to comple...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2005.07.010

    authors: Hellesø R,Sorensen L,Lorensen M

    更新日期:2005-12-01 00:00:00

  • Design and implementation of I2Vote--an interactive image-based voting system using windows mobile devices.

    abstract:PURPOSE:To develop, implement and test a novel audience response system (ARS) that allows image based interaction for radiology education. METHODS:The ARS developed in this project is based on standard Personal Digital Assistants (PDAs) (HP iPAQ 114 classic handheld) running Microsoft® Windows Mobile® 6 Classic with a...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2011.05.002

    authors: van Ooijen PM,Broekema A,Oudkerk M

    更新日期:2011-08-01 00:00:00

  • Rate of electronic health record adoption in South Korea: A nation-wide survey.

    abstract:OBJECTIVE:The adoption rate of electronic health record (EHR) systems in South Korea has continuously increased. However, in contrast to the situation in the United States (US), where there has been a national effort to improve and standardize EHR interoperability, no consensus has been established in South Korea. The ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2017.02.009

    authors: Kim YG,Jung K,Park YT,Shin D,Cho SY,Yoon D,Park RW

    更新日期:2017-05-01 00:00:00

  • Internet skill-related problems in accessing online health information.

    abstract:PURPOSE:Despite the amount of health information available online, there are several barriers that limit the Internet from being adopted as a source of health information. The purpose of this study was to identify individual skill-related problems that users experience when accessing the Internet for health information...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2011.10.005

    authors: van Deursen AJ

    更新日期:2012-01-01 00:00:00

  • Nonlinear analysis of the performance and reliability of wavelet singularity detection based denoising for Doppler ultrasound fetal heart rate signals.

    abstract::Many studies on the physiology of the cardiovascular system revealed that nonlinear chaotic dynamics govern the generation of the heart rate signal. This is also valid for the fetal heart rate (FHR) variability, where however the variability is affected by many more factors and is significantly more complicated than f...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00102-6

    authors: Papadimitriou S,Bezerianos A

    更新日期:1999-01-01 00:00:00