Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic Retinopathy.

Abstract:

PURPOSE:To understand the impact of deep learning diabetic retinopathy (DR) algorithms on physician readers in computer-assisted settings. DESIGN:Evaluation of diagnostic technology. PARTICIPANTS:One thousand seven hundred ninety-six retinal fundus images from 1612 diabetic patients. METHODS:Ten ophthalmologists (5 general ophthalmologists, 4 retina specialists, 1 retina fellow) read images for DR severity based on the International Clinical Diabetic Retinopathy disease severity scale in each of 3 conditions: unassisted, grades only, or grades plus heatmap. Grades-only assistance comprised a histogram of DR predictions (grades) from a trained deep-learning model. For grades plus heatmap, we additionally showed explanatory heatmaps. MAIN OUTCOME MEASURES:For each experiment arm, we computed sensitivity and specificity of each reader and the algorithm for different levels of DR severity against an adjudicated reference standard. We also measured accuracy (exact 5-class level agreement and Cohen's quadratically weighted κ), reader-reported confidence (5-point Likert scale), and grading time. RESULTS:Readers graded more accurately with model assistance than without for the grades-only condition (P < 0.001). Grades plus heatmaps improved accuracy for patients with DR (P < 0.001), but reduced accuracy for patients without DR (P = 0.006). Both forms of assistance increased readers' sensitivity moderate-or-worse DR: unassisted: mean, 79.4% [95% confidence interval (CI), 72.3%-86.5%]; grades only: mean, 87.5% [95% CI, 85.1%-89.9%]; grades plus heatmap: mean, 88.7% [95% CI, 84.9%-92.5%] without a corresponding drop in specificity (unassisted: mean, 96.6% [95% CI, 95.9%-97.4%]; grades only: mean, 96.1% [95% CI, 95.5%-96.7%]; grades plus heatmap: mean, 95.5% [95% CI, 94.8%-96.1%]). Algorithmic assistance increased the accuracy of retina specialists above that of the unassisted reader or model alone; and increased grading confidence and grading time across all readers. For most cases, grades plus heatmap was only as effective as grades only. Over the course of the experiment, grading time decreased across all conditions, although most sharply for grades plus heatmap. CONCLUSIONS:Deep learning algorithms can improve the accuracy of, and confidence in, DR diagnosis in an assisted read setting. They also may increase grading time, although these effects may be ameliorated with experience.

journal_name

Ophthalmology

journal_title

Ophthalmology

authors

Sayres R,Taly A,Rahimy E,Blumer K,Coz D,Hammel N,Krause J,Narayanaswamy A,Rastegar Z,Wu D,Xu S,Barb S,Joseph A,Shumski M,Smith J,Sood AB,Corrado GS,Peng L,Webster DR

doi

10.1016/j.ophtha.2018.11.016

subject

Has Abstract

pub_date

2019-04-01 00:00:00

pages

552-564

issue

4

eissn

0161-6420

issn

1549-4713

pii

S0161-6420(18)31575-6

journal_volume

126

pub_type

杂志文章
  • Evidence-based Criteria for Assessment of Visual Field Reliability.

    abstract:PURPOSE:Assess the impact of false-positives (FP), false-negatives (FN), fixation losses (FL), and test duration (TD) on visual field (VF) reliability at different stages of glaucoma severity. DESIGN:Retrospective. PARTICIPANTS:A total of 10 262 VFs from 1538 eyes of 909 subjects with suspect or manifest glaucoma and...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2017.04.035

    authors: Yohannan J,Wang J,Brown J,Chauhan BC,Boland MV,Friedman DS,Ramulu PY

    更新日期:2017-11-01 00:00:00

  • Diffuse iris melanoma: a report of 25 cases.

    abstract:BACKGROUND:Diffuse iris melanoma is a rare variant of iris melanoma that has a flat growth pattern and often presents as unilateral hyperchromic heterochromia and glaucoma. There have been no large clinical reports of diffuse iris melanoma. DESIGN:Single-center retrospective case series. PARTICIPANTS:Twenty-five cons...

    journal_title:Ophthalmology

    pub_type: 杂志文章,评审

    doi:10.1016/s0161-6420(02)01104-1

    authors: Demirci H,Shields CL,Shields JA,Eagle RC Jr,Honavar SG

    更新日期:2002-08-01 00:00:00

  • Narrowing of the retinal arterioles in descending optic atrophy. A quantitative clinical study.

    abstract::Measurements were made on fundus photographs of the diameters of retinal arterioles in a series of cases with various nonvascular lesions of the anterior visual pathways, before and after the development of fundus signs of optic atrophy. A simple method was devised for reliable estimation of the diameter of the centra...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(84)34144-6

    authors: Frisén L,Claesson M

    更新日期:1984-11-01 00:00:00

  • Relative frequency of ultrasound diagnoses in patients referred for ophthalmic ultrasound.

    abstract::An ultrasound diagnostic coding system was developed that permitted entry of diagnoses into a programmable calculator, thus permitting rapid information retrieval of patients with a specific diagnosis or diagnoses as well as the number of patients with a specific diagnosis. Cataract, vitreous opacity, trauma, choroida...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(78)35564-0

    authors: Frank KE,Purnell EW,Jennings WD

    更新日期:1978-11-01 00:00:00

  • Orbital lesions in the blue rubber bleb nevus syndrome.

    abstract:PURPOSE:To identify ophthalmologic manifestations of the blue rubber bleb nevus syndrome, a rare cutaneovisceral hemangiomatosis. METHODS:The authors report two patients with a diagnosis of blue rubber bleb nevus syndrome with orbital hemangiomas. RESULTS:In one patient, the orbital lesion presented with signs and sy...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(96)30584-8

    authors: McCannel CA,Hoenig J,Umlas J,Woog JJ,Newman AN,Bateman JB

    更新日期:1996-06-01 00:00:00

  • Ocular complications of pediatric uveitis.

    abstract:PURPOSE:To determine the cumulative proportion and the visual significance of ocular complications of pediatric uveitis. DESIGN:Cohort study. PARTICIPANTS:Patients with onset of endogenous or infectious uveitis before or at age 16 years. METHODS:Retrospective review of existing records at a university-based uveitis ...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2004.06.014

    authors: Rosenberg KD,Feuer WJ,Davis JL

    更新日期:2004-12-01 00:00:00

  • New retinal detachment after pneumatic retinopexy.

    abstract::Thirteen cases of rhegmatogenous retinal detachment repaired by pneumatic retinopexy were reviewed retrospectively. All patients were followed for a minimum of 6 months after surgery. At the end of follow-up, retinal detachment repair by pneumatic retinopexy succeeded in nine cases (70%) and failed in four (30%). With...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(87)33445-1

    authors: Poliner LS,Grand MG,Schoch LH,Olk RJ,Johnston GP,Okun E,Boniuk I,Escoffery RF

    更新日期:1987-04-01 00:00:00

  • Scatter Photocoagulation Does Not Reduce Macular Edema or Treatment Burden in Patients with Retinal Vein Occlusion: The RELATE Trial.

    abstract:PURPOSE:To determine whether scatter and grid laser photocoagulation (laser) adds benefit to ranibizumab injections in patients with macular edema from retinal vein occlusion (RVO) and to compare 0.5-mg with 2.0-mg ranibizumab. DESIGN:Randomized, double-masked, controlled clinical trial. PARTICIPANTS:Thirty-nine pati...

    journal_title:Ophthalmology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.ophtha.2015.04.006

    authors: Campochiaro PA,Hafiz G,Mir TA,Scott AW,Solomon S,Zimmer-Galler I,Sodhi A,Duh E,Ying H,Wenick A,Shah SM,Do DV,Nguyen QD,Kherani S,Sophie R

    更新日期:2015-07-01 00:00:00

  • A new low-concentration preparation for mydriasis and cycloplegia.

    abstract::This study was designed to evaluate a low-concentration, cycloplegic-mydriatic mixture of phenylephrine and tropicamide in a routine office examination. No clinically significant difference in pupillary dilation was found between the usual instillation of the standard, commercially available phenylephrine 10% and trop...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(80)35251-2

    authors: Forman AR

    更新日期:1980-03-01 00:00:00

  • An improved technique for management of dislocated posterior chamber implants.

    abstract::Many techniques for repositioning dislocated posterior chamber implants described in the recent literature involve intricate intraocular manipulation of a needle or other sharp instrument. The author describes an improved sulcus fixation technique, which combines the best features of external and internal approaches. ...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(92)32012-3

    authors: Chan CK

    更新日期:1992-01-01 00:00:00

  • Negative predictive value of a population-based preschool vision screening program.

    abstract:BACKGROUND:The Enhanced Vision Screening Program is a population-based vision screening program that has, at present, examined 59,782 children. Its main goal is to detect amblyopia, strabismus, and high refractive errors. An average of 11,910 4 1/2- to 5 1/2-year-old children are screened yearly. The current study dete...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(92)31865-2

    authors: De Becker I,MacPherson HJ,LaRoche GR,Braunstein J,Cottle R,McIntyre LL,Kozousek V

    更新日期:1992-06-01 00:00:00

  • Holmium laser thermokeratoplasty.

    abstract:PURPOSE:Corneal curvature can be altered by shrinking stromal collagen with a pulsed solid-state holmium: YAG laser in a procedure termed laser thermokeratoplasty. METHODS:The authors performed laser thermokeratoplasty in 40 human cadaver eyes using a ring pattern of 32 spots, each spot having a diameter of 300 micron...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(93)31579-4

    authors: Moreira H,Campos M,Sawusch MR,McDonnell JM,Sand B,McDonnell PJ

    更新日期:1993-05-01 00:00:00

  • Argon green (514 nm) versus krypton red (647 nm) modified grid laser photocoagulation for diffuse diabetic macular edema.

    abstract::Between 1984 and 1988, 225 eyes of 132 patients were entered in a prospective, randomized clinical trial to determine if any significant differences exist between treatment with argon green (514 nm) and krypton red (647 nm) modified grid laser photocoagulation for patients with diffuse diabetic maculopathy with or wit...

    journal_title:Ophthalmology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/s0161-6420(90)32449-1

    authors: Olk RJ

    更新日期:1990-09-01 00:00:00

  • Longitudinal study of the ocular complications of AIDS: 1. Ocular diagnoses at enrollment.

    abstract:OBJECTIVE:To report the prevalence of ocular complications of AIDS in the era of highly active antiretroviral therapy (HAART). DESIGN:Cohort study. PARTICIPANTS:Patients with AIDS, 13 years or older. METHODS:History, eye examination, and laboratory testing at enrollment. MAIN OUTCOME MEASURE:Frequency of ocular com...

    journal_title:Ophthalmology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.ophtha.2006.11.008

    authors: Jabs DA,Van Natta ML,Holbrook JT,Kempen JH,Meinert CL,Davis MD,Studies of the Ocular Complications of AIDS Research Group.

    更新日期:2007-04-01 00:00:00

  • Microbial keratitis in los angeles: the doheny eye institute and the los angeles county hospital experience.

    abstract:OBJECTIVE:To evaluate the spectrum and antibiotic susceptibility panel of infectious keratitis at a major tertiary care referral eye center and a major county hospital in Southern California. DESIGN:Retrospective case series. PARTICIPANTS:All cultured infectious keratitis cases from July 1, 2008, through December 31,...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2014.11.027

    authors: Sand D,She R,Shulman IA,Chen DS,Schur M,Hsu HY

    更新日期:2015-05-01 00:00:00

  • Inaccuracy of fine needle aspiration biopsy.

    abstract::Fine needle aspiration biopsy (FNAB) of orbital tumors has been recently advocated as a reliable diagnostic modality. An accuracy rate of 92% has been claimed by some authors. This figure remains unproven as most patients have not undergone simultaneous pathologic examination. We recently performed FNAB on 34 patients...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(85)33984-2

    authors: Krohel GB,Tobin DR,Chavis RM

    更新日期:1985-05-01 00:00:00

  • Influence of wearing schedule on extended-wear complications.

    abstract::The effect of wearing schedule on extended-wear (EW) success was evaluated over a nine-month period by assigning 36 subjects to 5 different wearing schedules (removal every 4, 7, 14, or 28 days, or daily wear [DW]). All but one EW patient required interruption of extended wear at least once; half of the DW patients co...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(86)33768-0

    authors: Kenyon E,Polse KA,Seger RG

    更新日期:1986-02-01 00:00:00

  • Posterior sub-Tenon's capsule injection of triamcinolone acetonide prevents panretinal photocoagulation-induced visual dysfunction in patients with severe diabetic retinopathy and good vision.

    abstract:PURPOSE:To evaluate prospectively the efficacy of a single sub-Tenon's capsule injection of triamcinolone acetonide (TA) against panretinal photocoagulation (PRP)-induced macular thickening and visual disturbance in patients with severe diabetic retinopathy and good vision. DESIGN:Prospective, comparative, interventio...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2005.10.035

    authors: Shimura M,Yasuda K,Shiono T

    更新日期:2006-03-01 00:00:00

  • Foveal Hypoplasia in Patients with Stickler Syndrome.

    abstract:PURPOSE:To determine the microstructure of the fovea in patients with Stickler syndrome using imaging by spectral-domain optical coherence tomography (SD OCT) and swept-source OCT. DESIGN:Retrospective case series study. PARTICIPANTS:A total of 39 eyes of 25 patients with genetically confirmed Stickler syndrome were ...

    journal_title:Ophthalmology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.ophtha.2017.01.046

    authors: Matsushita I,Nagata T,Hayashi T,Kimoto K,Kubota T,Ohji M,Kusaka S,Kondo H

    更新日期:2017-06-01 00:00:00

  • Whole Exome Sequencing Identifies Candidate Genes Associated with Hereditary Predisposition to Uveal Melanoma.

    abstract:PURPOSE:To identify susceptibility genes associated with hereditary predisposition to uveal melanoma (UM) in patients with no detectable germline BAP1 alterations. DESIGN:Retrospective case series from academic referral centers. PARTICIPANTS:Cohort of 154 UM patients with high risk of hereditary cancer defined as pat...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2019.11.009

    authors: Abdel-Rahman MH,Sample KM,Pilarski R,Walsh T,Grosel T,Kinnamon D,Boru G,Massengill JB,Schoenfield L,Kelly B,Gordon D,Johansson P,DeBenedictis MJ,Singh A,Casadei S,Davidorf FH,White P,Stacey AW,Scarth J,Fewings E,T

    更新日期:2020-05-01 00:00:00

  • Normal endothelial cell count range.

    abstract::It was the purpose of this study to determine whether age could be used to predict central endothelial cell count in preoperative cataract patients aged 40 to 90. Three separate series of cell counts on a total of almost 3,000 eyes were performed and analyzed regarding age relationship. Although statistically endothel...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(80)35149-x

    authors: Hoffer KJ,Kraff MC

    更新日期:1980-09-01 00:00:00

  • Prognosticators for visual outcome in sarcoid uveitis.

    abstract:PURPOSE:The purpose of the study is to delineate the visual prognosticators in sarcoid-associated uveitis given the current standards of care. METHODS:The records of 60 patients with sarcoid-associated uveitis who were observed for at least 6 months were studied retrospectively. Multivariate regression models using th...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(96)30417-x

    authors: Dana MR,Merayo-Lloves J,Schaumberg DA,Foster CS

    更新日期:1996-11-01 00:00:00

  • Responsiveness of health-related quality-of-life questionnaires in adults undergoing Strabismus surgery.

    abstract:OBJECTIVE:To evaluate the responsiveness of 2 health-related quality-of-life (HRQOL) questionnaires, the Adult Strabismus-20 (AS-20) and National Eye Institute Visual Function Questionnaire-25 (VFQ-25), to changes in HRQOL after strabismus surgery. DESIGN:Cohort study. PARTICIPANTS:We included 106 adults (aged 18-84 ...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2010.03.042

    authors: Hatt SR,Leske DA,Holmes JM

    更新日期:2010-12-01 00:00:00

  • Oversized grafts in children.

    abstract:OBJECTIVE:To evaluate the efficacy of oversized corneal grafts in the pediatric age group. DESIGN:Prospective, nonrandomized clinical trial. PARTICIPANTS AND INTERVENTION:Forty pediatric patients with unilateral or bilateral corneal opacification of congenital or acquired origin underwent corneal grafting surgery ove...

    journal_title:Ophthalmology

    pub_type: 临床试验,杂志文章

    doi:10.1016/S0161-6420(99)90174-4

    authors: Vajpayee RB,Ramu M,Panda A,Sharma N,Tabin GC,Anand JR

    更新日期:1999-04-01 00:00:00

  • Droperidol and dolasetron alone or in combination for prevention of postoperative nausea and vomiting after vitrectomy.

    abstract:PURPOSE:Droperidol and the new serotonin-3 antagonists are effective drugs for the prophylaxis of postoperative nausea and vomiting (PONV). The aim of this trial was to evaluate whether dolasetron could be a substitute for droperidol, because the Food and Drug Administration has required a Black Box warning on the drop...

    journal_title:Ophthalmology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/j.ophtha.2004.01.031

    authors: Eberhart LH,Morin AM,Hoerle S,Wulf H,Geldner G

    更新日期:2004-08-01 00:00:00

  • Displacement of submacular hemorrhages in age-related macular degeneration with subretinal tissue plasminogen activator and air.

    abstract:OBJECTIVE:To study the anatomic and visual outcomes of a surgical procedure in which tissue plasminogen activator and air are injected subretinally to displace massive submacular hemorrhages secondary to age-related macular degeneration. DESIGN:Prospective, consecutive, interventional case series. PARTICIPANTS:Thirte...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2014.07.027

    authors: Kadonosono K,Arakawa A,Yamane S,Inoue M,Yamakawa T,Uchio E,Yanagi Y

    更新日期:2015-01-01 00:00:00

  • Specular microscopy of hard contact lens wearers II.

    abstract::Specular microscopy was done on 65 long-term hard contact lens (CL) wearers and controls matched for age, sex, race, and refractive error. There was no difference in mean endothelial cell size between the two groups, although median cell area was slightly smaller in the CL group. Standard deviation and coefficient of ...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(89)32754-0

    authors: Yamauchi K,Hirst LW,Enger C,Rosenfeld J,Vogelpohl W

    更新日期:1989-08-01 00:00:00

  • Episodic astigmatism heralding generalized myopathy: report of a case managed with a new type of soft contact lens.

    abstract::A 29-year-old woman presented with marked variations in refraction. A few minutes of physical exertion or reading at a close distance induced up to 2D of myopia and 2D of myopic astigmatism, which regressed upon resting with closed eyes. Cycloplegic agents did not affect the refractive changes, which were shown to be ...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(84)34314-7

    authors: Frisén L,Blomstrand C

    更新日期:1984-02-01 00:00:00

  • Stability of corneal polarization axis measurements for scanning laser polarimetry.

    abstract:OBJECTIVE:Corneal polarization axis (CPA) has been reported to affect retardation measurements obtained with scanning laser polarimetry. The purpose of this investigation was to evaluate the longitudinal stability of CPA measurements. DESIGN:Prospective, noncomparative case series. PARTICIPANTS:Persons with normal co...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/s0161-6420(01)00569-3

    authors: Greenfield DS,Knighton RW

    更新日期:2001-06-01 00:00:00

  • Intraocular concentration of triamcinolone acetonide after intravitreal injection in the rabbit eye.

    abstract:PURPOSE:To examine the decrease in the intraocular concentration of intravitreally injected triamcinolone acetonide over an 8-month period in a rabbit model. DESIGN:Experimental study. PARTICIPANTS:The study included 18 white New Zealand rabbits. METHODS:The animals received an intravitreal injection of 6 mg triamci...

    journal_title:Ophthalmology

    pub_type: 杂志文章

    doi:10.1016/j.ophtha.2008.01.019

    authors: Kamppeter BA,Cej A,Jonas JB

    更新日期:2008-08-01 00:00:00