Deep Learning for Chest Radiograph Diagnosis in the Emergency Department.

Abstract:

:BackgroundThe performance of a deep learning (DL) algorithm should be validated in actual clinical situations, before its clinical implementation.PurposeTo evaluate the performance of a DL algorithm for identifying chest radiographs with clinically relevant abnormalities in the emergency department (ED) setting.Materials and MethodsThis single-center retrospective study included consecutive patients who visited the ED and underwent initial chest radiography between January 1 and March 31, 2017. Chest radiographs were analyzed with a commercially available DL algorithm. The performance of the algorithm was evaluated by determining the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity at predefined operating cutoffs (high-sensitivity and high-specificity cutoffs). The sensitivities and specificities of the algorithm were compared with those of the on-call radiology residents who interpreted the chest radiographs in the actual practice by using McNemar tests. If there were discordant findings between the algorithm and resident, the residents reinterpreted the chest radiographs by using the algorithm's output.ResultsA total of 1135 patients (mean age, 53 years ± 18; 582 men) were evaluated. In the identification of abnormal chest radiographs, the algorithm showed an AUC of 0.95 (95% confidence interval [CI]: 0.93, 0.96), a sensitivity of 88.7% (227 of 256 radiographs; 95% CI: 84.1%, 92.3%), and a specificity of 69.6% (612 of 879 radiographs; 95% CI: 66.5%, 72.7%) at the high-sensitivity cutoff and a sensitivity of 81.6% (209 of 256 radiographs; 95% CI: 76.3%, 86.2%) and specificity of 90.3% (794 of 879 radiographs; 95% CI: 88.2%, 92.2%) at the high-specificity cutoff. Radiology residents showed lower sensitivity (65.6% [168 of 256 radiographs; 95% CI: 59.5%, 71.4%], P < .001) and higher specificity (98.1% [862 of 879 radiographs; 95% CI: 96.9%, 98.9%], P < .001) compared with the algorithm. After reinterpretation of chest radiographs with use of the algorithm's outputs, the sensitivity of the residents improved (73.4% [188 of 256 radiographs; 95% CI: 68.0%, 78.8%], P = .003), whereas specificity was reduced (94.3% [829 of 879 radiographs; 95% CI: 92.8%, 95.8%], P < .001).ConclusionA deep learning algorithm used with emergency department chest radiographs showed diagnostic performance for identifying clinically relevant abnormalities and helped improve the sensitivity of radiology residents' evaluation.Published under a CC BY 4.0 license.Online supplemental material is available for this article.See also the editorial by Munera and Infante in this issue.

journal_name

Radiology

journal_title

Radiology

authors

Hwang EJ,Nam JG,Lim WH,Park SJ,Jeong YS,Kang JH,Hong EK,Kim TM,Goo JM,Park S,Kim KH,Park CM

doi

10.1148/radiol.2019191225

subject

Has Abstract

pub_date

2019-12-01 00:00:00

pages

573-580

issue

3

eissn

0033-8419

issn

1527-1315

journal_volume

293

pub_type

杂志文章
  • Step-wedge sensitometry.

    abstract::An aluminum step-wedge filter placed far from the film cassette provides the constant variation of subject contrast required for quantitative sensitometry while virtually eliminating scatter radiations. Attenuation curves made with this configuration are almost exponentially linear. ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/128.3.820

    authors: Hale J,Bloch P

    更新日期:1978-09-01 00:00:00

  • Cervical radiculopathy: value of oblique MR imaging.

    abstract::Eighteen patients with cervical radiculopathy were entered into a prospective study to compare the accuracy of surface coil magnetic resonance (MR) imaging with that of metrizamide myelography and computed tomography (CT) with metrizamide. All MR studies included tailored axial and oblique images as well as routine sa...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.163.1.3823440

    authors: Modic MT,Masaryk TJ,Ross JS,Mulopulos GP,Bundschuh CV,Bohlman H

    更新日期:1987-04-01 00:00:00

  • Breast cancers: noninvasive method of preoperative localization with three-dimensional US and surface contour mapping.

    abstract::Formal ethical approval was granted by the local research ethics committee; all participants gave written consent. The purpose of the study was to prospectively evaluate the feasibility of a noninvasive method of breast tumor localization in 25 participants, based on the coregistration of three-dimensional (3D) ultras...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2452060906

    authors: Cash CJ,Coles CE,Treece GM,Purushotham AD,Britton P,Sinnatamby R,Gee AH,Prager RW

    更新日期:2007-11-01 00:00:00

  • Vaginal agenesis: classification by MR imaging.

    abstract::Vaginal agenesis was studied by magnetic resonance (MR) imaging lin a 15-year-old girl, a 19-year-old woman, and a 21-year-old woman. In each case MR studies demonstrated the presence or absence of a normal cervix and functioning endometrium. This information was useful in planning surgical management. MR imaging assi...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.162.3.3809480

    authors: Togashi K,Nishimura K,Itoh K,Fujisawa I,Nakano Y,Torizuka K,Ozasa H,Ohshima M

    更新日期:1987-03-01 00:00:00

  • Bronchial collapsibility at forced expiration in healthy volunteers: assessment with multidetector CT.

    abstract:PURPOSE:To assess forced-expiratory bronchial collapsibility in healthy volunteers by using multidetector computed tomography (CT) and to compare the results with the current diagnostic criterion for bronchomalacia. MATERIALS AND METHODS:The institutional review board approved this HIPAA-compliant study. Following inf...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.10100219

    authors: Litmanovich D,O'Donnell CR,Bankier AA,Ernst A,Millett ME,Loring SH,Boiselle PM

    更新日期:2010-11-01 00:00:00

  • Radiologist's guide to the use of the laboratory in diagnosing rheumatic diseases.

    abstract::Laboratory tests that are commonly used in the evaluation of rheumatic diseases are described. The techniques for performing these tests; their use in screening, diagnosis, and follow-up; and the pitfalls in interpreting their results are discussed to provide the radiologist with an understanding of the current techno...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.139.3.6972050

    authors: Sack KE,Genant HK

    更新日期:1981-06-01 00:00:00

  • Cortical deactivation in mild cognitive impairment: high-field-strength functional MR imaging.

    abstract:PURPOSE:To prospectively identify brain regions in which task-related changes in activation during a memory encoding task, measured with functional magnetic resonance (MR) imaging, correlate with degree of memory impairment across Alzheimer disease (AD), mild cognitive impairment (MCI), and elderly control subjects. M...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2451061847

    authors: Petrella JR,Wang L,Krishnan S,Slavin MJ,Prince SE,Tran TT,Doraiswamy PM

    更新日期:2007-10-01 00:00:00

  • Neural network analysis of ventilation-perfusion lung scans.

    abstract::A neural network model was constructed to interpret ventilation-perfusion (V/Q) lung scans. This model was trained with data from 100 consecutive V/Q scans with pulmonary angiographic correlation. The network was constructed from 28 input parameters that described various standard V/Q findings, which were fed into a s...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.186.3.8430170

    authors: Scott JA,Palmer EL

    更新日期:1993-03-01 00:00:00

  • Presence or absence of gas in the appendix: additional criteria to rule out or confirm acute appendicitis--evaluation with US.

    abstract:PURPOSE:To investigate whether the presence or absence of gas in the appendix may be considered as additional ultrasonographic (US) criteria to rule out or confirm acute appendicitis. MATERIALS AND METHODS:The appendices in 239 control subjects, 138 patients with lower right quadrant pain without acute appendicitis, a...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.214.1.r00ja20183

    authors: Rettenbacher T,Hollerweger A,Macheiner P,Rettenbacher L,Frass R,Schneider B,Gritzmann N

    更新日期:2000-01-01 00:00:00

  • Work in progress: abnormal parathyroid glands. Comparison of nonselective arterial digital arteriography, selective parathyroid arteriography, and venous digital arteriography as methods of detection.

    abstract::Nonselective arterial digital arteriography (NSADA), selective parathyroid arteriography (SPA), and venous digital arteriography (VDA) were compared as methods of detecting parathyroid enlargement in 14 patients with primary hyperparathyroidism undergoing preoperative localization following unsuccessful neck surgery. ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.148.1.6134300

    authors: Krudy AG,Doppman JL,Miller DL,Marx SJ,Norton JA,Santora AC 2nd,Lasker RD,Downs RW,Spiegel AM,Aurbach GD

    更新日期:1983-07-01 00:00:00

  • Surface coil assembly with switchable field of view.

    abstract::The authors designed and built an overlapping surface coil assembly for magnetic resonance imaging of the spine. A small and a large coil are included, and use of one can be switched to the other without need for patient repositioning. The images are not degraded, and screening studies can immediately be followed by d...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.164.3.3615890

    authors: Arakawa M,Krasnor S,Fehn J,McCarten B,Kaufman L

    更新日期:1987-09-01 00:00:00

  • Suture granuloma of the stomach following total colectomy.

    abstract::Stitch granuloma is rarely a consideration in the differential diagnosis of stomach lesions. This report documents the occurrence of a granulomatous mass of gastric origin simulating an intramural tumor. ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/127.1.84

    authors: Belleza NA,Lowman RM

    更新日期:1978-04-01 00:00:00

  • Artifacts produced by moving grids.

    abstract::Anti-scatter grids reduce the amount of secondary radiation contributing to the image and improve the signal-to-noise ratio. However, they may also lead to the creation of linear artifacts representing the shadows of the radiopaque septa. Grid motion perpendicular to the septa during the exposure can cause blurring of...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.147.1.6828740

    authors: Bednarek DR,Rudin S,Wong R

    更新日期:1983-04-01 00:00:00

  • Ioglucomide: a new nonionic myelographic agent. Preclinical studies.

    abstract::Ioglucomide, a new iodinated nonionic contrast medium directed primarily toward myelographic use, was subjected to an extensive toxicological examination in animals. In the majority of studies, ioglucomide was compared directly with metrizamide. In some respects, including freedom from production of arachnoiditis, iog...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.140.3.7280240

    authors: Hopkins RM,Adams MD,Lau DH,Creighton JM,Hoey GB

    更新日期:1981-09-01 00:00:00

  • Postbiopsy bleeding in a porcine model: reduction with radio-frequency ablation--preliminary results.

    abstract:PURPOSE:To test a biopsy needle modified for use of radio-frequency (RF) energy to produce hemostasis after core biopsy of liver or kidney. MATERIALS AND METHODS:RF energy was applied to a partially insulated 17-gauge needle, and tip temperature was monitored with a thermocouple. Domestic Yorkshire pigs (n = 4; mean w...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2272020173

    authors: Laeseke PF,Winter TC 3rd,Davis CL,Stevens KR,Johnson CD,Fronczak FJ,Webster JG,Lee FT Jr

    更新日期:2003-05-01 00:00:00

  • The portacaval space: CT with MR correlation.

    abstract::Between the portal vein and the inferior vena cava lies a small space that may be occupied by multiple anatomic structures including the caudate and papillary processes of the caudate lobe of the liver, portacaval lymph nodes, replaced or accessory right hepatic arteries, posterosuperior pancreaticoduodenal vessels, t...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.156.2.4011910

    authors: Zirinsky K,Auh YH,Rubenstein WA,Kneeland JB,Whalen JP,Kazam E

    更新日期:1985-08-01 00:00:00

  • Metastatic prostate cancer: initial findings of PET with 2-deoxy-2-[F-18]fluoro-D-glucose.

    abstract:PURPOSE:To evaluate the accuracy of positron emission tomography (PET) with 2-deoxy-2-[fluorine-18] fluoro-D-glucose (FDG) in the detection of osseous and soft-tissue metastases of prostate cancer. MATERIALS AND METHODS:Thirty-four patients (mean age, 71 years) with biopsy-proved prostate cancer and known or suspected...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.199.3.8638000

    authors: Shreve PD,Grossman HB,Gross MD,Wahl RL

    更新日期:1996-06-01 00:00:00

  • Occlusion of biliary endoprostheses: presentation and management.

    abstract::A retrospective review of 20 cases of endoprosthesis occlusion in 17 patients was performed. The average length of stent patency before occlusion was 3.7 months. Clinical manifestations included one or a combination of the following: cholangitis (n = 17), jaundice (n = 9), and leakage of bile or purulent material from...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.176.2.2367670

    authors: Lee MJ,Mueller PR,Saini S,Morrison MC,Brink JA,Hahn PF

    更新日期:1990-08-01 00:00:00

  • Renal arteries: optimization of three-dimensional gadolinium-enhanced MR angiography with bolus-timing-independent fast multiphase acquisition in a single breath hold.

    abstract:PURPOSE:To compare two different three-dimensional (3D) gadolinium-enhanced magnetic resonance (MR) angiographic techniques. MATERIALS AND METHODS:In 26 patients suspected of having renal artery stenosis, results with fast multiphase 3D MR angiography were compared to those with standard 3D MR angiography in 37 patien...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.211.3.r99jn26667

    authors: Schoenberg SO,Bock M,Knopp MV,Essig M,Laub G,Hawighorst H,Zuna I,Kallinowski F,van Kaick G

    更新日期:1999-06-01 00:00:00

  • Lumbar degenerative disk disease.

    abstract::The sequelae of disk degeneration are among the leading causes of functional incapacity in both sexes and are a common source of chronic disability in the working years. Disk degeneration involves structural disruption and cell-mediated changes in composition. Mechanical, traumatic, nutritional, and genetic factors al...

    journal_title:Radiology

    pub_type: 杂志文章,评审

    doi:10.1148/radiol.2451051706

    authors: Modic MT,Ross JS

    更新日期:2007-10-01 00:00:00

  • Inflammatory fibroid polyp of the colon simulating malignancy.

    abstract::The authors report an inflammatory fibroid polyp of the colon which simulated a tumor on the air-contrast barium-enema examination. Histological evaluation revealed the inflammatory nature of the polyp. These rare lesions can be radiographically indistinguishable from primary colon carcinoma. ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.149.1.6611950

    authors: Ferin P,Skucas J

    更新日期:1983-10-01 00:00:00

  • Superior mesenteric artery embolization: an angiographic emergency.

    abstract::Eleven cases of superior mesenteric artery embolization are presented. The extent of bowel necrosis was found to be related to two major factors: the site of occlusion and the elapsed time between the onset of symptoms and definitive therapy. Angiography, available on an emergency basis, provides a definitive diagnosi...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/124.3.625

    authors: Kaufman SL,Harrington DP,Siegelman SS

    更新日期:1977-09-01 00:00:00

  • Focal cortical dysplasia: appearance on MR images.

    abstract:PURPOSE:To clarify the magnetic resonance (MR) imaging characteristics of focal cortical dysplasia (FCD). MATERIALS AND METHODS:The authors reviewed the MR images of 14 patients with FCD, which was confirmed with histologic examination. RESULTS:MR images exhibited FCD in 13 of the 14 patients. All lesions were locali...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.203.2.9114120

    authors: Yagishita A,Arai N,Maehara T,Shimizu H,Tokumaru AM,Oda M

    更新日期:1997-05-01 00:00:00

  • Duplication of the müllerian ducts and genitourinary malformations. Part II: analysis of malformations.

    abstract::Forty-seven females with duplication of the uterus and cervix were retrospectively studied to obtain a better understanding of the reasons for failure of fusion of the müllerian ducts by analyzing the associated genitourinary malformations. Thirty-one of the 47 patients had major genitourinary malformations that corre...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.144.4.6213980

    authors: Gilsanz V,Cleveland RH,Reid BS

    更新日期:1982-09-01 00:00:00

  • Cystic fibrosis: detecting changes in airway inflammation with FDG PET/CT.

    abstract:PURPOSE:To determine if fluorine 18 fluorodeoxyglucose (FDG) positron emission tomographic (PET)/computed tomographic (CT) imaging can depict a treatment effect from intravenous antibiotics for pulmonary exacerbation in cystic fibrosis (CF). MATERIALS AND METHODS:The study was approved by the institutional review boar...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.12111873

    authors: Amin R,Charron M,Grinblat L,Shammas A,Grasemann H,Graniel K,Ciet P,Tiddens H,Ratjen F

    更新日期:2012-09-01 00:00:00

  • Use of I-131 labeled, murine Fab against a high molecular weight antigen of human melanoma: preliminary experience.

    abstract::High molecular weight antigen (HMWA) is a tumor-associated proteoglycan of human malignant melanoma. I-131 labeled Fab fragments of these specific antibodies were used for preliminary feasibility studies for radioimmunodetection and therapy of human subjects who had inoperable metastatic melanoma. Ten patients receive...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.155.2.3983400

    authors: Larson SM,Carrasquillo JA,McGuffin RW,Krohn KA,Ferens JM,Hill LD,Beaumier PL,Reynolds JC,Hellström KE,Hellström I

    更新日期:1985-05-01 00:00:00

  • Hyperintense dentate nucleus on unenhanced T1-weighted MR images is associated with a history of brain irradiation.

    abstract:PURPOSE:To assess the frequency of hyperintensity in the dentate nucleus on T1-weighted magnetic resonance (MR) images and to establish correlations between such hyperintensity and clinical factors, including a history of brain irradiation. MATERIALS AND METHODS:This study was approved by the institutional review boar...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.10100508

    authors: Kasahara S,Miki Y,Kanagaki M,Yamamoto A,Mori N,Sawada T,Taoka T,Okada T,Togashi K

    更新日期:2011-01-01 00:00:00

  • Intracortical fissuring in osteomyelitis.

    abstract::Cortical fissuring, a well-recognized radiographic sign of osteomyelitis, represents spread of infection through the haversian system with osteoclastic bone resorption. In the proper clinical setting this finding may be recognized before there is other evidence of bone destruction or periosteal reaction. Three cases a...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.141.1.7027310

    authors: Rosen RA,Morehouse HT,Karp HJ,Yu GS

    更新日期:1981-10-01 00:00:00

  • Developmental Hip Dysplasia Diagnosis at Three-dimensional US: A Multicenter Study.

    abstract::Purpose To validate accuracy of diagnosis of developmental dysplasia of the hip (DDH) from geometric properties of acetabular shape extracted from three-dimensional (3D) ultrasonography (US). Materials and Methods In this retrospective multi-institutional study, 3D US was added to conventional two-dimensional (2D) US ...

    journal_title:Radiology

    pub_type: 杂志文章,多中心研究

    doi:10.1148/radiol.2018172592

    authors: Zonoobi D,Hareendranathan A,Mostofi E,Mabee M,Pasha S,Cobzas D,Rao P,Dulai SK,Kapur J,Jaremko JL

    更新日期:2018-06-01 00:00:00

  • Endometrial Carcinoma: MR Imaging-based Texture Model for Preoperative Risk Stratification-A Preliminary Analysis.

    abstract::Purpose To evaluate the associations among mathematical modeling with the use of magnetic resonance (MR) imaging-based texture features and deep myometrial invasion (DMI), lymphovascular space invasion (LVSI), and histologic high-grade endometrial carcinoma. Materials and Methods Institutional review board approval wa...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2017161950

    authors: Ueno Y,Forghani B,Forghani R,Dohan A,Zeng XZ,Chamming's F,Arseneau J,Fu L,Gilbert L,Gallix B,Reinhold C

    更新日期:2017-09-01 00:00:00