Abstract:
:BackgroundThe performance of a deep learning (DL) algorithm should be validated in actual clinical situations, before its clinical implementation.PurposeTo evaluate the performance of a DL algorithm for identifying chest radiographs with clinically relevant abnormalities in the emergency department (ED) setting.Materials and MethodsThis single-center retrospective study included consecutive patients who visited the ED and underwent initial chest radiography between January 1 and March 31, 2017. Chest radiographs were analyzed with a commercially available DL algorithm. The performance of the algorithm was evaluated by determining the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity at predefined operating cutoffs (high-sensitivity and high-specificity cutoffs). The sensitivities and specificities of the algorithm were compared with those of the on-call radiology residents who interpreted the chest radiographs in the actual practice by using McNemar tests. If there were discordant findings between the algorithm and resident, the residents reinterpreted the chest radiographs by using the algorithm's output.ResultsA total of 1135 patients (mean age, 53 years ± 18; 582 men) were evaluated. In the identification of abnormal chest radiographs, the algorithm showed an AUC of 0.95 (95% confidence interval [CI]: 0.93, 0.96), a sensitivity of 88.7% (227 of 256 radiographs; 95% CI: 84.1%, 92.3%), and a specificity of 69.6% (612 of 879 radiographs; 95% CI: 66.5%, 72.7%) at the high-sensitivity cutoff and a sensitivity of 81.6% (209 of 256 radiographs; 95% CI: 76.3%, 86.2%) and specificity of 90.3% (794 of 879 radiographs; 95% CI: 88.2%, 92.2%) at the high-specificity cutoff. Radiology residents showed lower sensitivity (65.6% [168 of 256 radiographs; 95% CI: 59.5%, 71.4%], P < .001) and higher specificity (98.1% [862 of 879 radiographs; 95% CI: 96.9%, 98.9%], P < .001) compared with the algorithm. After reinterpretation of chest radiographs with use of the algorithm's outputs, the sensitivity of the residents improved (73.4% [188 of 256 radiographs; 95% CI: 68.0%, 78.8%], P = .003), whereas specificity was reduced (94.3% [829 of 879 radiographs; 95% CI: 92.8%, 95.8%], P < .001).ConclusionA deep learning algorithm used with emergency department chest radiographs showed diagnostic performance for identifying clinically relevant abnormalities and helped improve the sensitivity of radiology residents' evaluation.Published under a CC BY 4.0 license.Online supplemental material is available for this article.See also the editorial by Munera and Infante in this issue.
journal_name
Radiologyjournal_title
Radiologyauthors
Hwang EJ,Nam JG,Lim WH,Park SJ,Jeong YS,Kang JH,Hong EK,Kim TM,Goo JM,Park S,Kim KH,Park CMdoi
10.1148/radiol.2019191225subject
Has Abstractpub_date
2019-12-01 00:00:00pages
573-580issue
3eissn
0033-8419issn
1527-1315journal_volume
293pub_type
杂志文章相关文献
RADIOLOGY文献大全abstract::An aluminum step-wedge filter placed far from the film cassette provides the constant variation of subject contrast required for quantitative sensitometry while virtually eliminating scatter radiations. Attenuation curves made with this configuration are almost exponentially linear. ...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/128.3.820
更新日期:1978-09-01 00:00:00
abstract::Eighteen patients with cervical radiculopathy were entered into a prospective study to compare the accuracy of surface coil magnetic resonance (MR) imaging with that of metrizamide myelography and computed tomography (CT) with metrizamide. All MR studies included tailored axial and oblique images as well as routine sa...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.163.1.3823440
更新日期:1987-04-01 00:00:00
abstract::Formal ethical approval was granted by the local research ethics committee; all participants gave written consent. The purpose of the study was to prospectively evaluate the feasibility of a noninvasive method of breast tumor localization in 25 participants, based on the coregistration of three-dimensional (3D) ultras...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.2452060906
更新日期:2007-11-01 00:00:00
abstract::Vaginal agenesis was studied by magnetic resonance (MR) imaging lin a 15-year-old girl, a 19-year-old woman, and a 21-year-old woman. In each case MR studies demonstrated the presence or absence of a normal cervix and functioning endometrium. This information was useful in planning surgical management. MR imaging assi...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.162.3.3809480
更新日期:1987-03-01 00:00:00
abstract:PURPOSE:To assess forced-expiratory bronchial collapsibility in healthy volunteers by using multidetector computed tomography (CT) and to compare the results with the current diagnostic criterion for bronchomalacia. MATERIALS AND METHODS:The institutional review board approved this HIPAA-compliant study. Following inf...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.10100219
更新日期:2010-11-01 00:00:00
abstract::Laboratory tests that are commonly used in the evaluation of rheumatic diseases are described. The techniques for performing these tests; their use in screening, diagnosis, and follow-up; and the pitfalls in interpreting their results are discussed to provide the radiologist with an understanding of the current techno...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.139.3.6972050
更新日期:1981-06-01 00:00:00
abstract:PURPOSE:To prospectively identify brain regions in which task-related changes in activation during a memory encoding task, measured with functional magnetic resonance (MR) imaging, correlate with degree of memory impairment across Alzheimer disease (AD), mild cognitive impairment (MCI), and elderly control subjects. M...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.2451061847
更新日期:2007-10-01 00:00:00
abstract::A neural network model was constructed to interpret ventilation-perfusion (V/Q) lung scans. This model was trained with data from 100 consecutive V/Q scans with pulmonary angiographic correlation. The network was constructed from 28 input parameters that described various standard V/Q findings, which were fed into a s...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.186.3.8430170
更新日期:1993-03-01 00:00:00
abstract:PURPOSE:To investigate whether the presence or absence of gas in the appendix may be considered as additional ultrasonographic (US) criteria to rule out or confirm acute appendicitis. MATERIALS AND METHODS:The appendices in 239 control subjects, 138 patients with lower right quadrant pain without acute appendicitis, a...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.214.1.r00ja20183
更新日期:2000-01-01 00:00:00
abstract::Nonselective arterial digital arteriography (NSADA), selective parathyroid arteriography (SPA), and venous digital arteriography (VDA) were compared as methods of detecting parathyroid enlargement in 14 patients with primary hyperparathyroidism undergoing preoperative localization following unsuccessful neck surgery. ...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.148.1.6134300
更新日期:1983-07-01 00:00:00
abstract::The authors designed and built an overlapping surface coil assembly for magnetic resonance imaging of the spine. A small and a large coil are included, and use of one can be switched to the other without need for patient repositioning. The images are not degraded, and screening studies can immediately be followed by d...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.164.3.3615890
更新日期:1987-09-01 00:00:00
abstract::Stitch granuloma is rarely a consideration in the differential diagnosis of stomach lesions. This report documents the occurrence of a granulomatous mass of gastric origin simulating an intramural tumor. ...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/127.1.84
更新日期:1978-04-01 00:00:00
abstract::Anti-scatter grids reduce the amount of secondary radiation contributing to the image and improve the signal-to-noise ratio. However, they may also lead to the creation of linear artifacts representing the shadows of the radiopaque septa. Grid motion perpendicular to the septa during the exposure can cause blurring of...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.147.1.6828740
更新日期:1983-04-01 00:00:00
abstract::Ioglucomide, a new iodinated nonionic contrast medium directed primarily toward myelographic use, was subjected to an extensive toxicological examination in animals. In the majority of studies, ioglucomide was compared directly with metrizamide. In some respects, including freedom from production of arachnoiditis, iog...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.140.3.7280240
更新日期:1981-09-01 00:00:00
abstract:PURPOSE:To test a biopsy needle modified for use of radio-frequency (RF) energy to produce hemostasis after core biopsy of liver or kidney. MATERIALS AND METHODS:RF energy was applied to a partially insulated 17-gauge needle, and tip temperature was monitored with a thermocouple. Domestic Yorkshire pigs (n = 4; mean w...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.2272020173
更新日期:2003-05-01 00:00:00
abstract::Between the portal vein and the inferior vena cava lies a small space that may be occupied by multiple anatomic structures including the caudate and papillary processes of the caudate lobe of the liver, portacaval lymph nodes, replaced or accessory right hepatic arteries, posterosuperior pancreaticoduodenal vessels, t...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.156.2.4011910
更新日期:1985-08-01 00:00:00
abstract:PURPOSE:To evaluate the accuracy of positron emission tomography (PET) with 2-deoxy-2-[fluorine-18] fluoro-D-glucose (FDG) in the detection of osseous and soft-tissue metastases of prostate cancer. MATERIALS AND METHODS:Thirty-four patients (mean age, 71 years) with biopsy-proved prostate cancer and known or suspected...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.199.3.8638000
更新日期:1996-06-01 00:00:00
abstract::A retrospective review of 20 cases of endoprosthesis occlusion in 17 patients was performed. The average length of stent patency before occlusion was 3.7 months. Clinical manifestations included one or a combination of the following: cholangitis (n = 17), jaundice (n = 9), and leakage of bile or purulent material from...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.176.2.2367670
更新日期:1990-08-01 00:00:00
abstract:PURPOSE:To compare two different three-dimensional (3D) gadolinium-enhanced magnetic resonance (MR) angiographic techniques. MATERIALS AND METHODS:In 26 patients suspected of having renal artery stenosis, results with fast multiphase 3D MR angiography were compared to those with standard 3D MR angiography in 37 patien...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.211.3.r99jn26667
更新日期:1999-06-01 00:00:00
abstract::The sequelae of disk degeneration are among the leading causes of functional incapacity in both sexes and are a common source of chronic disability in the working years. Disk degeneration involves structural disruption and cell-mediated changes in composition. Mechanical, traumatic, nutritional, and genetic factors al...
journal_title:Radiology
pub_type: 杂志文章,评审
doi:10.1148/radiol.2451051706
更新日期:2007-10-01 00:00:00
abstract::The authors report an inflammatory fibroid polyp of the colon which simulated a tumor on the air-contrast barium-enema examination. Histological evaluation revealed the inflammatory nature of the polyp. These rare lesions can be radiographically indistinguishable from primary colon carcinoma. ...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.149.1.6611950
更新日期:1983-10-01 00:00:00
abstract::Eleven cases of superior mesenteric artery embolization are presented. The extent of bowel necrosis was found to be related to two major factors: the site of occlusion and the elapsed time between the onset of symptoms and definitive therapy. Angiography, available on an emergency basis, provides a definitive diagnosi...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/124.3.625
更新日期:1977-09-01 00:00:00
abstract:PURPOSE:To clarify the magnetic resonance (MR) imaging characteristics of focal cortical dysplasia (FCD). MATERIALS AND METHODS:The authors reviewed the MR images of 14 patients with FCD, which was confirmed with histologic examination. RESULTS:MR images exhibited FCD in 13 of the 14 patients. All lesions were locali...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.203.2.9114120
更新日期:1997-05-01 00:00:00
abstract::Forty-seven females with duplication of the uterus and cervix were retrospectively studied to obtain a better understanding of the reasons for failure of fusion of the müllerian ducts by analyzing the associated genitourinary malformations. Thirty-one of the 47 patients had major genitourinary malformations that corre...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.144.4.6213980
更新日期:1982-09-01 00:00:00
abstract:PURPOSE:To determine if fluorine 18 fluorodeoxyglucose (FDG) positron emission tomographic (PET)/computed tomographic (CT) imaging can depict a treatment effect from intravenous antibiotics for pulmonary exacerbation in cystic fibrosis (CF). MATERIALS AND METHODS:The study was approved by the institutional review boar...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.12111873
更新日期:2012-09-01 00:00:00
abstract::High molecular weight antigen (HMWA) is a tumor-associated proteoglycan of human malignant melanoma. I-131 labeled Fab fragments of these specific antibodies were used for preliminary feasibility studies for radioimmunodetection and therapy of human subjects who had inoperable metastatic melanoma. Ten patients receive...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.155.2.3983400
更新日期:1985-05-01 00:00:00
abstract:PURPOSE:To assess the frequency of hyperintensity in the dentate nucleus on T1-weighted magnetic resonance (MR) images and to establish correlations between such hyperintensity and clinical factors, including a history of brain irradiation. MATERIALS AND METHODS:This study was approved by the institutional review boar...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.10100508
更新日期:2011-01-01 00:00:00
abstract::Cortical fissuring, a well-recognized radiographic sign of osteomyelitis, represents spread of infection through the haversian system with osteoclastic bone resorption. In the proper clinical setting this finding may be recognized before there is other evidence of bone destruction or periosteal reaction. Three cases a...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiology.141.1.7027310
更新日期:1981-10-01 00:00:00
abstract::Purpose To validate accuracy of diagnosis of developmental dysplasia of the hip (DDH) from geometric properties of acetabular shape extracted from three-dimensional (3D) ultrasonography (US). Materials and Methods In this retrospective multi-institutional study, 3D US was added to conventional two-dimensional (2D) US ...
journal_title:Radiology
pub_type: 杂志文章,多中心研究
doi:10.1148/radiol.2018172592
更新日期:2018-06-01 00:00:00
abstract::Purpose To evaluate the associations among mathematical modeling with the use of magnetic resonance (MR) imaging-based texture features and deep myometrial invasion (DMI), lymphovascular space invasion (LVSI), and histologic high-grade endometrial carcinoma. Materials and Methods Institutional review board approval wa...
journal_title:Radiology
pub_type: 杂志文章
doi:10.1148/radiol.2017161950
更新日期:2017-09-01 00:00:00