The RSNA Pediatric Bone Age Machine Learning Challenge.

Abstract:

:Purpose The Radiological Society of North America (RSNA) Pediatric Bone Age Machine Learning Challenge was created to show an application of machine learning (ML) and artificial intelligence (AI) in medical imaging, promote collaboration to catalyze AI model creation, and identify innovators in medical imaging. Materials and Methods The goal of this challenge was to solicit individuals and teams to create an algorithm or model using ML techniques that would accurately determine skeletal age in a curated data set of pediatric hand radiographs. The primary evaluation measure was the mean absolute distance (MAD) in months, which was calculated as the mean of the absolute values of the difference between the model estimates and those of the reference standard, bone age. Results A data set consisting of 14 236 hand radiographs (12 611 training set, 1425 validation set, 200 test set) was made available to registered challenge participants. A total of 260 individuals or teams registered on the Challenge website. A total of 105 submissions were uploaded from 48 unique users during the training, validation, and test phases. Almost all methods used deep neural network techniques based on one or more convolutional neural networks (CNNs). The best five results based on MAD were 4.2, 4.4, 4.4, 4.5, and 4.5 months, respectively. Conclusion The RSNA Pediatric Bone Age Machine Learning Challenge showed how a coordinated approach to solving a medical imaging problem can be successfully conducted. Future ML challenges will catalyze collaboration and development of ML tools and methods that can potentially improve diagnostic accuracy and patient care. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by Siegel in this issue.

journal_name

Radiology

journal_title

Radiology

authors

Halabi SS,Prevedello LM,Kalpathy-Cramer J,Mamonov AB,Bilbily A,Cicero M,Pan I,Pereira LA,Sousa RT,Abdala N,Kitamura FC,Thodberg HH,Chen L,Shih G,Andriole K,Kohli MD,Erickson BJ,Flanders AE

doi

10.1148/radiol.2018180736

subject

Has Abstract

pub_date

2019-02-01 00:00:00

pages

498-503

issue

2

eissn

0033-8419

issn

1527-1315

journal_volume

290

pub_type

杂志文章
  • Depiction of transplant renal vascular anatomy and complications: unenhanced MR angiography by using spatial labeling with multiple inversion pulses.

    abstract:PURPOSE:To evaluate the ability to depict anatomy and complications of renal vascular transplant with unenhanced magnetic resonance (MR) angiography with spatial labeling with multiple inversion pulses (SLEEK) and to compare the results with color Doppler (CD) ultrasonography (US), digital subtraction angiography (DSA)...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.14131800

    authors: Tang H,Wang Z,Wang L,Hu X,Wang Q,Li Z,Li J,Meng X,Wang Y,Hu D

    更新日期:2014-06-01 00:00:00

  • Breast MR imaging: computer-aided evaluation program for discriminating benign from malignant lesions.

    abstract:PURPOSE:To retrospectively determine the sensitivity of kinetic features measured with computer-aided evaluation at breast magnetic resonance (MR) imaging in discriminating benign from malignant lesions, with histopathologic findings used as the reference standard. MATERIALS AND METHODS:Institutional review board appr...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2441060634

    authors: Williams TC,DeMartini WB,Partridge SC,Peacock S,Lehman CD

    更新日期:2007-07-01 00:00:00

  • Spinal arteriovenous malformation: evaluation of change in venous oxygenation with susceptibility-weighted MR imaging after treatment.

    abstract:PURPOSE:To evaluate the efficacy of susceptibility-weighted (SW) magnetic resonance (MR) imaging for the assessment of the posttreatment change in oxygen saturation in the draining vein in patients with spinal arteriovenous malformation (AVM). MATERIALS AND METHODS:The study protocol was approved by the institutional ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.09090286

    authors: Fujima N,Kudo K,Terae S,Hida K,Ishizaka K,Zaitsu Y,Asano T,Yoshida D,Tha KK,Haacke EM,Sasaki M,Shirato H

    更新日期:2010-03-01 00:00:00

  • Criteria for classifying normal and degenerated lumbar intervertebral disks.

    abstract::The purpose of this study was to develop criteria for distinguishing normal and degenerated lumbar intervertebral disks. Cryomicrotome sections from and magnetic resonance images of 31 cadavers were reviewed. The immature nucleus pulposus, found up to age 2 years; the transitional nucleus pulposus, found in teenagers;...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.170.2.2911680

    authors: Yu S,Haughton VM,Sether LA,Ho KC,Wagner M

    更新日期:1989-02-01 00:00:00

  • Detection of biliary duct narrowing and choledocholithiasis: accuracy of portal venous phase multidetector CT.

    abstract:PURPOSE:To retrospectively evaluate the sensitivity and specificity of 64-detector computed tomography (CT) in the portal venous phase by using transverse images and both multiplanar and minimum intensity reformations for the detection of biliary duct narrowing and choledocholithiasis, with magnetic resonance cholangio...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2472070473

    authors: Anderson SW,Rho E,Soto JA

    更新日期:2008-05-01 00:00:00

  • Diffusion-tensor MR imaging and tractography: exploring brain microstructure and connectivity.

    abstract::Diffusion magnetic resonance (MR) imaging is evolving into a potent tool in the examination of the central nervous system. Although it is often used for the detection of acute ischemia, evaluation of directionality in a diffusion measurement can be useful in white matter, which demonstrates strong diffusion anisotropy...

    journal_title:Radiology

    pub_type: 杂志文章,评审

    doi:10.1148/radiol.2452060445

    authors: Nucifora PG,Verma R,Lee SK,Melhem ER

    更新日期:2007-11-01 00:00:00

  • Acute flank pain: comparison of non-contrast-enhanced CT and intravenous urography.

    abstract:PURPOSE:To compare non-contrast-enhanced computed tomography (CT) and intravenous urography (IVU) in the evaluation of patients who present with acute flank pain and in whom ureteric obstruction is suspected. MATERIALS AND METHODS:The findings at non-contrast-enhanced CT and IVU in 20 patients with acute flank pain we...

    journal_title:Radiology

    pub_type: 临床试验,杂志文章

    doi:10.1148/radiology.194.3.7862980

    authors: Smith RC,Rosenfield AT,Choe KA,Essenmacher KR,Verga M,Glickman MG,Lange RC

    更新日期:1995-03-01 00:00:00

  • Respiratory effects in two-dimensional Fourier transform MR imaging.

    abstract::Respiratory and other regular motions during two-dimensional Fourier transform magnetic resonance imaging produce image artifacts consisting of local blurring and more or less regularly spaced "ghost" images propagating along the direction of the phase-encoding magnetic field gradient. The patterns of these ghost arti...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.160.3.3737920

    authors: Axel L,Summers RM,Kressel HY,Charles C

    更新日期:1986-09-01 00:00:00

  • Arteriovenous Fistula Development in the First 6 Weeks after Creation.

    abstract:PURPOSE:To assess the anatomic development of native arteriovenous fistula (AVF) during the first 6 weeks after creation by using ultrasonographic (US) measurements in a multicenter hemodialysis fistula maturation study. MATERIALS AND METHODS:Each institutional review board approved the prospective study protocol, and...

    journal_title:Radiology

    pub_type: 杂志文章,多中心研究

    doi:10.1148/radiol.2015150385

    authors: Robbin ML,Greene T,Cheung AK,Allon M,Berceli SA,Kaufman JS,Allen M,Imrey PB,Radeva MK,Shiu YT,Umphrey HR,Young CJ,Hemodialysis Fistula Maturation Study Group.

    更新日期:2016-05-01 00:00:00

  • Radionuclide studies of chronic schistosomal uropathy.

    abstract::Fifty patients with chronic urinary tract schistosomiasis were studied with 99mTc-DTPA. All had a flow study, sequential analog imaging, and digital imaging for 25-35 minutes (20-sec. frames). Time-activity curves (DTPA renograms) were extracted; 12 patients had 131I-Hippuran probe renograms as well. Renal changes inc...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.140.2.7019960

    authors: Lamki LM,Lamki N

    更新日期:1981-08-01 00:00:00

  • Laparoscopic gray-scale and color Doppler US: preliminary animal and clinical studies.

    abstract:PURPOSE:To evaluate a semiflexible ultrasound (US) transducer inserted through a laparoscopic port to image abdominal structures. MATERIALS AND METHODS:Laparoscopic US with a 9.6-mm-diameter, 5.0-7.5-MHz semiflexible transducer with gray-scale, color, and spectral Doppler capabilities was performed in three miniature ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.194.3.7862990

    authors: Liu JB,Feld RI,Goldberg BB,Barbot DJ,Nazarian LN,Merton DA,Rawool NM,Rosato FE,Winkel CA,Gillum DR

    更新日期:1995-03-01 00:00:00

  • Focal cortical dysplasia: appearance on MR images.

    abstract:PURPOSE:To clarify the magnetic resonance (MR) imaging characteristics of focal cortical dysplasia (FCD). MATERIALS AND METHODS:The authors reviewed the MR images of 14 patients with FCD, which was confirmed with histologic examination. RESULTS:MR images exhibited FCD in 13 of the 14 patients. All lesions were locali...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.203.2.9114120

    authors: Yagishita A,Arai N,Maehara T,Shimizu H,Tokumaru AM,Oda M

    更新日期:1997-05-01 00:00:00

  • Case 281: Thoracic Air Leak Syndrome in a Patient with Hematopoietic Stem Cell Transplantation and Graft-versus-Host Disease.

    abstract::HistoryAn 18-year-old man was diagnosed with precursor B-cell lymphoblastic leukemia and underwent transplantation of hematopoietic stem cells from his human leukocyte antigen-matched sister 1 year prior to admission. He was admitted to evaluate progressive shortness of breath and dry cough of 1-month duration. He did...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2020182477

    authors: Khoshbin AP,Aliannejad R

    更新日期:2020-09-01 00:00:00

  • BRCA Mutation Carriers: Breast and Ovarian Cancer Screening Guidelines and Imaging Considerations.

    abstract::Patients who carry the BRCA1 and BRCA2 gene mutations have an underlying genetic predisposition for breast and ovarian cancers. These deleterious genetic mutations are the most common genes implicated in hereditary breast and ovarian cancers. This monograph summarizes the evidence behind current screening recommendati...

    journal_title:Radiology

    pub_type: 杂志文章,评审

    doi:10.1148/radiol.2019181814

    authors: Elezaby M,Lees B,Maturen KE,Barroilhet L,Wisinski KB,Schrager S,Wilke LG,Sadowski E

    更新日期:2019-06-01 00:00:00

  • Volume detection threshold: quantitative comparison of computed radiography and screen-film radiography in detection of pneumothoraces in an animal model that simulates the neonate.

    abstract:PURPOSE:To quantitatively compare computed radiography (CR) and screen-film radiography (SFR) in the detection of pneumothorax in an animal model that simulates the neonate. MATERIALS AND METHODS:Three rabbits underwent placement of 5-F catheters in the right pleural space. Eight CR and eight SFR images were obtained....

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.194.3.7862970

    authors: Don S,Cohen MD,Kruger RA,Winkler TA,Katz BP,Li W,Dreesen RG,Kennan N,Tarver R,Klatte EC

    更新日期:1995-03-01 00:00:00

  • Biliary atresia and noncardiac polysplenic syndrome: US and surgical considerations.

    abstract::Ten percent of children with biliary atresia have an associated complex of anomalies, including polysplenia, azygous continuation of the inferior vena cava, preduodenal portal vein, hepatic arterial anomalies, and bilaterally bilobed lungs. These abnormalities will not be detected if the preoperative workup is limited...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.163.2.3550880

    authors: Abramson SJ,Berdon WE,Altman RP,Amodio JB,Levy J

    更新日期:1987-05-01 00:00:00

  • Pneumonia caused by Pittsburgh pneumonia agent: radiologic manifestations.

    abstract::Using an objective scoring system, chest radiographs were reviewed in 23 cases of pneumonia due to the Pittsburgh pneumonia agent (PPA, Tatlockia micdadei, Legionella micdadei), including six cases of pneumonia with simultaneous isolation of PPA and L pneumophila (Legionnaires' disease). Infiltrates were typically seg...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.150.3.6695060

    authors: Muder RR,Reddy SC,Yu VL,Kroboth FJ

    更新日期:1984-03-01 00:00:00

  • Acute peripheral arterial occlusion: predictors of success in catheter-directed thrombolytic therapy.

    abstract:PURPOSE:To determine predictors of clot dissolution in patients undergoing catheter-directed urokinase thrombolysis for peripheral arterial occlusion (PAO). MATERIALS AND METHODS:The study included 103 patients with limb-threatening symptoms of embolism lasting 14 days or less and resulting from embolism (n = 20) or t...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.193.2.7972780

    authors: Ouriel K,Shortell CK,Azodo MV,Guiterrez OH,Marder VJ

    更新日期:1994-11-01 00:00:00

  • The natural history of the double pylorus.

    abstract::A study of 11 patients with "double pylorus" revealed that a second channel between the gastric antrum and the duodenal bulb is the result of ulcer penetration. The fistula can be a sign of spontaneous recovery from ulcerative disease; the fistula occurred in conjunction with clinical improvement in the majority of th...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/126.1.29

    authors: Hegedus V,Poulsen PE,Reichardt J

    更新日期:1978-01-01 00:00:00

  • Pheochromocytomas: detection with 18F DOPA whole body PET--initial results..

    abstract:PURPOSE:To evaluate fluorine 18 ((18)F) dihydroxyphenylalanine (DOPA) whole-body positron emission tomography (PET) as a biochemical imaging approach for detection of pheochromocytomas. MATERIALS AND METHODS:(18)F DOPA PET and magnetic resonance (MR) imaging were performed in 14 consecutive patients suspected of havin...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2222010622

    authors: Hoegerle S,Nitzsche E,Altehoefer C,Ghanem N,Manz T,Brink I,Reincke M,Moser E,Neumann HP

    更新日期:2002-02-01 00:00:00

  • Improved MR venography: use of fast short inversion time inversion-recovery technique in evaluation of venous angiomas.

    abstract::Eleven patients (five female and six male, aged 6-67 years) with venous angiomas underwent axial and coronal T1-weighted and fast short inversion time inversion-recovery (STIR) magnetic resonance (MR) imaging to assess the full extent of the malformations. Images were assessed subjectively by the authors in a nonblind...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.194.3.7863000

    authors: Saks AM,Paterson FC,Irvine AT,Ayers BA,Burnand KG

    更新日期:1995-03-01 00:00:00

  • Complementary role of Tc-99m-diethyl-IDA and ultrasound in large and small duct biliary tract obstruction.

    abstract::Fifty-one patients underwent both radionuclide and ultrasound studies of the hepatobiliary system. Eleven patients had large bile duct obstruction, six had intrahepatic diffuse small duct obstruction, and 37 had no obstruction. In all 11 patients with large duct obstruction, the radionuclide images were abnormal, but ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.138.1.7455080

    authors: Klingensmith WC 3rd,Johnson ML,Kuni CC,Dunne MG,Fritzberg AR

    更新日期:1981-01-01 00:00:00

  • Intrahepatic amebic abscesses: indications for and results of percutaneous catheter drainage.

    abstract::Medical therapy is standard for intrahepatic amebic abscess and generally is effective. However, we have encountered a group of patients in whom percutaneous aspiration and drainage was indicated due to uncertainty of diagnosis or clinical deterioration of the patient. Twenty such patients underwent percutaneous drain...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.156.3.4023220

    authors: vanSonnenberg E,Mueller PR,Schiffman HR,Ferrucci JT Jr,Casola G,Simeone JF,Cabrera OA,Gosink BB

    更新日期:1985-09-01 00:00:00

  • The selection, acceptance testing, and quality control of radiotherapy treatment simulators.

    abstract::The critical aspects of selection, acceptance testing, and quality control of a radiotherapy treatment simulator are discussed. The selection of a simulator involves consideration of: (a) motions and readouts, (b) safety features, (c) x-ray and imaging systems, and (d) mechanical tolerances (including guarantees). Whe...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/131.1.221

    authors: McCullough EC,Earle JD

    更新日期:1979-04-01 00:00:00

  • Cerebral circulation after cardiac arrest. Angiographic and carbon black perfusion studies.

    abstract::Cardiac arrest of 2-15 minutes was induced in 14 dogs. When circulatory arrest lasted longer than 5 minutes, abnormal cerebral angiographic findings were seen 3-4 hours after resuscitation, consisting of (a) marked prolongation of the arterial phase in both intracranial and extracranial arteries, and (b) faint (poor) ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/117.3.627

    authors: Lin SR

    更新日期:1975-12-01 00:00:00

  • Atraumatic evaluation of myocardial revascularization procedures with 43K1.

    abstract::Least-squares regression analysis was computerized to provide functional color images of myocardial perfusion patterns. In 8 of the 9 patients studied, changes in pattern indicated that the revascularization procedure speeded the appearance time and/or net rate of 43K uptake. The functional images correlated well with...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/114.1.99

    authors: Smith RO,Bennett KR,Suzuki A,Lehan PH,Hellems HK

    更新日期:1975-01-01 00:00:00

  • Stereotaxic fine-needle aspiration of low-suspicion, nonpalpable breast nodules: valid alternative to follow-up mammography.

    abstract::Seventy "low-suspicion," nonpalpable solid breast nodules were evaluated with stereotaxic fine-needle aspiration with cytologic analysis as an alternative to follow-up mammography. Sonography was performed in all cases to determine the solid nature of the nodules. Eight cysts were incorrectly classified with sonograph...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.183.3.1584910

    authors: Franquet T,Cozcolluela R,De Miguel C

    更新日期:1992-06-01 00:00:00

  • Circumferential Thick Enhancement at Vessel Wall MRI Has High Specificity for Intracranial Aneurysm Instability.

    abstract::Purpose To identify wall enhancement patterns on vessel wall MRI that discriminate between stable and unstable unruptured intracranial aneurysm (UIA). Materials and Methods Patients were included from November 2012 through January 2016. Vessel wall MR images were acquired at 3 T in patients with stable (incidental and...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiol.2018172879

    authors: Edjlali M,Guédon A,Ben Hassen W,Boulouis G,Benzakoun J,Rodriguez-Régent C,Trystram D,Nataf F,Meder JF,Turski P,Oppenheim C,Naggara O

    更新日期:2018-10-01 00:00:00

  • Double-lumen central venous catheter for percutaneous ureteral perfusion studies.

    abstract::A commercially available double-lumen central venous catheter that can be inserted over a 0.018-inch guide wire was used for ureteral perfusion studies in three infants. Complications or difficulties were not encountered in any patients. This technique allows simultaneous monitoring of perfusion and intrarenal pressur...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/radiology.181.1.1887050

    authors: Diament MJ,Koenig JC Jr

    更新日期:1991-10-01 00:00:00

  • The radiological investigation of hepatic tumors in childhood.

    abstract::In hepatic tumors seen in children, treatment and prognosis differ from tumor to tumor and thus accurate determination of their extent and characteristics is important. Evaluation by gray scale ultrasonography, radionuclide imaging and angiography has produced definable characteristics for the various tumor types and ...

    journal_title:Radiology

    pub_type: 杂志文章

    doi:10.1148/124.2.451

    authors: Miller JH,Gates GF,Stanley P

    更新日期:1977-08-01 00:00:00