Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery using Diffusion Tractography and Convolutional Neural Networks.

Abstract:

:Convolutional neural networks (CNNs) have recently been used in biomedical imaging applications with great success. In this paper, we investigated the classi?cation performance of CNN models on diffusion weighted imaging (DWI) streamlines de?ned by functional MRI (fMRI) and electrical stimulation mapping (ESM). To learn a set of discriminative and interpretable features from the extremely unbalanced dataset, we evaluated different CNN architectures with multiple loss functions (e.g., focal loss and center loss) and a soft attention mechanism, and compared our models with current state-ofthe-art methods. Through extensive experiments on streamlines collected from 70 healthy children and 70 children with focal epilepsy, we demonstrated that our deep CNN model with focal and central losses and soft attention outperforms all existing models in the literature and provides clinically acceptable accuracy (73 -100%) for the objective detection of functionally-important white matter pathways including ESM determined eloquent areas such as primary motor, aphasia, speech arrest, auditory, and visual functions. The ?ndings of this study encourage further investigations to determine if DWICNN analysis can serve as a noninvasive diagnostic tool during pediatric presurgical planning by estimating not only the location of essential cortices at the gyral level, but also the underlying ?bers connecting these cortical areas, to minimize or predict postsurgical functional de?cits. This study translates an advanced CNN model to clinical practice in the pediatric population where currently available approaches (e.g., ESM, fMRI) are suboptimal. The implementation will be released at https://github. com/HaotianMXu/Brain-?ber-classi?cation-using-CNNs.

journal_name

IEEE Trans Med Imaging

authors

Xu H,Dong M,Lee MH,OrHara N,Asano E,Jeong JW

doi

10.1109/TMI.2019.2902073

subject

Has Abstract

pub_date

2019-02-27 00:00:00

eissn

0278-0062

issn

1558-254X

pub_type

杂志文章
  • Nonrigid image registration using conditional mutual information.

    abstract::Maximization of mutual information (MMI) is a popular similarity measure for medical image registration. Although its accuracy and robustness has been demonstrated for rigid body image registration, extending MMI to nonrigid image registration is not trivial and an active field of research. We propose conditional mutu...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2009.2021843

    authors: Loeckx D,Slagmolen P,Maes F,Vandermeulen D,Suetens P

    更新日期:2010-01-01 00:00:00

  • Simultaneous Photoacoustic Imaging and Cavitation Mapping in Shockwave Lithotripsy.

    abstract::Kidney stone disease is a major health problem worldwide. Shockwave lithotripsy (SWL), which uses high-energy shockwave pulses to break up kidney stones, is extensively used in clinic. However, despite its noninvasiveness, SWL can produce cavitation in vivo. The rapid expansion and violent collapse of cavitation bubbl...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2928740

    authors: Li M,Lan B,Sankin G,Zhou Y,Liu W,Xia J,Wang D,Trahey G,Zhong P,Yao J

    更新日期:2020-02-01 00:00:00

  • Standing-wave and RF penetration artifacts caused by elliptic geometry: an electrodynamic analysis of MRI.

    abstract::Motivated by the observation that the diagonal pattern of intensity nonuniformity usually associated with linearly polarized radio-frequency (RF) coils is often present in neurological scans using circularly polarized coils, a theoretical analysis has been conducted of the intensity nonuniformity inherent in imaging a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.730409

    authors: Sled JG,Pike GB

    更新日期:1998-08-01 00:00:00

  • Exact frequency-domain reconstruction for thermoacoustic tomography--II: Cylindrical geometry.

    abstract::Microwave-induced thermoacoustic tomography (TAT) in a cylindrical configuration is developed to image biological tissue. Thermoacoustic signals are acquired by scanning a flat ultrasonic transducer. Using a new expansion of a spherical wave in cylindrical coordinates, we apply the Fourier and Hankel transforms to TAT...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2002.801171

    authors: Xu Y,Xu M,Wang LV

    更新日期:2002-07-01 00:00:00

  • Improved intrinsic motion detection using time-of-flight PET.

    abstract::Intrinsic or data-driven respiratory and cardiac motion detection often track the center-of-mass (COM) change in PET data to derive a motion gating signal. The effectiveness of this method depends on the contrast of the moving target to the relatively stationary background. The stationary background leads to a reduced...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2423976

    authors: Xu J,Tsui BM

    更新日期:2015-10-01 00:00:00

  • Separation of Metabolites and Macromolecules for Short-TE 1H-MRSI Using Learned Component-Specific Representations.

    abstract::Short-echo-time (TE) proton magnetic resonance spectroscopic imaging (MRSI) allows for simultaneously mapping a number of molecules in the brain, and has been recognized as an important tool for studying in vivo biochemistry in various neuroscience and disease applications. However, separation of the metabolite and ma...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3048933

    authors: Li Y,Wang Z,Sun R,Lam F

    更新日期:2021-01-04 00:00:00

  • An image-guided planning system for endosseous oral implants.

    abstract::A preoperative planning system for oral implant surgery was developed which takes as input computed tomographies (CT's) of the jaws. Two-dimensional (2-D) reslices of these axial CT slices orthogonal to a curve following the jaw arch are computed and shown together with three-dimensional (3-D) surface rendered models ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.736056

    authors: Verstreken K,Van Cleynenbreugel J,Martens K,Marchal G,van Steenberghe D,Suetens P

    更新日期:1998-10-01 00:00:00

  • Probabilistic independent component analysis for functional magnetic resonance imaging.

    abstract::We present an integrated approach to probabilistic independent component analysis (ICA) for functional MRI (FMRI) data that allows for nonsquare mixing in the presence of Gaussian noise. In order to avoid overfitting, we employ objective estimation of the amount of Gaussian noise through Bayesian analysis of the true ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2003.822821

    authors: Beckmann CF,Smith SM

    更新日期:2004-02-01 00:00:00

  • A proof of the spherical homeomorphism conjecture for surfaces.

    abstract::The human cerebral cortex is topologically equivalent to a sphere when it is viewed as closed at the brain stem. Due to noise and/or resolution issues, magnetic resonance imaging may see "handles" that need to be eliminated to reflect the true spherical topology. Shattuck and Leahy present an algorithm to correct such...

    journal_title:IEEE transactions on medical imaging

    pub_type: 评论,信件

    doi:10.1109/TMI.2002.806590

    authors: Abrams L,Fishkind DE,Priebe CE

    更新日期:2002-12-01 00:00:00

  • Online Combination of EPID & Cherenkov Imaging for 3-D Dosimetry in a Liquid Phantom.

    abstract::Online acquisition of Cherenkov and portal imaging data was combined with a reconstruction scheme called EC3-D, providing a full 3-D dosimetry of megavoltage X-ray beams in a water tank. The methodology was demonstrated and quantified in a single static beam. Furthermore, the dynamics and visualization of the 3-D dose...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2717800

    authors: Bruza P,Andreozzi JM,Gladstone DJ,Jarvis LA,Rottmann J,Pogue BW

    更新日期:2017-10-01 00:00:00

  • A robust ultrashort TE (UTE) imaging method with corrected k-space trajectory by using parametric multiple function model of gradient waveform.

    abstract::Ultra-short TE (UTE) sequences with radial sampling make it possible to visualize tissues with very short T2 decay times. The UTE sequence acquires an echo signal from the central to the outer parts of k-space and is very sensitive to small trajectory errors. Therefore, k-space errors caused by imperfections in the gr...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2226050

    authors: Takizawa M,Hanada H,Oka K,Takahashi T,Yamamoto E,Fujii M

    更新日期:2013-02-01 00:00:00

  • PVR: Patch-to-Volume Reconstruction for Large Area Motion Correction of Fetal MRI.

    abstract::In this paper, we present a novel method for the correction of motion artifacts that are present in fetal magnetic resonance imaging (MRI) scans of the whole uterus. Contrary to current slice-to-volume registration (SVR) methods, requiring an inflexible anatomical enclosure of a single investigated organ, the proposed...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2737081

    authors: Alansary A,Rajchl M,McDonagh SG,Murgasova M,Damodaram M,Lloyd DFA,Davidson A,Rutherford M,Hajnal JV,Rueckert D,Kainz B

    更新日期:2017-10-01 00:00:00

  • Practical considerations for 3-D image reconstruction using spherically symmetric volume elements.

    abstract::Spherically symmetric volume elements with smooth tapering of the values near their boundaries are alternatives to the more conventional voxels for the construction of volume images in the computer. Their use, instead of voxels, introduces additional parameters which enable the user to control the shape of the volume ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.481442

    authors: Matej S,Lewitt RM

    更新日期:1996-01-01 00:00:00

  • Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curves.

    abstract::It is well understood that binary classifiers have two implicit objective functions (sensitivity and specificity) describing their performance. Traditional methods of classifier training attempt to combine these two objective functions (or two analogous class performance measures) into one so that conventional scalar ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.796281

    authors: Kupinski MA,Anastasio MA

    更新日期:1999-08-01 00:00:00

  • Principal Component Analysis Based Dynamic Cone Beam X-Ray Luminescence Computed Tomography: A Feasibility Study.

    abstract::Cone beam X-ray luminescence computed tomography (CB-XLCT) is a promising imaging technique in studying the physiological and pathological processes in small animals. However, the dynamic bio-distributions of probes in small animal, especially in adjacent targets are still hard to be captured directly from dynamic CB-...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2917026

    authors: Pu H,Gao P,Liu Y,Rong J,Shi F,Lu H

    更新日期:2019-12-01 00:00:00

  • A direct reconstruction algorithm for electrical impedance tomography.

    abstract::A direct (noniterative) reconstruction algorithm for electrical impedance tomography in the two-dimensional (2-D), cross-sectional geometry is reviewed. New results of a reconstruction of a numerically simulated phantom chest are presented. The algorithm is based on the mathematical uniqueness proof by A. I. Nachman [...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2002.800574

    authors: Mueller JL,Siltanen S,Isaacson D

    更新日期:2002-06-01 00:00:00

  • Corrections to "Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity".

    abstract::In the above paper [1], there are typos in Algorithm 1 table. The correct version of Algorithm 1 is given below. ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章,已发布勘误

    doi:10.1109/TMI.2018.2849798

    authors: Gong K,Cheng-Liao J,Wang G,Chen KT,Catana C,Qi J

    更新日期:2018-08-01 00:00:00

  • Low-level segmentation of 3-D magnetic resonance brain images-a rule-based system.

    abstract::A rule-based, low-level segmentation system that can automatically identify the space occupied by different structures of the brain by magnetic resonance imaging (MRI) is described. Given three-dimensional image data as a stack of slices, it can extract brain parenchyma, cerebro-spinal fluid, and high-intensity abnorm...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.57771

    authors: Raya SP

    更新日期:1990-01-01 00:00:00

  • Effect of detector weighting functions on the point spread function of high-resolution PET tomographs: a simulation study.

    abstract::The point spread function (PSF) of a ring PET tomograph is known to be spatially variant and difficult to obtain because it must be reconstructed from projections. A mathematical model was developed to simulate the data acquisition from a point source and to reconstruct the PSF, taking into account weighting functions...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.158942

    authors: Karuta B,Lecomte R

    更新日期:1992-01-01 00:00:00

  • Ultrafast Ultrasound Imaging With Cascaded Dual-Polarity Waves.

    abstract::Ultrafast ultrasound imaging using plane or diverging waves, instead of focused beams, has advanced greatly the development of novel ultrasound imaging methods for evaluating tissue functions beyond anatomical information. However, the sonographic signal-to-noise ratio (SNR) of ultrafast imaging remains limited due to...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2781261

    authors: Zhang Y,Guo Y,Lee WN

    更新日期:2018-04-01 00:00:00

  • Segmentation of the optic disc, macula and vascular arch in fundus photographs.

    abstract::An automatic system is presented to find the location of the major anatomical structures in color fundus photographs; the optic disc, the macula, and the vascular arch. These structures are found by fitting a single point-distribution-model to the image, that contains points on each structure. The method can handle op...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2006.885336

    authors: Niemeijer M,Abràmoff MD,van Ginneken B

    更新日期:2007-01-01 00:00:00

  • Dynamic Cell Imaging in PET With Optimal Transport Regularization.

    abstract::We propose a novel dynamic image reconstruction method from PET listmode data that could be particularly suited to tracking single or small numbers of cells. In contrast to conventional PET reconstruction our method combines the information from all detected events not only to reconstruct the dynamic evolution of the ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2953773

    authors: Schmitzer B,Schafers KP,Wirth B

    更新日期:2020-05-01 00:00:00

  • A Predictive Model of Vertebral Trabecular Anisotropy From Ex Vivo Micro-CT.

    abstract::Spine-related disorders are amongst the most frequently encountered problems in clinical medicine. For several applications such as 1) to improve the assessment of the strength of the spine, as well as 2) to optimize the personalization of spinal interventions, image-based biomechanical modeling of the vertebrae is ex...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2014.2387114

    authors: Lekadir K,Hoogendoorn C,Hazrati-Marangalou J,Taylor Z,Noble C,van Rietbergen B,Frangi AF

    更新日期:2015-08-01 00:00:00

  • Accurate localization of optic radiation during neurosurgery in an interventional MRI suite.

    abstract::Accurate localization of the optic radiation is key to improving the surgical outcome for patients undergoing anterior temporal lobe resection for the treatment of refractory focal epilepsy. Current commercial interventional magnetic resonance imaging (MRI) scanners are capable of performing anatomical and diffusion w...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2179668

    authors: Daga P,Winston G,Modat M,White M,Mancini L,Cardoso MJ,Symms M,Stretton J,McEvoy AW,Thornton J,Micallef C,Yousry T,Hawkes DJ,Duncan JS,Ourselin S

    更新日期:2012-04-01 00:00:00

  • Constrained Fourier space method for compensation of missing data in emission computed tomography.

    abstract::A method is introduced to compensate for missing projection data that can result from gas between detectors or from malfunctioning detectors. This method uses constraints in the Fourier domain to estimate the missing data, thus completing the data set so that the filtered backprojection algorithm can be used to recons...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.3925

    authors: Karp JS,Muehllehner G,Lewitt RM

    更新日期:1988-01-01 00:00:00

  • Mixture model analysis of DNA microarray images.

    abstract::In this paper, we propose a new methodology for analysis of microarray images. First, a new gridding algorithm is proposed for determining the individual spots and their borders. Then, a Gaussian mixture model (GMM) approach is presented for the analysis of the individual spot images. The main advantages of the propos...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2005.848358

    authors: Blekas K,Galatsanos NP,Likas A,Lagaris IE

    更新日期:2005-07-01 00:00:00

  • Multi-dimensional tumor detection in automated whole breast ultrasound using topographic watershed.

    abstract::Automated whole breast ultrasound (ABUS) is becoming a popular screening modality for whole breast examination. Compared to conventional handheld ultrasound, ABUS achieves operator-independent and is feasible for mass screening. However, reviewing hundreds of slices in an ABUS image volume is time-consuming. A compute...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2014.2315206

    authors: Lo CM,Chen RT,Chang YC,Yang YW,Hung MJ,Huang CS,Chang RF

    更新日期:2014-07-01 00:00:00

  • Narrowband magnetic particle imaging.

    abstract::The magnetic particle imaging (MPI) method directly images the magnetization of super-paramagnetic iron oxide (SPIO) nanoparticles, which are contrast agents commonly used in magnetic resonance imaging (MRI). MPI, as originally envisioned, requires a high-bandwidth receiver coil and preamplifier, which are difficult t...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2009.2013849

    authors: Goodwill PW,Scott GC,Stang PP,Conolly SM

    更新日期:2009-08-01 00:00:00

  • Characteristic quantities of microvascular structures in CLSM volume datasets.

    abstract::A method for fully automated morphological and topological quantification of microvascular structures in confocal laser scanning microscopy (CLSM) volume datasets is presented. Several characteristic morphological and topological quantities are calculated in a series of image-processing steps and can be used to compar...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2007.900379

    authors: Winter K,Metz LH,Kuska JP,Frerich B

    更新日期:2007-08-01 00:00:00

  • MDM-PCCT: Multiple Dynamic Modulations for High-Performance Spectral PCCT Imaging.

    abstract::Photon counting computed tomography (PCCT) has the ability to identify individual photons, resulting in quantitative material identification. Meanwhile, several technical challenges still exist in current PCCT imaging systems, including increased noise and suboptimal bin selection. These nonideal effects can substanti...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3001616

    authors: Li D,Zeng D,Li S,Ge Y,Bian Z,Huang J,Ma J

    更新日期:2020-11-01 00:00:00