Spherical Deformable U-Net: Application to Cortical Surface Parcellation and Development Prediction.

Abstract:

:Convolutional Neural Networks (CNNs) have achieved overwhelming success in learning-related problems for 2D/3D images in the Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have an inherent spherical topology in a manifold space, e.g., the convoluted brain cortical surfaces represented by triangular meshes. There is no consistent neighborhood definition and thus no straightforward convolution/pooling operations for such cortical surface data. In this paper, leveraging the regular and hierarchical geometric structure of the resampled spherical cortical surfaces, we create the 1-ring filter on spherical cortical triangular meshes and accordingly develop convolution/pooling operations for constructing Spherical U-Net for cortical surface data. However, the regular nature of the 1-ring filter makes it inherently limited to model fixed geometric transformations. To further enhance the transformation modeling capability of Spherical U-Net, we introduce the deformable convolution and deformable pooling to cortical surface data and accordingly propose the Spherical Deformable U-Net (SDU-Net). Specifically, spherical offsets are learned to freely deform the 1-ring filter on the sphere to adaptively localize cortical structures with different sizes and shapes. We then apply the SDU-Net to two challenging and scientifically important tasks in neuroimaging: cortical surface parcellation and cortical attribute map prediction. Both applications validate the competitive performance of our approach in accuracy and computational efficiency in comparison with state-of-the-art methods.

journal_name

IEEE Trans Med Imaging

authors

Zhao F,Wu Z,Wang L,Lin W,Gilmore JH,Xia S,Shen D,Li G

doi

10.1109/TMI.2021.3050072

subject

Has Abstract

pub_date

2021-01-08 00:00:00

eissn

0278-0062

issn

1558-254X

journal_volume

PP

pub_type

杂志文章
  • A "twisting and bending" model-based nonrigid image registration technique for 3-D ultrasound carotid images.

    abstract::Atherosclerosis at the carotid bifurcation resulting in cerebral emboli is a major cause of ischemic stroke. Most strokes associated with carotid atherosclerosis can be prevented by lifestyle/dietary changes and pharmacological treatments if identified early by monitoring carotid plaque changes. Registration of 3-D ul...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.918326

    authors: Nanayakkara ND,Chiu B,Samani A,Spence JD,Samarabandu J,Fenster A

    更新日期:2008-10-01 00:00:00

  • A wavelet-based multiresolution regularized least squares reconstruction approach for optical tomography.

    abstract::In this paper, we present a wavelet-based multigrid approach to solve the perturbation equation encountered in optical tomography. With this scheme, the unknown image, the data, as well as the weight matrix are all represented by wavelet expansions, thus yielding a multiresolution representation of the original pertur...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.563666

    authors: Zhu W,Wang Y,Deng Y,Yao Y,Barbour RL

    更新日期:1997-04-01 00:00:00

  • Ultra fast symmetry and SIMD-based projection-backprojection (SSP) algorithm for 3-D PET image reconstruction.

    abstract::Remarkable progress in positron emission tomography (PET) development has occurred in recent years, in hardware, software, and computer implementation of image reconstruction. Recent development in PET scanners such as the high-resolution research tomograph (HRRT) developed by CTI (now Siemens) represents such a case ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2007.892644

    authors: Hong IK,Chung ST,Kim HK,Kim YB,Son YD,Cho ZH

    更新日期:2007-06-01 00:00:00

  • Increased spatial resolution in transillumination using collimated light.

    abstract::In traditional transillumination of the breast (diaphanography), the abundance of diffuse light resulting from the use of extended noncollimated sources reduces the visibility of deep seated lesions. A prototype scanning imaging system has been developed to investigate the effectiveness of thin collimated light beams ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.251126

    authors: Wist AO,Fatouros PP,Herr SL

    更新日期:1993-01-01 00:00:00

  • Image Registration Based on Low Rank Matrix: Rank-Regularized SSD.

    abstract::Similarity measure is a main core of image registration algorithms. Spatially varying intensity distortion is an important challenge, which affects the performance of similarity measures. Correlation among the pixels is the main characteristic of this distortion. Similarity measures such as sum-of-squared-differences ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2744663

    authors: Ghaffari A,Fatemizadeh E

    更新日期:2018-01-01 00:00:00

  • Topology-based kernels with application to inference problems in Alzheimer's disease.

    abstract::Alzheimer's disease (AD) research has recently witnessed a great deal of activity focused on developing new statistical learning tools for automated inference using imaging data. The workhorse for many of these techniques is the support vector machine (SVM) framework (or more generally kernel-based methods). Most of t...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2147327

    authors: Pachauri D,Hinrichs C,Chung MK,Johnson SC,Singh V

    更新日期:2011-10-01 00:00:00

  • Improvement of Chest Region CT Images through Automated Gray-Level Remapping.

    abstract::A software system, CTIP, written in Fortran is discussed which remaps the computerized tomography (CT) image gray level so that both the lung and heart regions are clearly visible with a "natural anatomical appearance." The system is adaptive to image statistics derived from the gray-level histogram of the entire imag...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.1986.4307736

    authors: Davis G,Wallenslager ST

    更新日期:1986-01-01 00:00:00

  • An Enhanced SMART-RECON Algorithm for Time-Resolved C-Arm Cone-Beam CT Imaging.

    abstract::Temporal resolution in time-resolved cone-beam CT (TR-CBCT) imaging is often limited by the time needed to acquire a complete data set for image reconstruction. With the recent developments of performing nearly limited-view artifact-free reconstruction from data in a limited-view angle range and a prior image, tempora...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2960720

    authors: Li Y,Garrett JW,Li K,Strother C,Chen GH

    更新日期:2020-06-01 00:00:00

  • Neuron Segmentation With High-Level Biological Priors.

    abstract::We present a novel approach to the problem of neuron segmentation in image volumes acquired by an electron microscopy. Existing methods, such as agglomerative or correlation clustering, rely solely on boundary evidence and have problems where such an evidence is lacking (e.g., incomplete staining) or ambiguous (e.g., ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2712360

    authors: Krasowski NE,Beier T,Knott GW,Kothe U,Hamprecht FA,Kreshuk A

    更新日期:2018-04-01 00:00:00

  • Fluorescence Diffusion in the Presence of Optically Clear Tissues in a Mouse Head Model.

    abstract::Diffuse Optical Tomography commonly neglects or assumes as insignificant the presence of optically clear regions in biological tissues, estimating their contribution as a small perturbation to light transport. The inaccuracy introduced by this practice is examined in detail in the context of a complete, based on reali...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2016.2646518

    authors: Ancora D,Zacharopoulos A,Ripoll J,Zacharakis G

    更新日期:2017-05-01 00:00:00

  • Algebraic reconstruction for magnetic resonance imaging under B0 inhomogeneity.

    abstract::In magnetic resonance imaging, spatial localization is usually achieved using Fourier encoding which is realized by applying a magnetic field gradient along the dimension of interest to create a linear correspondence between the resonance frequency and spatial location following the Larmor equation. In the presence of...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.712126

    authors: Kadah YM,Hu X

    更新日期:1998-06-01 00:00:00

  • Retinal vessel centerline extraction using multiscale matched filters, confidence and edge measures.

    abstract::Motivated by the goals of improving detection of low-contrast and narrow vessels and eliminating false detections at nonvascular structures, a new technique is presented for extracting vessels in retinal images. The core of the technique is a new likelihood ratio test that combines matched-filter responses, confidence...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2006.884190

    authors: Sofka M,Stewart CV

    更新日期:2006-12-01 00:00:00

  • Regularized field map estimation in MRI.

    abstract::In fast magnetic resonance (MR) imaging with long readout times, such as echo-planar imaging (EPI) and spiral scans, it is important to correct for the effects of field inhomogeneity to reduce image distortion and blurring. Such corrections require an accurate field map, a map of the off-resonance frequency at each vo...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.923956

    authors: Funai AK,Fessler JA,Yeo DT,Olafsson VT,Noll DC

    更新日期:2008-10-01 00:00:00

  • Flux-based anisotropic diffusion applied to enhancement of 3-D angiogram.

    abstract::We present a new approach to anisotropic diffusion based on a multidirectional diffusion flux. The diffusion flux is decomposed in an orthogonal basis, effectively enabling enhancement of contours as well as diffusion along the contours. To this end, we have selected a three-dimensional basis that depicts the directio...

    journal_title:IEEE transactions on medical imaging

    pub_type: 信件

    doi:10.1109/TMI.2002.806403

    authors: Krissian K

    更新日期:2002-11-01 00:00:00

  • Electrical impedance tomography using induced currents.

    abstract::The mathematical basis of a new imaging modality, induced current electrical impedance tomography (EIT), is investigated, The ultimate aim of this technique is the reconstruction of conductivity distribution of the human body, from voltage measurements made between electrodes placed on the surface, when currents are i...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.293927

    authors: Gencer NG,Kuzuoglu M,Ider YZ

    更新日期:1994-01-01 00:00:00

  • Frequency-domain optical tomographic imaging of arthritic finger joints.

    abstract::We are presenting data from the largest clinical trial on optical tomographic imaging of finger joints to date. Overall we evaluated 99 fingers of patients affected by rheumatoid arthritis (RA) and 120 fingers from healthy volunteers. Using frequency-domain imaging techniques we show that sensitivities and specificiti...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2135374

    authors: Hielscher AH,Kim HK,Montejo LD,Blaschke S,Netz UJ,Zwaka PA,Illing G,Muller GA,Beuthan J

    更新日期:2011-10-01 00:00:00

  • Implementation, investigation, and improvement of a novel cone-beam reconstruction method [SPECT].

    abstract::A three-dimensional reconstruction method which uses cone-beam data was implemented. Issues concerning implementation are investigated and discussed in detail. Computer simulations were used to determine the amount of image degradation occurring in each of the three steps that comprise the reconstruction method. In ad...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.141650

    authors: Smith BD,Chen J

    更新日期:1992-01-01 00:00:00

  • Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring.

    abstract::Mammographic risk scoring has commonly been automated by extracting a set of handcrafted features from mammograms, and relating the responses directly or indirectly to breast cancer risk. We present a method that learns a feature hierarchy from unlabeled data. When the learned features are used as the input to a simpl...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2016.2532122

    authors: Kallenberg M,Petersen K,Nielsen M,Ng AY,Pengfei Diao,Igel C,Vachon CM,Holland K,Winkel RR,Karssemeijer N,Lillholm M

    更新日期:2016-05-01 00:00:00

  • A Tensor B-Spline Approach for Solving the Diffusion PDE With Application to Optical Diffusion Tomography.

    abstract::Optical Diffusion Tomography (ODT) is a modern non-invasive medical imaging modality which requires mathematical modelling of near-infrared light propagation in tissue. Solving the ODT forward problem equation accurately and efficiently is crucial. Typically, the forward problem is represented by a Diffusion PDE and i...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2016.2641500

    authors: Shulga D,Morozov O,Hunziker P

    更新日期:2017-04-01 00:00:00

  • EMS-Net: A Deep Learning Method for Autodetecting Epileptic Magnetoencephalography Spikes.

    abstract::Epilepsy is a neurological disorder characterized by sudden and unpredictable epileptic seizures, which incurs significant negative impacts on patients' physical, psychological and social health. A practical approach to assist with the clinical assessment and treatment planning for patients is to process magnetoenceph...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2958699

    authors: Zheng L,Liao P,Luo S,Sheng J,Teng P,Luan G,Gao JH

    更新日期:2020-06-01 00:00:00

  • Electrical impedance spectroscopy of the breast: clinical imaging results in 26 subjects.

    abstract::Electrical impedance spectroscopy (EIS) is a potential, noninvasive technique to image women for breast cancer. Studies have shown characteristic frequency dispersions in the electrical conductivity and permittivity of malignant versus normal tissue. Using a multifrequency EIS system, we imaged the breasts of 26 women...

    journal_title:IEEE transactions on medical imaging

    pub_type: 临床试验,杂志文章

    doi:10.1109/tmi.2002.800606

    authors: Kerner TE,Paulsen KD,Hartov A,Soho SK,Poplack SP

    更新日期:2002-06-01 00:00:00

  • A proof of the spherical homeomorphism conjecture for surfaces.

    abstract::The human cerebral cortex is topologically equivalent to a sphere when it is viewed as closed at the brain stem. Due to noise and/or resolution issues, magnetic resonance imaging may see "handles" that need to be eliminated to reflect the true spherical topology. Shattuck and Leahy present an algorithm to correct such...

    journal_title:IEEE transactions on medical imaging

    pub_type: 评论,信件

    doi:10.1109/TMI.2002.806590

    authors: Abrams L,Fishkind DE,Priebe CE

    更新日期:2002-12-01 00:00:00

  • Magnetic resonance angiography.

    abstract::This paper describes several methods for magnetic resonance angiography that create projection images based solely on flowing blood. To both remove static tissue from the image and generate signals from blood, two classes of methods considered are temporal subtraction and cancelling excitation. Temporal subtraction, a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.1986.4307763

    authors: Nishimura DG,Macovski A,Pauly JM

    更新日期:1986-01-01 00:00:00

  • Deep Learning for Fast and Spatially Constrained Tissue Quantification From Highly Accelerated Data in Magnetic Resonance Fingerprinting.

    abstract::Magnetic resonance fingerprinting (MRF) is a quantitative imaging technique that can simultaneously measure multiple important tissue properties of human body. Although MRF has demonstrated improved scan efficiency as compared to conventional techniques, further acceleration is still desired for translation into routi...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2899328

    authors: Fang Z,Chen Y,Liu M,Xiang L,Zhang Q,Wang Q,Lin W,Shen D

    更新日期:2019-10-01 00:00:00

  • Surface Reconstruction for free-space 360 degrees fluorescence molecular tomography and the effects of animal motion.

    abstract::Complete projection (360 degrees ) free-space fluorescence tomography of opaque media is poised to enable 3-D imaging through entire small animals in vivo with improved depth resolution compared to 360 degrees -projection fiber-based systems or limited-view angle systems. This approach can lead to a new generation of ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2007.904662

    authors: Lasser T,Soubret A,Ripoll J,Ntziachristos V

    更新日期:2008-02-01 00:00:00

  • SVD compression for magnetic resonance fingerprinting in the time domain.

    abstract::Magnetic resonance (MR) fingerprinting is a technique for acquiring and processing MR data that simultaneously provides quantitative maps of different tissue parameters through a pattern recognition algorithm. A predefined dictionary models the possible signal evolutions simulated using the Bloch equations with differ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2014.2337321

    authors: McGivney DF,Pierre E,Ma D,Jiang Y,Saybasili H,Gulani V,Griswold MA

    更新日期:2014-12-01 00:00:00

  • Sparse patch-based label propagation for accurate prostate localization in CT images.

    abstract::In this paper, we propose a new prostate computed tomography (CT) segmentation method for image guided radiation therapy. The main contributions of our method lie in the following aspects. 1) Instead of using voxel intensity information alone, patch-based representation in the discriminative feature space with logisti...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2230018

    authors: Liao S,Gao Y,Lian J,Shen D

    更新日期:2013-02-01 00:00:00

  • Soft tissue differentiation using multiband signatures of high resolution ultrasonic transmission tomography.

    abstract::In this paper, we are interested in soft tissue differentiation by multiband images obtained from the High-Resolution Ultrasonic Transmission Tomography (HUTT) system using a spectral target detection method based on constrained energy minimization (CEM). We have developed a new tissue differentiation method (called "...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2004.843179

    authors: Jeong JW,Kim TS,Shin DC,Do S,Singh M,Marmarelis VZ

    更新日期:2005-03-01 00:00:00

  • MDM-PCCT: Multiple Dynamic Modulations for High-Performance Spectral PCCT Imaging.

    abstract::Photon counting computed tomography (PCCT) has the ability to identify individual photons, resulting in quantitative material identification. Meanwhile, several technical challenges still exist in current PCCT imaging systems, including increased noise and suboptimal bin selection. These nonideal effects can substanti...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3001616

    authors: Li D,Zeng D,Li S,Ge Y,Bian Z,Huang J,Ma J

    更新日期:2020-11-01 00:00:00

  • Spatially adaptive mixture modeling for analysis of FMRI time series.

    abstract::Within-subject analysis in fMRI essentially addresses two problems, the detection of brain regions eliciting evoked activity and the estimation of the underlying dynamics. In Makni et aL, 2005 and Makni et aL, 2008, a detection-estimation framework has been proposed to tackle these problems jointly, since they are con...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2010.2042064

    authors: Vincent T,Risser L,Ciuciu P

    更新日期:2010-04-01 00:00:00