Multi-Task Deep Model With Margin Ranking Loss for Lung Nodule Analysis.

Abstract:

:Lung cancer is the leading cause of cancer deaths worldwide and early diagnosis of lung nodule is of great importance for therapeutic treatment and saving lives. Automated lung nodule analysis requires both accurate lung nodule benign-malignant classification and attribute score regression. However, this is quite challenging due to the considerable difficulty of lung nodule heterogeneity modeling and the limited discrimination capability on ambiguous cases. To solve these challenges, we propose a Multi-Task deep model with Margin Ranking loss (referred as MTMR-Net) for automated lung nodule analysis. Compared to existing methods which consider these two tasks separately, the relatedness between lung nodule classification and attribute score regression is explicitly explored in a cause-and-effect manner within our multi-task deep model, which can contribute to the performance gains of both tasks. The results of different tasks can be yielded simultaneously for assisting the radiologists in diagnosis interpretation. Furthermore, a Siamese network with a margin ranking loss is elaborately designed to enhance the discrimination capability on ambiguous nodule cases. To further explore the internal relationship between two tasks and validate the effectiveness of the proposed model, we use the recursive feature elimination method to iteratively rank the most malignancy-related features. We validate the efficacy of our method MTMR-Net on the public benchmark LIDC-IDRI dataset. Extensive experiments show that the diagnosis results with internal relationship explicitly explored in our model has met some similar patterns in clinical usage and also demonstrate that our approach can achieve competitive classification performance and more accurate scoring on attributes over the state-of-the-arts. Codes are publicly available at: https://github.com/CaptainWilliam/MTMR-NET.

journal_name

IEEE Trans Med Imaging

authors

Liu L,Dou Q,Chen H,Qin J,Heng PA

doi

10.1109/TMI.2019.2934577

subject

Has Abstract

pub_date

2020-03-01 00:00:00

pages

718-728

issue

3

eissn

0278-0062

issn

1558-254X

journal_volume

39

pub_type

杂志文章
  • Ultra fast symmetry and SIMD-based projection-backprojection (SSP) algorithm for 3-D PET image reconstruction.

    abstract::Remarkable progress in positron emission tomography (PET) development has occurred in recent years, in hardware, software, and computer implementation of image reconstruction. Recent development in PET scanners such as the high-resolution research tomograph (HRRT) developed by CTI (now Siemens) represents such a case ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2007.892644

    authors: Hong IK,Chung ST,Kim HK,Kim YB,Son YD,Cho ZH

    更新日期:2007-06-01 00:00:00

  • Dynamic PET reconstruction using wavelet regularization with adapted basis functions.

    abstract::Tomographic reconstruction from positron emission tomography (PET) data is an ill-posed problem that requires regularization. An attractive approach is to impose an l(1) -regularization constraint, which favors sparse solutions in the wavelet domain. This can be achieved quite efficiently thanks to the iterative algor...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.923698

    authors: Verhaeghe J,Van de Ville D,Khalidov I,D'Asseler Y,Lemahieu I,Unser M

    更新日期:2008-01-01 00:00:00

  • Twenty new digital brain phantoms for creation of validation image data bases.

    abstract::Simulations provide a way of generating data where ground truth is known, enabling quantitative testing of image processing methods. In this paper, we present the construction of 20 realistic digital brain phantoms that can be used to simulate medical imaging data. The phantoms are made from 20 normal adults to take i...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2006.883453

    authors: Aubert-Broche B,Griffin M,Pike GB,Evans AC,Collins DL

    更新日期:2006-11-01 00:00:00

  • Automatic, Age Consistent Reconstruction of the Corpus Callosum Guided by Coherency From In Utero Diffusion-Weighted MRI.

    abstract::Reconstruction of white matter connectivity in the fetal brain from in utero diffusion-weighted magnetic resonance imaging (MRI) faces many challenges, including subject motion, small anatomical scale, and limited image resolution and signal. These issues are compounded by the need to track significant changes in stru...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2932681

    authors: Hunt D,Dighe M,Gatenby C,Studholme C

    更新日期:2020-03-01 00:00:00

  • Nonrigid image registration using conditional mutual information.

    abstract::Maximization of mutual information (MMI) is a popular similarity measure for medical image registration. Although its accuracy and robustness has been demonstrated for rigid body image registration, extending MMI to nonrigid image registration is not trivial and an active field of research. We propose conditional mutu...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2009.2021843

    authors: Loeckx D,Slagmolen P,Maes F,Vandermeulen D,Suetens P

    更新日期:2010-01-01 00:00:00

  • Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT.

    abstract::X-ray computed tomography (CT) using sparse projection views is a recent approach to reduce the radiation dose. However, due to the insufficient projection views, an analytic reconstruction approach using the filtered back projection (FBP) produces severe streaking artifacts. Recently, deep learning approaches using l...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2823768

    authors: Han Y,Ye JC

    更新日期:2018-06-01 00:00:00

  • Fast local trust region technique for diffusion tensor registration using exact reorientation and regularization.

    abstract::Diffusion tensor imaging is widely used in brain connectivity research. As more and more studies recruit large numbers of subjects, it is important to design registration methods which are not only theoretically rigorous, but also computationally efficient. However, the requirement of reorienting diffusion tensors com...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2013.2274051

    authors: Li J,Shi Y,Tran G,Dinov I,Wang DJ,Toga A

    更新日期:2014-05-01 00:00:00

  • Sparse reconstruction of the magnetic particle imaging system matrix.

    abstract::Magnetic particle imaging allows to determine the spatial distribution of magnetic nanoparticles in vivo. The system matrix in magnetic particle imaging is commonly acquired in a tedious calibration scan and requires to measure the system response at numerous positions in the field-of-view. In this paper, we propose a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2013.2258029

    authors: Knopp T,Weber A

    更新日期:2013-08-01 00:00:00

  • Establishment of an Automated Algorithm Utilizing Optical Coherence Tomography and Micro-Computed Tomography Imaging to Reconstruct the 3-D Deformed Stent Geometry.

    abstract::Percutaneous coronary intervention (PCI) is the prevalent treatment for coronary artery disease, with hundreds of thousands of stents implanted annually. Computational studies have demonstrated the role of biomechanics in the failure of vascular stents, but clinical studies is this area are limited by a lack of unders...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2870714

    authors: Elliott MR,Kim D,Molony DS,Morris L,Samady H,Joshi S,Timmins LH

    更新日期:2019-03-01 00:00:00

  • Fully automated attenuation measurement and motion correction in FLIP image sequences.

    abstract::Fluorescence loss in photobleaching (FLIP) is a method to study compartment connectivity in living cells. A FLIP sequence is obtained by alternatively bleaching a spot in a cell and acquiring an image of the complete cell. Connectivity is estimated by comparing fluorescence signal attenuation in different cell parts. ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2171497

    authors: van de Giessen M,van der Laan A,Hendriks EA,Vidorreta M,Reiber JH,Jost CR,Tanke HJ,Lelieveldt BP

    更新日期:2012-02-01 00:00:00

  • Improved intrinsic motion detection using time-of-flight PET.

    abstract::Intrinsic or data-driven respiratory and cardiac motion detection often track the center-of-mass (COM) change in PET data to derive a motion gating signal. The effectiveness of this method depends on the contrast of the moving target to the relatively stationary background. The stationary background leads to a reduced...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2423976

    authors: Xu J,Tsui BM

    更新日期:2015-10-01 00:00:00

  • Improved watershed transform for medical image segmentation using prior information.

    abstract::The watershed transform has interesting properties that make it useful for many different image segmentation applications: it is simple and intuitive, can be parallelized, and always produces a complete division of the image. However, when applied to medical image analysis, it has important drawbacks (oversegmentation...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2004.824224

    authors: Grau V,Mewes AU,Alcañiz M,Kikinis R,Warfield SK

    更新日期:2004-04-01 00:00:00

  • Three-dimensional microwave breast imaging: dispersive dielectric properties estimation using patient-specific basis functions.

    abstract::Breast imaging via microwave tomography involves estimating the distribution of dielectric properties within the patient's breast on a discrete mesh. The number of unknowns in the discrete mesh can be very large for 3-D imaging, and this results in computational challenges. We propose a new approach where the discrete...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.2008959

    authors: Winters DW,Shea JD,Kosmas P,Van Veen BD,Hagness SC

    更新日期:2009-07-01 00:00:00

  • Endoscopic video manifolds for targeted optical biopsy.

    abstract::Gastro-intestinal (GI) endoscopy is a widely used clinical procedure for screening and surveillance of digestive tract diseases ranging from Barrett's Oesophagus to oesophageal cancer. Current surveillance protocol consists of periodic endoscopic examinations performed in 3-4 month intervals including expert's visual ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2174252

    authors: Atasoy S,Mateus D,Meining A,Yang GZ,Navab N

    更新日期:2012-03-01 00:00:00

  • Voxel-guided morphometry ("VGM") and application to stroke.

    abstract::Monitoring of cerebral diseases associated with a change of morphology (e.g., stroke) requires unprecedented accuracy for quantification of its morphological progression for each voxel. The purpose of this paper is to provide a technique [voxel-guided morphometry (VGM)] to quantify macroscopic anatomical differences. ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2002.806571

    authors: Schormann T,Kraemer M

    更新日期:2003-01-01 00:00:00

  • An investigation of methods of pileup rejection for 2-D array detectors employed in high resolution PET.

    abstract::Two methods of rejecting pileup events in 2-D array detectors used in positron emission tomography (PET) are investigated. Since the methods are based on different physical properties, they were investigated separately and in combination. Method one is based on the fact that valid events in the 2-D array detector occu...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.79481

    authors: Germano G,Hoffman EJ

    更新日期:1991-01-01 00:00:00

  • Ultrafast Ultrasound Imaging Using Combined Transmissions With Cross-Coherence-Based Reconstruction.

    abstract::Plane-wave-based ultrafast imaging has become the prevalent technique for non-conventional ultrasound imaging. The image quality, especially in terms of the suppression of artifacts, is generally compromised by reducing the number of transmissions for a higher frame rate. We hereby propose a new ultrafast imaging fram...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2736423

    authors: Zhang Y,Guo Y,Lee WN

    更新日期:2018-02-01 00:00:00

  • Wavelet analysis for brain-function imaging.

    abstract::The authors present a new algorithmic procedure for the analysis of brain images. This procedure is specifically designed to image the activity and functional organization of the brain. The authors' results are tested on data collected and previously analyzed with the technique known as in vivo optical imaging of intr...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.414621

    authors: Carmona RA,Hwang WL,Frostig RD

    更新日期:1995-01-01 00:00:00

  • Separation of Metabolites and Macromolecules for Short-TE 1H-MRSI Using Learned Component-Specific Representations.

    abstract::Short-echo-time (TE) proton magnetic resonance spectroscopic imaging (MRSI) allows for simultaneously mapping a number of molecules in the brain, and has been recognized as an important tool for studying in vivo biochemistry in various neuroscience and disease applications. However, separation of the metabolite and ma...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3048933

    authors: Li Y,Wang Z,Sun R,Lam F

    更新日期:2021-01-04 00:00:00

  • Validation of nonrigid image registration using finite-element methods: application to breast MR images.

    abstract::This paper presents a novel method for validation of nonrigid medical image registration. This method is based on the simulation of physically plausible, biomechanical tissue deformations using finite-element methods. Applying a range of displacements to finite-element models of different patient anatomies generates m...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2002.808367

    authors: Schnabel JA,Tanner C,Castellano-Smith AD,Degenhard A,Leach MO,Hose DR,Hill DL,Hawkes DJ

    更新日期:2003-02-01 00:00:00

  • Segmentation of prostate boundaries from ultrasound images using statistical shape model.

    abstract::This paper presents a statistical shape model for the automatic prostate segmentation in transrectal ultrasound images. A Gabor filter bank is first used to characterize the prostate boundaries in ultrasound images in both multiple scales and multiple orientations. The Gabor features are further reconstructed to be in...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2003.809057

    authors: Shen D,Zhan Y,Davatzikos C

    更新日期:2003-04-01 00:00:00

  • Red Lesion Detection Using Dynamic Shape Features for Diabetic Retinopathy Screening.

    abstract::The development of an automatic telemedicine system for computer-aided screening and grading of diabetic retinopathy depends on reliable detection of retinal lesions in fundus images. In this paper, a novel method for automatic detection of both microaneurysms and hemorrhages in color fundus images is described and va...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2509785

    authors: Seoud L,Hurtut T,Chelbi J,Cheriet F,Langlois JM

    更新日期:2016-04-01 00:00:00

  • Total variation regularization for fMRI-based prediction of behavior.

    abstract::While medical imaging typically provides massive amounts of data, the extraction of relevant information for predictive diagnosis remains a difficult challenge. Functional magnetic resonance imaging (fMRI) data, that provide an indirect measure of task-related or spontaneous neuronal activity, are classically analyzed...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2113378

    authors: Michel V,Gramfort A,Varoquaux G,Eger E,Thirion B

    更新日期:2011-07-01 00:00:00

  • Simultaneous Analysis of 2D Echo Views for Left Atrial Segmentation and Disease Detection.

    abstract::We propose a joint information approach for automatic analysis of 2D echocardiography (echo) data. The approach combines a priori images, their segmentations and patient diagnostic information within a unified framework to determine various clinical parameters, such as cardiac chamber volumes, and cardiac disease labe...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2016.2593900

    authors: Allan G,Nouranian S,Tsang T,Seitel A,Mirian M,Jue J,Hawley D,Fleming S,Gin K,Swift J,Rohling R,Abolmaesumi P

    更新日期:2017-01-01 00:00:00

  • Application of micro-computed tomography with iodine staining to cardiac imaging, segmentation, and computational model development.

    abstract::Micro-computed tomography (micro-CT) has been widely used to generate high-resolution 3-D tissue images from small animals nondestructively, especially for mineralized skeletal tissues. However, its application to the analysis of soft cardiovascular tissues has been limited by poor inter-tissue contrast. Recent ex viv...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2209183

    authors: Aslanidi OV,Nikolaidou T,Zhao J,Smaill BH,Gilbert SH,Holden AV,Lowe T,Withers PJ,Stephenson RS,Jarvis JC,Hancox JC,Boyett MR,Zhang H

    更新日期:2013-01-01 00:00:00

  • A row-action alternative to the EM algorithm for maximizing likelihood in emission tomography.

    abstract::The maximum likelihood (ML) approach to estimating the radioactive distribution in the body cross section has become very popular among researchers in emission computed tomography (ECT) since it has been shown to provide very good images compared to those produced with the conventional filtered backprojection (FBP) al...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.538946

    authors: Browne J,de Pierro AB

    更新日期:1996-01-01 00:00:00

  • Improved SPECT quantitation using fully three-dimensional iterative spatially variant scatter response compensation.

    abstract::The quality and quantitative accuracy of iteratively reconstructed SPECT images improves when better point spread function (PSF) models of the gamma camera are used during reconstruction. Here, inclusion in the PSF model of photon crosstalk between different slices caused by limited gamma camera resolution and scatter...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.511752

    authors: Beekman FJ,Kamphuis C,Viergever MA

    更新日期:1996-01-01 00:00:00

  • Reconstruction of SPECT images using generalized matrix inverses.

    abstract::Generalized matrix inverses are used to estimate source activity distributions from single photon emission computed tomography (SPECT) projection measurements. Image reconstructions for a numerical simulation and a clinical brain study are examined. The photon flux from the source region and photon detection by the ga...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.141640

    authors: Smith MF,Floyd CR,Jaszczak RJ,Coleman RE

    更新日期:1992-01-01 00:00:00

  • An Improved Method of Total Variation Superiorization Applied to Reconstruction in Proton Computed Tomography.

    abstract::Previous work has shown that total variation superiorization (TVS) improves reconstructed image quality in proton computed tomography (pCT). The structure of the TVS algorithm has evolved since then and this paper investigated if this new algorithmic structure provides additional benefits to pCT image quality. Structu...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2019.2911482

    authors: Schultze B,Censor Y,Karbasi P,Schubert KE,Schulte RW

    更新日期:2020-02-01 00:00:00

  • Quantification of Wave Reflection in the Human Umbilical Artery From Asynchronous Doppler Ultrasound Measurements.

    abstract::Elevated umbilical artery pulsatility is a widely used biomarker for placental pathology leading to intra-uterine growth restriction and, in severe cases, still-birth. It has been hypothesized that placental pathology modifies umbilical artery pulsatility by altering the degree to which the pulse pressure wave, which ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3004511

    authors: Stortz G,Cahill LS,Chandran AR,Baschat A,Sled JG,Macgowan CK

    更新日期:2020-11-01 00:00:00