Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks.

Abstract:

:Anisotropic multi-slice Cardiac Magnetic Resonance (CMR) Images are conventionally acquired in patient-specific short-axis (SAX) orientation. In specific cardiovascular diseases that affect right ventricular (RV) morphology, acquisitions in standard axial (AX) orientation are preferred by some investigators, due to potential superiority in RV volume measurement for treatment planning. Unfortunately, due to the rare occurrence of these diseases, data in this domain is scarce. Recent research in deep learning-based methods mainly focused on SAX CMR images and they had proven to be very successful. In this work, we show that there is a considerable domain shift between AX and SAX images, and therefore, direct application of existing models yield sub-optimal results on AX samples. We propose a novel unsupervised domain adaptation approach, which uses task-related probabilities in an attention mechanism. Beyond that, cycle consistency is imposed on the learned patient-individual 3D rigid transformation to improve stability when automatically re-sampling the AX images to SAX orientations. The network was trained on 122 registered 3D AX-SAX CMR volume pairs from a multi-centric patient cohort. A mean 3D Dice of 0.86 ± 0.06 for the left ventricle, 0.65 ± 0.08 for the myocardium, and 0.77 ± 0.10 for the right ventricle could be achieved. This is an improvement of 25% in Dice for RV in comparison to direct application on axial slices. To conclude, our pre-trained task module has neither seen CMR images nor labels from the target domain, but is able to segment them after the domain gap is reduced. Code: https://github.com/Cardio-AI/3d-mri-domain-adaptation.

journal_name

IEEE Trans Med Imaging

authors

Koehler S,Hussain T,Blair Z,Huffaker T,Ritzmann F,Tandon A,Pickardt T,Sarikouch S,Sarikouch S,Latus H,Greil G,Wolf I,Engelhardt S

doi

10.1109/TMI.2021.3052972

subject

Has Abstract

pub_date

2021-01-20 00:00:00

eissn

0278-0062

issn

1558-254X

journal_volume

PP

pub_type

杂志文章
  • A novel approach to extract colon lumen from CT images for virtual colonoscopy.

    abstract::An automatic method has been developed for segmentation of abdominal computed tomography (CT) images for virtual colonoscopy obtained after a bowel preparation of a low-residue diet with ingested contrast solutions to enhance the image intensities of residual colonic materials. Removal of the enhanced materials was pe...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.897814

    authors: Chen D,Liang Z,Wax MR,Li L,Li B,Kaufman AE

    更新日期:2000-12-01 00:00:00

  • Automatic segmentation of scaling in 2-D psoriasis skin images.

    abstract::Psoriasis is a chronic inflammatory skin disease that affects over 3% of the population. Various methods are currently used to evaluate psoriasis severity and to monitor therapeutic response. The PASI system of scoring is widely used for evaluating psoriasis severity. It employs a visual analogue scale to score the th...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2236349

    authors: Lu J,Kazmierczak E,Manton JH,Sinclair R

    更新日期:2013-04-01 00:00:00

  • Combined volumetric and surface registration.

    abstract::In this paper, we propose a novel method for the registration of volumetric images of the brain that optimizes the alignment of both cortical and subcortical structures. In order to achieve this, relevant geometrical information is extracted from a surface-based morph and diffused into the volume using the Navier oper...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.2004426

    authors: Postelnicu G,Zollei L,Fischl B

    更新日期:2009-04-01 00:00:00

  • Choice of initial conditions in the ML reconstruction of fan-beam transmission with truncated projection data.

    abstract::We investigate the effects of initial conditions in the iterative maximum-likelihood (ML) reconstruction of fan-beam transmission projection data with truncation. In an iterative ML reconstruction, the estimate of the transmission reconstructed image in the previous iteration is multiplied by some factors to obtain th...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.611352

    authors: Pan TS,Tsui BM,Byrne CL

    更新日期:1997-08-01 00:00:00

  • Quantitative ECT: Comparison of Recovery Coefficient and Linearity of Detector Response for Single Photon and Coincidence Detection (F-18, B+ 511 keV).

    abstract::The response characteristics of two tomographic systems were compared for imaging of positron emitters: a) a SPECT system with a 3/8 in crystal and 511 keV detector shielding, equipped with a specially designed 511 keV collimator, and b) a PET V system using coincidence detection. SPECT transverse plane resolution was...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.1986.4307776

    authors: Clarke LP,Cullom SJ,Kenny PJ,Saw CB,Silbiger ML

    更新日期:1986-01-01 00:00:00

  • Image reconstruction in magnetic resonance conductivity tensor imaging (MRCTI).

    abstract::Almost all magnetic resonance electrical impedance tomography (MREIT) reconstruction algorithms proposed to date assume isotropic conductivity in order to simplify the image reconstruction. However, it is well known that most of biological tissues have anisotropic conductivity values. In this study, four novel anisotr...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2171192

    authors: Değirmenci E,Eyüboğlu BM

    更新日期:2012-03-01 00:00:00

  • A registration framework for the comparison of mammogram sequences.

    abstract::In this paper, we present a two-stage algorithm for mammogram registration, the geometrical alignment of mammogram sequences. The rationale behind this paper stems from the intrinsic difficulties in comparing mammogram sequences. Mammogram comparison is a valuable tool in national breast screening programs as well as ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 临床试验,杂志文章

    doi:10.1109/TMI.2005.848374

    authors: Marias K,Behrenbruch C,Parbhoo S,Seifalian A,Brady M

    更新日期:2005-06-01 00:00:00

  • A maximum a posteriori probability expectation maximization algorithm for image reconstruction in emission tomography.

    abstract::The expectation maximization method for maximum likelihood image reconstruction in emission tomography, based on the Poisson distribution of the statistically independent components of the image and measurement vectors, is extended to a maximum aposteriori image reconstruction using a multivariate Gaussian a priori pr...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.1987.4307826

    authors: Levitan E,Herman GT

    更新日期:1987-01-01 00:00:00

  • Pubic arch detection in transrectal ultrasound guided prostate cancer therapy.

    abstract::New biopsy techniques, increased life expectancy, and prostate-specific antigen (PSA) screening have contributed to an increase in the reported incidence of prostate cancer. Among several treatment options available to the patients, transperineal prostate brachytherapy has emerged as a medically successful, cost-effec...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.736032

    authors: Pathak SD,Grimm PD,Chalana V,Kim Y

    更新日期:1998-10-01 00:00:00

  • Space-time segmentation using level set active contours applied to myocardial gated SPECT.

    abstract::This paper presents a new variational method for the segmentation of a moving object against a still background, over a sequence of [two-dimensional or three-dimensional (3-D)] image frames. The method is illustrated in application to myocardial gated single photon emission computed tomography (SPECT) data, and incorp...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.932748

    authors: Debreuve E,Barlaud M,Aubert G,Laurette I,Darcourt J

    更新日期:2001-07-01 00:00:00

  • Interactive CT-video registration for the continuous guidance of bronchoscopy.

    abstract::Bronchoscopy is a major step in lung cancer staging. To perform bronchoscopy, the physician uses a procedure plan, derived from a patient's 3D computed-tomography (CT) chest scan, to navigate the bronchoscope through the lung airways. Unfortunately, physicians vary greatly in their ability to perform bronchoscopy. As ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2013.2252361

    authors: Merritt SA,Khare R,Bascom R,Higgins WE

    更新日期:2013-08-01 00:00:00

  • Amplified Flow Imaging (aFlow): A Novel MRI-Based Tool to Unravel the Coupled Dynamics Between the Human Brain and Cerebrovasculature.

    abstract::With each heartbeat, periodic variations in arterial blood pressure are transmitted along the vasculature, resulting in localized deformations of the arterial wall and its surrounding tissue. Quantification of such motions may help understand various cerebrovascular conditions, yet it has proven technically challengin...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3012932

    authors: Abderezaei J,Martinez J,Terem I,Fabris G,Pionteck A,Yang Y,Holdsworth SJ,Nael K,Kurt M

    更新日期:2020-12-01 00:00:00

  • Optimizing rod window width in positron emission tomography.

    abstract::A technique determines the optimal window width for orbiting rod transmission studies in positron emission tomography (PET). Windowing reduces noise in orbiting rod transmission studies. Lines-of-response (LOR) which intersect the rods generate primarily true coincidence events. LOR which pass far from the rods genera...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.387708

    authors: Jones WF,Digby WM,Luk WK,Casey ME,Byars LG

    更新日期:1995-01-01 00:00:00

  • Automated characterization of breast lesions imaged with an ultrafast DCE-MR protocol.

    abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) of the breast has become an invaluable tool in the clinical work-up of patients suspected of having breast carcinoma. The purpose of this study is to introduce novel features extracted from the kinetics of contrast agent uptake imaged by a short (100 s) vi...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2013.2281984

    authors: Platel B,Mus R,Welte T,Karssemeijer N,Mann R

    更新日期:2014-02-01 00:00:00

  • Detection and Localization of Ultrasound Scatterers Using Convolutional Neural Networks.

    abstract::Delay-and-sum (DAS) beamforming is unable to identify individual scatterers when their density is so high that their point spread functions overlap. This paper proposes a convolutional neural network (CNN)-based method to detect and localize high-density scatterers, some of which are closer than the resolution limit o...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3006445

    authors: Youn J,Ommen ML,Stuart MB,Thomsen EV,Larsen NB,Jensen JA

    更新日期:2020-12-01 00:00:00

  • Association Between Changes in Mammographic Image Features and Risk for Near-Term Breast Cancer Development.

    abstract::The purpose of this study is to develop and test a new computerized model for predicting near-term breast cancer risk based on quantitative assessment of bilateral mammographic image feature variations in a series of negative full-field digital mammography (FFDM) images. The retrospective dataset included series of fo...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2016.2527619

    authors: Tan M,Zheng B,Leader JK,Gur D

    更新日期:2016-07-01 00:00:00

  • Fractal feature analysis and classification in medical imaging.

    abstract::Following B.B. Mandelbrot's fractal theory (1982), it was found that the fractal dimension could be obtained in medical images by the concept of fractional Brownian motion. An estimation concept for determination of the fractal dimension based upon the concept of fractional Brownian motion is discussed. Two applicatio...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.24861

    authors: Chen CC,Daponte JS,Fox MD

    更新日期:1989-01-01 00:00:00

  • Bidirectional Mapping-Based Domain Adaptation for Nucleus Detection in Cross-Modality Microscopy Images.

    abstract::Cell or nucleus detection is a fundamental task in microscopy image analysis and has recently achieved state-of-the-art performance by using deep neural networks. However, training supervised deep models such as convolutional neural networks (CNNs) usually requires sufficient annotated image data, which is prohibitive...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3042789

    authors: Xing F,Cornish TC,Bennett TD,Ghosh D

    更新日期:2020-12-07 00:00:00

  • Keypoint Transfer for Fast Whole-Body Segmentation.

    abstract::We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transf...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2851194

    authors: Wachinger C,Toews M,Langs G,Wells W,Golland P

    更新日期:2020-02-01 00:00:00

  • DetexNet: Accurately Diagnosing Frequent and Challenging Pediatric Malignant Tumors.

    abstract::The most frequent extracranial solid tumors of childhood, named peripheral neuroblastic tumors (pNTs), are very challenging to diagnose due to their diversified categories and varying forms. Auxiliary diagnosis methods of such pediatric malignant cancers are highly needed to provide pathologists assistance and reduce ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3027547

    authors: Liu Y,Yin M,Sun S

    更新日期:2021-01-01 00:00:00

  • Low-Rank Atlas Image Analyses in the Presence of Pathologies.

    abstract::We present a common framework, for registering images to an atlas and for forming an unbiased atlas, that tolerates the presence of pathologies such as tumors and traumatic brain injury lesions. This common framework is particularly useful when a sufficient number of protocol-matched scans from healthy subjects cannot...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2448556

    authors: Liu X,Niethammer M,Kwitt R,Singh N,McCormick M,Aylward S

    更新日期:2015-12-01 00:00:00

  • Direct Parametric Reconstruction Using Anatomical Regularization for Simultaneous PET/MRI Data.

    abstract::Pharmacokinetic analysis of dynamic positron emission tomography (PET) imaging data maps the measured time activity curves to a set of model-specific pharmacokinetic parameters. Voxel-based parameter estimation via curve fitting is conventionally performed indirectly on a sequence of independently reconstructed PET im...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2427777

    authors: Loeb R,Navab N,Ziegler SI

    更新日期:2015-11-01 00:00:00

  • Optoacoustic Dermoscopy of the Human Skin: Tuning Excitation Energy for Optimal Detection Bandwidth With Fast and Deep Imaging in vivo.

    abstract::Optoacoustic (photoacoustic) dermoscopy offers two principal advantages over conventional optical imaging applied in dermatology. First, it yields high-resolution cross-sectional images of the skin at depths not accessible to other non-invasive optical imaging methods. Second, by resolving absorption spectra at multip...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2664142

    authors: Schwarz M,Soliman D,Omar M,Buehler A,Ovsepian SV,Aguirre J,Ntziachristos V

    更新日期:2017-06-01 00:00:00

  • Narrowband magnetic particle imaging.

    abstract::The magnetic particle imaging (MPI) method directly images the magnetization of super-paramagnetic iron oxide (SPIO) nanoparticles, which are contrast agents commonly used in magnetic resonance imaging (MRI). MPI, as originally envisioned, requires a high-bandwidth receiver coil and preamplifier, which are difficult t...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2009.2013849

    authors: Goodwill PW,Scott GC,Stang PP,Conolly SM

    更新日期:2009-08-01 00:00:00

  • Multislice radio-frequency current density imaging.

    abstract::Radio-frequency current density imaging (RF-CDI) is an imaging technique that noninvasively measures current density distribution at the Larmor frequency utilizing magnetic resonance imaging (MRI). Previously implemented RF-CDI techniques were only able to image a single slice transverse to the static magnetic field B...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.2012161

    authors: Wang D,DeMonte TP,Ma W,Joy ML,Nachman AI

    更新日期:2009-07-01 00:00:00

  • An optimization transfer algorithm for nonlinear parametric image reconstruction from dynamic PET data.

    abstract::Direct reconstruction of kinetic parameters from raw projection data is a challenging task in molecular imaging using dynamic positron emission tomography (PET). This paper presents a new optimization transfer algorithm for penalized likelihood direct reconstruction of nonlinear parametric images that is easy to use a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2212203

    authors: Wang G,Qi J

    更新日期:2012-10-01 00:00:00

  • Automatic construction of parts+geometry models for initializing groupwise registration.

    abstract::Groupwise nonrigid image registration is a powerful tool to automatically establish correspondences across sets of images. Such correspondences are widely used for constructing statistical models of shape and appearance. As existing techniques usually treat registration as an optimization problem, a good initializatio...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2169077

    authors: Zhang P,Cootes TF

    更新日期:2012-02-01 00:00:00

  • Burn depth analysis using multidimensional scaling applied to psychophysical experiment data.

    abstract::In this paper a psychophysical experiment and a multidimensional scaling (MDS) analysis are undergone to determine the physical characteristics that physicians employ to diagnose a burn depth. Subsequently, these characteristics are translated into mathematical features, correlated with these physical characteristics ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2013.2254719

    authors: Acha B,Serrano C,Fondón I,Gómez-Cía T

    更新日期:2013-06-01 00:00:00

  • Time-frequency MEG-MUSIC algorithm.

    abstract::We propose a method that incorporates the time-frequency characteristics of neural sources into magnetoencephalographic (MEG) source estimation. The method is based on the multiple-signal-classification (MUSIC) algorithm and it calculates a time--frequency matrix in which diagonal and off-diagonal terms are the auto a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.750262

    authors: Sekihara K,Nagarajan S,Poeppel D,Miyashita Y

    更新日期:1999-01-01 00:00:00

  • Semiautomated border tracking of cine echocardiographic ventnrcular images.

    abstract::Two-dimensional ultrasound sector scans of the left ventricle (LV) are commonly used to diagnose cardiac mechanical function. Present quantification procedures of wall motion by this technique entail inaccuracies, mainly due to relatively poor image quality and the absence of a definition of the relative position of t...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.1987.4307836

    authors: Adam D,Hareuveni O,Sideman S

    更新日期:1987-01-01 00:00:00