Abstract：
:Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for second-trimester anomaly screening, for which ultrasound (US) is employed. Although expert sonographers are adept at reading US images, MR images which closely resemble anatomical images are much easier for non-experts to interpret. Thus in this article we propose to generate MR-like images directly from clinical US images. In medical image analysis such a capability is potentially useful as well, for instance for automatic US-MRI registration and fusion. The proposed model is end-to-end trainable and self-supervised without any external annotations. Specifically, based on an assumption that the US and MRI data share a similar anatomical latent space, we first utilise a network to extract the shared latent features, which are then used for MRI synthesis. Since paired data is unavailable for our study (and rare in practice), pixel-level constraints are infeasible to apply. We instead propose to enforce the distributions to be statistically indistinguishable, by adversarial learning in both the image domain and feature space. To regularise the anatomical structures between US and MRI during synthesis, we further propose an adversarial structural constraint. A new cross-modal attention technique is proposed to utilise non-local spatial information, by encouraging multi-modal knowledge fusion and propagation. We extend the approach to consider the case where 3D auxiliary information (e.g., 3D neighbours and a 3D location index) from volumetric data is also available, and show that this improves image synthesis. The proposed approach is evaluated quantitatively and qualitatively with comparison to real fetal MR images and other approaches to synthesis, demonstrating its feasibility of synthesising realistic MR images.
journal_name
IEEE Trans Med Imagingjournal_title
IEEE transactions on medical imagingauthors
Jiao J,Namburete AIL,Papageorghiou AT,Noble JAdoi
10.1109/TMI.2020.3018560subject
Has Abstractpub_date
2020-12-01 00:00:00pages
4413-4424issue
12eissn
0278-0062issn
1558-254Xjournal_volume
39pub_type
杂志文章abstract：:Thin, dense interslice septa have long been used to reduce the scattered radiation collected in positron emission tomography (PET). These septa prevent the acquisition of coincident gamma rays that are oblique to the scanning planes. Several volume imaging systems that acquire oblique rays have been built. The reasons...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.222675
更新日期：1993-01-01 00:00:00
abstract：:Ultrafast ultrasound imaging using plane or diverging waves, instead of focused beams, has advanced greatly the development of novel ultrasound imaging methods for evaluating tissue functions beyond anatomical information. However, the sonographic signal-to-noise ratio (SNR) of ultrafast imaging remains limited due to...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2017.2781261
更新日期：2018-04-01 00:00:00
abstract：:Imaging intramyocardial vascular flows in real-time could strongly help to achieve better diagnostic of cardiovascular diseases. To date, no standard imaging modality allows describing accurately myocardial blood flow dynamics with good spatial and temporal resolution. We recently introduced a novel ultrasonic Doppler...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2203316
更新日期：2012-08-01 00:00:00
abstract：:A software system, CTIP, written in Fortran is discussed which remaps the computerized tomography (CT) image gray level so that both the lung and heart regions are clearly visible with a "natural anatomical appearance." The system is adaptive to image statistics derived from the gray-level histogram of the entire imag...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.1986.4307736
更新日期：1986-01-01 00:00:00
abstract：:To improve the quantitative accuracy of linear attenuation coefficients measured by computed tomography (CT), we used a single scatter model to estimate the Compton scatter distribution and then a polychromatic image reconstruction algorithm, namely the iterative maximum-likelihood polychromatic algorithm for CT (IMPA...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2015.2395438
更新日期：2015-06-01 00:00:00
abstract：:Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator v...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.746626
更新日期：1998-12-01 00:00:00
abstract：:For fully characterizing renal cell carcinoma (RCC), information about the 3D tissue microstructure is essential. Histopathology, which represents the current diagnostic gold standard, is destructive and only provides 2D information. 3D X-ray histology endeavors to overcome these limitations by generating 3D data. In ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2019.2952028
更新日期：2020-05-01 00:00:00
abstract：:Motion degrades magnetic resonance (MR) images and prevents acquisition of self-consistent and high-quality volume images. A novel methodology, Snapshot magnetic resonance imaging (MRI) with Volume Reconstruction (SVR) has been developed for imaging moving subjects at high resolution and high signal-to-noise ratio (SN...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2007.895456
更新日期：2007-07-01 00:00:00
abstract：:Reaction-diffusion based tumor growth models have been widely used in the literature for modeling the growth of brain gliomas. Lately, recent models have started integrating medical images in their formulation. Including different tissue types, geometry of the brain and the directions of white matter fiber tracts impr...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2009.2026413
更新日期：2010-01-01 00:00:00
abstract：:Most benign breast tumors possess well-defined, sharp boundaries that delineate them from surrounding tissues, as opposed to malignant tumors. Computer techniques proposed to date for tumor analysis have concentrated on shape factors of tumor regions and texture measures. While shape measures based on contours of tumo...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.650876
更新日期：1997-12-01 00:00:00
abstract：:Dynamic contrast-enhanced magnetic resonance imaging (MRI) is a promising tool in the evaluation of tumor physiology. From rapidly acquired images and a model for contrast agent pharmacokinetics, physiological parameters are derived. One pharmacokinetic model, the tissue homogeneity model, enables estimation of both b...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2009.2016212
更新日期：2009-09-01 00:00:00
abstract：:Robust and fast 3D tracking of deformable objects, such as heart, is a challenging task because of the relatively low image contrast and speed requirement. Many existing 2D algorithms might not be directly applied on the 3D tracking problem. The 3D tracking performance is limited due to dramatically increased data siz...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2158440
更新日期：2011-11-01 00:00:00
abstract：:Anisotropic multi-slice Cardiac Magnetic Resonance (CMR) Images are conventionally acquired in patient-specific short-axis (SAX) orientation. In specific cardiovascular diseases that affect right ventricular (RV) morphology, acquisitions in standard axial (AX) orientation are preferred by some investigators, due to po...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2021.3052972
更新日期：2021-01-20 00:00:00
abstract：:Statistical image reconstruction methods for X-ray computed tomography (CT) provide improved spatial resolution and noise properties over conventional filtered back-projection (FBP) reconstruction, along with other potential advantages such as reduced patient dose and artifacts. Conventional regularized image reconstr...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2014.2365179
更新日期：2015-02-01 00:00:00
abstract：:We propose a method for restoring the underlying true signal in noisy functional images. The Nadaraya-Watson (NW) estimator described in, e.g., [1] is a classical nonparametric estimator for this problem. Since the true scene in many applications contains abrupt changes between pixels of different types, a modificatio...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.906423
更新日期：2001-01-01 00:00:00
abstract：:The continuous medial representation (cm-rep) is an approach that makes it possible to model, normalize, and analyze anatomical structures on the basis of medial geometry. Having recently presented a partial differential equation (PDE)-based approach for 3-D cm-rep modeling [1], here we present an equivalent 2-D appro...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2007.900322
更新日期：2007-09-01 00:00:00
abstract：:We consider 3-D brain structures as continuous parameterized surfaces and present a metric for their comparisons that is invariant to the way they are parameterized. Past comparisons of such surfaces involve either volume deformations or nonrigid matching under fixed parameterizations of surfaces. We propose a new mat...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2010.2099130
更新日期：2011-03-01 00:00:00
abstract：:Peripheral Nerve Stimulation (PNS) limits the acquisition rate of Magnetic Resonance Imaging data for fast sequences employing powerful gradient systems. The PNS characteristics are currently assessed after the coil design phase in experimental stimulation studies using constructed coil prototypes. This makes it diffi...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.3023329
更新日期：2021-01-01 00:00:00
abstract：:The Bayesian ideal observer provides an absolute upper bound for diagnostic performance of an imaging system and hence should be used for the assessment of image quality whenever possible. However, computation of ideal-observer performance in clinical tasks is difficult since the probability density functions of the d...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2008.2008967
更新日期：2009-05-01 00:00:00
abstract：:A special-purpose hardware architecture is proposed to implement the expectation-maximization algorithm to compute, in clinically useful times, the maximum-likelihood estimate of a radionuclide distribution for a positron-emission tomogram from time-of-flight measurements. Two-dimensional convolutions required for for...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.14510
更新日期：1988-01-01 00:00:00
abstract：:In magnetic resonance imaging (MRI), spatial resolution is limited by several factors such as acquisition time, short physiological phenomena, and organ motion. The acquired image usually has higher resolution in two dimensions (the acquisition plane) in comparison with the third dimension, resulting in highly anisotr...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2014.2329271
更新日期：2014-10-01 00:00:00
abstract：:Cone beam X-ray luminescence computed tomography (CB-XLCT) is a promising imaging technique in studying the physiological and pathological processes in small animals. However, the dynamic bio-distributions of probes in small animal, especially in adjacent targets are still hard to be captured directly from dynamic CB-...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2019.2917026
更新日期：2019-12-01 00:00:00
abstract：:A capacitive impedance metasurface combined with a transceiver coil to improve the radio frequency magnetic field for 1.5T magnetic resonance imaging applications is presented. The novel transceiver provides localized enhancement in magnetic flux density when compared to a transceiver coil alone by incorporating an el...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2019.2942194
更新日期：2020-04-01 00:00:00
abstract：:Decomposition of water and fat in magnetic resonance imaging (MRI) is important for biomedical research and clinical applications. In this paper, we propose a two-phased approach for the three-point water-fat decomposition problem. Our contribution consists of two components: 1) a background-masked Markov random field...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2125980
更新日期：2011-08-01 00:00:00
abstract：:Radio-frequency (RF) transceiver array design using primary and higher order harmonics for in vivo parallel magnetic resonance imaging imaging (MRI) and spectroscopic imaging is proposed. The improved electromagnetic decoupling performance, unique magnetic field distributions and high-frequency operation capabilities ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2166273
更新日期：2012-02-01 00:00:00
abstract：:The response characteristics of two tomographic systems were compared for imaging of positron emitters: a) a SPECT system with a 3/8 in crystal and 511 keV detector shielding, equipped with a specially designed 511 keV collimator, and b) a PET V system using coincidence detection. SPECT transverse plane resolution was...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.1986.4307776
更新日期：1986-01-01 00:00:00
abstract：:Automated whole breast ultrasound (ABUS) is becoming a popular screening modality for whole breast examination. Compared to conventional handheld ultrasound, ABUS achieves operator-independent and is feasible for mass screening. However, reviewing hundreds of slices in an ABUS image volume is time-consuming. A compute...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2014.2315206
更新日期：2014-07-01 00:00:00
abstract：:The development of an automatic telemedicine system for computer-aided screening and grading of diabetic retinopathy depends on reliable detection of retinal lesions in fundus images. In this paper, a novel method for automatic detection of both microaneurysms and hemorrhages in color fundus images is described and va...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2015.2509785
更新日期：2016-04-01 00:00:00
abstract：:Prostate cancer (PCa) recurrences are often predicted by assessing the status of surgical margins (SM)- positive surgical margins (PSM) increase the chances of biochemical recurrence by 2-4 times which may lead to PCa recurrence. To this end, an electrical impedance acquisition system with a microendoscopic probe was ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2016.2578939
更新日期：2016-12-01 00:00:00
abstract：:Determining the susceptibility distribution from the magnetic field measured in a magnetic resonance (MR) scanner is an ill-posed inverse problem, because of the presence of zeroes in the convolution kernel in the forward problem. An algorithm called morphology enabled dipole inversion (MEDI), which incorporates spati...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2182523
更新日期：2012-03-01 00:00:00
