Abstract:
:The automatic diagnosis of various retinal diseases from fundus images is important to support clinical decision-making. However, developing such automatic solutions is challenging due to the requirement of a large amount of human-annotated data. Recently, unsupervised/self-supervised feature learning techniques receive a lot of attention, as they do not need massive annotations. Most of the current self-supervised methods are analyzed with single imaging modality and there is no method currently utilize multi-modal images for better results. Considering that the diagnostics of various vitreoretinal diseases can greatly benefit from another imaging modality, e.g., FFA, this paper presents a novel self-supervised feature learning method by effectively exploiting multi-modal data for retinal disease diagnosis. To achieve this, we first synthesize the corresponding FFA modality and then formulate a patient feature-based softmax embedding objective. Our objective learns both modality-invariant features and patient-similarity features. Through this mechanism, the neural network captures the semantically shared information across different modalities and the apparent visual similarity between patients. We evaluate our method on two public benchmark datasets for retinal disease diagnosis. The experimental results demonstrate that our method clearly outperforms other self-supervised feature learning methods and is comparable to the supervised baseline. Our code is available at GitHub.
journal_name
IEEE Trans Med Imagingjournal_title
IEEE transactions on medical imagingauthors
Li X,Jia M,Islam MT,Yu L,Xing Ldoi
10.1109/TMI.2020.3008871subject
Has Abstractpub_date
2020-12-01 00:00:00pages
4023-4033issue
12eissn
0278-0062issn
1558-254Xjournal_volume
39pub_type
杂志文章abstract::One-dimensional (1-D) linear transducer arrays can be used for three-dimensional (3-D) ultrasound image acquisition. However, the relatively low spatial resolution of these arrays in the elevation direction results in blurry 3-D images. Here, the authors introduce an elevation direction deconvolution (EDD) method that...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.500148
更新日期:1996-01-01 00:00:00
abstract::Automatic computer-based methods are well suited for the image analysis of the different components in atherosclerotic plaques. Although several groups work on such analysis some of the methods used are oversimplified and require improvements when used within a computational framework for predicting meaningful stress ...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2006.870485
更新日期:2006-03-01 00:00:00
abstract::The development and tests of an iterative reconstruction algorithm for emission tomography based on Bayesian statistical concepts are described. The algorithm uses the entropy of the generated image as a prior distribution, can be accelerated by the choice of an exponent, and converges uniformly to feasible images by ...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.56340
更新日期:1990-01-01 00:00:00
abstract::Digital processing that increases resolution by spatial deconvolution and histogram-based amplitude mapping has been used to improve ultrasonic abdominal image quality. The processing was applied to pulse-echo ultrasound data obtained from clinical imaging instrumentation modified to permit digital recording of signal...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.1983.4307617
更新日期:1983-01-01 00:00:00
abstract::The comment of Stig Steenstrup on the use of gray level entropy function in our paper' has been addressed. The entropy measure has not been used in the procedure of enhancement, but it has only been used to show statistically that the enhanced images have larger gray level entropy, and therefore better utilize the gra...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.1987.4307802
更新日期:1987-01-01 00:00:00
abstract::Displacement estimated interframe (DEI) coding, a coding scheme for 3-D medical image data sets such as X-ray computed tomography (CT) or magnetic resonance (MR) images, is presented. To take advantage of the correlation between contiguous slices, a displacement-compensated difference image based on the previous image...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.241875
更新日期:1993-01-01 00:00:00
abstract::We propose a novel adaptive approach based on the Reproducing Kernel Particle Method (RKPM) to extract the cortical surfaces of the brain from three-dimensional (3-D) magnetic resonance images (MRIs). To formulate the discrete equations of the deformable model, a flexible particle shape function is employed in the Gal...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/tmi.2006.873614
更新日期:2006-06-01 00:00:00
abstract::Maximization of mutual information (MMI) is a popular similarity measure for medical image registration. Although its accuracy and robustness has been demonstrated for rigid body image registration, extending MMI to nonrigid image registration is not trivial and an active field of research. We propose conditional mutu...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2009.2021843
更新日期:2010-01-01 00:00:00
abstract::Optoacoustic (photoacoustic) dermoscopy offers two principal advantages over conventional optical imaging applied in dermatology. First, it yields high-resolution cross-sectional images of the skin at depths not accessible to other non-invasive optical imaging methods. Second, by resolving absorption spectra at multip...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2017.2664142
更新日期:2017-06-01 00:00:00
abstract::Fast magnetic resonance imaging slice acquisition techniques such as single shot fast spin echo are routinely used in the presence of uncontrollable motion. These techniques are widely used for fetal magnetic resonance imaging (MRI) and MRI of moving subjects and organs. Although high-quality slices are frequently acq...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2010.2051680
更新日期:2010-10-01 00:00:00
abstract::A new, sample independent optimization criterion for minimizing the effect of the imaging gradients, including the directional awareness they create, is defined for diffusion tensor imaging (DTI) experiments. The DTI linear algebraic framework is expanded to a normed space to design optimal diffusion gradient schemes ...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2010.2090539
更新日期:2011-03-01 00:00:00
abstract::High-frame-rate ultrasonography based on coherent compounding of unfocused beams can potentially transform the assessment of cardiac function. As it requires successive waves to be combined coherently, this approach is sensitive to high-velocity tissue motion. We investigated coherent compounding of tilted diverging w...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2016.2523346
更新日期:2016-07-01 00:00:00
abstract::We describe the efficient algebraic reconstruction (EAR) method, which applies to cone-beam tomographic reconstruction problems with a circular symmetry. Three independant steps/stages are presented, which use two symmetries and a factorization of the point spread functions (PSFs), each reducing computing times and ev...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2005.861707
更新日期:2006-02-01 00:00:00
abstract::Cell or nucleus detection is a fundamental task in microscopy image analysis and has recently achieved state-of-the-art performance by using deep neural networks. However, training supervised deep models such as convolutional neural networks (CNNs) usually requires sufficient annotated image data, which is prohibitive...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2020.3042789
更新日期:2020-12-07 00:00:00
abstract::To solve the problem that traditional image registration methods based on continuous optimization for large motion lung 4D CT image sequences are easy to fall into local optimal solutions and lead to serious misregistration, a novel image registration method based on high-order Markov Random Field (MRF) is proposed. B...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2019.2937458
更新日期:2020-04-01 00:00:00
abstract::We present a new method to automatically compute, reorient, and recenter the mid-sagittal plane in anatomical and functional three-dimensional (3-D) brain images. This iterative approach is composed of two steps. At first, given an initial guess of the mid-sagittal plane (generally, the central plane of the image grid...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.993131
更新日期:2002-02-01 00:00:00
abstract::The aim of this study was to provide mathematical descriptors for the border of pigmented skin lesion images and to assess their efficacy for distinction among different lesion groups. New descriptors such as lesion slope and lesion slope regularity are introduced and mathematically defined. A new algorithm based on t...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2003.815901
更新日期:2003-08-01 00:00:00
abstract::A technique determines the optimal window width for orbiting rod transmission studies in positron emission tomography (PET). Windowing reduces noise in orbiting rod transmission studies. Lines-of-response (LOR) which intersect the rods generate primarily true coincidence events. LOR which pass far from the rods genera...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.387708
更新日期:1995-01-01 00:00:00
abstract::Diffuse Optical Tomography commonly neglects or assumes as insignificant the presence of optically clear regions in biological tissues, estimating their contribution as a small perturbation to light transport. The inaccuracy introduced by this practice is examined in detail in the context of a complete, based on reali...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2016.2646518
更新日期:2017-05-01 00:00:00
abstract::This paper presents an algorithm to transform and reconstruct diffusion-weighted imaging (DWI) data for alignment of micro-structures in association with spatial transformations. The key idea is to decompose the diffusion signal profile, a function defined on a unit sphere, into a series of weighted diffusion basis fu...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2012.2204766
更新日期:2012-11-01 00:00:00
abstract::In this paper, we present a robust approach to the registration of white matter tractographies extracted from diffusion tensor-magnetic resonance imaging scans. The fibers are projected into a high dimensional feature space based on the sequence of their 3-D coordinates. Adaptive mean-shift clustering is applied to ex...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2009.2029097
更新日期:2010-01-01 00:00:00
abstract::Magnetic resonance diffusion tensor imaging is being widely used to reconstruct brain white matter fiber tracts. To characterize structural properties of the tracts, reconstructed fibers are often grouped into bundles that correspond to coherent anatomic structures. For further group analysis of fiber bundles, it is d...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2009.2016337
更新日期:2009-09-01 00:00:00
abstract::A method for measuring the spatial concentration of specific categories of vessels in a vascular network consisting of vessels of several diameters, lengths, and orientations is demonstrated. It is shown that a combination of the mathematical morphology operation, opening, with a linear rotating structuring element (R...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.241865
更新日期:1993-01-01 00:00:00
abstract::X-ray computed tomography is a powerful medical imaging device. It allows high-resolution 3-D visualization of the human body. However, one drawback is the health risk associated with ionizing radiation. Simply downscaling the radiation intensities over the entire scan results in increased quantum noise. This paper pr...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2009.2034515
更新日期:2010-03-01 00:00:00
abstract::For fully characterizing renal cell carcinoma (RCC), information about the 3D tissue microstructure is essential. Histopathology, which represents the current diagnostic gold standard, is destructive and only provides 2D information. 3D X-ray histology endeavors to overcome these limitations by generating 3D data. In ...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2019.2952028
更新日期:2020-05-01 00:00:00
abstract::The accuracy of in vivo dopamine D2 receptor quantification by positron emission tomography (PET) was determined for several models by means of singular-value decomposition, and some of the model assumptions were reviewed. These include steady-state, transient, double injection, and equilibrium approaches. All four mo...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.7783
更新日期:1988-01-01 00:00:00
abstract::The quality of magnetic resonance imaging systems has improved to the point that motion is a major limitation in many examinations. Translational motion in the imaging plane causes the phase of the data to be corrupted. An algorithm using computer post-processing is proposed to correct the phase of the data, and hence...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.108589
更新日期:1991-01-01 00:00:00
abstract::Two methods for recovering an image that has been degraded while being processed are presented. The restoration problem is formulated as a constrained optimization problem in which a measure of smoothness based on the second derivatives of the restored image is maximized subject to the constraint that noise energy is ...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.126904
更新日期:1992-01-01 00:00:00
abstract::The theory and techniques of compressed sensing (CS) have shown their potential as a breakthrough in accelerating k-space data acquisition for parallel magnetic resonance imaging (pMRI). However, the performance of CS reconstruction models in pMRI has not been fully maximized, and CS recovery guarantees for pMRI are l...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/TMI.2015.2474383
更新日期:2016-01-01 00:00:00
abstract::A system for digital flashing tomosynthesis (DFTS) consists of four ECG-gated simultaneously flashed X-ray tubes, a 14-in image intensifier, a unit for digital subtraction angiography (DSA), a PC-hosted transputer network for three-dimensional (3-D) reconstruction as well as for quantitative coronary angiography and v...
journal_title:IEEE transactions on medical imaging
pub_type: 杂志文章
doi:10.1109/42.232261
更新日期:1993-01-01 00:00:00