Rubik's Cube+: A self-supervised feature learning framework for 3D medical image analysis.

Abstract:

:Due to the development of deep learning, an increasing number of research works have been proposed to establish automated analysis systems for 3D volumetric medical data to improve the quality of patient care. However, it is challenging to obtain a large number of annotated 3D medical data needed to train a neural network well, as such manual annotation by physicians is time consuming and laborious. Self-supervised learning is one of the potential solutions to mitigate the strong requirement of data annotation by deeply exploiting raw data information. In this paper, we propose a novel self-supervised learning framework for volumetric medical data. Specifically, we propose a pretext task, i.e., Rubik's cube+, to pre-train 3D neural networks. The pretext task involves three operations, namely cube ordering, cube rotating and cube masking, forcing networks to learn translation and rotation invariant features from the original 3D medical data, and tolerate the noise of the data at the same time. Compared to the strategy of training from scratch, fine-tuning from the Rubik's cube+ pre-trained weights can remarkablely boost the accuracy of 3D neural networks on various tasks, such as cerebral hemorrhage classification and brain tumor segmentation, without the use of extra data.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Zhu J,Li Y,Hu Y,Ma K,Zhou SK,Zheng Y

doi

10.1016/j.media.2020.101746

subject

Has Abstract

pub_date

2020-08-01 00:00:00

pages

101746

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(20)30110-9

journal_volume

64

pub_type

杂志文章
  • Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model.

    abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.001

    authors: Lee S,Reinhardt JM,Cattin PC,Abràmoff MD

    更新日期:2010-08-01 00:00:00

  • Intrasubject multimodal groupwise registration with the conditional template entropy.

    abstract::Image registration is an important task in medical image analysis. Whereas most methods are designed for the registration of two images (pairwise registration), there is an increasing interest in simultaneously aligning more than two images using groupwise registration. Multimodal registration in a groupwise setting r...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.02.003

    authors: Polfliet M,Klein S,Huizinga W,Paulides MM,Niessen WJ,Vandemeulebroucke J

    更新日期:2018-05-01 00:00:00

  • Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network.

    abstract::Synthesized medical images have several important applications. For instance, they can be used as an intermedium in cross-modality image registration or used as augmented training samples to boost the generalization capability of a classifier. In this work, we propose a generic cross-modality synthesis approach with t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.12.002

    authors: Cai J,Zhang Z,Cui L,Zheng Y,Yang L

    更新日期:2019-02-01 00:00:00

  • Local spatio-temporal encoding of raw perfusion MRI for the prediction of final lesion in stroke.

    abstract::We address the medical image analysis issue of predicting the final lesion in stroke from early perfusion magnetic resonance imaging. The classical processing approach for the dynamical perfusion images consists in a temporal deconvolution to improve the temporal signals associated with each voxel before performing pr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.08.008

    authors: Giacalone M,Rasti P,Debs N,Frindel C,Cho TH,Grenier E,Rousseau D

    更新日期:2018-12-01 00:00:00

  • A variational framework for integrating segmentation and registration through active contours.

    abstract::Traditionally, segmentation and registration have been solved as two independent problems, even though it is often the case that the solution to one impacts the solution to the other. In this paper, we introduce a geometric, variational framework that uses active contours to simultaneously segment and register feature...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(03)00004-5

    authors: Yezzi A,Zöllei L,Kapur T

    更新日期:2003-06-01 00:00:00

  • Segmentation of pulmonary nodules of various densities with morphological approaches and convexity models.

    abstract::Accurate segmentation of a pulmonary nodule is an important and active area of research in medical image processing. Although many algorithms have been reported in literature for this problem, those that are applicable to various density types have not been available until recently. In this paper, we propose a new alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.08.005

    authors: Kubota T,Jerebko AK,Dewan M,Salganicoff M,Krishnan A

    更新日期:2011-02-01 00:00:00

  • Multiple hypothesis template tracking of small 3D vessel structures.

    abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.12.003

    authors: Friman O,Hindennach M,Kühnel C,Peitgen HO

    更新日期:2010-04-01 00:00:00

  • Quantification of the detailed cardiac left ventricular trabecular morphogenesis in the mouse embryo.

    abstract::During embryogenesis, a mammalian heart develops from a simple tubular shape into a complex 4-chamber organ, going through four distinct phases: early primitive tubular heart, emergence of trabeculations, trabecular remodeling and development of the compact myocardium. In this paper we propose a framework for standard...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.08.001

    authors: Paun B,Bijnens B,Cook AC,Mohun TJ,Butakoff C

    更新日期:2018-10-01 00:00:00

  • Longitudinal segmentation of age-related white matter hyperintensities.

    abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.02.007

    authors: Sudre CH,Cardoso MJ,Ourselin S,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2017-05-01 00:00:00

  • An automated pipeline for cortical sulcal fundi extraction.

    abstract::In this paper, we propose a novel automated pipeline for extraction of sulcal fundi from triangulated cortical surfaces. This method consists of four consecutive steps. Firstly, we adopt a finite difference method to estimate principal curvatures, principal directions and curvature derivatives, along the principal dir...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.005

    authors: Li G,Guo L,Nie J,Liu T

    更新日期:2010-06-01 00:00:00

  • Automatic detection of over 100 anatomical landmarks in medical CT images: A framework with independent detectors and combinatorial optimization.

    abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.04.001

    authors: Hanaoka S,Shimizu A,Nemoto M,Nomura Y,Miki S,Yoshikawa T,Hayashi N,Ohtomo K,Masutani Y

    更新日期:2017-01-01 00:00:00

  • Non-invasive estimation of relative pressure in turbulent flow using virtual work-energy.

    abstract::Vascular pressure differences are established risk markers for a number of cardiovascular diseases. Relative pressures are, however, often driven by turbulence-induced flow fluctuations, where conventional non-invasive methods may yield inaccurate results. Recently, we proposed a novel method for non-turbulent flows, ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101627

    authors: Marlevi D,Ha H,Dillon-Murphy D,Fernandes JF,Fovargue D,Colarieti-Tosti M,Larsson M,Lamata P,Figueroa CA,Ebbers T,Nordsletten DA

    更新日期:2020-02-01 00:00:00

  • Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization.

    abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.07.007

    authors: Genet M,Stoeck CT,von Deuster C,Lee LC,Kozerke S

    更新日期:2018-12-01 00:00:00

  • Recovering from missing data in population imaging - Cardiac MR image imputation via conditional generative adversarial nets.

    abstract::Accurate ventricular volume measurements are the primary indicators of normal/abnor- mal cardiac function and are dependent on the Cardiac Magnetic Resonance (CMR) volumes being complete. However, missing or unusable slices owing to the presence of image artefacts such as respiratory or motion ghosting, aliasing, ring...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101812

    authors: Xia Y,Zhang L,Ravikumar N,Attar R,Piechnik SK,Neubauer S,Petersen SE,Frangi AF

    更新日期:2021-01-01 00:00:00

  • Quantitative analysis of multi-spectral fundus images.

    abstract::We have developed a new technique for extracting histological parameters from multi-spectral images of the ocular fundus. The new method uses a Monte Carlo simulation of the reflectance of the fundus to model how the spectral reflectance of the tissue varies with differing tissue histology. The model is parameterised ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2006.05.007

    authors: Styles IB,Calcagni A,Claridge E,Orihuela-Espina F,Gibson JM

    更新日期:2006-08-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • A symbolic environment for visualizing activated foci in functional neuroimaging datasets.

    abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80020-0

    authors: Rehm K,Lakshminaryan K,Frutiger S,Schaper KA,Sumners DW,Strother SC,Anderson JR,Rottenberg DA

    更新日期:1998-09-01 00:00:00

  • Adaptive local window for level set segmentation of CT and MRI liver lesions.

    abstract::We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and the changes of th...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.002

    authors: Hoogi A,Beaulieu CF,Cunha GM,Heba E,Sirlin CB,Napel S,Rubin DL

    更新日期:2017-04-01 00:00:00

  • Continuous diffusion signal, EAP and ODF estimation via Compressive Sensing in diffusion MRI.

    abstract::In this paper, we exploit the ability of Compressed Sensing (CS) to recover the whole 3D Diffusion MRI (dMRI) signal from a limited number of samples while efficiently recovering important diffusion features such as the Ensemble Average Propagator (EAP) and the Orientation Distribution Function (ODF). Some attempts to...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.02.010

    authors: Merlet SL,Deriche R

    更新日期:2013-07-01 00:00:00

  • Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation.

    abstract::Phase contrast, a noninvasive microscopy imaging technique, is widely used to capture time-lapse images to monitor the behavior of transparent cells without staining or altering them. Due to the optical principle, phase contrast microscopy images contain artifacts such as the halo and shade-off that hinder image segme...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.12.006

    authors: Yin Z,Kanade T,Chen M

    更新日期:2012-07-01 00:00:00

  • Automated localization of breast cancer in DCE-MRI.

    abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly being used for the detection and diagnosis of breast cancer. Compared to mammography, DCE-MRI provides higher sensitivity, however its specificity is variable. Moreover, DCE-MRI data analysis is time consuming and depends on reader expertis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.12.001

    authors: Gubern-Mérida A,Martí R,Melendez J,Hauth JL,Mann RM,Karssemeijer N,Platel B

    更新日期:2015-02-01 00:00:00

  • RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification.

    abstract::The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze them are quite challenging during the automatic diagnosis process. The multi-instance learning bas...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101549

    authors: Wang S,Zhu Y,Yu L,Chen H,Lin H,Wan X,Fan X,Heng PA

    更新日期:2019-12-01 00:00:00

  • Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: atlas-based approach and comparative study.

    abstract::Atlas-based methods for automated preoperative planning of the femoral stem implant in total hip arthroplasty are described. Statistical atlases are constructed from a number of past preoperative plans prepared by experienced surgeons in order to represent the surgeon's expertise of the planning. Two types of atlases ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.10.005

    authors: Otomaru I,Nakamoto M,Kagiyama Y,Takao M,Sugano N,Tomiyama N,Tada Y,Sato Y

    更新日期:2012-02-01 00:00:00

  • Multi-modal volume registration by maximization of mutual information.

    abstract::A new information-theoretic approach is presented for finding the registration of volumetric medical images of differing modalities. Registration is achieved by adjustment of the relative position and orientation until the mutual information between the images is maximized. In our derivation of the registration proced...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(01)80004-9

    authors: Wells WM 3rd,Viola P,Atsumi H,Nakajima S,Kikinis R

    更新日期:1996-03-01 00:00:00

  • Deformable image registration by combining uncertainty estimates from supervoxel belief propagation.

    abstract::Discrete optimisation strategies have a number of advantages over their continuous counterparts for deformable registration of medical images. For example: it is not necessary to compute derivatives of the similarity term; dense sampling of the search space reduces the risk of becoming trapped in local optima; and (in...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.09.005

    authors: Heinrich MP,Simpson IJ,Papież BW,Brady SM,Schnabel JA

    更新日期:2016-01-01 00:00:00

  • Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM.

    abstract::In order to improve the accuracy of image-guided neurosurgery, different biomechanical models have been developed to correct preoperative images with respect to intraoperative changes like brain shift or tumor resection. All existing biomechanical models simulate different anatomical structures by using either appropr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00059-2

    authors: Hagemann A,Rohr K,Stiehl HS

    更新日期:2002-12-01 00:00:00

  • Manifold modeling for brain population analysis.

    abstract::This paper describes a method for building efficient representations of large sets of brain images. Our hypothesis is that the space spanned by a set of brain images can be captured, to a close approximation, by a low-dimensional, nonlinear manifold. This paper presents a method to learn such a low-dimensional manifol...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.05.008

    authors: Gerber S,Tasdizen T,Thomas Fletcher P,Joshi S,Whitaker R,Alzheimers Disease Neuroimaging Initiative (ADNI).

    更新日期:2010-10-01 00:00:00

  • A subject-specific technique for respiratory motion correction in image-guided cardiac catheterisation procedures.

    abstract::We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small numb...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.01.003

    authors: King AP,Boubertakh R,Rhode KS,Ma YL,Chinchapatnam P,Gao G,Tangcharoen T,Ginks M,Cooklin M,Gill JS,Hawkes DJ,Razavi RS,Schaeffter T

    更新日期:2009-06-01 00:00:00

  • Hierarchical max-flow segmentation framework for multi-atlas segmentation with Kohonen self-organizing map based Gaussian mixture modeling.

    abstract::The incorporation of intensity, spatial, and topological information into large-scale multi-region segmentation has been a topic of ongoing research in medical image analysis. Multi-region segmentation problems, such as segmentation of brain structures, pose unique challenges in image segmentation in which regions may...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.05.005

    authors: Rajchl M,Baxter JS,McLeod AJ,Yuan J,Qiu W,Peters TM,Khan AR

    更新日期:2016-01-01 00:00:00

  • Computer aided diagnosis of thyroid nodules based on the devised small-datasets multi-view ensemble learning.

    abstract::With the development of deep learning, its application in diagnosis of benign and malignant thyroid nodules has been widely concerned. However, it is difficult to obtain medical images, resulting in insufficient number of data, which contradicts the large amount of data required for acquiring effective deep learning d...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101819

    authors: Chen Y,Li D,Zhang X,Jin J,Shen Y

    更新日期:2021-01-01 00:00:00