RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification.

Abstract:

:The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze them are quite challenging during the automatic diagnosis process. The multi-instance learning based on the most discriminative instances can be of great benefit for whole slide gastric image diagnosis. In this paper, we design a recalibrated multi-instance deep learning method (RMDL) to address this challenging problem. We first select the discriminative instances, and then utilize these instances to diagnose diseases based on the proposed RMDL approach. The designed RMDL network is capable of capturing instance-wise dependencies and recalibrating instance features according to the importance coefficient learned from the fused features. Furthermore, we build a large whole-slide gastric histopathology image dataset with detailed pixel-level annotations. Experimental results on the constructed gastric dataset demonstrate the significant improvement on the accuracy of our proposed framework compared with other state-of-the-art multi-instance learning methods. Moreover, our method is general and can be extended to other diagnosis tasks of different cancer types based on WSIs.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Wang S,Zhu Y,Yu L,Chen H,Lin H,Wan X,Fan X,Heng PA

doi

10.1016/j.media.2019.101549

subject

Has Abstract

pub_date

2019-12-01 00:00:00

pages

101549

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(19)30084-2

journal_volume

58

pub_type

杂志文章
  • Involuntary eye motion correction in retinal optical coherence tomography: Hardware or software solution?

    abstract::In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional ha...

    journal_title:Medical image analysis

    pub_type: 杂志文章,评审

    doi:10.1016/j.media.2017.02.002

    authors: Baghaie A,Yu Z,D'Souza RM

    更新日期:2017-04-01 00:00:00

  • Spine detection in CT and MR using iterated marginal space learning.

    abstract::Examinations of the spinal column with both, Magnetic Resonance (MR) imaging and Computed Tomography (CT), often require a precise three-dimensional positioning, angulation and labeling of the spinal disks and the vertebrae. A fully automatic and robust approach is a prerequisite for an automated scan alignment as wel...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.09.007

    authors: Michael Kelm B,Wels M,Kevin Zhou S,Seifert S,Suehling M,Zheng Y,Comaniciu D

    更新日期:2013-12-01 00:00:00

  • LinSEM: Linearizing segmentation evaluation metrics for medical images.

    abstract::Numerous algorithms are available for segmenting medical images. Empirical discrepancy metrics are commonly used in measuring the similarity or difference between segmentations by algorithms and "true" segmentations. However, one issue with the commonly used metrics is that the same metric value often represents diffe...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101601

    authors: Li J,Udupa JK,Tong Y,Wang L,Torigian DA

    更新日期:2020-02-01 00:00:00

  • Automated model-based vertebra detection, identification, and segmentation in CT images.

    abstract::For many orthopaedic, neurological, and oncological applications, an exact segmentation of the vertebral column including an identification of each vertebra is essential. However, although bony structures show high contrast in CT images, the segmentation and labelling of individual vertebrae is challenging. In this pa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.02.004

    authors: Klinder T,Ostermann J,Ehm M,Franz A,Kneser R,Lorenz C

    更新日期:2009-06-01 00:00:00

  • Shape regression machine and efficient segmentation of left ventricle endocardium from 2D B-mode echocardiogram.

    abstract::We present a machine learning approach called shape regression machine (SRM) for efficient segmentation of an anatomic structure that exhibits a deformable shape in a medical image, e.g., left ventricle endocardial wall in an echocardiogram. The SRM achieves efficient segmentation via statistical learning of the inter...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.002

    authors: Zhou SK

    更新日期:2010-08-01 00:00:00

  • Ultrasound-fluoroscopy registration for prostate brachytherapy dosimetry.

    abstract::Prostate brachytherapy is a treatment for prostate cancer using radioactive seeds that are permanently implanted in the prostate. The treatment success depends on adequate coverage of the target gland with a therapeutic dose, while sparing the surrounding tissue. Since seed implantation is performed under transrectal ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.001

    authors: Dehghan E,Lee J,Fallavollita P,Kuo N,Deguet A,Le Y,Clif Burdette E,Song DY,Prince JL,Fichtinger G

    更新日期:2012-10-01 00:00:00

  • Improved fidelity of brain microstructure mapping from single-shell diffusion MRI.

    abstract::Diffusion weighted imaging (DWI) is sensitive to alterations in the diffusion of water molecules caused by microstructural barriers. Different microstructural compartments are characterized by differences in DWI signal. Diffusion tensor imaging conflates the signal from these compartments into a single tensor, which p...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.10.004

    authors: Taquet M,Scherrer B,Boumal N,Peters JM,Macq B,Warfield SK

    更新日期:2015-12-01 00:00:00

  • Hierarchical segmentation using equivalence test (HiSET): Application to DCE image sequences.

    abstract::Dynamical contrast enhanced (DCE) imaging allows non invasive access to tissue micro-vascularization. It appears as a promising tool to build imaging biomarkers for diagnostic, prognosis or anti-angiogenesis treatment monitoring of cancer. However, quantitative analysis of DCE image sequences suffers from low signal t...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.10.007

    authors: Liu F,Cuenod CA,Thomassin-Naggara I,Chemouny S,Rozenholc Y

    更新日期:2019-01-01 00:00:00

  • Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images.

    abstract::This paper describes a method for the enhancement of curvilinear structures such as vessels and bronchi in three-dimensional (3-D) medical images. A 3-D line enhancement filter is developed with the aim of discriminating line structures from other structures and recovering line structures of various widths. The 3-D li...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80009-1

    authors: Sato Y,Nakajima S,Shiraga N,Atsumi H,Yoshida S,Koller T,Gerig G,Kikinis R

    更新日期:1998-06-01 00:00:00

  • Segmentation of the visible human for high-quality volume-based visualization.

    abstract::This article describes a combination of interactive classification and super-sampling visualization algorithms that greatly enhances the realism of 3-D reconstructions of the Visible Human data sets. Objects are classified on the basis of ellipsoidal regions in RGB space. The ellipsoids are used for super-sampling in ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(97)85001-3

    authors: Schiemann T,Tiede U,Höhne KH

    更新日期:1997-09-01 00:00:00

  • IDRiD: Diabetic Retinopathy - Segmentation and Grading Challenge.

    abstract::Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is chal...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101561

    authors: Porwal P,Pachade S,Kokare M,Deshmukh G,Son J,Bae W,Liu L,Wang J,Liu X,Gao L,Wu T,Xiao J,Wang F,Yin B,Wang Y,Danala G,He L,Choi YH,Lee YC,Jung SH,Li Z,Sui X,Wu J,Li X,Zhou T,Toth J,Baran A,Kori A,Ch

    更新日期:2020-01-01 00:00:00

  • Unsupervised boundary delineation of spinal neural foramina using a multi-feature and adaptive spectral segmentation.

    abstract::As a common disease in the elderly, neural foramina stenosis (NFS) brings a significantly negative impact on the quality of life due to its symptoms including pain, disability, fall risk and depression. Accurate boundary delineation is essential to the clinical diagnosis and treatment of NFS. However, existing clinica...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.10.009

    authors: He X,Zhang H,Landis M,Sharma M,Warrington J,Li S

    更新日期:2017-02-01 00:00:00

  • Adaptive local window for level set segmentation of CT and MRI liver lesions.

    abstract::We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and the changes of th...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.01.002

    authors: Hoogi A,Beaulieu CF,Cunha GM,Heba E,Sirlin CB,Napel S,Rubin DL

    更新日期:2017-04-01 00:00:00

  • Clavicle segmentation in chest radiographs.

    abstract::Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two s...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.06.009

    authors: Hogeweg L,Sánchez CI,de Jong PA,Maduskar P,van Ginneken B

    更新日期:2012-12-01 00:00:00

  • Group-level cortical surface parcellation with sulcal pits labeling.

    abstract::Sulcal pits are the points of maximal depth within the folds of the cortical surface. These shape descriptors give a unique opportunity to access to a rich, fine-scale representation of the geometry and the developmental milestones of the cortical surface. However, using sulcal pits analysis at group level requires ne...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101749

    authors: Kaltenmark I,Deruelle C,Brun L,Lefèvre J,Coulon O,Auzias G

    更新日期:2020-12-01 00:00:00

  • Spatially variable Rician noise in magnetic resonance imaging.

    abstract::Magnetic resonance images tend to be influenced by various random factors usually referred to as "noise". The principal sources of noise and related artefacts can be divided into two types: arising from hardware (acquisition coil arrays, gradient coils, field inhomogeneity); and arising from the subject (physiological...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2011.12.002

    authors: Maximov II,Farrher E,Grinberg F,Shah NJ

    更新日期:2012-02-01 00:00:00

  • Cardiac image modelling: Breadth and depth in heart disease.

    abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...

    journal_title:Medical image analysis

    pub_type: 社论,评审

    doi:10.1016/j.media.2016.06.027

    authors: Suinesiaputra A,McCulloch AD,Nash MP,Pontre B,Young AA

    更新日期:2016-10-01 00:00:00

  • Automated age estimation from MRI volumes of the hand.

    abstract::Highly relevant for both clinical and legal medicine applications, the established radiological methods for estimating unknown age in children and adolescents are based on visual examination of bone ossification in X-ray images of the hand. Our group has initiated the development of fully automatic age estimation meth...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101538

    authors: Štern D,Payer C,Urschler M

    更新日期:2019-12-01 00:00:00

  • DT-MRI denoising and neuronal fiber tracking.

    abstract::Diffusion tensor imaging can provide the fundamental information required for viewing structural connectivity. However, robust and accurate acquisition and processing algorithms are needed to accurately map the nerve connectivity. In this paper, we present a novel algorithm for extracting and visualizing the fiber tra...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2003.12.001

    authors: McGraw T,Vemuri BC,Chen Y,Rao M,Mareci T

    更新日期:2004-06-01 00:00:00

  • Segmentation of the skull in MRI volumes using deformable model and taking the partial volume effect into account.

    abstract::Segmentation of the skull in medical imagery is an important stage in applications that require the construction of realistic models of the head. Such models are used, for example, to simulate the behavior of electro-magnetic fields in the head and to model the electrical activity of the cortex in EEG and MEG data. In...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(00)00016-5

    authors: Rifa H,Bloch I,Hutchinson S,Wiart J,Garnero L

    更新日期:2000-09-01 00:00:00

  • Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black-blood MRI with a registration based geodesic active contour model.

    abstract::Segmentation of the geometric morphology of abdominal aortic aneurysm is important for interventional planning. However, the segmentation of both the lumen and the outer wall of aneurysm in magnetic resonance (MR) image remains challenging. This study proposes a registration based segmentation methodology for efficien...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.05.005

    authors: Wang Y,Seguro F,Kao E,Zhang Y,Faraji F,Zhu C,Haraldsson H,Hope M,Saloner D,Liu J

    更新日期:2017-08-01 00:00:00

  • Predicting the progression of mild cognitive impairment using machine learning: A systematic, quantitative and critical review.

    abstract::We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extr...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101848

    authors: Ansart M,Epelbaum S,Bassignana G,Bône A,Bottani S,Cattai T,Couronné R,Faouzi J,Koval I,Louis M,Thibeau-Sutre E,Wen J,Wild A,Burgos N,Dormont D,Colliot O,Durrleman S

    更新日期:2021-01-01 00:00:00

  • Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization.

    abstract::In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus rep...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.07.007

    authors: Genet M,Stoeck CT,von Deuster C,Lee LC,Kozerke S

    更新日期:2018-12-01 00:00:00

  • Recovering from missing data in population imaging - Cardiac MR image imputation via conditional generative adversarial nets.

    abstract::Accurate ventricular volume measurements are the primary indicators of normal/abnor- mal cardiac function and are dependent on the Cardiac Magnetic Resonance (CMR) volumes being complete. However, missing or unusable slices owing to the presence of image artefacts such as respiratory or motion ghosting, aliasing, ring...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101812

    authors: Xia Y,Zhang L,Ravikumar N,Attar R,Piechnik SK,Neubauer S,Petersen SE,Frangi AF

    更新日期:2021-01-01 00:00:00

  • An information theoretic approach for non-rigid image registration using voxel class probabilities.

    abstract::We propose two information theoretic similarity measures that allow to incorporate tissue class information in non-rigid image registration. The first measure assumes that tissue class probabilities have been assigned to each of the images to be registered by prior segmentation of both of them. One image is then non-r...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2005.03.004

    authors: D'Agostino E,Maes F,Vandermeulen D,Suetens P

    更新日期:2006-06-01 00:00:00

  • Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow.

    abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.001

    authors: Zheng Q,Delingette H,Ayache N

    更新日期:2019-08-01 00:00:00

  • Incomplete multi-modal representation learning for Alzheimer's disease diagnosis.

    abstract::Alzheimers disease (AD) is a complex neurodegenerative disease. Its early diagnosis and treatment have been a major concern of researchers. Currently, the multi-modality data representation learning of this disease is gradually becoming an emerging research field, attracting widespread attention. However, in practice,...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101953

    authors: Liu Y,Fan L,Zhang C,Zhou T,Xiao Z,Geng L,Shen D

    更新日期:2021-01-01 00:00:00

  • Automated voxel-based 3D cortical thickness measurement in a combined Lagrangian-Eulerian PDE approach using partial volume maps.

    abstract::Accurate cortical thickness estimation is important for the study of many neurodegenerative diseases. Many approaches have been previously proposed, which can be broadly categorised as mesh-based and voxel-based. While the mesh-based approaches can potentially achieve subvoxel resolution, they usually lack the computa...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.07.003

    authors: Acosta O,Bourgeat P,Zuluaga MA,Fripp J,Salvado O,Ourselin S,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2009-10-01 00:00:00

  • A novel deformation method for fast simulation of biological tissue formed by fibers and fluid.

    abstract::This paper presents a new approach to the simulation of soft tissues deformation suitable for real time computation, particularly intriguing for medical applications. The approach implements a quasi-static solution for elastic global deformations of objects filled with fluid and fibers, which can be a good approximati...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2012.04.002

    authors: Costa IF

    更新日期:2012-07-01 00:00:00

  • 4D hyperspherical harmonic (HyperSPHARM) representation of surface anatomy: a holistic treatment of multiple disconnected anatomical structures.

    abstract::Image-based parcellation of the brain often leads to multiple disconnected anatomical structures, which pose significant challenges for analyses of morphological shapes. Existing shape models, such as the widely used spherical harmonic (SPHARM) representation, assume topological invariance, so are unable to simultaneo...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.02.004

    authors: Pasha Hosseinbor A,Chung MK,Koay CG,Schaefer SM,van Reekum CM,Schmitz LP,Sutterer M,Alexander AL,Davidson RJ

    更新日期:2015-05-01 00:00:00