Abstract:
:We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentric patches at multiple resolutions with different fields of view, feed different branches of HookNet, and intermediate representations are combined via a hooking mechanism. We describe a framework to design and train HookNet for achieving high-resolution semantic segmentation and introduce constraints to guarantee pixel-wise alignment in feature maps during hooking. We show the advantages of using HookNet in two histopathology image segmentation tasks where tissue type prediction accuracy strongly depends on contextual information, namely (1) multi-class tissue segmentation in breast cancer and, (2) segmentation of tertiary lymphoid structures and germinal centers in lung cancer. We show the superiority of HookNet when compared with single-resolution U-Net models working at different resolutions as well as with a recently published multi-resolution model for histopathology image segmentation. We have made HookNet publicly available by releasing the source code1 as well as in the form of web-based applications2,3 based on the grand-challenge.org platform.
journal_name
Med Image Analjournal_title
Medical image analysisauthors
van Rijthoven M,Balkenhol M,Siliņa K,van der Laak J,Ciompi Fdoi
10.1016/j.media.2020.101890subject
Has Abstractpub_date
2021-02-01 00:00:00pages
101890eissn
1361-8415issn
1361-8423pii
S1361-8415(20)30254-1journal_volume
68pub_type
杂志文章abstract::Analyses of the human tongue motion as captured from 2D dynamic ultrasound data often requires segmentation of the mid-sagittal tongue contours. However, semi-automatic extraction of the tongue shape presents practical challenges. We approach this segmentation problem by proposing a novel higher-order Markov random fi...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2012.07.001
更新日期:2012-12-01 00:00:00
abstract::Clinical acceptance of 3-D OCT retinal imaging brought rapid development of quantitative 3-D analysis of retinal layers, vasculature, retinal lesions as well as facilitated new research in retinal diseases. One of the cornerstones of many such analyses is segmentation and thickness quantification of retinal layers and...
journal_title:Medical image analysis
pub_type: 社论
doi:10.1016/j.media.2016.06.001
更新日期:2016-10-01 00:00:00
abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.02.001
更新日期:2016-07-01 00:00:00
abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101861
更新日期:2021-01-01 00:00:00
abstract::Fundus camera imaging of the retina is widely used to diagnose and manage ophthalmologic disorders including diabetic retinopathy, glaucoma, and age-related macular degeneration. Retinal images typically have a limited field of view, and multiple images can be joined together using an image registration technique to f...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.04.001
更新日期:2010-08-01 00:00:00
abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101535
更新日期:2019-12-01 00:00:00
abstract::Both resting state fMRI (R-fMRI) and task-based fMRI (T-fMRI) have been widely used to study the functional activities of the human brain during task-free and task-performance periods, respectively. However, due to the difficulty in strictly controlling the participating subject's mental status and their cognitive beh...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.07.003
更新日期:2013-12-01 00:00:00
abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101859
更新日期:2021-01-01 00:00:00
abstract::With the advent of large-scale imaging studies and big health data, and the corresponding growth in analytics, machine learning and computational image analysis methods, there are now exciting opportunities for deepening our understanding of the mechanisms and characteristics of heart disease. Two emerging fields are ...
journal_title:Medical image analysis
pub_type: 社论,评审
doi:10.1016/j.media.2016.06.027
更新日期:2016-10-01 00:00:00
abstract::Accurate cortical thickness estimation is important for the study of many neurodegenerative diseases. Many approaches have been previously proposed, which can be broadly categorised as mesh-based and voxel-based. While the mesh-based approaches can potentially achieve subvoxel resolution, they usually lack the computa...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.07.003
更新日期:2009-10-01 00:00:00
abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.06.001
更新日期:2019-08-01 00:00:00
abstract::Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is chal...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101561
更新日期:2020-01-01 00:00:00
abstract::The accurate localization of anatomical landmarks is a challenging task, often solved by domain specific approaches. We propose a method for the automatic localization of landmarks in complex, repetitive anatomical structures. The key idea is to combine three steps: (1) a classifier for pre-filtering anatomical landma...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.02.004
更新日期:2013-12-01 00:00:00
abstract::Percutaneous coronary intervention is a minimally invasive procedure that is usually performed under image guidance using X-ray angiograms in which coronary arteries are opacified with contrast agent. In X-ray images, 3D objects are projected on a 2D plane, generating semi-transparent layers that overlap each other. T...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.04.011
更新日期:2017-07-01 00:00:00
abstract::Retinal images are routinely acquired and assessed to provide diagnostic evidence for many important diseases, e.g. diabetes or hypertension. Because of the acquisition process, very often these images are non-uniformly illuminated and exhibit local luminosity and contrast variability. This problem may seriously affec...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2004.07.001
更新日期:2005-06-01 00:00:00
abstract::We present an algorithm estimating the width of retinal vessels in fundus camera images. The algorithm uses a novel parametric surface model of the cross-sectional intensities of vessels, and ensembles of bagged decision trees to estimate the local width from the parameters of the best-fit surface. We report comparati...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.07.006
更新日期:2013-12-01 00:00:00
abstract::We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small numb...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.01.003
更新日期:2009-06-01 00:00:00
abstract::In this paper, we propose a new strategy for modelling sliding conditions when registering 3D images in a piecewise-diffeomorphic framework. More specifically, our main contribution is the development of a mathematical formalism to perform Large Deformation Diffeomorphic Metric Mapping registration with sliding condit...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2012.10.001
更新日期:2013-02-01 00:00:00
abstract::The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.01.003
更新日期:2010-06-01 00:00:00
abstract::Diffusion tensor imaging can provide the fundamental information required for viewing structural connectivity. However, robust and accurate acquisition and processing algorithms are needed to accurately map the nerve connectivity. In this paper, we present a novel algorithm for extracting and visualizing the fiber tra...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2003.12.001
更新日期:2004-06-01 00:00:00
abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.09.004
更新日期:2018-01-01 00:00:00
abstract::A novel image segmentation algorithm was developed to allow the automatic segmentation of both normal and abnormal anatomy from medical images. The new algorithm is a form of spatially varying statistical classification, in which an explicit anatomical template is used to moderate the segmentation obtained by statisti...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(00)00003-7
更新日期:2000-03-01 00:00:00
abstract::Diffusion magnetic resonance imaging (dMRI) offers a unique tool for noninvasively assessing tissue microstructure. However, accurate estimation of tissue microstructure described by complicated signal models can be challenging when a reduced number of diffusion gradients are used. Deep learning based microstructure e...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.04.006
更新日期:2019-07-01 00:00:00
abstract::This paper presents a symbolic visualization environment known as the Corner Cube environment, which was developed to facilitate rapid examination and comparison of activated foci defined by analyses of functional neuroimaging datasets. We have performed a comparative evaluation of this environment against maximum-int...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(98)80020-0
更新日期:1998-09-01 00:00:00
abstract::Pixelwise segmentation of the left ventricular (LV) myocardium and the four cardiac chambers in 2-D steady state free precession (SSFP) cine sequences is an essential preprocessing step for a wide range of analyses. Variability in contrast, appearance, orientation, and placement of the heart between patients, clinical...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.05.008
更新日期:2018-08-01 00:00:00
abstract::In this paper, we present a generative Bayesian approach for estimating the low-dimensional latent space of diffeomorphic shape variability in a population of images. We develop a latent variable model for principal geodesic analysis (PGA) that provides a probabilistic framework for factor analysis in the space of dif...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2015.04.009
更新日期:2015-10-01 00:00:00
abstract::A probabilistic framework for registering generalised point sets comprising multiple voxel-wise data features such as positions, orientations and scalar-valued quantities, is proposed. It is employed for the analysis of magnetic resonance diffusion tensor image (DTI)-derived quantities, such as fractional anisotropy (...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.01.001
更新日期:2019-04-01 00:00:00
abstract::In prostate cancer radiotherapy, computed tomography (CT) is widely used for dose planning purposes. However, because CT has low soft tissue contrast, it makes manual contouring difficult for major pelvic organs. In contrast, magnetic resonance imaging (MRI) provides high soft tissue contrast, which makes it ideal for...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.05.004
更新日期:2017-10-01 00:00:00
abstract::In this note we summarize the history of computer aided surgery in orthopaedics and traumatology from the end of the nineteenth century to currently observable future trends. We concentrate on the two major components of such systems, pre-operative planning and intra-operative execution. The evolution of the necessary...
journal_title:Medical image analysis
pub_type: 社论
doi:10.1016/j.media.2016.06.033
更新日期:2016-10-01 00:00:00
abstract::It has previously been demonstrated that freehand 3D ultrasound can be acquired without a position sensor by measuring the elevational speckle decorrelation from frame to frame. However, this requires that the B-scans contain significant amounts of fully developed speckle. In this paper, we show that this condition is...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2005.08.001
更新日期:2006-04-01 00:00:00