Abstract:
:Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient solutions for surgical workflow analysis, with potential applications in report generation, surgical training and even real-time decision support. Most existing tool annotation algorithms focus on laparoscopic surgeries. However, with 19 million interventions per year, the most common surgical procedure in the world is cataract surgery. The CATARACTS challenge was organized in 2017 to evaluate tool annotation algorithms in the specific context of cataract surgery. It relies on more than nine hours of videos, from 50 cataract surgeries, in which the presence of 21 surgical tools was manually annotated by two experts. With 14 participating teams, this challenge can be considered a success. As might be expected, the submitted solutions are based on deep learning. This paper thoroughly evaluates these solutions: in particular, the quality of their annotations are compared to that of human interpretations. Next, lessons learnt from the differential analysis of these solutions are discussed. We expect that they will guide the design of efficient surgery monitoring tools in the near future.
journal_name
Med Image Analjournal_title
Medical image analysisauthors
Al Hajj H,Lamard M,Conze PH,Roychowdhury S,Hu X,Maršalkaitė G,Zisimopoulos O,Dedmari MA,Zhao F,Prellberg J,Sahu M,Galdran A,Araújo T,Vo DM,Panda C,Dahiya N,Kondo S,Bian Z,Vahdat A,Bialopetravičius J,Flouty E,Qiudoi
10.1016/j.media.2018.11.008subject
Has Abstractpub_date
2019-02-01 00:00:00pages
24-41eissn
1361-8415issn
1361-8423pii
S1361-8415(18)30865-Xjournal_volume
52pub_type
杂志文章abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101861
更新日期:2021-01-01 00:00:00
abstract::We describe a new magnetic resonance (MR) image analysis tool that produces cortical surface representations with spherical topology from MR images of the human brain. The tool provides a sequence of low-level operations in a single package that can produce accurate brain segmentations in clinical time. The tools incl...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(02)00054-3
更新日期:2002-06-01 00:00:00
abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.06.001
更新日期:2019-08-01 00:00:00
abstract::Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decis...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101724
更新日期:2020-08-01 00:00:00
abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.02.007
更新日期:2017-05-01 00:00:00
abstract::The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.01.003
更新日期:2010-06-01 00:00:00
abstract::This paper describes a method for the enhancement of curvilinear structures such as vessels and bronchi in three-dimensional (3-D) medical images. A 3-D line enhancement filter is developed with the aim of discriminating line structures from other structures and recovering line structures of various widths. The 3-D li...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(98)80009-1
更新日期:1998-06-01 00:00:00
abstract::Fast and accurate 2D/3D registration plays an important role in many applications, ranging from scientific and engineering domains all the way to medical care. Today's predominant methods are based on computationally expensive approaches, such as virtual forward or back projections, that limit the real-time applicabil...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101815
更新日期:2021-01-01 00:00:00
abstract::Accurate digital representation of major white matter bundles in the brain is an important goal in neuroscience image computing since the representations can be used for surgical planning, intra-patient longitudinal analysis and inter-subject population connectivity studies. Reconstructing desired fiber bundles genera...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.02.008
更新日期:2018-05-01 00:00:00
abstract::Due to the development of deep learning, an increasing number of research works have been proposed to establish automated analysis systems for 3D volumetric medical data to improve the quality of patient care. However, it is challenging to obtain a large number of annotated 3D medical data needed to train a neural net...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101746
更新日期:2020-08-01 00:00:00
abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2020.101859
更新日期:2021-01-01 00:00:00
abstract::Recent progress in cardiac catheterization and devices has allowed the development of new therapies for severe cardiac diseases like arrhythmias and heart failure. The skills required for such interventions are very challenging to learn, and are typically acquired over several years. Virtual reality simulators may red...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.06.040
更新日期:2017-01-01 00:00:00
abstract::Ultrasonic techniques are presented for the study of soft biological tissue structure and function. Changes in echo waveforms caused by microscopic variations in the mechanical properties of tissue can reveal disease mechanism, in vivo. On a larger scale, elasticity imaging describes the macroscopic mechanical propert...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/s1361-8415(98)80014-5
更新日期:1998-12-01 00:00:00
abstract::Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the l...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101537
更新日期:2019-12-01 00:00:00
abstract::During embryogenesis, a mammalian heart develops from a simple tubular shape into a complex 4-chamber organ, going through four distinct phases: early primitive tubular heart, emergence of trabeculations, trabecular remodeling and development of the compact myocardium. In this paper we propose a framework for standard...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2018.08.001
更新日期:2018-10-01 00:00:00
abstract::Mutual information (MI) has been widely used as a similarity measure for rigid registration of multi-modal and uni-modal medical images. However, robust application of MI to deformable registration is challenging mainly because rich structural information, which are critical cues for successful deformable registration...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2013.12.003
更新日期:2014-02-01 00:00:00
abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.11.001
更新日期:2012-04-01 00:00:00
abstract::The automatic detection of exudates in color eye fundus images is an important task in applications such as diabetic retinopathy screening. The presented work has been undertaken in the framework of the TeleOphta project, whose main objective is to automatically detect normal exams in a tele-ophthalmology network, thu...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.05.004
更新日期:2014-10-01 00:00:00
abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2019.101535
更新日期:2019-12-01 00:00:00
abstract::Segmentation of the geometric morphology of abdominal aortic aneurysm is important for interventional planning. However, the segmentation of both the lumen and the outer wall of aneurysm in magnetic resonance (MR) image remains challenging. This study proposes a registration based segmentation methodology for efficien...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.05.005
更新日期:2017-08-01 00:00:00
abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly being used for the detection and diagnosis of breast cancer. Compared to mammography, DCE-MRI provides higher sensitivity, however its specificity is variable. Moreover, DCE-MRI data analysis is time consuming and depends on reader expertis...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.12.001
更新日期:2015-02-01 00:00:00
abstract::In this paper, we present a graph-based concurrent brain tumor segmentation and atlas to diseased patient registration framework. Both segmentation and registration problems are modeled using a unified pairwise discrete Markov Random Field model on a sparse grid superimposed to the image domain. Segmentation is addres...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2014.02.006
更新日期:2014-05-01 00:00:00
abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.09.004
更新日期:2018-01-01 00:00:00
abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.12.003
更新日期:2010-04-01 00:00:00
abstract::The goal of this study is to provide a theoretical framework for accurately optimizing the segmentation energy considering all of the possible shapes generated from the level-set-based statistical shape model (SSM). The proposed algorithm solves the well-known open problem, in which a shape prior may not be optimal in...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2015.11.003
更新日期:2016-02-01 00:00:00
abstract::We present a machine learning approach called shape regression machine (SRM) for efficient segmentation of an anatomic structure that exhibits a deformable shape in a medical image, e.g., left ventricle endocardial wall in an echocardiogram. The SRM achieves efficient segmentation via statistical learning of the inter...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2010.04.002
更新日期:2010-08-01 00:00:00
abstract::We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small numb...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2009.01.003
更新日期:2009-06-01 00:00:00
abstract::Percutaneous coronary intervention is a minimally invasive procedure that is usually performed under image guidance using X-ray angiograms in which coronary arteries are opacified with contrast agent. In X-ray images, 3D objects are projected on a 2D plane, generating semi-transparent layers that overlap each other. T...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2017.04.011
更新日期:2017-07-01 00:00:00
abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.02.001
更新日期:2016-07-01 00:00:00
abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...
journal_title:Medical image analysis
pub_type: 杂志文章
doi:10.1016/j.media.2016.04.001
更新日期:2017-01-01 00:00:00