CATARACTS: Challenge on automatic tool annotation for cataRACT surgery.

Abstract:

:Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient solutions for surgical workflow analysis, with potential applications in report generation, surgical training and even real-time decision support. Most existing tool annotation algorithms focus on laparoscopic surgeries. However, with 19 million interventions per year, the most common surgical procedure in the world is cataract surgery. The CATARACTS challenge was organized in 2017 to evaluate tool annotation algorithms in the specific context of cataract surgery. It relies on more than nine hours of videos, from 50 cataract surgeries, in which the presence of 21 surgical tools was manually annotated by two experts. With 14 participating teams, this challenge can be considered a success. As might be expected, the submitted solutions are based on deep learning. This paper thoroughly evaluates these solutions: in particular, the quality of their annotations are compared to that of human interpretations. Next, lessons learnt from the differential analysis of these solutions are discussed. We expect that they will guide the design of efficient surgery monitoring tools in the near future.

journal_name

Med Image Anal

journal_title

Medical image analysis

authors

Al Hajj H,Lamard M,Conze PH,Roychowdhury S,Hu X,Maršalkaitė G,Zisimopoulos O,Dedmari MA,Zhao F,Prellberg J,Sahu M,Galdran A,Araújo T,Vo DM,Panda C,Dahiya N,Kondo S,Bian Z,Vahdat A,Bialopetravičius J,Flouty E,Qiu

doi

10.1016/j.media.2018.11.008

subject

Has Abstract

pub_date

2019-02-01 00:00:00

pages

24-41

eissn

1361-8415

issn

1361-8423

pii

S1361-8415(18)30865-X

journal_volume

52

pub_type

杂志文章
  • Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy.

    abstract::Accurate vertebral body (VB) detection and segmentation are critical for spine disease identification and diagnosis. Existing automatic VB detection and segmentation methods may cause false-positive results to the background tissue or inaccurate results to the desirable VB. Because they usually cannot take both the gl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101861

    authors: Zhang D,Chen B,Li S

    更新日期:2021-01-01 00:00:00

  • BrainSuite: an automated cortical surface identification tool.

    abstract::We describe a new magnetic resonance (MR) image analysis tool that produces cortical surface representations with spherical topology from MR images of the human brain. The tool provides a sequence of low-level operations in a single package that can produce accurate brain segmentations in clinical time. The tools incl...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(02)00054-3

    authors: Shattuck DW,Leahy RM

    更新日期:2002-06-01 00:00:00

  • Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow.

    abstract::We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented man...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.06.001

    authors: Zheng Q,Delingette H,Ayache N

    更新日期:2019-08-01 00:00:00

  • Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection.

    abstract::Deep learning-based systems can achieve a diagnostic performance comparable to physicians in a variety of medical use cases including the diagnosis of diabetic retinopathy. To be useful in clinical practice, it is necessary to have well calibrated measures of the uncertainty with which these systems report their decis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101724

    authors: Ayhan MS,Kühlewein L,Aliyeva G,Inhoffen W,Ziemssen F,Berens P

    更新日期:2020-08-01 00:00:00

  • Longitudinal segmentation of age-related white matter hyperintensities.

    abstract::Although white matter hyperintensities evolve in the course of ageing, few solutions exist to consider the lesion segmentation problem longitudinally. Based on an existing automatic lesion segmentation algorithm, a longitudinal extension is proposed. For evaluation purposes, a longitudinal lesion simulator is created ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.02.007

    authors: Sudre CH,Cardoso MJ,Ourselin S,Alzheimer’s Disease Neuroimaging Initiative.

    更新日期:2017-05-01 00:00:00

  • High resolution cortical bone thickness measurement from clinical CT data.

    abstract::The distribution of cortical bone in the proximal femur is believed to be a critical component in determining fracture resistance. Current CT technology is limited in its ability to measure cortical thickness, especially in the sub-millimetre range which lies within the point spread function of today's clinical scanne...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.01.003

    authors: Treece GM,Gee AH,Mayhew PM,Poole KE

    更新日期:2010-06-01 00:00:00

  • Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images.

    abstract::This paper describes a method for the enhancement of curvilinear structures such as vessels and bronchi in three-dimensional (3-D) medical images. A 3-D line enhancement filter is developed with the aim of discriminating line structures from other structures and recovering line structures of various widths. The 3-D li...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80009-1

    authors: Sato Y,Nakajima S,Shiraga N,Atsumi H,Yoshida S,Koller T,Gerig G,Kikinis R

    更新日期:1998-06-01 00:00:00

  • A novel approach to 2D/3D registration of X-ray images using Grangeat's relation.

    abstract::Fast and accurate 2D/3D registration plays an important role in many applications, ranging from scientific and engineering domains all the way to medical care. Today's predominant methods are based on computationally expensive approaches, such as virtual forward or back projections, that limit the real-time applicabil...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101815

    authors: Frysch R,Pfeiffer T,Rose G

    更新日期:2021-01-01 00:00:00

  • Neighborhood resolved fiber orientation distributions (NRFOD) in automatic labeling of white matter fiber pathways.

    abstract::Accurate digital representation of major white matter bundles in the brain is an important goal in neuroscience image computing since the representations can be used for surgical planning, intra-patient longitudinal analysis and inter-subject population connectivity studies. Reconstructing desired fiber bundles genera...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.02.008

    authors: Ugurlu D,Firat Z,Türe U,Unal G

    更新日期:2018-05-01 00:00:00

  • Rubik's Cube+: A self-supervised feature learning framework for 3D medical image analysis.

    abstract::Due to the development of deep learning, an increasing number of research works have been proposed to establish automated analysis systems for 3D volumetric medical data to improve the quality of patient care. However, it is challenging to obtain a large number of annotated 3D medical data needed to train a neural net...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101746

    authors: Zhu J,Li Y,Hu Y,Ma K,Zhou SK,Zheng Y

    更新日期:2020-08-01 00:00:00

  • Reducing annotation effort in digital pathology: A Co-Representation learning framework for classification tasks.

    abstract::Classification of digital pathology images is imperative in cancer diagnosis and prognosis. Recent advancements in deep learning and computer vision have greatly benefited the pathology workflow by developing automated solutions for classification tasks. However, the cost and time for acquiring high quality task-speci...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2020.101859

    authors: Pati P,Foncubierta-Rodríguez A,Goksel O,Gabrani M

    更新日期:2021-01-01 00:00:00

  • Interactive training system for interventional electrocardiology procedures.

    abstract::Recent progress in cardiac catheterization and devices has allowed the development of new therapies for severe cardiac diseases like arrhythmias and heart failure. The skills required for such interventions are very challenging to learn, and are typically acquired over several years. Virtual reality simulators may red...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.06.040

    authors: Talbot H,Spadoni F,Duriez C,Sermesant M,O'Neill M,Jaïs P,Cotin S,Delingette H

    更新日期:2017-01-01 00:00:00

  • Ultrasonic and elasticity imaging to model disease-induced changes in soft-tissue structure.

    abstract::Ultrasonic techniques are presented for the study of soft biological tissue structure and function. Changes in echo waveforms caused by microscopic variations in the mechanical properties of tissue can reveal disease mechanism, in vivo. On a larger scale, elasticity imaging describes the macroscopic mechanical propert...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/s1361-8415(98)80014-5

    authors: Chaturvedi P,Insana MF,Hall TJ

    更新日期:1998-12-01 00:00:00

  • Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge.

    abstract::Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the l...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101537

    authors: Zhuang X,Li L,Payer C,Štern D,Urschler M,Heinrich MP,Oster J,Wang C,Smedby Ö,Bian C,Yang X,Heng PA,Mortazi A,Bagci U,Yang G,Sun C,Galisot G,Ramel JY,Brouard T,Tong Q,Si W,Liao X,Zeng G,Shi Z,Zheng G,Wang

    更新日期:2019-12-01 00:00:00

  • Quantification of the detailed cardiac left ventricular trabecular morphogenesis in the mouse embryo.

    abstract::During embryogenesis, a mammalian heart develops from a simple tubular shape into a complex 4-chamber organ, going through four distinct phases: early primitive tubular heart, emergence of trabeculations, trabecular remodeling and development of the compact myocardium. In this paper we propose a framework for standard...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2018.08.001

    authors: Paun B,Bijnens B,Cook AC,Mohun TJ,Butakoff C

    更新日期:2018-10-01 00:00:00

  • Self-similarity weighted mutual information: a new nonrigid image registration metric.

    abstract::Mutual information (MI) has been widely used as a similarity measure for rigid registration of multi-modal and uni-modal medical images. However, robust application of MI to deformable registration is challenging mainly because rich structural information, which are critical cues for successful deformable registration...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2013.12.003

    authors: Rivaz H,Karimaghaloo Z,Collins DL

    更新日期:2014-02-01 00:00:00

  • Development and comparison of new hybrid motion tracking for bronchoscopic navigation.

    abstract::This paper presents a new hybrid camera motion tracking method for bronchoscopic navigation combining SIFT, epipolar geometry analysis, Kalman filtering, and image registration. In a thorough evaluation, we compare it to state-of-the-art tracking methods. Our hybrid algorithm for predicting bronchoscope motion uses SI...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.11.001

    authors: Luó X,Feuerstein M,Deguchi D,Kitasaka T,Takabatake H,Mori K

    更新日期:2012-04-01 00:00:00

  • Exudate detection in color retinal images for mass screening of diabetic retinopathy.

    abstract::The automatic detection of exudates in color eye fundus images is an important task in applications such as diabetic retinopathy screening. The presented work has been undertaken in the framework of the TeleOphta project, whose main objective is to automatically detect normal exams in a tele-ophthalmology network, thu...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.05.004

    authors: Zhang X,Thibault G,Decencière E,Marcotegui B,Laÿ B,Danno R,Cazuguel G,Quellec G,Lamard M,Massin P,Chabouis A,Victor Z,Erginay A

    更新日期:2014-10-01 00:00:00

  • Disentangled representation learning in cardiac image analysis.

    abstract::Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be interpreted in this way. We can venture further and consider that a medical image na...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2019.101535

    authors: Chartsias A,Joyce T,Papanastasiou G,Semple S,Williams M,Newby DE,Dharmakumar R,Tsaftaris SA

    更新日期:2019-12-01 00:00:00

  • Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black-blood MRI with a registration based geodesic active contour model.

    abstract::Segmentation of the geometric morphology of abdominal aortic aneurysm is important for interventional planning. However, the segmentation of both the lumen and the outer wall of aneurysm in magnetic resonance (MR) image remains challenging. This study proposes a registration based segmentation methodology for efficien...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.05.005

    authors: Wang Y,Seguro F,Kao E,Zhang Y,Faraji F,Zhu C,Haraldsson H,Hope M,Saloner D,Liu J

    更新日期:2017-08-01 00:00:00

  • Automated localization of breast cancer in DCE-MRI.

    abstract::Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly being used for the detection and diagnosis of breast cancer. Compared to mammography, DCE-MRI provides higher sensitivity, however its specificity is variable. Moreover, DCE-MRI data analysis is time consuming and depends on reader expertis...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.12.001

    authors: Gubern-Mérida A,Martí R,Melendez J,Hauth JL,Mann RM,Karssemeijer N,Platel B

    更新日期:2015-02-01 00:00:00

  • Concurrent tumor segmentation and registration with uncertainty-based sparse non-uniform graphs.

    abstract::In this paper, we present a graph-based concurrent brain tumor segmentation and atlas to diseased patient registration framework. Both segmentation and registration problems are modeled using a unified pairwise discrete Markov Random Field model on a sparse grid superimposed to the image domain. Segmentation is addres...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2014.02.006

    authors: Parisot S,Wells W 3rd,Chemouny S,Duffau H,Paragios N

    更新日期:2014-05-01 00:00:00

  • An efficient Riemannian statistical shape model using differential coordinates: With application to the classification of data from the Osteoarthritis Initiative.

    abstract::We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as ele...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.09.004

    authors: von Tycowicz C,Ambellan F,Mukhopadhyay A,Zachow S

    更新日期:2018-01-01 00:00:00

  • Multiple hypothesis template tracking of small 3D vessel structures.

    abstract::A multiple hypothesis tracking approach to the segmentation of small 3D vessel structures is presented. By simultaneously tracking multiple hypothetical vessel trajectories, low contrast passages can be traversed, leading to an improved tracking performance in areas of low contrast. This work also contributes a novel ...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.12.003

    authors: Friman O,Hindennach M,Kühnel C,Peitgen HO

    更新日期:2010-04-01 00:00:00

  • Joint optimization of segmentation and shape prior from level-set-based statistical shape model, and its application to the automated segmentation of abdominal organs.

    abstract::The goal of this study is to provide a theoretical framework for accurately optimizing the segmentation energy considering all of the possible shapes generated from the level-set-based statistical shape model (SSM). The proposed algorithm solves the well-known open problem, in which a shape prior may not be optimal in...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2015.11.003

    authors: Saito A,Nawano S,Shimizu A

    更新日期:2016-02-01 00:00:00

  • Shape regression machine and efficient segmentation of left ventricle endocardium from 2D B-mode echocardiogram.

    abstract::We present a machine learning approach called shape regression machine (SRM) for efficient segmentation of an anatomic structure that exhibits a deformable shape in a medical image, e.g., left ventricle endocardial wall in an echocardiogram. The SRM achieves efficient segmentation via statistical learning of the inter...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2010.04.002

    authors: Zhou SK

    更新日期:2010-08-01 00:00:00

  • A subject-specific technique for respiratory motion correction in image-guided cardiac catheterisation procedures.

    abstract::We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small numb...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2009.01.003

    authors: King AP,Boubertakh R,Rhode KS,Ma YL,Chinchapatnam P,Gao G,Tangcharoen T,Ginks M,Cooklin M,Gill JS,Hawkes DJ,Razavi RS,Schaeffter T

    更新日期:2009-06-01 00:00:00

  • Automatic online layer separation for vessel enhancement in X-ray angiograms for percutaneous coronary interventions.

    abstract::Percutaneous coronary intervention is a minimally invasive procedure that is usually performed under image guidance using X-ray angiograms in which coronary arteries are opacified with contrast agent. In X-ray images, 3D objects are projected on a 2D plane, generating semi-transparent layers that overlap each other. T...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2017.04.011

    authors: Ma H,Hoogendoorn A,Regar E,Niessen WJ,van Walsum T

    更新日期:2017-07-01 00:00:00

  • Directional wavelet based features for colonic polyp classification.

    abstract::In this work, various wavelet based methods like the discrete wavelet transform, the dual-tree complex wavelet transform, the Gabor wavelet transform, curvelets, contourlets and shearlets are applied for the automated classification of colonic polyps. The methods are tested on 8 HD-endoscopic image databases, where ea...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.02.001

    authors: Wimmer G,Tamaki T,Tischendorf JJ,Häfner M,Yoshida S,Tanaka S,Uhl A

    更新日期:2016-07-01 00:00:00

  • Automatic detection of over 100 anatomical landmarks in medical CT images: A framework with independent detectors and combinatorial optimization.

    abstract::An automatic detection method for 197 anatomically defined landmarks in computed tomography (CT) volumes is presented. The proposed method can handle missed landmarks caused by detection failure, a limited imaging range and other problems using a novel combinatorial optimization framework with a two-stage sampling alg...

    journal_title:Medical image analysis

    pub_type: 杂志文章

    doi:10.1016/j.media.2016.04.001

    authors: Hanaoka S,Shimizu A,Nemoto M,Nomura Y,Miki S,Yoshikawa T,Hayashi N,Ohtomo K,Masutani Y

    更新日期:2017-01-01 00:00:00