Abstract：
:Instrument detection, pose estimation, and tracking in surgical videos are an important vision component for computer-assisted interventions. While significant advances have been made in recent years, articulation detection is still a major challenge. In this paper, we propose a deep neural network for articulated multi-instrument 2-D pose estimation, which is trained on detailed annotations of endoscopic and microscopic data sets. Our model is formed by a fully convolutional detection-regression network. Joints and associations between joint pairs in our instrument model are located by the detection subnetwork and are subsequently refined through a regression subnetwork. Based on the output from the model, the poses of the instruments are inferred using maximum bipartite graph matching. Our estimation framework is powered by deep learning techniques without any direct kinematic information from a robot. Our framework is tested on single-instrument RMIT data, and also on multi-instrument EndoVis and in vivo data with promising results. In addition, the data set annotations are publicly released along with our code and model.
journal_name
IEEE Trans Med Imagingjournal_title
IEEE transactions on medical imagingauthors
Du X,Kurmann T,Chang PL,Allan M,Ourselin S,Sznitman R,Kelly JD,Stoyanov Ddoi
10.1109/TMI.2017.2787672subject
Has Abstractpub_date
2018-05-01 00:00:00pages
1276-1287issue
5eissn
0278-0062issn
1558-254Xjournal_volume
37pub_type
杂志文章abstract：:The interest of compressive sampling in ultrasound imaging has been recently extensively evaluated by several research teams. Following the different application setups, it has been shown that the RF data may be reconstructed from a small number of measurements and/or using a reduced number of ultrasound pulse emissio...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2015.2493241
更新日期：2016-03-01 00:00:00
abstract：:A new graph-based approach for segmentation of luminal and external elastic lamina (EEL) surface of coronary vessels in gated 20 MHz intravascular ultrasound (IVUS) image sequences (volumes) is presented. The approach consists of a fully automated segmentation stage ("new automated" or NA) and a user-guided computer-a...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2013.2260763
更新日期：2013-08-01 00:00:00
abstract：:Decomposition of water and fat in magnetic resonance imaging (MRI) is important for biomedical research and clinical applications. In this paper, we propose a two-phased approach for the three-point water-fat decomposition problem. Our contribution consists of two components: 1) a background-masked Markov random field...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2125980
更新日期：2011-08-01 00:00:00
abstract：:We present an integrated approach to probabilistic independent component analysis (ICA) for functional MRI (FMRI) data that allows for nonsquare mixing in the presence of Gaussian noise. In order to avoid overfitting, we employ objective estimation of the amount of Gaussian noise through Bayesian analysis of the true ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2003.822821
更新日期：2004-02-01 00:00:00
abstract：:For wrist complaints related to motion, a 2-D radiograph or CT scan of the static wrist may not always be considered diagnostic. 3-D motion imaging, i.e., multiple 3DCT scans in time (4DCT), enables quantifying carpal motion and comparing motion patterns of the affected wrist with those of the healthy contralateral si...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2018.2877503
更新日期：2019-04-01 00:00:00
abstract：:A novel splat feature classification method is presented with application to retinal hemorrhage detection in fundus images. Reliable detection of retinal hemorrhages is important in the development of automated screening systems which can be translated into practice. Under our supervised approach, retinal color images...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2227119
更新日期：2013-02-01 00:00:00
abstract：:Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator v...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.746626
更新日期：1998-12-01 00:00:00
abstract：:A method for fully automated morphological and topological quantification of microvascular structures in confocal laser scanning microscopy (CLSM) volume datasets is presented. Several characteristic morphological and topological quantities are calculated in a series of image-processing steps and can be used to compar...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2007.900379
更新日期：2007-08-01 00:00:00
abstract：:Similarity measure is a main core of image registration algorithms. Spatially varying intensity distortion is an important challenge, which affects the performance of similarity measures. Correlation among the pixels is the main characteristic of this distortion. Similarity measures such as sum-of-squared-differences ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2017.2744663
更新日期：2018-01-01 00:00:00
abstract：:Many segmentation methods for thoracic volume data require manual input in the form of a seed point, initial contour, volume of interest etc. The aim of the work presented here is to further automate this segmentation initialization step. In this paper an anatomical modeling and matching method is proposed to coarsely...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.764893
更新日期：1999-03-01 00:00:00
abstract：:3D Statistical Shape Models (3D-SSM) are widely used for medical image segmentation. However, during segmentation, they typically perform a very limited unidirectional search for suitable landmark positions in the image, relying on weak learners or use-case specific appearance models that solely take local image infor...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2016.2600502
更新日期：2017-01-01 00:00:00
abstract：:Psoriasis is a chronic inflammatory skin disease that affects over 3% of the population. Various methods are currently used to evaluate psoriasis severity and to monitor therapeutic response. The PASI system of scoring is widely used for evaluating psoriasis severity. It employs a visual analogue scale to score the th...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2236349
更新日期：2013-04-01 00:00:00
abstract：:True three-dimensional (3-D) volume reconstruction from fully 3-D data in positron emission tomography (PET) has only a limited clinical use because of its large computational burden. Fourier rebinning (FORE) of the fully 3-D data into a set of 2-D sinogram data decomposes the 3-D reconstruction process into multiple ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.870257
更新日期：2000-05-01 00:00:00
abstract：:We present a method (DMESH) for nonrigid cyclic motion analysis using a series of velocity images covering the cycle acquired, for example, from phase-contrast magnetic resonance imaging. The method is based on fitting a dynamic finite-element mesh model to velocity samples of an extended region, at all time frames. T...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.790456
更新日期：1999-07-01 00:00:00
abstract：:Transmembrane voltage-sensitive fluorescent dyes are used to study electrical activity in hearts. Green and red fluorescence emissions from di-4-ANEPPS excited with 488 nm light indicate both transmembrane voltage changes and heart movement. We have previously shown that the ratio, green fluorescence divided by red fl...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2005.861019
更新日期：2006-01-01 00:00:00
abstract：:Foreshortening of vessel segments in angiographic (biplane) projection images may cause misinterpretation of the extent and degree of coronary artery disease. The views in which the object of interest are visualized with minimum foreshortening are called optimal views. The authors present a complete approach to obtain...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.276141
更新日期：1994-01-01 00:00:00
abstract：:The authors present a new algorithmic procedure for the analysis of brain images. This procedure is specifically designed to image the activity and functional organization of the brain. The authors' results are tested on data collected and previously analyzed with the technique known as in vivo optical imaging of intr...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.414621
更新日期：1995-01-01 00:00:00
abstract：:Cervical cancer causes the fourth most cancer-related deaths of women worldwide. Early detection of cervical intraepithelial neoplasia (CIN) can significantly increase the survival rate of patients. In this paper, we propose a deep learning framework for the accurate identification of LSIL+ (including CIN and cervical...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.2994778
更新日期：2020-11-01 00:00:00
abstract：:In this paper, discrepancies and reference inaccuracies in the paper (Grana et al., 2003) are pointed out. Specifically, it is demonstrated that the definitions of "lesion gradient" and "skin lesion gradient," widely used in a number of medical papers on computer analysis of pigmented skin lesions, are unambiguous, an...
journal_title：IEEE transactions on medical imaging
pub_type： 评论,信件
doi：10.1109/tmi.2006.884205
更新日期：2006-12-01 00:00:00
abstract：:It is now recognized that prediction of the vulnerable coronary plaque rupture requires not only an accurate quantification of fibrous cap thickness and necrotic core morphology but also a precise knowledge of the mechanical properties of plaque components. Indeed, such knowledge would allow a precise evaluation of th...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2009.2012852
更新日期：2009-07-01 00:00:00
abstract：:Most existing CNNs-based segmentation methods rely on local appearances learned on the regular image grid, without consideration of the object global information. This article aims to embed the object global geometric information into a learning framework via the classical geodesic active contours (GAC). We propose a ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.3022693
更新日期：2021-01-01 00:00:00
abstract：:Following B.B. Mandelbrot's fractal theory (1982), it was found that the fractal dimension could be obtained in medical images by the concept of fractional Brownian motion. An estimation concept for determination of the fractal dimension based upon the concept of fractional Brownian motion is discussed. Two applicatio...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.24861
更新日期：1989-01-01 00:00:00
abstract：:The performance of a classifier is largely dependent on the size and representativeness of data used for its training. In circumstances where accumulation and/or labeling of training samples is difficult or expensive, such as medical applications, data augmentation can potentially be used to alleviate the limitations ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2016.2640180
更新日期：2017-04-01 00:00:00
abstract：:Fluorescence molecular tomography (FMT), which can visualize the distribution of fluorescence biomarkers, has become a novel three-dimensional noninvasive imaging technique for in vivo studies such as tumor detection and lymph node location. However, it remains a challenging problem to achieve satisfactory reconstruct...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.2964853
更新日期：2020-06-01 00:00:00
abstract：:We propose a joint information approach for automatic analysis of 2D echocardiography (echo) data. The approach combines a priori images, their segmentations and patient diagnostic information within a unified framework to determine various clinical parameters, such as cardiac chamber volumes, and cardiac disease labe...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2016.2593900
更新日期：2017-01-01 00:00:00
abstract：:Tracking pylorus in ultrasonic image sequences is an important step in the analysis of duodenogastric reflux (DGR). We propose a joint prediction and segmentation method (JPS) which combines optical flow with active contour to track pylorus. The goal of the proposed method is to improve the pyloric tracking accuracy b...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2183884
更新日期：2012-03-01 00:00:00
abstract：:Deformable image registration is an important tool in medical image analysis. In the case of lung computed tomography (CT) registration there are three major challenges: large motion of small features, sliding motions between organs, and changing image contrast due to compression. Recently, Markov random field (MRF)-b...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2013.2246577
更新日期：2013-07-01 00:00:00
abstract：:Computed tomography (CT) imaging is an essential tool in various clinical diagnoses and radiotherapy treatment planning. Since CT image intensities are directly related to positron emission tomography (PET) attenuation coefficients, they are indispensable for attenuation correction (AC) of the PET images. However, due...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2015.2461533
更新日期：2016-01-01 00:00:00
abstract：:Quantitative positron emission tomography (PET) imaging relies on accurate attenuation correction. Predicting attenuation values from magnetic resonance (MR) images is difficult because MR signals are related to proton density and relaxation properties of tissues. Here, we propose a method to derive the attenuation ma...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2198831
更新日期：2012-09-01 00:00:00
abstract：:An algorithm is developed for electrical impedance tomography (EIT) of finite cylinders with general cross-sectional boundaries and translationally uniform conductivity distributions. The electrodes for data collection are assumed to be placed around a cross-sectional plane; therefore, the axial variation of the bound...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.52982
更新日期：1990-01-01 00:00:00
