Abstract：
:Instrument detection, pose estimation, and tracking in surgical videos are an important vision component for computer-assisted interventions. While significant advances have been made in recent years, articulation detection is still a major challenge. In this paper, we propose a deep neural network for articulated multi-instrument 2-D pose estimation, which is trained on detailed annotations of endoscopic and microscopic data sets. Our model is formed by a fully convolutional detection-regression network. Joints and associations between joint pairs in our instrument model are located by the detection subnetwork and are subsequently refined through a regression subnetwork. Based on the output from the model, the poses of the instruments are inferred using maximum bipartite graph matching. Our estimation framework is powered by deep learning techniques without any direct kinematic information from a robot. Our framework is tested on single-instrument RMIT data, and also on multi-instrument EndoVis and in vivo data with promising results. In addition, the data set annotations are publicly released along with our code and model.
journal_name
IEEE Trans Med Imagingjournal_title
IEEE transactions on medical imagingauthors
Du X,Kurmann T,Chang PL,Allan M,Ourselin S,Sznitman R,Kelly JD,Stoyanov Ddoi
10.1109/TMI.2017.2787672subject
Has Abstractpub_date
2018-05-01 00:00:00pages
1276-1287issue
5eissn
0278-0062issn
1558-254Xjournal_volume
37pub_type
杂志文章abstract：:A two-stage algorithm for extraction of the ventricular chambers (endocardial surfaces) in flow-enhanced magnetic resonance images is described. In the first stage, the approximate locations and sizes of the endocardial surfaces are determined by intensity thresholding. In the second stage, points on each approximated...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.370402
更新日期：1995-01-01 00:00:00
abstract：:Gastro-intestinal (GI) endoscopy is a widely used clinical procedure for screening and surveillance of digestive tract diseases ranging from Barrett's Oesophagus to oesophageal cancer. Current surveillance protocol consists of periodic endoscopic examinations performed in 3-4 month intervals including expert's visual ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2174252
更新日期：2012-03-01 00:00:00
abstract：:Monitoring of cerebral diseases associated with a change of morphology (e.g., stroke) requires unprecedented accuracy for quantification of its morphological progression for each voxel. The purpose of this paper is to provide a technique [voxel-guided morphometry (VGM)] to quantify macroscopic anatomical differences. ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2002.806571
更新日期：2003-01-01 00:00:00
abstract：:The accuracy of in vivo dopamine D2 receptor quantification by positron emission tomography (PET) was determined for several models by means of singular-value decomposition, and some of the model assumptions were reviewed. These include steady-state, transient, double injection, and equilibrium approaches. All four mo...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.7783
更新日期：1988-01-01 00:00:00
abstract：:We are presenting data from the largest clinical trial on optical tomographic imaging of finger joints to date. Overall we evaluated 99 fingers of patients affected by rheumatoid arthritis (RA) and 120 fingers from healthy volunteers. Using frequency-domain imaging techniques we show that sensitivities and specificiti...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2135374
更新日期：2011-10-01 00:00:00
abstract：:In this paper, we are interested in soft tissue differentiation by multiband images obtained from the High-Resolution Ultrasonic Transmission Tomography (HUTT) system using a spectral target detection method based on constrained energy minimization (CEM). We have developed a new tissue differentiation method (called "...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/tmi.2004.843179
更新日期：2005-03-01 00:00:00
abstract：:Breast imaging via microwave tomography involves estimating the distribution of dielectric properties within the patient's breast on a discrete mesh. The number of unknowns in the discrete mesh can be very large for 3-D imaging, and this results in computational challenges. We propose a new approach where the discrete...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2008.2008959
更新日期：2009-07-01 00:00:00
abstract：:This paper presents a learning-based method for deformable registration of magnetic resonance (MR) brain images. There are two novelties in the proposed registration method. First, a set of best-scale geometric features are selected for each point in the brain, in order to facilitate correspondence detection during th...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/tmi.2006.879320
更新日期：2006-09-01 00:00:00
abstract：:The feasibility of ultrasonic Nakagami imaging to evaluate thermal lesions by high-intensity focused ultrasound and microwave ablation was explored in ex vivo and in vivo liver models. Dynamic changes of the ultrasonic Nakagami parameter in thermal lesions were calculated, and ultrasonic B-mode and Nakagami images wer...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2018.2829934
更新日期：2018-07-01 00:00:00
abstract：:Three-dimensional (3-D) reconstructions of coronary bypass grafts performed from X-ray angiographic images may become increasingly important for the investigation of damaging mechanical stresses imposed to these vessels by the cyclic movement of the heart. Contrary to what we had experienced with coronary arteries, ap...
journal_title：IEEE transactions on medical imaging
pub_type： 信件
doi：10.1109/42.875203
更新日期：2000-07-01 00:00:00
abstract：:Transmit arrays have been developed to mitigate the RF field inhomogeneity commonly observed in high field magnetic resonance imaging (MRI), typically above 3T. To this end, the knowledge of the RF complex-valued B1 transmit-sensitivities of each independent radiating element has become essential. This paper details a...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2014.2322440
更新日期：2014-08-01 00:00:00
abstract：:We have developed a method to study the statistical properties of the noise found in various medical images. The method is specifically designed for types of noise with uncorrelated fluctuations. Such signal fluctuations generally originate in the physical processes of imaging rather than in the tissue textures. Vario...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2004.832656
更新日期：2004-10-01 00:00:00
abstract：:Small pulmonary nodules are a common radiographic finding that presents an important diagnostic challenge in contemporary medicine. While pulmonary nodules are the major radiographic indicator of lung cancer, they may also be signs of a variety of benign conditions. Measurement of nodule growth rate over time has been...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2003.817785
更新日期：2003-10-01 00:00:00
abstract：:The ordinary sample correlation coefficient is a popular similarity measure for aligning images from the same or similar modalities. However, this measure can be sensitive to the presence of "outlier" objects that appear in one image but not the other, such as surgical instruments, the patient table, etc., which can l...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2004.835313
更新日期：2004-11-01 00:00:00
abstract：:An automatic method has been developed for segmentation of abdominal computed tomography (CT) images for virtual colonoscopy obtained after a bowel preparation of a low-residue diet with ingested contrast solutions to enhance the image intensities of residual colonic materials. Removal of the enhanced materials was pe...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.897814
更新日期：2000-12-01 00:00:00
abstract：:Deep learning is becoming an indispensable tool for various tasks in science and engineering. A critical step in constructing a reliable deep learning model is the selection of a loss function, which measures the discrepancy between the network prediction and the ground truth. While a variety of loss functions have be...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.3031913
更新日期：2020-10-19 00:00:00
abstract：:High-resolution functional imaging of small animals is often obtained by single pinhole SPECT with circular orbit acquisition. Multipinhole SPECT adds information due to its improved sampling, and can improve the trade-off between resolution and sensitivity. To evaluate different pinhole collimator designs an efficien...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2007.902802
更新日期：2008-01-01 00:00:00
abstract：:Ultrasonic imaging is the noninvasive clinical imaging modality of choice for diagnosing heart disease. At present, two-dimensional ultrasonic grayscale images provide a relatively cheap, fast, bedside method to study the morphology of the heart. Several methods have been proposed to assess myocardial function. These ...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2002.804440
更新日期：2002-09-01 00:00:00
abstract：:In waveform design for magnetic resonance applications, periodic continuous-wave excitation offers potential advantages that remain largely unexplored because of a lack of understanding of the Bloch equation with periodic continuous-wave excitations. Using harmonic balancing techniques the steady state solutions of th...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2015.2423313
更新日期：2015-10-01 00:00:00
abstract：:Cardiac motion estimation is very important in understanding cardiac dynamics and in noninvasive diagnosis of heart disease. Magnetic resonance (MR) imaging tagging is a technique for measuring heart deformations. In cardiac tagged MR images, a set of dark lines are noninvasively encoded within myocardial tissue provi...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.929616
更新日期：2001-06-01 00:00:00
abstract：:The aim of this work is the evaluation of the design for a nonconventional PET scanner, the voxel imaging PET (VIP), based on pixelated room-temperature CdTe detectors yielding a true 3-D impact point with a density of 450 channels/cm(3), for a total 6 336 000 channels in a seamless ring shaped volume. The system is s...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2013.2284657
更新日期：2014-02-01 00:00:00
abstract：:A novel splat feature classification method is presented with application to retinal hemorrhage detection in fundus images. Reliable detection of retinal hemorrhages is important in the development of automated screening systems which can be translated into practice. Under our supervised approach, retinal color images...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2012.2227119
更新日期：2013-02-01 00:00:00
abstract：:Within-subject analysis in fMRI essentially addresses two problems, the detection of brain regions eliciting evoked activity and the estimation of the underlying dynamics. In Makni et aL, 2005 and Makni et aL, 2008, a detection-estimation framework has been proposed to tackle these problems jointly, since they are con...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2010.2042064
更新日期：2010-04-01 00:00:00
abstract：:Cell segmentation and tracking in time-lapse fluorescence microscopy images is a task of fundamental importance in many biological studies on cell migration and proliferation. In recent years, level sets have been shown to provide a very appropriate framework for this purpose, as they are well suited to capture topolo...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2009.2038693
更新日期：2010-03-01 00:00:00
abstract：:Measures of vascular tortuosity-how curved and twisted a vessel is-are associated with a variety of vascular diseases. Consequently, measurements of vessel tortuosity that are accurate and comparable across modality, resolution, and size are greatly needed. Yet in practice, precise and consistent measurements are prob...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2020.3025467
更新日期：2021-01-01 00:00:00
abstract：:A minimalist numerical model of white matter is presented, the objective of which is to help provide a biological basis for improved diffusion tensor imaging (DTI) analysis. Water diffuses, relaxes, and exchanges in three compartments-intracellular, extracellular, and myelin sheath. Exchange between compartments is de...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2007.906787
更新日期：2007-11-01 00:00:00
abstract：:Optical coherence tomography (OCT) uses retroreflected light to provide micrometer-resolution, cross-sectional scans of biological tissues. OCT's first application was in ophthalmic imaging where it has proven particularly useful in diagnosing, monitoring, and studying glaucoma. Diagnosing glaucoma is difficult and it...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2006.871417
更新日期：2006-05-01 00:00:00
abstract：:Video capsule endoscopy (VCE) is a noninvasive method for examining the gastrointestinal tract which has been successful in small intestine studies. Recently, VCE has been attempted in the colon. However, the capsule often tumbles in the wider colonic lumen, resulting in missed regions. Self-stabilizing VCE is a novel...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/TMI.2011.2163165
更新日期：2011-12-01 00:00:00
abstract：:A general approach that the authors proposed elsewhere reveals the intrinsic relationship among methods for inversion of the 2-D exponential Radon transform described by Bellini et al. (1979), by Tretiak and Metz (1980), by Hawkins et al. (1988), and by Inouye et al. (1989). Moreover, the authors' approach provides an...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.476107
更新日期：1995-01-01 00:00:00
abstract：:One-dimensional (1-D) linear transducer arrays can be used for three-dimensional (3-D) ultrasound image acquisition. However, the relatively low spatial resolution of these arrays in the elevation direction results in blurry 3-D images. Here, the authors introduce an elevation direction deconvolution (EDD) method that...
journal_title：IEEE transactions on medical imaging
pub_type： 杂志文章
doi：10.1109/42.500148
更新日期：1996-01-01 00:00:00
