Detecting Surgical Tools by Modelling Local Appearance and Global Shape.

Abstract:

:Detecting tools in surgical videos is an important ingredient for context-aware computer-assisted surgical systems. To this end, we present a new surgical tool detection dataset and a method for joint tool detection and pose estimation in 2d images. Our two-stage pipeline is data-driven and relaxes strong assumptions made by previous works regarding the geometry, number, and position of tools in the image. The first stage classifies each pixel based on local appearance only, while the second stage evaluates a tool-specific shape template to enforce global shape. Both local appearance and global shape are learned from training data. Our method is validated on a new surgical tool dataset of 2 476 images from neurosurgical microscopes, which is made freely available. It improves over existing datasets in size, diversity and detail of annotation. We show that our method significantly improves over competitive baselines from the computer vision field. We achieve 15% detection miss-rate at 10(-1) false positives per image (for the suction tube) over our surgical tool dataset. Results indicate that performing semantic labelling as an intermediate task is key for high quality detection.

journal_name

IEEE Trans Med Imaging

authors

Bouget D,Benenson R,Omran M,Riffaud L,Schiele B,Jannin P

doi

10.1109/TMI.2015.2450831

subject

Has Abstract

pub_date

2015-12-01 00:00:00

pages

2603-17

issue

12

eissn

0278-0062

issn

1558-254X

journal_volume

34

pub_type

杂志文章
  • Elevation direction deconvolution in three-dimensional ultrasound imaging.

    abstract::One-dimensional (1-D) linear transducer arrays can be used for three-dimensional (3-D) ultrasound image acquisition. However, the relatively low spatial resolution of these arrays in the elevation direction results in blurry 3-D images. Here, the authors introduce an elevation direction deconvolution (EDD) method that...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.500148

    authors: Wang X,Ritchie CJ,Kim Y

    更新日期:1996-01-01 00:00:00

  • Ovarian ultrasound image analysis: follicle segmentation.

    abstract::Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator v...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.746626

    authors: Krivanek A,Sonka M

    更新日期:1998-12-01 00:00:00

  • Detecting Cardiovascular Disease from Mammograms With Deep Learning.

    abstract::Coronary artery disease is a major cause of death in women. Breast arterial calcifications (BACs), detected inmammograms, can be useful riskmarkers associated with the disease. We investigate the feasibility of automated and accurate detection ofBACsinmammograms for risk assessment of coronary artery disease. We devel...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2655486

    authors: Wang J,Ding H,Bidgoli FA,Zhou B,Iribarren C,Molloi S,Baldi P

    更新日期:2017-05-01 00:00:00

  • Accelerating the nonequispaced fast Fourier transform on commodity graphics hardware.

    abstract::We present a fast parallel algorithm to compute the nonequispaced fast Fourier transform on commodity graphics hardware (the GPU). We focus particularly on a novel implementation of the convolution step in the transform as it was previously its most time consuming part. We describe the performance for two common sampl...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2007.909834

    authors: Sorensen TS,Schaeffter T,Noe KO,Hansen MS

    更新日期:2008-04-01 00:00:00

  • Toward Electrical Impedance Tomography Coupled Ultrasound Imaging for Assessing Muscle Health.

    abstract::This paper establishes for the first time that a coupled ultrasound (US) and electrical impedance tomography (EIT) system can serve as a non-invasive, spatially localized approach to extract clinically relevant muscle properties. The US/EIT system represents a potential enhancement to electrical impedance myography (E...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2886152

    authors: Murphy EK,Skinner J,Martucci M,Rutkove SB,Halter RJ

    更新日期:2019-06-01 00:00:00

  • Semi-automatic segmentation of vascular network images using a rotating structuring element (ROSE) with mathematical morphology and dual feature thresholding.

    abstract::A method for measuring the spatial concentration of specific categories of vessels in a vascular network consisting of vessels of several diameters, lengths, and orientations is demonstrated. It is shown that a combination of the mathematical morphology operation, opening, with a linear rotating structuring element (R...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.241865

    authors: Thackray BD,Nelson AC

    更新日期:1993-01-01 00:00:00

  • Regularization designs for uniform spatial resolution and noise properties in statistical image reconstruction for 3-D X-ray CT.

    abstract::Statistical image reconstruction methods for X-ray computed tomography (CT) provide improved spatial resolution and noise properties over conventional filtered back-projection (FBP) reconstruction, along with other potential advantages such as reduced patient dose and artifacts. Conventional regularized image reconstr...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2014.2365179

    authors: Cho JH,Fessler JA

    更新日期:2015-02-01 00:00:00

  • Corrections to "Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity".

    abstract::In the above paper [1], there are typos in Algorithm 1 table. The correct version of Algorithm 1 is given below. ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章,已发布勘误

    doi:10.1109/TMI.2018.2849798

    authors: Gong K,Cheng-Liao J,Wang G,Chen KT,Catana C,Qi J

    更新日期:2018-08-01 00:00:00

  • Geometric modeling of the human normal cerebral arterial system.

    abstract::We propose an anatomy-based approach for an efficient construction of a three-dimensional human normal cerebral arterial model from segmented and skeletonized angiographic data. The centerline-based model is used for an accurate angiographic data representation. A vascular tree is represented by tubular segments and b...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/tmi.2005.845041

    authors: Volkau I,Zheng W,Baimouratov R,Aziz A,Nowinski WL

    更新日期:2005-04-01 00:00:00

  • Time-frequency MEG-MUSIC algorithm.

    abstract::We propose a method that incorporates the time-frequency characteristics of neural sources into magnetoencephalographic (MEG) source estimation. The method is based on the multiple-signal-classification (MUSIC) algorithm and it calculates a time--frequency matrix in which diagonal and off-diagonal terms are the auto a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.750262

    authors: Sekihara K,Nagarajan S,Poeppel D,Miyashita Y

    更新日期:1999-01-01 00:00:00

  • A fast Bayesian reconstruction algorithm for emission tomography with entropy prior converging to feasible images.

    abstract::The development and tests of an iterative reconstruction algorithm for emission tomography based on Bayesian statistical concepts are described. The algorithm uses the entropy of the generated image as a prior distribution, can be accelerated by the choice of an exponent, and converges uniformly to feasible images by ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.56340

    authors: Nunez J,Llacer J

    更新日期:1990-01-01 00:00:00

  • Experimental evaluation of two iterative reconstruction methods for induced current electrical impedance tomography.

    abstract::The Newton-Raphson (N-R) with two different regularization methods: the Levenberg-Marquardt (N-R-LM) and the Hachtel's Augmented Matrix (N-R-HAM), were used to reconstruct images of conductivity changes in a cylindrical medium by Induced Current Electrical Impedance Tomography (ic-EIT). Experimental data were obtained...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.491419

    authors: Ruan W,Guardo R,Adler A

    更新日期:1996-01-01 00:00:00

  • Frequency-domain optical tomographic imaging of arthritic finger joints.

    abstract::We are presenting data from the largest clinical trial on optical tomographic imaging of finger joints to date. Overall we evaluated 99 fingers of patients affected by rheumatoid arthritis (RA) and 120 fingers from healthy volunteers. Using frequency-domain imaging techniques we show that sensitivities and specificiti...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2135374

    authors: Hielscher AH,Kim HK,Montejo LD,Blaschke S,Netz UJ,Zwaka PA,Illing G,Muller GA,Beuthan J

    更新日期:2011-10-01 00:00:00

  • Optoacoustic Dermoscopy of the Human Skin: Tuning Excitation Energy for Optimal Detection Bandwidth With Fast and Deep Imaging in vivo.

    abstract::Optoacoustic (photoacoustic) dermoscopy offers two principal advantages over conventional optical imaging applied in dermatology. First, it yields high-resolution cross-sectional images of the skin at depths not accessible to other non-invasive optical imaging methods. Second, by resolving absorption spectra at multip...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2664142

    authors: Schwarz M,Soliman D,Omar M,Buehler A,Ovsepian SV,Aguirre J,Ntziachristos V

    更新日期:2017-06-01 00:00:00

  • Segmentation of cardiac cine MR images for extraction of right and left ventricular chambers.

    abstract::A two-stage algorithm for extraction of the ventricular chambers (endocardial surfaces) in flow-enhanced magnetic resonance images is described. In the first stage, the approximate locations and sizes of the endocardial surfaces are determined by intensity thresholding. In the second stage, points on each approximated...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.370402

    authors: Goshtasby A,Turner DA

    更新日期:1995-01-01 00:00:00

  • Standing-wave and RF penetration artifacts caused by elliptic geometry: an electrodynamic analysis of MRI.

    abstract::Motivated by the observation that the diagonal pattern of intensity nonuniformity usually associated with linearly polarized radio-frequency (RF) coils is often present in neurological scans using circularly polarized coils, a theoretical analysis has been conducted of the intensity nonuniformity inherent in imaging a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.730409

    authors: Sled JG,Pike GB

    更新日期:1998-08-01 00:00:00

  • Statistical Biomechanical Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions.

    abstract::A common challenge when performing surface-based registration of images is ensuring that the surfaces accurately represent consistent anatomical boundaries. Image segmentation may be difficult in some regions due to either poor contrast, low slice resolution, or tissue ambiguities. To address this, we present a novel ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2443978

    authors: Khallaghi S,Sánchez CA,Rasoulian A,Nouranian S,Romagnoli C,Abdi H,Chang SD,Black PC,Goldenberg L,Morris WJ,Spadinger I,Fenster A,Ward A,Fels S,Abolmaesumi P

    更新日期:2015-12-01 00:00:00

  • High-Permittivity Pad Design for Dielectric Shimming in Magnetic Resonance Imaging Using Projection-Based Model Reduction and a Nonlinear Optimization Scheme.

    abstract::Inhomogeneities in the transmit radio frequency magnetic field ( ) reduce the quality of magnetic resonance (MR) images. This quality can be improved by using high-permittivity pads that tailor the fields. The design of an optimal pad is application-specific and not straightforward and would therefore benefit from a s...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2791179

    authors: van Gemert JHF,Brink WM,Webb AG,Remis RF

    更新日期:2018-04-01 00:00:00

  • 3-D Contrast Source Inversion-Electrical Properties Tomography.

    abstract::Contrast source inversion-electrical properties tomography (CSI-EPT) is an iterative reconstruction method to retrieve the electrical properties (EPs) of tissues from magnetic resonance data. The method is based on integral representations of the electromagnetic field and has been shown to allow EP reconstructions of ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2816125

    authors: Leijsen RL,Brink WM,van den Berg CAT,Webb AG,Remis RF

    更新日期:2018-09-01 00:00:00

  • Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model.

    abstract::Computed tomography (CT) imaging is an essential tool in various clinical diagnoses and radiotherapy treatment planning. Since CT image intensities are directly related to positron emission tomography (PET) attenuation coefficients, they are indispensable for attenuation correction (AC) of the PET images. However, due...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2461533

    authors: Huynh T,Gao Y,Kang J,Wang L,Zhang P,Lian J,Shen D,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2016-01-01 00:00:00

  • Deep Geodesic Learning for Segmentation and Anatomical Landmarking.

    abstract::In this paper, we propose a novel deep learning framework for anatomy segmentation and automatic landmarking. Specifically, we focus on the challenging problem of mandible segmentation from cone-beam computed tomography (CBCT) scans and identification of 9 anatomical landmarks of the mandible on the geodesic space. Th...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2018.2875814

    authors: Torosdagli N,Liberton DK,Verma P,Sincan M,Lee JS,Bagci U

    更新日期:2019-04-01 00:00:00

  • Prediction based collaborative trackers (PCT): a robust and accurate approach toward 3D medical object tracking.

    abstract::Robust and fast 3D tracking of deformable objects, such as heart, is a challenging task because of the relatively low image contrast and speed requirement. Many existing 2D algorithms might not be directly applied on the 3D tracking problem. The 3D tracking performance is limited due to dramatically increased data siz...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2011.2158440

    authors: Yang L,Georgescu B,Zheng Y,Wang Y,Meer P,Comaniciu D

    更新日期:2011-11-01 00:00:00

  • Estimation of Strain Elastography from Ultrasound Radio-Frequency Data by Utilizing Analytic Gradient of the Similarity Metric.

    abstract::Most strain imaging techniques follow a pipeline strategy: in the first step, tissue displacement is estimated from radio-frequency (RF) frames, and in the second step, a spatial derivative operation is applied. There are two main issues that arise from this framework. First, the gradient operation amplifies noise, an...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2017.2685522

    authors: Omidyeganeh M,Xiao Y,Ahmad MO,Rivaz H

    更新日期:2017-06-01 00:00:00

  • A comprehensive cardiac motion estimation framework using both untagged and 3-D tagged MR images based on nonrigid registration.

    abstract::In this paper, we present a novel technique based on nonrigid image registration for myocardial motion estimation using both untagged and 3-D tagged MR images. The novel aspect of our technique is its simultaneous usage of complementary information from both untagged and 3-D tagged MR images. To estimate the motion wi...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2012.2188104

    authors: Shi W,Zhuang X,Wang H,Duckett S,Luong DV,Tobon-Gomez C,Tung K,Edwards PJ,Rhode KS,Razavi RS,Ourselin S,Rueckert D

    更新日期:2012-06-01 00:00:00

  • Algebraic reconstruction for magnetic resonance imaging under B0 inhomogeneity.

    abstract::In magnetic resonance imaging, spatial localization is usually achieved using Fourier encoding which is realized by applying a magnetic field gradient along the dimension of interest to create a linear correspondence between the resonance frequency and spatial location following the Larmor equation. In the presence of...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/42.712126

    authors: Kadah YM,Hu X

    更新日期:1998-06-01 00:00:00

  • Voxel-guided morphometry ("VGM") and application to stroke.

    abstract::Monitoring of cerebral diseases associated with a change of morphology (e.g., stroke) requires unprecedented accuracy for quantification of its morphological progression for each voxel. The purpose of this paper is to provide a technique [voxel-guided morphometry (VGM)] to quantify macroscopic anatomical differences. ...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2002.806571

    authors: Schormann T,Kraemer M

    更新日期:2003-01-01 00:00:00

  • Mobile Biplane X-Ray Imaging System for Measuring 3D Dynamic Joint Motion During Overground Gait.

    abstract::Most X-ray fluoroscopy systems are stationary and impose restrictions on the measurement of dynamic joint motion; for example, knee-joint kinematics during gait is usually measured with the subject ambulating on a treadmill. We developed a computer-controlled, mobile, biplane, X-ray fluoroscopy system to track human b...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2015.2473168

    authors: Guan S,Gray HA,Keynejad F,Pandy MG

    更新日期:2016-01-01 00:00:00

  • A geometry-driven optical flow warping for spatial normalization of cortical surfaces.

    abstract::Spatial normalization is frequently used to map data to a standard coordinate system by removing intersubject morphological differences, thereby allowing for group analysis to be carried out. The work presented in this paper is motivated by the need for an automated cortical surface normalization technique that will a...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2008.925080

    authors: Tosun D,Prince JL

    更新日期:2008-12-01 00:00:00

  • Electrical impedance spectroscopy of the breast: clinical imaging results in 26 subjects.

    abstract::Electrical impedance spectroscopy (EIS) is a potential, noninvasive technique to image women for breast cancer. Studies have shown characteristic frequency dispersions in the electrical conductivity and permittivity of malignant versus normal tissue. Using a multifrequency EIS system, we imaged the breasts of 26 women...

    journal_title:IEEE transactions on medical imaging

    pub_type: 临床试验,杂志文章

    doi:10.1109/tmi.2002.800606

    authors: Kerner TE,Paulsen KD,Hartov A,Soho SK,Poplack SP

    更新日期:2002-06-01 00:00:00

  • Closing the Gap between Deep Neural Network Modeling and Biomedical Decision-Making Metrics in Segmentation via Adaptive Loss Functions.

    abstract::Deep learning is becoming an indispensable tool for various tasks in science and engineering. A critical step in constructing a reliable deep learning model is the selection of a loss function, which measures the discrepancy between the network prediction and the ground truth. While a variety of loss functions have be...

    journal_title:IEEE transactions on medical imaging

    pub_type: 杂志文章

    doi:10.1109/TMI.2020.3031913

    authors: Seo H,Bassenne M,Xing L

    更新日期:2020-10-19 00:00:00