System events: readily accessible features for surgical phase detection.

Abstract:

PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologies. Phase annotation is a highly labor-intensive task and would benefit greatly from automated solutions. METHODS:We propose a novel approach using system events-for example, activation of cautery tools-that are easily captured in most surgical procedures. Our method involves extracting event-based features over 90-s intervals and assigning a phase label to each interval. We explore three classification techniques: support vector machines, random forests, and temporal convolution neural networks. Each of these models independently predicts a label for each time interval. We also examine segmental inference using an approach based on the semi-Markov conditional random field, which jointly performs phase segmentation and classification. Our method is evaluated on a data set of 24 robot-assisted hysterectomy procedures. RESULTS:Our framework is able to detect surgical phases with an accuracy of 74 % using event-based features over a set of five different phases-ligation, dissection, colpotomy, cuff closure, and background. Precision and recall values for the cuff closure (Precision: 83 %, Recall: 98 %) and dissection (Precision: 75 %, Recall: 88 %) classes were higher than other classes. The normalized Levenshtein distance between predicted and ground truth phase sequence was 25 %. CONCLUSIONS:Our findings demonstrate that system events features are useful for automatically detecting surgical phase. Events contain phase information that cannot be obtained from motion data and that would require advanced computer vision algorithms to extract from a video. Many of these events are not specific to robotic surgery and can easily be recorded in non-robotic surgical modalities. In future work, we plan to combine information from system events, tool motion, and videos to automate phase detection in surgical procedures.

authors

Malpani A,Lea C,Chen CC,Hager GD

doi

10.1007/s11548-016-1409-0

subject

Has Abstract

pub_date

2016-06-01 00:00:00

pages

1201-9

issue

6

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-016-1409-0

journal_volume

11

pub_type

杂志文章
  • Scaled, patient-specific 3D vertebral model reconstruction based on 2D lateral fluoroscopy.

    abstract:BACKGROUNDS:Accurate three-dimensional (3D) models of lumbar vertebrae are required for image-based 3D kinematics analysis. MRI or CT datasets are frequently used to derive 3D models but have the disadvantages that they are expensive, time-consuming or involving ionizing radiation (e.g., CT acquisition). An alternative...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0515-7

    authors: Zheng G,Nolte LP,Ferguson SJ

    更新日期:2011-05-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Gain determination of feedback force for an ultrasound scanning robot using genetic algorithm.

    abstract:PURPOSE:The remote medical diagnosis system (RMDS) is for providing medical diagnosis to the patients located in remote sites. To apply to RMDS and medical automation, many master-slave type ultrasound scanning robots are being developed and researched. One of the important research issue of the master-slave type ultra...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01915-3

    authors: Kim YJ,Park CK,Kim KG

    更新日期:2019-05-01 00:00:00

  • Orbital volume analysis: validation of a semi-automatic software segmentation method.

    abstract:PURPOSE:The purpose of this study was to validate a quick, accurate and reproducible (semi-) automatic software segmentation method to measure orbital volume in the unaffected bony orbit. Precise volume measurement of the orbital cavity is a useful addition to pre-operative planning and intraoperative navigation in orb...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1254-6

    authors: Jansen J,Schreurs R,Dubois L,Maal TJ,Gooris PJ,Becking AG

    更新日期:2016-01-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00

  • Edge map analysis in chest X-rays for automatic pulmonary abnormality screening.

    abstract:PURPOSE:Our particular motivator is the need for screening HIV+ populations in resource-constrained regions for the evidence of tuberculosis, using posteroanterior chest radiographs (CXRs). METHOD:The proposed method is motivated by the observation that abnormal CXRs tend to exhibit corrupted and/or deformed thoracic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1359-6

    authors: Santosh KC,Vajda S,Antani S,Thoma GR

    更新日期:2016-09-01 00:00:00

  • Learning soft tissue behavior of organs for surgical navigation with convolutional neural networks.

    abstract:PURPOSE:In surgical navigation, pre-operative organ models are presented to surgeons during the intervention to help them in efficiently finding their target. In the case of soft tissue, these models need to be deformed and adapted to the current situation by using intra-operative sensor data. A promising method to rea...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01965-7

    authors: Pfeiffer M,Riediger C,Weitz J,Speidel S

    更新日期:2019-07-01 00:00:00

  • Patient-specific estimation of detailed cochlear shape from clinical CT images.

    abstract:PURPOSE:A personalized estimation of the cochlear shape can be used to create computational anatomical models to aid cochlear implant (CI) surgery and CI audio processor programming ultimately resulting in improved hearing restoration. The purpose of this work is to develop and test a method for estimation of the detai...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1701-7

    authors: Kjer HM,Fagertun J,Wimmer W,Gerber N,Vera S,Barazzetti L,Mangado N,Ceresa M,Piella G,Stark T,Stauber M,Reyes M,Weber S,Caversaccio M,González Ballester MÁ,Paulsen RR

    更新日期:2018-03-01 00:00:00

  • Shared control of a medical robot with haptic guidance.

    abstract:PURPOSE:Tele-operation of robotic surgery reduces the radiation exposure during the interventional radiological operations. However, endoscope vision without force feedback on the surgical tool increases the difficulty for precise manipulation and the risk of tissue damage. The shared control of vision and force provid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1425-0

    authors: Xiong L,Chng CB,Chui CK,Yu P,Li Y

    更新日期:2017-01-01 00:00:00

  • Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments.

    abstract:PURPOSE:Flexible surgical robot can work in confined and complex environments, which makes it a good option for minimally invasive surgery. In order to utilize flexible manipulators in complicated and constrained surgical environments, it is of great significance to monitor the position and shape of the curvilinear man...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1672-8

    authors: Song S,Zhang C,Liu L,Meng MQ

    更新日期:2018-02-01 00:00:00

  • Comparison of different grid of tags detection methods in tagged cardiac MR imaging.

    abstract:PURPOSE:Non-invasive imaging assessment of cardiac function is important in cardiovascular disease diagnosis, especially for evaluation of local cardiac motion. Tagged cardiac MRI has been developed for this purpose, but evaluation of the results requires quantification and automation. METHODS:Two methods utilizing ac...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0495-7

    authors: Histace A,Portefaix C,Matuszewski B

    更新日期:2011-03-01 00:00:00

  • Language-based translation and prediction of surgical navigation steps for endoscopic wayfinding assistance in minimally invasive surgery.

    abstract:PURPOSE:In the context of aviation and automotive navigation technology, assistance functions are associated with predictive planning and wayfinding tasks. In endoscopic minimally invasive surgery, however, assistance so far relies primarily on image-based localization and classification. We show that navigation workfl...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02264-2

    authors: Bieck R,Heuermann K,Pirlich M,Neumann J,Neumuth T

    更新日期:2020-12-01 00:00:00

  • A framework for correcting brain retraction based on an eXtended Finite Element Method using a laser range scanner.

    abstract:BACKGROUND:Brain retraction causes great distortion that limits the accuracy of an image-guided neurosurgery system that uses preoperative images. Therefore, brain retraction correction is an important intraoperative clinical application. METHODS:We used a linear elastic biomechanical model, which deforms based on the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0958-8

    authors: Li P,Wang W,Song Z,An Y,Zhang C

    更新日期:2014-07-01 00:00:00

  • PyDBS: an automated image processing workflow for deep brain stimulation surgery.

    abstract:PURPOSE:Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmenta...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1007-y

    authors: D'Albis T,Haegelen C,Essert C,Fernández-Vidal S,Lalys F,Jannin P

    更新日期:2015-02-01 00:00:00

  • A preregistered STAMP method for image-guided temporal bone surgery.

    abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0916-5

    authors: Oka M,Cho B,Matsumoto N,Hong J,Jinnouchi M,Ouchida R,Komune S,Hashizume M

    更新日期:2014-01-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • Robust GPU-based virtual reality simulation of radio-frequency ablations for various needle geometries and locations.

    abstract:PURPOSE:Radio-frequency ablations play an important role in the therapy of malignant liver lesions. The navigation of a needle to the lesion poses a challenge for both the trainees and intervening physicians. METHODS:This publication presents a new GPU-based, accurate method for the simulation of radio-frequency ablat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02033-w

    authors: Kath N,Handels H,Mastmeyer A

    更新日期:2019-11-01 00:00:00

  • Multimodal mixed reality visualisation for intraoperative surgical guidance.

    abstract:PURPOSE:In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02165-4

    authors: Cartucho J,Shapira D,Ashrafian H,Giannarou S

    更新日期:2020-05-01 00:00:00

  • Optimal setting of image bounding box can improve registration accuracy of diffusion tensor tractography.

    abstract:PURPOSE:When we register diffusion tensor tractography (DTT) to anatomical images such as fast imaging employing steady-state acquisition (FIESTA), we register the B0 image to FIESTA. Precise registration of the DTT B0 image to FIESTA is possible with non-rigid registration compared to rigid registration, although the ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0934-3

    authors: Yoshino M,Kin T,Saito T,Nakagawa D,Nakatomi H,Kunimatsu A,Oyama H,Saito N

    更新日期:2013-08-20 00:00:00

  • A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.

    abstract:PURPOSE:Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods wer...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01910-0

    authors: Laves MH,Bicker J,Kahrs LA,Ortmaier T

    更新日期:2019-03-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • Hand-eye calibration for surgical cameras: a Procrustean Perspective-n-Point solution.

    abstract:PURPOSE:Surgical cameras are prevalent in modern operating theatres often used as surrogates for direct vision. A surgical navigational system is a useful adjunct, but requires an accurate "hand-eye" calibration to determine the geometrical relationship between the surgical camera and tracking markers. METHODS:Using a...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1590-9

    authors: Morgan I,Jayarathne U,Rankin A,Peters TM,Chen ECS

    更新日期:2017-07-01 00:00:00

  • Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms.

    abstract:PURPOSE:In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1692-4

    authors: Reena Benjamin J,Jayasree T

    更新日期:2018-02-01 00:00:00

  • Meaningful Assessment of Robotic Surgical Style using the Wisdom of Crowds.

    abstract:OBJECTIVE:Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1738-2

    authors: Ershad M,Rege R,Fey AM

    更新日期:2018-07-01 00:00:00

  • Robust motion tracking in liver from 2D ultrasound images using supporters.

    abstract:PURPOSE:Effectiveness of image-guided radiation therapy with precise dose delivery depends highly on accurate target localization, which may involve motion during treatment due to, e.g., breathing and drift. Therefore, it is important to track the motion and adjust the radiation delivery accordingly. Tracking generally...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1559-8

    authors: Ozkan E,Tanner C,Kastelic M,Mattausch O,Makhinya M,Goksel O

    更新日期:2017-06-01 00:00:00

  • Video-based computer navigation in knee arthroscopy for patient-specific ACL reconstruction.

    abstract:PURPOSE:The anterior cruciate ligament tear is a common medical condition that is treated using arthroscopy by pulling a tissue graft through a tunnel opened with a drill. The correct anatomical position and orientation of this tunnel are crucial for knee stability, and drilling an adequate bone tunnel is the most tech...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02021-0

    authors: Raposo C,Barreto JP,Sousa C,Ribeiro L,Melo R,Oliveira JP,Marques P,Fonseca F,Barrett D

    更新日期:2019-09-01 00:00:00

  • Ultrasound imaging method for internal jugular vein measurement and estimation of circulating blood volume.

    abstract:PURPOSE:Evaluation of circulating blood volume is important in assessing the status of patients. Although some studies have suggested that ultrasound images of the internal jugular vein (IJV) can be used for the analysis of circulating blood volume, accurate extraction of IJV is necessary to reduce errors. Therefore, t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0921-8

    authors: Qian K,Ando T,Nakamura K,Liao H,Kobayashi E,Yahagi N,Sakuma I

    更新日期:2014-03-01 00:00:00

  • Estimating needle tip deflection in biological tissue from a single transverse ultrasound image: application to brachytherapy.

    abstract:PURPOSE:This paper proposes a method to predict the deflection of a flexible needle inserted into soft tissue based on the observation of deflection at a single point along the needle shaft. METHODS:We model the needle-tissue as a discretized structure composed of several virtual, weightless, rigid links connected by ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1329-4

    authors: Rossa C,Sloboda R,Usmani N,Tavakoli M

    更新日期:2016-07-01 00:00:00

  • A deep learning framework for efficient analysis of breast volume and fibroglandular tissue using MR data with strong artifacts.

    abstract:PURPOSE:The main purpose of this work is to develop, apply, and evaluate an efficient approach for breast density estimation in magnetic resonance imaging data, which contain strong artifacts including intensity inhomogeneities. METHODS:We present a pipeline for breast density estimation, which consists of intensity i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01928-y

    authors: Ivanovska T,Jentschke TG,Daboul A,Hegenscheid K,Völzke H,Wörgötter F

    更新日期:2019-10-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00