Evaluation of a marker-less, intra-operative, augmented reality guidance system for robot-assisted laparoscopic radical prostatectomy.

Abstract:

PURPOSE:Robot-assisted laparoscopic radical prostatectomy (RALRP) using the da Vinci surgical robot is a common treatment for organ-confined prostate cancer. Augmented reality (AR) can help during RALRP by showing the surgeon the location of anatomical structures and tumors from preoperative imaging. Previously, we proposed hand-eye and camera intrinsic matrix estimation procedures that can be carried out with conventional instruments within the patient during surgery, take < 3 min to perform, and fit seamlessly in the existing surgical workflow. In this paper, we describe and evaluate a complete AR guidance system for RALRP and quantify its accuracy. METHODS:Our AR system requires three transformations: the transrectal ultrasound (TRUS) to da Vinci transformation, the camera intrinsic matrix, and the hand-eye transformation. For evaluation, a 3D-printed cross-wire was visualized in TRUS and stereo endoscope in a water bath. Manually triangulated cross-wire points from stereo images were used as ground truth to evaluate overall TRE between these points and points transformed from TRUS to camera. RESULTS:After transforming the ground-truth points from the TRUS to the camera coordinate frame, the mean target registration error (TRE) (SD) was [Formula: see text] mm. The mean TREs (SD) in the x-, y-, and z-directions are [Formula: see text] mm, [Formula: see text] mm, and [Formula: see text] mm, respectively. CONCLUSIONS:We describe and evaluate a complete AR guidance system for RALRP which can augment preoperative data to endoscope camera image, after a deformable magnetic resonance image to TRUS registration step. The streamlined procedures with current surgical workflow and low TRE demonstrate the compatibility and readiness of the system for clinical translation. A detailed sensitivity study remains part of future work.

authors

Kalia M,Mathur P,Tsang K,Black P,Navab N,Salcudean S

doi

10.1007/s11548-020-02181-4

subject

Has Abstract

pub_date

2020-07-01 00:00:00

pages

1225-1233

issue

7

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02181-4

journal_volume

15

pub_type

杂志文章
  • A fully 3D work context for oral implant planning and simulation.

    abstract:PURPOSE:Most software systems for oral implantology are based on a two-dimensional multi-view approach, often accompanied with a surface rendered model. Usually they are affected by common errors like anisotropy of the volume and distortion on measurements. A more integrated and realistic 3D approach for implant surger...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0394-y

    authors: Chiarelli T,Lamma E,Sansoni T

    更新日期:2010-01-01 00:00:00

  • Translatory hip kinematics measured with optoelectronic surgical navigation.

    abstract:PURPOSE:An optoelectronic surgical navigation system was used to detect small but measurable translational motion of human hip cadavers in high-range passive motions. Kinematic data were also examined to demonstrate the role of soft tissues in constraining hip translation. METHODS:Twelve cadaver hips were scanned usin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1629-y

    authors: Zakani S,Rudan JF,Ellis RE

    更新日期:2017-08-01 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology.

    abstract:PURPOSE:Knee arthroscopy suffers from a lack of depth information and easy occlusion of the visual field. To solve these limitations, we propose an arthroscopic navigation system based on self-positioning technology, with the guidance of virtual-vision views. This system can work without any external tracking devices o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02099-6

    authors: Ma C,Cui X,Chen F,Ma L,Xin S,Liao H

    更新日期:2020-03-01 00:00:00

  • Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features.

    abstract:PURPOSE:Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested. METHODS:Simple thresholds and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0922-7

    authors: Wu W,Chen AY,Zhao L,Corso JJ

    更新日期:2014-03-01 00:00:00

  • Shared control of a medical robot with haptic guidance.

    abstract:PURPOSE:Tele-operation of robotic surgery reduces the radiation exposure during the interventional radiological operations. However, endoscope vision without force feedback on the surgical tool increases the difficulty for precise manipulation and the risk of tissue damage. The shared control of vision and force provid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1425-0

    authors: Xiong L,Chng CB,Chui CK,Yu P,Li Y

    更新日期:2017-01-01 00:00:00

  • Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope.

    abstract:PURPOSE:Calibration and registration are the first steps for augmented reality and mixed reality applications. In the medical field, the calibration between an RGB-D camera and a C-arm fluoroscope is a new topic which introduces challenges. METHOD:A convenient and efficient calibration phantom is designed by combining...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1347-2

    authors: Wang X,Habert S,Ma M,Huang CH,Fallavollita P,Navab N

    更新日期:2016-08-01 00:00:00

  • Computer-aided detection of breast carcinoma in standard mammographic projections with digital mammography.

    abstract:PURPOSE:A retrospective evaluation of the ability of computer-aided detection (CAD) ability to identify breast carcinoma in standard mammographic projections. MATERIALS AND METHODS:Forty-five biopsy proven lesions in 44 patients imaged digitally with CAD applied at examination were reviewed. Forty-four screening BIRAD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0300-7

    authors: Destounis S,Hanson S,Morgan R,Murphy P,Somerville P,Seifert P,Andolina V,Arieno A,Skolny M,Logan-Young W

    更新日期:2009-06-01 00:00:00

  • Automatic needle tracking using Mask R-CNN for MRI-guided percutaneous interventions.

    abstract:PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02226-8

    authors: Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HH

    更新日期:2020-10-01 00:00:00

  • Development of preoperative planning software for transforaminal endoscopic surgery and the guidance for clinical applications.

    abstract:PURPOSE:Preoperative planning is of great importance for transforaminal endoscopic techniques applied in percutaneous endoscopic lumbar discectomy. In this study, a modular preoperative planning software for transforaminal endoscopic surgery was developed and demonstrated. METHODS:The path searching method is based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1282-2

    authors: Chen X,Cheng J,Gu X,Sun Y,Politis C

    更新日期:2016-04-01 00:00:00

  • Myocardium tracking via matching distributions.

    abstract:OBJECTIVE:The goal of this study is to investigate automatic myocardium tracking in cardiac Magnetic Resonance (MR) sequences using global distribution matching via level-set curve evolution. Rather than relying on the pixelwise information as in existing approaches, distribution matching compares intensity distributio...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-008-0265-y

    authors: Ben Ayed I,Li S,Ross I,Islam A

    更新日期:2009-01-01 00:00:00

  • Automated muscle segmentation from CT images of the hip and thigh using a hierarchical multi-atlas method.

    abstract:PURPOSE:Patient-specific quantitative assessments of muscle mass and biomechanical musculoskeletal simulations require segmentation of the muscles from medical images. The objective of this work is to automate muscle segmentation from CT data of the hip and thigh. METHOD:We propose a hierarchical multi-atlas method in...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1758-y

    authors: Yokota F,Otake Y,Takao M,Ogawa T,Okada T,Sugano N,Sato Y

    更新日期:2018-07-01 00:00:00

  • A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

    abstract:PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1881-9

    authors: Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

    更新日期:2019-04-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT.

    abstract:PURPOSE:Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately. METHODS:The proposed method starts with manually delineated ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1457-5

    authors: Liu Y,Jin R,Chen M,Song E,Xu X,Zhang S,Hung CC

    更新日期:2016-12-01 00:00:00

  • Augmentation of haptic feedback for teleoperated robotic surgery.

    abstract:PURPOSE:A frequently mentioned lack of teleoperated surgical robots is the lack of haptic feedback. Haptics are not only able to mirror force information from the situs, but also to provide spatial guidance according to a surgical plan. However, superposition of the two haptic information can lead to overlapping and ma...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02118-x

    authors: Schleer P,Kaiser P,Drobinsky S,Radermacher K

    更新日期:2020-03-01 00:00:00

  • Optimal setting of image bounding box can improve registration accuracy of diffusion tensor tractography.

    abstract:PURPOSE:When we register diffusion tensor tractography (DTT) to anatomical images such as fast imaging employing steady-state acquisition (FIESTA), we register the B0 image to FIESTA. Precise registration of the DTT B0 image to FIESTA is possible with non-rigid registration compared to rigid registration, although the ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0934-3

    authors: Yoshino M,Kin T,Saito T,Nakagawa D,Nakatomi H,Kunimatsu A,Oyama H,Saito N

    更新日期:2013-08-20 00:00:00

  • Four-dimensional fully convolutional residual network-based liver segmentation in Gd-EOB-DTPA-enhanced MRI.

    abstract:PURPOSE:Gadolinium-ethoxybenzyl-diethylenetriamine pentaacetic acid (Gd-EOB-DTPA)-enhanced magnetic resonance imaging (MRI) tends to show higher diagnostic accuracy than other modalities. There is a demand for computer-assisted detection (CAD) software for Gd-EOB-DTPA-enhanced MRI. Segmentation with high accuracy is im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01935-z

    authors: Takenaga T,Hanaoka S,Nomura Y,Nemoto M,Murata M,Nakao T,Miki S,Yoshikawa T,Hayashi N,Abe O

    更新日期:2019-08-01 00:00:00

  • Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms.

    abstract:PURPOSE:In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1692-4

    authors: Reena Benjamin J,Jayasree T

    更新日期:2018-02-01 00:00:00

  • A framework for correcting brain retraction based on an eXtended Finite Element Method using a laser range scanner.

    abstract:BACKGROUND:Brain retraction causes great distortion that limits the accuracy of an image-guided neurosurgery system that uses preoperative images. Therefore, brain retraction correction is an important intraoperative clinical application. METHODS:We used a linear elastic biomechanical model, which deforms based on the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0958-8

    authors: Li P,Wang W,Song Z,An Y,Zhang C

    更新日期:2014-07-01 00:00:00

  • Multistage segmentation model and SVM-ensemble for precise lung nodule detection.

    abstract:PURPOSE:Lung cancer detection at its initial stages increases the survival chances of patients. Automatic detection of lung nodules facilitates radiologists during the diagnosis. However, there is a challenge of false positives in automated systems which may lead to wrong findings. Precise segmentation facilitates to a...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1715-9

    authors: Naqi SM,Sharif M,Yasmin M

    更新日期:2018-07-01 00:00:00

  • Projection-based visual guidance for robot-aided RF needle insertion.

    abstract:PURPOSE:The use of projector-based augmented reality (AR) in surgery may enable surgeons to directly view anatomical models and surgical data from the patient's surface (skin). It has the advantages of a consistent viewing focus on the patient, an extended field of view and augmented interaction. This paper presents an...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0897-4

    authors: Wen R,Chui CK,Ong SH,Lim KB,Chang SK

    更新日期:2013-11-01 00:00:00

  • A deep learning framework for efficient analysis of breast volume and fibroglandular tissue using MR data with strong artifacts.

    abstract:PURPOSE:The main purpose of this work is to develop, apply, and evaluate an efficient approach for breast density estimation in magnetic resonance imaging data, which contain strong artifacts including intensity inhomogeneities. METHODS:We present a pipeline for breast density estimation, which consists of intensity i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01928-y

    authors: Ivanovska T,Jentschke TG,Daboul A,Hegenscheid K,Völzke H,Wörgötter F

    更新日期:2019-10-01 00:00:00

  • System events: readily accessible features for surgical phase detection.

    abstract:PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologie...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1409-0

    authors: Malpani A,Lea C,Chen CC,Hager GD

    更新日期:2016-06-01 00:00:00

  • PyDBS: an automated image processing workflow for deep brain stimulation surgery.

    abstract:PURPOSE:Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmenta...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1007-y

    authors: D'Albis T,Haegelen C,Essert C,Fernández-Vidal S,Lalys F,Jannin P

    更新日期:2015-02-01 00:00:00

  • Long-term experience with setup and implementation of an IHE-based image management and distribution system in intersectoral clinical routine.

    abstract:PURPOSE:Sharing of medical data is crucial for the proper treatment of patients as it could reduce the risk of duplicated medical tests and speed up the care process if all documents are readily available. Despite great technical progress, sharing patient data while maintaining full control over the process in an inter...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1819-2

    authors: Schwind F,Münch H,Schröter A,Brandner R,Kutscha U,Brandner A,Heinze O,Bergh B,Engelmann U

    更新日期:2018-11-01 00:00:00

  • Ultrasound imaging method for internal jugular vein measurement and estimation of circulating blood volume.

    abstract:PURPOSE:Evaluation of circulating blood volume is important in assessing the status of patients. Although some studies have suggested that ultrasound images of the internal jugular vein (IJV) can be used for the analysis of circulating blood volume, accurate extraction of IJV is necessary to reduce errors. Therefore, t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0921-8

    authors: Qian K,Ando T,Nakamura K,Liao H,Kobayashi E,Yahagi N,Sakuma I

    更新日期:2014-03-01 00:00:00

  • BEM-based simulation of lung respiratory deformation for CT-guided biopsy.

    abstract:PURPOSE:Accurate and real-time prediction of the lung and lung tumor deformation during respiration are important considerations when performing a peripheral biopsy procedure. However, most existing work focused on offline whole lung simulation using 4D image data, which is not applicable in real-time image-guided biop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1603-8

    authors: Chen D,Chen W,Huang L,Feng X,Peters T,Gu L

    更新日期:2017-09-01 00:00:00

  • Automatic airway tree segmentation based on multi-scale context information.

    abstract:PURPOSE:Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies. METHODS...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02293-x

    authors: Zhou K,Chen N,Xu X,Wang Z,Guo J,Liu L,Yi Z

    更新日期:2021-01-19 00:00:00

  • Unravelling the effect of data augmentation transformations in polyp segmentation.

    abstract:PURPOSE:Data augmentation is a common technique to overcome the lack of large annotated databases, a usual situation when applying deep learning to medical imaging problems. Nevertheless, there is no consensus on which transformations to apply for a particular field. This work aims at identifying the effect of differen...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02262-4

    authors: Sánchez-Peralta LF,Picón A,Sánchez-Margallo FM,Pagador JB

    更新日期:2020-12-01 00:00:00