Augmentation of haptic feedback for teleoperated robotic surgery.

Abstract:

PURPOSE:A frequently mentioned lack of teleoperated surgical robots is the lack of haptic feedback. Haptics are not only able to mirror force information from the situs, but also to provide spatial guidance according to a surgical plan. However, superposition of the two haptic information can lead to overlapping and masking of the feedback and guidance forces. This study investigates different approaches toward a combination of both information and investigates effects on system usability. METHODS:Preliminary studies are conducted to define parameters for two main experiments. The two main experiments constitute simulated surgical interventions where haptic guidance as well as haptic feedback provide information for the surgeon. The first main experiment considers drilling for pedicle screw placements, while the second main experiment refers to three-dimensional milling tasks such as during partial knee replacements or craniectomies. For both experiments, different guidance modes in combination with haptic feedback are evaluated regarding effectiveness (e.g., distance to target depth), efficiency and user satisfaction (e.g., detectability of discrepancies in case of technical guidance error). RESULTS:Regarding pedicle screw placements a combination of a peripheral visual signal and a vibration constitutes a good compromise regarding distance to target depth and detectability of discrepancies. For milling tasks, trajectory guidance is able to improve efficiency and user satisfaction (e.g., perceived workload), while boundary constraints improve effectiveness. If, assistance cannot be offered in all degrees of freedom (e.g., craniectomies), a visual substitution of the haptic force feedback shows the best results, though participants prefer using haptic force feedback. CONCLUSION:Our results suggest that in case haptic feedback and haptic assistance are combined appropriately, benefits of both haptic modalities can be exploited. Thereby, capabilities of the human-machine system are improved compared to usage of exclusively one of the haptic information.

authors

Schleer P,Kaiser P,Drobinsky S,Radermacher K

doi

10.1007/s11548-020-02118-x

subject

Has Abstract

pub_date

2020-03-01 00:00:00

pages

515-529

issue

3

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02118-x

journal_volume

15

pub_type

杂志文章
  • Ultrasound texture-based CAD system for detecting neuromuscular diseases.

    abstract:PURPOSE:Diagnosis of neuromuscular diseases in ultrasonography is a challenging task since experts are often unable to discriminate between healthy and pathological cases. A computer-aided diagnosis (CAD) system for skeletal muscle ultrasonography was developed and tested for myositis detection in ultrasound images of ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1133-6

    authors: König T,Steffen J,Rak M,Neumann G,von Rohden L,Tönnies KD

    更新日期:2015-09-01 00:00:00

  • A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

    abstract:PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1881-9

    authors: Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

    更新日期:2019-04-01 00:00:00

  • Feature detection in biological tissues using multi-band and narrow-band imaging.

    abstract:PURPOSE:In the past decade, augmented reality systems have been expected to support surgical operations by making it possible to view invisible objects that are inside or occluded by the skull, hands, or organs. However, the properties of biological tissues that are non-rigid and featureless require a large number of d...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1458-4

    authors: Tamura Y,Mashita T,Kuroda Y,Kiyokawa K,Takemura H

    更新日期:2016-12-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • Suspension laryngoscopy using a curved-frame trans-oral robotic system.

    abstract:PURPOSE:Suspension laryngoscopy has been employed for laryngeal diseases such as treatment for a polyp, cystoma, or granuloma. After securing a straight path with a laryngoscope, the surgeon inserts rigid instruments and examines the target lesion by using a microscope. However, many patients suffer from secondary comp...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0944-1

    authors: Kwon YS,Tae K,Yi BJ

    更新日期:2014-07-01 00:00:00

  • A vision-based system for fast and accurate laser scanning in robot-assisted phonomicrosurgery.

    abstract:PURPOSE:Surgical quality in phonomicrosurgery can be improved by open-loop laser control (e.g., high-speed scanning capabilities) with a robust and accurate closed-loop visual servoing systems. A new vision-based system for laser scanning control during robot-assisted phonomicrosurgery was developed and tested. METHOD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1078-9

    authors: Dagnino G,Mattos LS,Caldwell DG

    更新日期:2015-02-01 00:00:00

  • Interactive bone drilling using a 2D pointing device to support Microendoscopic Discectomy planning.

    abstract:PURPOSE:To support preoperative planning of bone drilling for Microendoscopic Discectomy, we present a set of interactive bone-drilling methods using a general 2D pointing device. METHODS:Unlike the existing methods, our framework has the following features: (1) the user can directly cut away arbitrary 3D regions on t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0413-z

    authors: Imanishi K,Nakao M,Kioka M,Mori M,Yoshida M,Takahashi T,Minato K

    更新日期:2010-09-01 00:00:00

  • A method for going from 2D laparoscope to 3D acquisition of surface landmarks by a novel computer vision approach.

    abstract:PURPOSE:This paper presents a method to use the Smart Trocars-our new surgical instrument recognition system-or any accurate localization system of surgical instrument for acquiring intraoperative surface data. Complex laparoscopic surgeries need a proper guidance system which requires registering the preoperative data...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1655-9

    authors: Garbey M,Nguyen TB,Huang AY,Fikfak V,Dunkin BJ

    更新日期:2018-02-01 00:00:00

  • Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks.

    abstract:PURPOSE:During needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes. METHODS:We present a novel appr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1798-3

    authors: Pourtaherian A,Ghazvinian Zanjani F,Zinger S,Mihajlovic N,Ng GC,Korsten HHM,de With PHN

    更新日期:2018-09-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00

  • Finger-attachment device for the feedback of gripping and pulling force in a manipulating system for brain tumor resection.

    abstract:PURPOSE:Development and evaluation of an effective attachment device for a bilateral brain tumor resection robotic surgery system based on the sensory performance of the human index finger in order to precisely detect gripping- and pulling-force feedback. METHODS:First, a basic test was conducted to investigate the pe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1640-3

    authors: Chinbe H,Yoneyama T,Watanabe T,Miyashita K,Nakada M

    更新日期:2018-01-01 00:00:00

  • Continuous roadmapping in liver TACE procedures using 2D-3D catheter-based registration.

    abstract:PURPOSE:Fusion of pre/perioperative images and intra-operative images may add relevant information during image-guided procedures. In abdominal procedures, respiratory motion changes the position of organs, and thus accurate image guidance requires a continuous update of the spatial alignment of the (pre/perioperative)...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1218-x

    authors: Ambrosini P,Ruijters D,Niessen WJ,Moelker A,van Walsum T

    更新日期:2015-09-01 00:00:00

  • Anatomy-driven multiple trajectory planning (ADMTP) of intracranial electrodes for epilepsy surgery.

    abstract:PURPOSE:Epilepsy is potentially curable with resective surgery if the epileptogenic zone (EZ) can be identified. If non-invasive imaging is unable to elucidate the EZ, intracranial electrodes may be implanted to identify the EZ as well as map cortical function. In current clinical practice, each electrode trajectory is...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1628-z

    authors: Sparks R,Vakharia V,Rodionov R,Vos SB,Diehl B,Wehner T,Miserocchi A,McEvoy AW,Duncan JS,Ourselin S

    更新日期:2017-08-01 00:00:00

  • Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms.

    abstract:PURPOSE:In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1692-4

    authors: Reena Benjamin J,Jayasree T

    更新日期:2018-02-01 00:00:00

  • Automatic cardiac ventricle segmentation in MR images: a validation study.

    abstract:PURPOSE:Segmenting the cardiac ventricles in magnetic resonance (MR) images is required for cardiac function assessment. Numerous segmentation methods have been developed and applied to MR ventriculography. Quantitative validation of these segmentation methods with ground truth is needed prior to clinical use, but requ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0532-6

    authors: Grosgeorge D,Petitjean C,Caudron J,Fares J,Dacher JN

    更新日期:2011-09-01 00:00:00

  • A CAD of fully automated colonic polyp detection for contrasted and non-contrasted CT scans.

    abstract:PURPOSE:Computer-aided detection (CAD) systems are developed to help radiologists detect colonic polyps over CT scans. It is possible to reduce the detection time and increase the detection accuracy rates by using CAD systems. In this paper, we aimed to develop a fully integrated CAD system for automated detection of p...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1521-9

    authors: Tulum G,Bolat B,Osman O

    更新日期:2017-04-01 00:00:00

  • Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty.

    abstract:PURPOSE:Previous work on surgical skill assessment using intraoperative tool motion has focused on highly structured surgical tasks such as cholecystectomy and used generic motion metrics such as time and number of movements. Other statistical methods such as hidden Markov models (HMM) and descriptive curve coding (DCC...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1194-1

    authors: Ahmidi N,Poddar P,Jones JD,Vedula SS,Ishii L,Hager GD,Ishii M

    更新日期:2015-06-01 00:00:00

  • Incorporating prior shape knowledge via data-driven loss model to improve 3D liver segmentation in deep CNNs.

    abstract:PURPOSE:Convolutional neural networks (CNNs) have obtained enormous success in liver segmentation. However, there are several challenges, including low-contrast images, and large variations in the shape, and appearance of the liver. Incorporating prior knowledge in deep CNN models improves their performance and general...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02085-y

    authors: Mohagheghi S,Foruzan AH

    更新日期:2020-02-01 00:00:00

  • On-patient see-through augmented reality based on visual SLAM.

    abstract:PURPOSE:An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS:We resort to visual SLAM t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1444-x

    authors: Mahmoud N,Grasa ÓG,Nicolau SA,Doignon C,Soler L,Marescaux J,Montiel JM

    更新日期:2017-01-01 00:00:00

  • Development of preoperative planning software for transforaminal endoscopic surgery and the guidance for clinical applications.

    abstract:PURPOSE:Preoperative planning is of great importance for transforaminal endoscopic techniques applied in percutaneous endoscopic lumbar discectomy. In this study, a modular preoperative planning software for transforaminal endoscopic surgery was developed and demonstrated. METHODS:The path searching method is based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1282-2

    authors: Chen X,Cheng J,Gu X,Sun Y,Politis C

    更新日期:2016-04-01 00:00:00

  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • Image-based 3D modeling and validation of radiofrequency interstitial tumor ablation using a tissue-mimicking breast phantom.

    abstract:PURPOSE:Minimally invasive treatment of solid cancers, especially in the breast and liver, remains clinically challenging, despite a variety of treatment modalities, including radiofrequency ablation (RFA), microwave ablation or high-intensity focused ultrasound. Each treatment modality has advantages and disadvantages...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0769-3

    authors: Wang Z,Aarya I,Gueorguieva M,Liu D,Luo H,Manfredi L,Wang L,McLean D,Coleman S,Brown S,Cuschieri A

    更新日期:2012-11-01 00:00:00

  • Deformable registration of trans-rectal ultrasound (TRUS) and magnetic resonance imaging (MRI) for focal prostate brachytherapy.

    abstract:PURPOSE:Focal therapy in low-risk prostate cancer may provide the best balance between cancer control and quality of life preservation. As a minimally invasive approach performed under TRUS guidance, brachytherapy is an appealing framework for focal therapy. However, the contrast in TRUS images is generally insufficien...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1380-9

    authors: Mayer A,Zholkover A,Portnoy O,Raviv G,Konen E,Symon Z

    更新日期:2016-06-01 00:00:00

  • Image-based laparoscopic bowel measurement.

    abstract:PURPOSE:Minimally invasive interventions offer benefits for patients, while also entailing drawbacks for surgeons, such as the loss of depth perception. Thus estimating distances, which is of particular importance in gastric bypasses, becomes difficult. In this paper, we propose an approach based on stereo endoscopy th...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1291-1

    authors: Bodenstedt S,Wagner M,Mayer B,Stemmer K,Kenngott H,Müller-Stich B,Dillmann R,Speidel S

    更新日期:2016-03-01 00:00:00

  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • A framework for correcting brain retraction based on an eXtended Finite Element Method using a laser range scanner.

    abstract:BACKGROUND:Brain retraction causes great distortion that limits the accuracy of an image-guided neurosurgery system that uses preoperative images. Therefore, brain retraction correction is an important intraoperative clinical application. METHODS:We used a linear elastic biomechanical model, which deforms based on the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0958-8

    authors: Li P,Wang W,Song Z,An Y,Zhang C

    更新日期:2014-07-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • A preregistered STAMP method for image-guided temporal bone surgery.

    abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0916-5

    authors: Oka M,Cho B,Matsumoto N,Hong J,Jinnouchi M,Ouchida R,Komune S,Hashizume M

    更新日期:2014-01-01 00:00:00

  • MRI-compatible positioning device for guiding a focused ultrasound system for transrectal treatment of prostate cancer.

    abstract:BACKGROUND:High-intensity focused ultrasound (HIFU) is a promising treatment method for many common cancers, including prostate cancer. Magnetic resonance image (MRI) guidance of HIFU permits targeting and monitoring of therapy. A prototype MRI-compatible positioning device that navigates a HIFU transducer was designed...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0964-x

    authors: Yiallouras C,Mylonas N,Damianou C

    更新日期:2014-07-01 00:00:00

  • Assessment of two 3-D fluoroscopic systems for articular fracture reduction: a cadaver study.

    abstract:OBJECTIVE:The most commonly used imaging device for assessment of fracture reduction is the two-dimensional X-ray fluoroscope. Two recently introduced 3D fluoroscopic devices, the Siremobil ISO-C3D (Siemens) and the C-InSight (Mazor Surgical Technologies), enable the surgeon to obtain spatial information for the assess...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0548-6

    authors: Weil YA,Liebergall M,Mosheiff R,Singer SB,Joskowicz L,Khoury A

    更新日期:2011-09-01 00:00:00