Force estimation from OCT volumes using 3D CNNs.

Abstract:

PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and sterilizability. We investigate a novel approach to estimate the force vector directly from optical coherence tomography image volumes. METHODS:We introduce a novel Siamese 3D CNN architecture. The network takes an undeformed reference volume and a deformed sample volume as an input and outputs the three components of the force vector. We employ a deep residual architecture with bottlenecks for increased efficiency. We compare the Siamese approach to methods using difference volumes and two-dimensional projections. Data were generated using a robotic setup to obtain ground-truth force vectors for silicon tissue phantoms as well as porcine tissue. RESULTS:Our method achieves a mean average error of [Formula: see text] when estimating the force vector. Our novel Siamese 3D CNN architecture outperforms single-path methods that achieve a mean average error of [Formula: see text]. Moreover, the use of volume data leads to significantly higher performance compared to processing only surface information which achieves a mean average error of [Formula: see text]. Based on the tissue dataset, our methods shows good generalization in between different subjects. CONCLUSIONS:We propose a novel image-based force estimation method using optical coherence tomography. We illustrate that capturing the deformation of subsurface structures substantially improves force estimation. Our approach can provide accurate force estimates in surgical setups when using intraoperative optical coherence tomography.

authors

Gessert N,Beringhoff J,Otte C,Schlaefer A

doi

10.1007/s11548-018-1777-8

subject

Has Abstract

pub_date

2018-07-01 00:00:00

pages

1073-1082

issue

7

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-018-1777-8

journal_volume

13

pub_type

杂志文章
  • GRAPE: a graphical pipeline environment for image analysis in adaptive magnetic resonance imaging.

    abstract:PURPOSE:We present a platform, GRAphical Pipeline Environment (GRAPE), to facilitate the development of patient-adaptive magnetic resonance imaging (MRI) protocols. METHODS:GRAPE is an open-source project implemented in the Qt C++ framework to enable graphical creation, execution, and debugging of real-time image anal...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1495-z

    authors: Gabr RE,Tefera GB,Allen WJ,Pednekar AS,Narayana PA

    更新日期:2017-03-01 00:00:00

  • [¹¹C]acetate and PET/CT assessment of muscle activation in rat studies.

    abstract:PURPOSE:The purpose of the present study is to apply kinetic analysis to investigate exercise-related changes in the metabolism of the skeletal muscle of the rat hindlimb by [[Formula: see text]]acetate positron emission tomography and computed tomography (PET/CT). METHODS:Contractions were induced in Wistar rats' lef...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1260-8

    authors: Trombella S,García D,Colin DJ,Germain S,Seimbille Y,Ratib O

    更新日期:2016-05-01 00:00:00

  • Estimating needle tip deflection in biological tissue from a single transverse ultrasound image: application to brachytherapy.

    abstract:PURPOSE:This paper proposes a method to predict the deflection of a flexible needle inserted into soft tissue based on the observation of deflection at a single point along the needle shaft. METHODS:We model the needle-tissue as a discretized structure composed of several virtual, weightless, rigid links connected by ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1329-4

    authors: Rossa C,Sloboda R,Usmani N,Tavakoli M

    更新日期:2016-07-01 00:00:00

  • Fast and flexible distance measures for treatment planning.

    abstract:PURPOSE:Distance measures are required for diagnoses, therapy decision and documentation. With today's high-resolution CT and MR imaging techniques, high- quality images have become possible. Yet, manual measurement can be tedious. We present a method for automatically determining different distance-based measures on s...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0519-3

    authors: Rössling I,Cyrus C,Dornheim L,Boehm A,Preim B

    更新日期:2010-11-01 00:00:00

  • Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle.

    abstract:PURPOSE:Most evaluations of surgical workflow or surgeon skill use simple, descriptive statistics (e.g., time) across whole procedures, thereby deemphasizing critical steps and potentially obscuring critical inefficiencies or skill deficiencies. In this work, we examine off-line, temporal clustering methods that chunk ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1606-5

    authors: French A,Lendvay TS,Sweet RM,Kowalewski TM

    更新日期:2017-07-01 00:00:00

  • Ultrasound thermal monitoring with an external ultrasound source for customized bipolar RF ablation shapes.

    abstract:PURPOSE:Thermotherapy is a clinical procedure which delivers thermal energy to a target, and it has been applied for various medical treatments. Temperature monitoring during thermotherapy is important to achieve precise and reproducible results. Medical ultrasound can be used for thermal monitoring and is an attractiv...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1744-4

    authors: Kim Y,Audigier C,Ziegle J,Friebe M,Boctor EM

    更新日期:2018-06-01 00:00:00

  • Design considerations for a novel MRI compatible manipulator for prostate cryoablation.

    abstract:PURPOSE:Prostate carcinoma is a commonly diagnosed cancer in men. Nonsurgical treatment of early stage prostate cancer is an important alternative. The use of MRI for tumor cryoablation is of particular interest: it offers lower morbidity compared with other localized techniques. However, the current manual procedure i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0558-4

    authors: Abdelaziz S,Esteveny L,Renaud P,Bayle B,Barbé L,De Mathelin M,Gangi A

    更新日期:2011-11-01 00:00:00

  • A framework for correcting brain retraction based on an eXtended Finite Element Method using a laser range scanner.

    abstract:BACKGROUND:Brain retraction causes great distortion that limits the accuracy of an image-guided neurosurgery system that uses preoperative images. Therefore, brain retraction correction is an important intraoperative clinical application. METHODS:We used a linear elastic biomechanical model, which deforms based on the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0958-8

    authors: Li P,Wang W,Song Z,An Y,Zhang C

    更新日期:2014-07-01 00:00:00

  • Patient-specific estimation of detailed cochlear shape from clinical CT images.

    abstract:PURPOSE:A personalized estimation of the cochlear shape can be used to create computational anatomical models to aid cochlear implant (CI) surgery and CI audio processor programming ultimately resulting in improved hearing restoration. The purpose of this work is to develop and test a method for estimation of the detai...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1701-7

    authors: Kjer HM,Fagertun J,Wimmer W,Gerber N,Vera S,Barazzetti L,Mangado N,Ceresa M,Piella G,Stark T,Stauber M,Reyes M,Weber S,Caversaccio M,González Ballester MÁ,Paulsen RR

    更新日期:2018-03-01 00:00:00

  • Accuracy and reliability of computer-assisted semi-automated morphological analysis of intracranial aneurysms: an experimental study with digital phantoms and clinical aneurysm cases.

    abstract:PURPOSE:Morphological parameters are very important for predicting aneurysm rupture. However, due to geometric radiographic distortion and plane/angle selection bias, the traditional manual measurements (MM) of aneurysm morphology are inaccurate and suffer from severe variability. Our study is to evaluate the accuracy ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02218-8

    authors: Geng J,Hu P,Ji Z,Li C,Li L,Shen J,Feng X,Wang W,Yang G,Li J,Zhang H

    更新日期:2020-10-01 00:00:00

  • Development of preoperative planning software for transforaminal endoscopic surgery and the guidance for clinical applications.

    abstract:PURPOSE:Preoperative planning is of great importance for transforaminal endoscopic techniques applied in percutaneous endoscopic lumbar discectomy. In this study, a modular preoperative planning software for transforaminal endoscopic surgery was developed and demonstrated. METHODS:The path searching method is based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1282-2

    authors: Chen X,Cheng J,Gu X,Sun Y,Politis C

    更新日期:2016-04-01 00:00:00

  • Robotic-assisted real-time MRI-guided TAVR: from system deployment to in vivo experiment in swine model.

    abstract:PURPOSE:Real-time magnetic resonance imaging (rtMRI) guidance provides significant advantages during transcatheter aortic valve replacement (TAVR) as it provides superior real-time visualization and accurate device delivery tracking. However, performing a TAVR within an MRI scanner remains difficult due to a constraine...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1421-4

    authors: Chan JL,Mazilu D,Miller JG,Hunt T,Horvath KA,Li M

    更新日期:2016-10-01 00:00:00

  • Comparison of different grid of tags detection methods in tagged cardiac MR imaging.

    abstract:PURPOSE:Non-invasive imaging assessment of cardiac function is important in cardiovascular disease diagnosis, especially for evaluation of local cardiac motion. Tagged cardiac MRI has been developed for this purpose, but evaluation of the results requires quantification and automation. METHODS:Two methods utilizing ac...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0495-7

    authors: Histace A,Portefaix C,Matuszewski B

    更新日期:2011-03-01 00:00:00

  • Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI.

    abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1483-3

    authors: Soltaninejad M,Yang G,Lambrou T,Allinson N,Jones TL,Barrick TR,Howe FA,Ye X

    更新日期:2017-02-01 00:00:00

  • Vertebra identification using template matching modelmp and K-means clustering.

    abstract:PURPOSE:Accurate vertebra detection and segmentation are essential steps for automating the diagnosis of spinal disorders. This study is dedicated to vertebra alignment measurement, the first step in a computer-aided diagnosis tool for cervical spine trauma. Automated vertebral segment alignment determination is a chal...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-013-0927-2

    authors: Larhmam MA,Benjelloun M,Mahmoudi S

    更新日期:2014-03-01 00:00:00

  • A Survey of auditory display in image-guided interventions.

    abstract:PURPOSE:This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of publi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-017-1547-z

    authors: Black D,Hansen C,Nabavi A,Kikinis R,Hahn H

    更新日期:2017-10-01 00:00:00

  • Analyzing shoulder translation with navigation technology.

    abstract:PURPOSE:Asymmetric stress imposed on the shoulder can lead to anterior shoulder instability in young athletes who perform repetitive overhead motions. A common treatment, surgical anterior capsule tightening, assumes that the instability is caused by abnormal anterior laxity. This study investigated the possibility tha...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0782-6

    authors: Zakani S,Venne G,Smith EJ,Bicknell R,Ellis RE

    更新日期:2012-11-01 00:00:00

  • Suspension laryngoscopy using a curved-frame trans-oral robotic system.

    abstract:PURPOSE:Suspension laryngoscopy has been employed for laryngeal diseases such as treatment for a polyp, cystoma, or granuloma. After securing a straight path with a laryngoscope, the surgeon inserts rigid instruments and examines the target lesion by using a microscope. However, many patients suffer from secondary comp...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0944-1

    authors: Kwon YS,Tae K,Yi BJ

    更新日期:2014-07-01 00:00:00

  • Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments.

    abstract:PURPOSE:Flexible surgical robot can work in confined and complex environments, which makes it a good option for minimally invasive surgery. In order to utilize flexible manipulators in complicated and constrained surgical environments, it is of great significance to monitor the position and shape of the curvilinear man...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1672-8

    authors: Song S,Zhang C,Liu L,Meng MQ

    更新日期:2018-02-01 00:00:00

  • Planning of mandibular reconstructions based on statistical shape models.

    abstract:PURPOSE:The reconstruction of large continuity defects of the mandible is a challenging task, especially when the shape of the missing part is not known prior to operation. Today, the surgical planning is based mainly on visual judgment and the individual skills and experience of the surgeons. The objective of the curr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1451-y

    authors: Raith S,Wolff S,Steiner T,Modabber A,Weber M,Hölzle F,Fischer H

    更新日期:2017-01-01 00:00:00

  • Anatomy-driven multiple trajectory planning (ADMTP) of intracranial electrodes for epilepsy surgery.

    abstract:PURPOSE:Epilepsy is potentially curable with resective surgery if the epileptogenic zone (EZ) can be identified. If non-invasive imaging is unable to elucidate the EZ, intracranial electrodes may be implanted to identify the EZ as well as map cortical function. In current clinical practice, each electrode trajectory is...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1628-z

    authors: Sparks R,Vakharia V,Rodionov R,Vos SB,Diehl B,Wehner T,Miserocchi A,McEvoy AW,Duncan JS,Ourselin S

    更新日期:2017-08-01 00:00:00

  • Incorporating prior shape knowledge via data-driven loss model to improve 3D liver segmentation in deep CNNs.

    abstract:PURPOSE:Convolutional neural networks (CNNs) have obtained enormous success in liver segmentation. However, there are several challenges, including low-contrast images, and large variations in the shape, and appearance of the liver. Incorporating prior knowledge in deep CNN models improves their performance and general...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02085-y

    authors: Mohagheghi S,Foruzan AH

    更新日期:2020-02-01 00:00:00

  • Spine labeling in MRI via regularized distribution matching.

    abstract:PURPOSE:This study investigates an efficient (nearly real-time) two-stage spine labeling algorithm that removes the need for an external training while being applicable to different types of MRI data and acquisition protocols. METHODS:Based solely on the image being labeled (i.e., we do not use training data), the fir...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1651-0

    authors: Hojjat SP,Ayed I,Garvin GJ,Punithakumar K

    更新日期:2017-11-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Correction to: Automated measurement of bone scan index from a whole-body bone scintigram.

    abstract::The article Automated measurement of bone scan index from a whole-body bone scintigram. ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 已发布勘误

    doi:10.1007/s11548-020-02119-w

    authors: Shimizu A,Wakabayashi H,Kanamori T,Saito A,Nishikawa K,Daisaki H,Higashiyama S,Kawabe J

    更新日期:2020-03-01 00:00:00

  • A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images.

    abstract:PURPOSE:The objective of medical content-based image retrieval (CBIR) is to assist clinicians in decision making by retrieving the most similar cases to a given query image from a large database. Herein, a new method for content-based image retrieval of cone beam CT (CBCT) scans is presented. METHODS:The introduced fr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01946-w

    authors: Abdolali F,Zoroofi RA,Otake Y,Sato Y

    更新日期:2019-05-01 00:00:00

  • The effect of CyberDome, a novel 3-dimensional dome-shaped display system, on laparoscopic procedures.

    abstract:BACKGROUND:Laparoscopic surgeons require extended experience of cases to overcome the lack of depth perception on a two-dimensional (2D) display. Although a three-dimensional (3D) display was reported to be useful over two decades ago, 3D systems have not been widely used. Recently, we developed a novel 3D dome-shaped ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0282-5

    authors: Ohuchida K,Kenmotsu H,Yamamoto A,Sawada K,Hayami T,Morooka K,Hoshino H,Uemura M,Konishi K,Yoshida D,Maeda T,Ieiri S,Tanoue K,Tanaka M,Hashizume M

    更新日期:2009-03-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Analysis of the micro-migration of sliding hip screws by using point-based registration.

    abstract:PURPOSE:The favored treatment for many hip fractures is a sliding hip screw, and its usage is expected to increase in the future. Failures can be reduced, and complications detected earlier by semi-automated CT image analysis. The most frequent failure is due to the screw cut-out from the femoral head. METHODS:An imag...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0498-4

    authors: Raudaschl P,Fritscher K,Roth T,Kammerlander C,Schubert R

    更新日期:2010-09-01 00:00:00

  • A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.

    abstract:PURPOSE:Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods wer...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01910-0

    authors: Laves MH,Bicker J,Kahrs LA,Ortmaier T

    更新日期:2019-03-01 00:00:00