Learning soft tissue behavior of organs for surgical navigation with convolutional neural networks.

Abstract:

PURPOSE:In surgical navigation, pre-operative organ models are presented to surgeons during the intervention to help them in efficiently finding their target. In the case of soft tissue, these models need to be deformed and adapted to the current situation by using intra-operative sensor data. A promising method to realize this are real-time capable biomechanical models. METHODS:We train a fully convolutional neural network to estimate a displacement field of all points inside an organ when given only the displacement of a part of the organ's surface. The network trains on entirely synthetic data of random organ-like meshes, which allows us to use much more data than is otherwise available. The input and output data are discretized into a regular grid, allowing us to fully utilize the capabilities of convolutional operators and to train and infer in a highly parallelized manner. RESULTS:The system is evaluated on in-silico liver models, phantom liver data and human in-vivo breathing data. We test the performance with varying material parameters, organ shapes and amount of visible surface. Even though the network is only trained on synthetic data, it adapts well to the various cases and gives a good estimation of the internal organ displacement. The inference runs at over 50 frames per second. CONCLUSION:We present a novel method for training a data-driven, real-time capable deformation model. The accuracy is comparable to other registration methods, it adapts very well to previously unseen organs and does not need to be re-trained for every patient. The high inferring speed makes this method useful for many applications such as surgical navigation and real-time simulation.

authors

Pfeiffer M,Riediger C,Weitz J,Speidel S

doi

10.1007/s11548-019-01965-7

subject

Has Abstract

pub_date

2019-07-01 00:00:00

pages

1147-1155

issue

7

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-019-01965-7

journal_volume

14

pub_type

杂志文章
  • Comparison of different grid of tags detection methods in tagged cardiac MR imaging.

    abstract:PURPOSE:Non-invasive imaging assessment of cardiac function is important in cardiovascular disease diagnosis, especially for evaluation of local cardiac motion. Tagged cardiac MRI has been developed for this purpose, but evaluation of the results requires quantification and automation. METHODS:Two methods utilizing ac...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0495-7

    authors: Histace A,Portefaix C,Matuszewski B

    更新日期:2011-03-01 00:00:00

  • MITK-US: real-time ultrasound support within MITK.

    abstract:PURPOSE:Intra-procedural acquisition of the patient anatomy is a key technique in the context of computer-assisted interventions (CAI). Ultrasound (US) offers major advantages as an interventional imaging modality because it is real time and low cost and does not expose the patient or physician to harmful radiation. To...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0962-z

    authors: März K,Franz AM,Seitel A,Winterstein A,Bendl R,Zelzer S,Nolden M,Meinzer HP,Maier-Hein L

    更新日期:2014-05-01 00:00:00

  • A technique for semiautomatic segmentation of echogenic structures in 3D ultrasound, applied to infant hip dysplasia.

    abstract:PURPOSE:Automatic segmentation of anatomical structures and lesions from medical ultrasound images is a formidable challenge in medical imaging due to image noise, blur and artifacts. In this paper we present a segmentation technique with features highly suited to use in noisy 3D ultrasound volumes and demonstrate its ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1239-5

    authors: Hareendranathan AR,Mabee M,Punithakumar K,Noga M,Jaremko JL

    更新日期:2016-01-01 00:00:00

  • Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology.

    abstract:PURPOSE:Knee arthroscopy suffers from a lack of depth information and easy occlusion of the visual field. To solve these limitations, we propose an arthroscopic navigation system based on self-positioning technology, with the guidance of virtual-vision views. This system can work without any external tracking devices o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02099-6

    authors: Ma C,Cui X,Chen F,Ma L,Xin S,Liao H

    更新日期:2020-03-01 00:00:00

  • Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI.

    abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1483-3

    authors: Soltaninejad M,Yang G,Lambrou T,Allinson N,Jones TL,Barrick TR,Howe FA,Ye X

    更新日期:2017-02-01 00:00:00

  • Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms.

    abstract:PURPOSE:In the medical field, radiologists need more informative and high-quality medical images to diagnose diseases. Image fusion plays a vital role in the field of biomedical image analysis. It aims to integrate the complementary information from multimodal images, producing a new composite image which is expected t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1692-4

    authors: Reena Benjamin J,Jayasree T

    更新日期:2018-02-01 00:00:00

  • Automatic needle tracking using Mask R-CNN for MRI-guided percutaneous interventions.

    abstract:PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02226-8

    authors: Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HH

    更新日期:2020-10-01 00:00:00

  • Model-based registration of preprocedure MR and intraprocedure US of the lumbar spine.

    abstract:PURPOSE:Epidural and spinal needle insertions, as well as facet joint denervation and injections are widely performed procedures on the lumbar spine for delivering anesthesia and analgesia. Ultrasound (US)-based approaches have gained popularity for accurate needle placement, as they use a non-ionizing, inexpensive and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1552-2

    authors: Behnami D,Sedghi A,Anas EMA,Rasoulian A,Seitel A,Lessoway V,Ungi T,Yen D,Osborn J,Mousavi P,Rohling R,Abolmaesumi P

    更新日期:2017-06-01 00:00:00

  • Deformable registration of trans-rectal ultrasound (TRUS) and magnetic resonance imaging (MRI) for focal prostate brachytherapy.

    abstract:PURPOSE:Focal therapy in low-risk prostate cancer may provide the best balance between cancer control and quality of life preservation. As a minimally invasive approach performed under TRUS guidance, brachytherapy is an appealing framework for focal therapy. However, the contrast in TRUS images is generally insufficien...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1380-9

    authors: Mayer A,Zholkover A,Portnoy O,Raviv G,Konen E,Symon Z

    更新日期:2016-06-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Generative multi-adversarial network for striking the right balance in abdominal image segmentation.

    abstract::Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02254-4

    authors: Rezaei M,Näppi JJ,Lippert C,Meinel C,Yoshida H

    更新日期:2020-11-01 00:00:00

  • Automatic bone segmentation in whole-body CT images.

    abstract:PURPOSE:Many diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1883-7

    authors: Klein A,Warszawski J,Hillengaß J,Maier-Hein KH

    更新日期:2019-01-01 00:00:00

  • Augmentation of haptic feedback for teleoperated robotic surgery.

    abstract:PURPOSE:A frequently mentioned lack of teleoperated surgical robots is the lack of haptic feedback. Haptics are not only able to mirror force information from the situs, but also to provide spatial guidance according to a surgical plan. However, superposition of the two haptic information can lead to overlapping and ma...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02118-x

    authors: Schleer P,Kaiser P,Drobinsky S,Radermacher K

    更新日期:2020-03-01 00:00:00

  • A method for going from 2D laparoscope to 3D acquisition of surface landmarks by a novel computer vision approach.

    abstract:PURPOSE:This paper presents a method to use the Smart Trocars-our new surgical instrument recognition system-or any accurate localization system of surgical instrument for acquiring intraoperative surface data. Complex laparoscopic surgeries need a proper guidance system which requires registering the preoperative data...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1655-9

    authors: Garbey M,Nguyen TB,Huang AY,Fikfak V,Dunkin BJ

    更新日期:2018-02-01 00:00:00

  • Automatic segmentation of stereoelectroencephalography (SEEG) electrodes post-implantation considering bending.

    abstract:PURPOSE:The accurate and automatic localisation of SEEG electrodes is crucial for determining the location of epileptic seizure onset. We propose an algorithm for the automatic segmentation of electrode bolts and contacts that accounts for electrode bending in relation to regional brain anatomy. METHODS:Co-registered ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1740-8

    authors: Granados A,Vakharia V,Rodionov R,Schweiger M,Vos SB,O'Keeffe AG,Li K,Wu C,Miserocchi A,McEvoy AW,Clarkson MJ,Duncan JS,Sparks R,Ourselin S

    更新日期:2018-06-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Model-based segmentation in orbital volume measurement with cone beam computed tomography and evaluation against current concepts.

    abstract:PURPOSE:Objective determination of the orbital volume is important in the diagnostic process and in evaluating the efficacy of medical and/or surgical treatment of orbital diseases. Tools designed to measure orbital volume with computed tomography (CT) often cannot be used with cone beam CT (CBCT) because of inferior t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1228-8

    authors: Wagner ME,Gellrich NC,Friese KI,Becker M,Wolter FE,Lichtenstein JT,Stoetzer M,Rana M,Essig H

    更新日期:2016-01-01 00:00:00

  • Dynamic contrast-enhanced computed tomography diagnosis of primary liver cancers using transfer learning of pretrained convolutional neural networks: Is registration of multiphasic images necessary?

    abstract:PURPOSE:To evaluate the effect of image registration on the diagnostic performance of transfer learning (TL) using pretrained convolutional neural networks (CNNs) and three-phasic dynamic contrast-enhanced computed tomography (DCE-CT) for primary liver cancers. METHODS:We retrospectively evaluated 215 consecutive pati...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01987-1

    authors: Yamada A,Oyama K,Fujita S,Yoshizawa E,Ichinohe F,Komatsu D,Fujinaga Y

    更新日期:2019-08-01 00:00:00

  • Automatic thalamus and hippocampus segmentation from MP2RAGE: comparison of publicly available methods and implications for DTI quantification.

    abstract:PURPOSE:In both structural and functional MRI, there is a need for accurate and reliable automatic segmentation of brain regions. Inconsistent segmentation reduces sensitivity and may bias results in clinical studies. The current study compares the performance of publicly available segmentation tools and their impact o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1433-0

    authors: Næss-Schmidt E,Tietze A,Blicher JU,Petersen M,Mikkelsen IK,Coupé P,Manjón JV,Eskildsen SF

    更新日期:2016-11-01 00:00:00

  • A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images.

    abstract:PURPOSE:The objective of medical content-based image retrieval (CBIR) is to assist clinicians in decision making by retrieving the most similar cases to a given query image from a large database. Herein, a new method for content-based image retrieval of cone beam CT (CBCT) scans is presented. METHODS:The introduced fr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01946-w

    authors: Abdolali F,Zoroofi RA,Otake Y,Sato Y

    更新日期:2019-05-01 00:00:00

  • Evaluation of a marker-less, intra-operative, augmented reality guidance system for robot-assisted laparoscopic radical prostatectomy.

    abstract:PURPOSE:Robot-assisted laparoscopic radical prostatectomy (RALRP) using the da Vinci surgical robot is a common treatment for organ-confined prostate cancer. Augmented reality (AR) can help during RALRP by showing the surgeon the location of anatomical structures and tumors from preoperative imaging. Previously, we pro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02181-4

    authors: Kalia M,Mathur P,Tsang K,Black P,Navab N,Salcudean S

    更新日期:2020-07-01 00:00:00

  • Fast and flexible distance measures for treatment planning.

    abstract:PURPOSE:Distance measures are required for diagnoses, therapy decision and documentation. With today's high-resolution CT and MR imaging techniques, high- quality images have become possible. Yet, manual measurement can be tedious. We present a method for automatically determining different distance-based measures on s...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0519-3

    authors: Rössling I,Cyrus C,Dornheim L,Boehm A,Preim B

    更新日期:2010-11-01 00:00:00

  • MIDG-Emerging grid technologies for multi-site preclinical molecular imaging research communities.

    abstract:PURPOSE:Molecular imaging is the visualization and identification of specific molecules in anatomy for insight into metabolic pathways, tissue consistency, and tracing of solute transport mechanisms. This paper presents the Molecular Imaging Data Grid (MIDG) which utilizes emerging grid technologies in preclinical mole...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0524-6

    authors: Lee J,Documet J,Liu B,Park R,Tank A,Huang HK

    更新日期:2011-03-01 00:00:00

  • Long-term experience with setup and implementation of an IHE-based image management and distribution system in intersectoral clinical routine.

    abstract:PURPOSE:Sharing of medical data is crucial for the proper treatment of patients as it could reduce the risk of duplicated medical tests and speed up the care process if all documents are readily available. Despite great technical progress, sharing patient data while maintaining full control over the process in an inter...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1819-2

    authors: Schwind F,Münch H,Schröter A,Brandner R,Kutscha U,Brandner A,Heinze O,Bergh B,Engelmann U

    更新日期:2018-11-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • Force estimation from OCT volumes using 3D CNNs.

    abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1777-8

    authors: Gessert N,Beringhoff J,Otte C,Schlaefer A

    更新日期:2018-07-01 00:00:00

  • Ultrasound thermal monitoring with an external ultrasound source for customized bipolar RF ablation shapes.

    abstract:PURPOSE:Thermotherapy is a clinical procedure which delivers thermal energy to a target, and it has been applied for various medical treatments. Temperature monitoring during thermotherapy is important to achieve precise and reproducible results. Medical ultrasound can be used for thermal monitoring and is an attractiv...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1744-4

    authors: Kim Y,Audigier C,Ziegle J,Friebe M,Boctor EM

    更新日期:2018-06-01 00:00:00

  • Planning nonlinear access paths for temporal bone surgery.

    abstract:PURPOSE:Interventions at the otobasis operate in the narrow region of the temporal bone where several highly sensitive organs define obstacles with minimal clearance for surgical instruments. Nonlinear trajectories for potential minimally invasive interventions can provide larger distances to risk structures and optimi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1712-z

    authors: Fauser J,Sakas G,Mukhopadhyay A

    更新日期:2018-05-01 00:00:00

  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • MINARO HD: control and evaluation of a handheld, highly dynamic surgical robot.

    abstract:PURPOSE:Current surgical robotic systems are either large serial arms, resulting in higher risks due to their high inertia and no inherent limitations of the working space, or they are bone-mounted, adding substantial additional task steps to the surgical workflow. The robot presented in this paper has a handy and ligh...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02306-9

    authors: Vossel M,Müller M,Niesche A,Theisgen L,Radermacher K,de la Fuente M

    更新日期:2021-01-23 00:00:00